{"title":"ImSTDP:隐式定时片上 STDP 学习","authors":"Dedong Zhao;Oliver Schrape;Zoran Stamenkovic;Milos Krstic","doi":"10.1109/TCSI.2024.3450958","DOIUrl":null,"url":null,"abstract":"Spike-Timing-Dependent Plasticity (STDP) is a biological-plausible learning mechanism widely adopted for building Spiking Neural Networks (SNNs). It determines plasticity polarity and synapse strength change according to the timing difference between pre- and postsynaptic spikes. The learning curves of STDP differ in temporal window size, magnitude and polarity across different synapse types and brain regions and even within a cell, in different dendritic compartments. To accelerate on-chip STDP learning, various implementations have been proposed. However, they either introduce significant latency due to costly counter-based time difference calculation and substantial area cost due to the implementation of weight change LUTs, or lose biologically-plausible timing information due to oversimplification. For low-cost and efficient on-chip learning, a high-throughput Implicit-timing STDP (ImSTDP) with optimized SR depth and a low-cost register-based Implicit-Timing Look-up (ITL) are proposed. ASIC implementation in 22 nm technology demonstrates that ImSTDP can achieve up to <inline-formula> <tex-math>$2\\times $ </tex-math></inline-formula> throughput improvement and <inline-formula> <tex-math>$3.61\\times $ </tex-math></inline-formula> power efficiency improvement at 27% less area cost compared to the cutting-edge counter-LUT on-chip STDP learning solution.","PeriodicalId":13039,"journal":{"name":"IEEE Transactions on Circuits and Systems I: Regular Papers","volume":"72 2","pages":"868-881"},"PeriodicalIF":5.2000,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"ImSTDP: Implicit Timing On-Chip STDP Learning\",\"authors\":\"Dedong Zhao;Oliver Schrape;Zoran Stamenkovic;Milos Krstic\",\"doi\":\"10.1109/TCSI.2024.3450958\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Spike-Timing-Dependent Plasticity (STDP) is a biological-plausible learning mechanism widely adopted for building Spiking Neural Networks (SNNs). It determines plasticity polarity and synapse strength change according to the timing difference between pre- and postsynaptic spikes. The learning curves of STDP differ in temporal window size, magnitude and polarity across different synapse types and brain regions and even within a cell, in different dendritic compartments. To accelerate on-chip STDP learning, various implementations have been proposed. However, they either introduce significant latency due to costly counter-based time difference calculation and substantial area cost due to the implementation of weight change LUTs, or lose biologically-plausible timing information due to oversimplification. For low-cost and efficient on-chip learning, a high-throughput Implicit-timing STDP (ImSTDP) with optimized SR depth and a low-cost register-based Implicit-Timing Look-up (ITL) are proposed. ASIC implementation in 22 nm technology demonstrates that ImSTDP can achieve up to <inline-formula> <tex-math>$2\\\\times $ </tex-math></inline-formula> throughput improvement and <inline-formula> <tex-math>$3.61\\\\times $ </tex-math></inline-formula> power efficiency improvement at 27% less area cost compared to the cutting-edge counter-LUT on-chip STDP learning solution.\",\"PeriodicalId\":13039,\"journal\":{\"name\":\"IEEE Transactions on Circuits and Systems I: Regular Papers\",\"volume\":\"72 2\",\"pages\":\"868-881\"},\"PeriodicalIF\":5.2000,\"publicationDate\":\"2024-09-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Circuits and Systems I: Regular Papers\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10665748/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Circuits and Systems I: Regular Papers","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10665748/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
摘要
spike - time - dependent Plasticity (STDP)是一种生物似是而非的学习机制,广泛用于构建spike神经网络(snn)。它根据突触前和突触后尖峰的时间差决定可塑性、极性和突触强度的变化。STDP的学习曲线在不同的突触类型和大脑区域,甚至在一个细胞内,在不同的树突隔室中,在时间窗口的大小、幅度和极性上都是不同的。为了加速片上STDP学习,已经提出了各种实现方案。然而,它们要么由于昂贵的基于计数器的时差计算而引入了显著的延迟,要么由于实现权重变化lut而引入了大量的面积成本,要么由于过度简化而丢失了生物学上合理的时间信息。为了实现低成本和高效率的片上学习,提出了一种优化SR深度的高通量隐式时序STDP (ImSTDP)和一种低成本的基于寄存器的隐式时序查找(ITL)。在22纳米技术上的ASIC实现表明,与尖端的反lut片上STDP学习解决方案相比,ImSTDP可以实现高达2倍的吞吐量提高和3.61倍的功率效率提高,面积成本减少27%。
Spike-Timing-Dependent Plasticity (STDP) is a biological-plausible learning mechanism widely adopted for building Spiking Neural Networks (SNNs). It determines plasticity polarity and synapse strength change according to the timing difference between pre- and postsynaptic spikes. The learning curves of STDP differ in temporal window size, magnitude and polarity across different synapse types and brain regions and even within a cell, in different dendritic compartments. To accelerate on-chip STDP learning, various implementations have been proposed. However, they either introduce significant latency due to costly counter-based time difference calculation and substantial area cost due to the implementation of weight change LUTs, or lose biologically-plausible timing information due to oversimplification. For low-cost and efficient on-chip learning, a high-throughput Implicit-timing STDP (ImSTDP) with optimized SR depth and a low-cost register-based Implicit-Timing Look-up (ITL) are proposed. ASIC implementation in 22 nm technology demonstrates that ImSTDP can achieve up to $2\times $ throughput improvement and $3.61\times $ power efficiency improvement at 27% less area cost compared to the cutting-edge counter-LUT on-chip STDP learning solution.
期刊介绍:
TCAS I publishes regular papers in the field specified by the theory, analysis, design, and practical implementations of circuits, and the application of circuit techniques to systems and to signal processing. Included is the whole spectrum from basic scientific theory to industrial applications. The field of interest covered includes: - Circuits: Analog, Digital and Mixed Signal Circuits and Systems - Nonlinear Circuits and Systems, Integrated Sensors, MEMS and Systems on Chip, Nanoscale Circuits and Systems, Optoelectronic - Circuits and Systems, Power Electronics and Systems - Software for Analog-and-Logic Circuits and Systems - Control aspects of Circuits and Systems.