首页 > 最新文献

Neuromorphic Computing and Engineering最新文献

英文 中文
Editorial: Focus issue on energy-efficient neuromorphic devices, systems and algorithms 编辑:关于高能效神经形态设备、系统和算法的焦点问题
Pub Date : 2023-10-31 DOI: 10.1088/2634-4386/ad06cb
Adnan Mehonic, Charlotte Frenkel, Eleni Vasilaki
{"title":"Editorial: Focus issue on energy-efficient neuromorphic devices, systems and algorithms","authors":"Adnan Mehonic, Charlotte Frenkel, Eleni Vasilaki","doi":"10.1088/2634-4386/ad06cb","DOIUrl":"https://doi.org/10.1088/2634-4386/ad06cb","url":null,"abstract":"","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"36 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139309127","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Editorial: ‘Bioinspired Adaptive Intelligent Robots’ 社论:“仿生自适应智能机器人”
Pub Date : 2023-09-05 DOI: 10.1088/2634-4386/acf6db
Elisa Donati, Cecilia Laschi, Barbara Mazzolai, C. Bartolozzi
The NCE Focus Issue on Bioinspired Adaptive Intelligent Robots aims at collecting evidence of the different forms of biomimicry in robotics, from soft robotics and embodiment to neuromorphic sensing, computation and control, as enabling approaches to intelligent and adaptive robots.
NCE聚焦议题:仿生自适应智能机器人旨在收集机器人中不同形式的仿生学的证据,从软机器人和体现到神经形态传感、计算和控制,作为智能和自适应机器人的实现方法。
{"title":"Editorial: ‘Bioinspired Adaptive Intelligent Robots’","authors":"Elisa Donati, Cecilia Laschi, Barbara Mazzolai, C. Bartolozzi","doi":"10.1088/2634-4386/acf6db","DOIUrl":"https://doi.org/10.1088/2634-4386/acf6db","url":null,"abstract":"The NCE Focus Issue on Bioinspired Adaptive Intelligent Robots aims at collecting evidence of the different forms of biomimicry in robotics, from soft robotics and embodiment to neuromorphic sensing, computation and control, as enabling approaches to intelligent and adaptive robots.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"186 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123044415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhanced synaptic characteristics of H x WO3-based neuromorphic devices, achieved by current pulse control, for artificial neural networks 通过电流脉冲控制实现的H x wo3神经形态装置的突触特性增强,用于人工神经网络
Pub Date : 2023-08-31 DOI: 10.1088/2634-4386/acf1c6
D. Nishioka, T. Tsuchiya, T. Higuchi, K. Terabe
Artificial synapses capable of mimicking the fundamental functionalities of biological synapses are critical to the building of efficient neuromorphic systems. We have developed a H x WO3-based artificial synapse that replicates such synaptic functionalities via an all-solid-state redox transistor mechanism. The subject synaptic-H x WO3 transistor, which operates by current pulse control, exhibits excellent synaptic properties including good linearity, low update variation and conductance modulation characteristics. We investigated the performance of the device under various operating conditions, and the impact of the characteristics of the device on artificial neural network computing. Although the subject synaptic-H x WO3 transistor showed an insufficient recognition accuracy of 66% for a handwritten digit recognition task with voltage pulse control, it achieved an excellent accuracy of 88% with current pulse control, which is approaching the 93% accuracy of an ideal synaptic device. This result suggests that the performance of any redox-transistor-type artificial synapse can be dramatically improved by current pulse control, which in turn paves the way for further exploration and the evolution of advanced neuromorphic systems, with the potential to revolutionize the artificial intelligence domain. It further marks a significant stride towards the realization of high-performance, low-power consumption computing devices.
人工突触能够模仿生物突触的基本功能,这对于构建高效的神经形态系统至关重要。我们开发了一种基于羟基wo3的人工突触,通过全固态氧化还原晶体管机制复制了这种突触功能。本课题的synaptic- h x WO3晶体管通过电流脉冲控制工作,具有良好的线性度、低更新变化和电导调制特性。我们研究了该设备在各种工况下的性能,以及设备特性对人工神经网络计算的影响。虽然被试synaptic- h x WO3晶体管在电压脉冲控制下的手写数字识别任务的识别精度不足66%,但在电流脉冲控制下,它的识别精度达到了88%,接近理想突触器件的93%的精度。这一结果表明,电流脉冲控制可以显著改善任何氧化还原晶体管型人工突触的性能,从而为进一步探索和进化高级神经形态系统铺平了道路,并有可能彻底改变人工智能领域。它进一步标志着向实现高性能、低功耗计算设备迈出了重要的一步。
{"title":"Enhanced synaptic characteristics of H x WO3-based neuromorphic devices, achieved by current pulse control, for artificial neural networks","authors":"D. Nishioka, T. Tsuchiya, T. Higuchi, K. Terabe","doi":"10.1088/2634-4386/acf1c6","DOIUrl":"https://doi.org/10.1088/2634-4386/acf1c6","url":null,"abstract":"Artificial synapses capable of mimicking the fundamental functionalities of biological synapses are critical to the building of efficient neuromorphic systems. We have developed a H x WO3-based artificial synapse that replicates such synaptic functionalities via an all-solid-state redox transistor mechanism. The subject synaptic-H x WO3 transistor, which operates by current pulse control, exhibits excellent synaptic properties including good linearity, low update variation and conductance modulation characteristics. We investigated the performance of the device under various operating conditions, and the impact of the characteristics of the device on artificial neural network computing. Although the subject synaptic-H x WO3 transistor showed an insufficient recognition accuracy of 66% for a handwritten digit recognition task with voltage pulse control, it achieved an excellent accuracy of 88% with current pulse control, which is approaching the 93% accuracy of an ideal synaptic device. This result suggests that the performance of any redox-transistor-type artificial synapse can be dramatically improved by current pulse control, which in turn paves the way for further exploration and the evolution of advanced neuromorphic systems, with the potential to revolutionize the artificial intelligence domain. It further marks a significant stride towards the realization of high-performance, low-power consumption computing devices.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115082128","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
How fast can vanadium dioxide neuron-mimicking devices oscillate? Physical mechanisms limiting the frequency of vanadium dioxide oscillators 二氧化钒神经元模拟装置的振荡速度有多快?限制二氧化钒振荡频率的物理机制
Pub Date : 2023-08-22 DOI: 10.1088/2634-4386/acf2bf
S. Carapezzi, Andrew Plews, G. Boschetto, A. Nejim, S. Karg, A. Todri-Sanial
The frequency of vanadium dioxide (VO2) oscillators is a fundamental figure of merit for the realization of neuromorphic circuits called oscillatory neural networks (ONNs) since the high frequency of oscillators ensures low-power consuming, real-time computing ONNs. In this study, we perform electrothermal 3D technology computer-aided design (TCAD) simulations of a VO2 relaxation oscillator. We find that there exists an upper limit to its operating frequency, where such a limit is not predicted from a purely circuital model of the VO2 oscillator. We investigate the intrinsic physical mechanisms that give rise to this upper limit. Our TCAD simulations show that it arises a dependence on the frequency of the points of the curve current versus voltage across the VO2 device corresponding to the insulator-to-metal transition (IMT) and metal-to-insulator transition (MIT) during oscillation, below some threshold values of Cext . This implies that the condition for the self-oscillatory regime may be satisfied by a given load-line in the low-frequency range but no longer at higher frequencies, with consequent suppression of oscillations. We note that this variation of the IMT/MIT points below some threshold values of Cext is due to a combination of different factors: intermediate resistive states achievable by VO2 channel and the interplay between frequency and heat transfer rate. Although the upper limit on the frequency that we extract is linked to the specific VO2 device we simulate, our findings apply qualitatively to any VO2 oscillator. Overall, our study elucidates the link between electrical and thermal behavior in VO2 devices that sets a constraint on the upper values of the operating frequency of any VO2 oscillator.
二氧化钒(VO2)振荡器的频率是实现称为振荡神经网络(ONNs)的神经形态电路的基本优点,因为振荡器的高频率确保了低功耗,实时计算ONNs。在这项研究中,我们对一个VO2弛豫振荡器进行了电热三维技术计算机辅助设计(TCAD)模拟。我们发现它的工作频率存在一个上限,而这个上限不能从VO2振荡器的纯电路模型中预测出来。我们研究了产生这个上限的内在物理机制。我们的TCAD模拟表明,在振荡期间,与绝缘体到金属的转变(IMT)和金属到绝缘体的转变(MIT)相对应的VO2器件上曲线电流对电压的点的频率低于ext的一些阈值,这取决于曲线电流对电压的频率。这意味着给定的载荷线在低频范围内可以满足自振荡状态的条件,但在高频范围内不再满足,从而抑制振荡。我们注意到,这种IMT/MIT点低于某些阈值的变化是由于不同因素的组合:VO2通道可实现的中间电阻状态以及频率和传热率之间的相互作用。虽然我们提取的频率上限与我们模拟的特定VO2器件有关,但我们的发现定性地适用于任何VO2振荡器。总的来说,我们的研究阐明了VO2器件中电行为和热行为之间的联系,这对任何VO2振荡器的工作频率的上限设置了限制。
{"title":"How fast can vanadium dioxide neuron-mimicking devices oscillate? Physical mechanisms limiting the frequency of vanadium dioxide oscillators","authors":"S. Carapezzi, Andrew Plews, G. Boschetto, A. Nejim, S. Karg, A. Todri-Sanial","doi":"10.1088/2634-4386/acf2bf","DOIUrl":"https://doi.org/10.1088/2634-4386/acf2bf","url":null,"abstract":"The frequency of vanadium dioxide (VO2) oscillators is a fundamental figure of merit for the realization of neuromorphic circuits called oscillatory neural networks (ONNs) since the high frequency of oscillators ensures low-power consuming, real-time computing ONNs. In this study, we perform electrothermal 3D technology computer-aided design (TCAD) simulations of a VO2 relaxation oscillator. We find that there exists an upper limit to its operating frequency, where such a limit is not predicted from a purely circuital model of the VO2 oscillator. We investigate the intrinsic physical mechanisms that give rise to this upper limit. Our TCAD simulations show that it arises a dependence on the frequency of the points of the curve current versus voltage across the VO2 device corresponding to the insulator-to-metal transition (IMT) and metal-to-insulator transition (MIT) during oscillation, below some threshold values of Cext . This implies that the condition for the self-oscillatory regime may be satisfied by a given load-line in the low-frequency range but no longer at higher frequencies, with consequent suppression of oscillations. We note that this variation of the IMT/MIT points below some threshold values of Cext is due to a combination of different factors: intermediate resistive states achievable by VO2 channel and the interplay between frequency and heat transfer rate. Although the upper limit on the frequency that we extract is linked to the specific VO2 device we simulate, our findings apply qualitatively to any VO2 oscillator. Overall, our study elucidates the link between electrical and thermal behavior in VO2 devices that sets a constraint on the upper values of the operating frequency of any VO2 oscillator.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128916795","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Impact of edge defects on the synaptic characteristic of a ferromagnetic domain-wall device and on on-chip learning 边缘缺陷对铁磁畴壁器件突触特性及片上学习的影响
Pub Date : 2023-08-16 DOI: 10.1088/2634-4386/acf0e4
Ram Singh Yadav, Aniket Sadashiva, Amod Holla, P. Muduli, D. Bhowmik
Topological-soliton-based devices, like the ferromagnetic domain-wall device, have been proposed as non-volatile memory (NVM) synapses in electronic crossbar arrays for fast and energy-efficient implementation of on-chip learning of neural networks (NN). High linearity and symmetry in the synaptic weight-update characteristic of the device (long-term potentiation (LTP) and long-term depression (LTD)) are important requirements to obtain high classification/regression accuracy in such an on-chip learning scheme. However, obtaining such linear and symmetric LTP and LTD characteristics in the ferromagnetic domain-wall device has remained a challenge. Here, we first carry out micromagnetic simulations of the device to show that the incorporation of defects at the edges of the device, with the defects having higher perpendicular magnetic anisotropy compared to the rest of the ferromagnetic layer, leads to massive improvement in the linearity and symmetry of the LTP and LTD characteristics of the device. This is because these defects act as pinning centres for the domain wall and prevent it from moving during the delay time between two consecutive programming current pulses, which is not the case when the device does not have defects. Next, we carry out system-level simulations of two crossbar arrays with synaptic characteristics of domain-wall synapse devices incorporated in them: one without such defects, and one with such defects. For on-chip learning of both long short-term memory networks (using a regression task) and fully connected NN (using a classification task), we show improved performance when the domain-wall synapse devices have defects at the edges. We also estimate the energy consumption in these synaptic devices and project their scaling, with respect to on-chip learning in corresponding crossbar arrays.
基于拓扑孤子的器件,如铁磁畴壁器件,已被提出作为电子横杆阵列中的非易失性存储器(NVM)突触,用于快速和节能地实现片上神经网络(NN)的学习。在这种片上学习方案中,突触权重更新特性(长期增强(LTP)和长期抑制(LTD))的高度线性和对称性是获得高分类/回归精度的重要要求。然而,在铁磁畴壁器件中获得这种线性和对称的LTP和LTD特性仍然是一个挑战。在这里,我们首先对该器件进行了微磁模拟,结果表明,与铁磁层的其他部分相比,在器件边缘加入缺陷具有更高的垂直磁各向异性,从而大大改善了器件的LTP和LTD特性的线性和对称性。这是因为这些缺陷充当了畴壁的固定中心,并防止畴壁在两个连续编程电流脉冲之间的延迟时间内移动,而当器件没有缺陷时则不是这种情况。接下来,我们进行了两种交叉棒阵列的系统级模拟,其中包含了域壁突触器件的突触特性:一种没有这种缺陷,一种有这种缺陷。对于长短期记忆网络(使用回归任务)和全连接神经网络(使用分类任务)的片上学习,当畴壁突触设备在边缘有缺陷时,我们显示了改进的性能。我们还估计了这些突触设备的能量消耗,并投影了它们的缩放,相对于片上学习在相应的交叉棒阵列。
{"title":"Impact of edge defects on the synaptic characteristic of a ferromagnetic domain-wall device and on on-chip learning","authors":"Ram Singh Yadav, Aniket Sadashiva, Amod Holla, P. Muduli, D. Bhowmik","doi":"10.1088/2634-4386/acf0e4","DOIUrl":"https://doi.org/10.1088/2634-4386/acf0e4","url":null,"abstract":"Topological-soliton-based devices, like the ferromagnetic domain-wall device, have been proposed as non-volatile memory (NVM) synapses in electronic crossbar arrays for fast and energy-efficient implementation of on-chip learning of neural networks (NN). High linearity and symmetry in the synaptic weight-update characteristic of the device (long-term potentiation (LTP) and long-term depression (LTD)) are important requirements to obtain high classification/regression accuracy in such an on-chip learning scheme. However, obtaining such linear and symmetric LTP and LTD characteristics in the ferromagnetic domain-wall device has remained a challenge. Here, we first carry out micromagnetic simulations of the device to show that the incorporation of defects at the edges of the device, with the defects having higher perpendicular magnetic anisotropy compared to the rest of the ferromagnetic layer, leads to massive improvement in the linearity and symmetry of the LTP and LTD characteristics of the device. This is because these defects act as pinning centres for the domain wall and prevent it from moving during the delay time between two consecutive programming current pulses, which is not the case when the device does not have defects. Next, we carry out system-level simulations of two crossbar arrays with synaptic characteristics of domain-wall synapse devices incorporated in them: one without such defects, and one with such defects. For on-chip learning of both long short-term memory networks (using a regression task) and fully connected NN (using a classification task), we show improved performance when the domain-wall synapse devices have defects at the edges. We also estimate the energy consumption in these synaptic devices and project their scaling, with respect to on-chip learning in corresponding crossbar arrays.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124046743","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Integration of Ag-CBRAM crossbars and Mott ReLU neurons for efficient implementation of deep neural networks in hardware Ag-CBRAM交叉棒和Mott ReLU神经元的集成,在硬件上有效实现深度神经网络
Pub Date : 2023-08-09 DOI: 10.1088/2634-4386/aceea9
Yuhan Shi, Sangheon Oh, Jaeseoung Park, J. D. Valle, Pavel Salev, Ivan K. Schuller, D. Kuzum
In-memory computing with emerging non-volatile memory devices (eNVMs) has shown promising results in accelerating matrix-vector multiplications. However, activation function calculations are still being implemented with general processors or large and complex neuron peripheral circuits. Here, we present the integration of Ag-based conductive bridge random access memory (Ag-CBRAM) crossbar arrays with Mott rectified linear unit (ReLU) activation neurons for scalable, energy and area-efficient hardware (HW) implementation of deep neural networks. We develop Ag-CBRAM devices that can achieve a high ON/OFF ratio and multi-level programmability. Compact and energy-efficient Mott ReLU neuron devices implementing ReLU activation function are directly connected to the columns of Ag-CBRAM crossbars to compute the output from the weighted sum current. We implement convolution filters and activations for VGG-16 using our integrated HW and demonstrate the successful generation of feature maps for CIFAR-10 images in HW. Our approach paves a new way toward building a highly compact and energy-efficient eNVMs-based in-memory computing system.
使用新兴的非易失性存储设备(envm)进行内存计算在加速矩阵向量乘法方面显示出了很好的结果。然而,激活函数计算仍然是在通用处理器或大而复杂的神经元外围电路中实现的。在这里,我们提出了基于银的导电桥随机存取存储器(Ag-CBRAM)交叉棒阵列与Mott整流线性单元(ReLU)激活神经元的集成,用于深度神经网络的可扩展,能量和面积高效的硬件(HW)实现。我们开发的Ag-CBRAM器件可以实现高开/关比和多级可编程性。实现ReLU激活功能的Mott ReLU神经元装置紧凑节能,直接连接到Ag-CBRAM横条的列上,计算加权和电流的输出。我们使用集成的硬件实现了VGG-16的卷积滤波器和激活,并演示了在硬件中成功生成CIFAR-10图像的特征图。我们的方法为构建高度紧凑和节能的基于envm的内存计算系统铺平了新的道路。
{"title":"Integration of Ag-CBRAM crossbars and Mott ReLU neurons for efficient implementation of deep neural networks in hardware","authors":"Yuhan Shi, Sangheon Oh, Jaeseoung Park, J. D. Valle, Pavel Salev, Ivan K. Schuller, D. Kuzum","doi":"10.1088/2634-4386/aceea9","DOIUrl":"https://doi.org/10.1088/2634-4386/aceea9","url":null,"abstract":"In-memory computing with emerging non-volatile memory devices (eNVMs) has shown promising results in accelerating matrix-vector multiplications. However, activation function calculations are still being implemented with general processors or large and complex neuron peripheral circuits. Here, we present the integration of Ag-based conductive bridge random access memory (Ag-CBRAM) crossbar arrays with Mott rectified linear unit (ReLU) activation neurons for scalable, energy and area-efficient hardware (HW) implementation of deep neural networks. We develop Ag-CBRAM devices that can achieve a high ON/OFF ratio and multi-level programmability. Compact and energy-efficient Mott ReLU neuron devices implementing ReLU activation function are directly connected to the columns of Ag-CBRAM crossbars to compute the output from the weighted sum current. We implement convolution filters and activations for VGG-16 using our integrated HW and demonstrate the successful generation of feature maps for CIFAR-10 images in HW. Our approach paves a new way toward building a highly compact and energy-efficient eNVMs-based in-memory computing system.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127567655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Editorial: Focus issue on machine learning for neuromorphic engineering 社论:关注神经形态工程中的机器学习问题
Pub Date : 2023-08-08 DOI: 10.1088/2634-4386/acee1a
M. Payvand, E. Neftci, Friedemann Zenke
NA
{"title":"Editorial: Focus issue on machine learning for neuromorphic engineering","authors":"M. Payvand, E. Neftci, Friedemann Zenke","doi":"10.1088/2634-4386/acee1a","DOIUrl":"https://doi.org/10.1088/2634-4386/acee1a","url":null,"abstract":"\u0000 <jats:p>NA</jats:p>","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123348602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A mixed-signal oscillatory neural network for scalable analog computations in phase domain 一种用于相位域可扩展模拟计算的混合信号振荡神经网络
Pub Date : 2023-07-24 DOI: 10.1088/2634-4386/ace9f5
Corentin Delacour, S. Carapezzi, G. Boschetto, Madeleine Abernot, Thierry Gil, N. Azémard, A. Todri-Sanial
Digital electronics based on von Neumann’s architecture is reaching its limits to solve large-scale problems essentially due to the memory fetching. Instead, recent efforts to bring the memory near the computation have enabled highly parallel computations at low energy costs. Oscillatory neural network (ONN) is one example of in-memory analog computing paradigm consisting of coupled oscillating neurons. When implemented in hardware, ONNs naturally perform gradient descent of an energy landscape which makes them particularly suited for solving optimization problems. Although the ONN computational capability and its link with the Ising model are known for decades, implementing a large-scale ONN remains difficult. Beyond the oscillators’ variations, there are still design challenges such as having compact, programmable synapses and a modular architecture for solving large problem instances. In this paper, we propose a mixed-signal architecture named Saturated Kuramoto ONN (SKONN) that leverages both analog and digital domains for efficient ONN hardware implementation. SKONN computes in the analog phase domain while propagating the information digitally to facilitate scaling up the ONN size. SKONN’s separation between computation and propagation enhances the robustness and enables a feed-forward phase propagation that is showcased for the first time. Moreover, the SKONN architecture leads to unique binarizing dynamics that are particularly suitable for solving NP-hard combinatorial optimization problems such as finding the weighted Max-cut of a graph. We find that SKONN’s accuracy is as good as the Goemans–Williamson 0.878-approximation algorithm for Max-cut; whereas SKONN’s computation time only grows logarithmically. We report on Weighted Max-cut experiments using a 9-neuron SKONN proof-of-concept on a printed circuit board (PCB). Finally, we present a low-power 16-neuron SKONN integrated circuit and illustrate SKONN’s feed-forward ability while computing the XOR function.
基于冯·诺伊曼架构的数字电子学在解决大规模问题方面已经达到了极限,这主要是由于内存提取。相反,最近的努力使内存接近计算,使高度并行计算在低能源成本。振荡神经网络(ONN)是由耦合振荡神经元组成的内存模拟计算范式的一个例子。当在硬件中实现时,onn自然地执行能量景观的梯度下降,这使得它们特别适合于解决优化问题。尽管ONN的计算能力及其与Ising模型的联系在几十年前就已经为人所知,但实现大规模的ONN仍然很困难。除了振荡器的变化之外,还存在设计挑战,例如具有紧凑的可编程突触和用于解决大型问题实例的模块化架构。在本文中,我们提出了一种混合信号架构,称为饱和Kuramoto ONN (SKONN),它利用模拟和数字域来实现有效的ONN硬件实现。SKONN在模拟相位域中进行计算,同时以数字方式传播信息,以方便扩展ONN的大小。SKONN在计算和传播之间的分离增强了鲁棒性,并首次展示了前馈相位传播。此外,SKONN架构导致了独特的二值化动力学,特别适合于解决NP-hard组合优化问题,例如寻找图的加权最大切割。我们发现SKONN的精度与Goemans-Williamson的0.878近似算法的Max-cut精度相当;而SKONN的计算时间只是对数增长。我们报告了在印刷电路板(PCB)上使用9神经元SKONN概念验证的加权最大切割实验。最后,我们提出了一个低功耗的16神经元SKONN集成电路,并说明了SKONN在计算异或函数时的前馈能力。
{"title":"A mixed-signal oscillatory neural network for scalable analog computations in phase domain","authors":"Corentin Delacour, S. Carapezzi, G. Boschetto, Madeleine Abernot, Thierry Gil, N. Azémard, A. Todri-Sanial","doi":"10.1088/2634-4386/ace9f5","DOIUrl":"https://doi.org/10.1088/2634-4386/ace9f5","url":null,"abstract":"Digital electronics based on von Neumann’s architecture is reaching its limits to solve large-scale problems essentially due to the memory fetching. Instead, recent efforts to bring the memory near the computation have enabled highly parallel computations at low energy costs. Oscillatory neural network (ONN) is one example of in-memory analog computing paradigm consisting of coupled oscillating neurons. When implemented in hardware, ONNs naturally perform gradient descent of an energy landscape which makes them particularly suited for solving optimization problems. Although the ONN computational capability and its link with the Ising model are known for decades, implementing a large-scale ONN remains difficult. Beyond the oscillators’ variations, there are still design challenges such as having compact, programmable synapses and a modular architecture for solving large problem instances. In this paper, we propose a mixed-signal architecture named Saturated Kuramoto ONN (SKONN) that leverages both analog and digital domains for efficient ONN hardware implementation. SKONN computes in the analog phase domain while propagating the information digitally to facilitate scaling up the ONN size. SKONN’s separation between computation and propagation enhances the robustness and enables a feed-forward phase propagation that is showcased for the first time. Moreover, the SKONN architecture leads to unique binarizing dynamics that are particularly suitable for solving NP-hard combinatorial optimization problems such as finding the weighted Max-cut of a graph. We find that SKONN’s accuracy is as good as the Goemans–Williamson 0.878-approximation algorithm for Max-cut; whereas SKONN’s computation time only grows logarithmically. We report on Weighted Max-cut experiments using a 9-neuron SKONN proof-of-concept on a printed circuit board (PCB). Finally, we present a low-power 16-neuron SKONN integrated circuit and illustrate SKONN’s feed-forward ability while computing the XOR function.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129000715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Editorial: Focus on algorithms for neuromorphic computing 社论:关注神经形态计算的算法
Pub Date : 2023-07-21 DOI: 10.1088/2634-4386/ace991
R. Legenstein, A. Basu, P. Panda
Neuromorphic computing provides a promising energy-efficient alternative to von-Neumann-type computing and learning architectures. However, the best neuromorphic hardware is useless without suitable inference and learning algorithms that can fully exploit hardware advantages. Such algorithms often have to deal with challenging constraints posed by neuromorphic hardware such as massive parallelism, sparse asynchronous communication, and analog and/or unreliable computing elements. This Focus Issue presents advances on various aspects of algorithms for neuromorphic computing. The collection of articles covers a wide range from very fundamental questions about the computational properties of the basic computing elements in neuromorphic systems, algorithms for continual learning, semantic segmentation, and novel efficient learning paradigms, up to algorithms for a specific application domain.
神经形态计算为冯-诺伊曼型计算和学习架构提供了一种有前途的节能替代方案。然而,如果没有合适的推理和学习算法来充分利用硬件的优势,再好的神经形态硬件也是无用的。此类算法通常必须处理神经形态硬件带来的挑战性约束,例如大规模并行性、稀疏异步通信以及模拟和/或不可靠的计算元素。这个焦点问题介绍了神经形态计算算法的各个方面的进展。文章的集合涵盖了广泛的范围,从关于神经形态系统中基本计算元素的计算特性的非常基本的问题,持续学习的算法,语义分割,新的高效学习范式,到特定应用领域的算法。
{"title":"Editorial: Focus on algorithms for neuromorphic computing","authors":"R. Legenstein, A. Basu, P. Panda","doi":"10.1088/2634-4386/ace991","DOIUrl":"https://doi.org/10.1088/2634-4386/ace991","url":null,"abstract":"Neuromorphic computing provides a promising energy-efficient alternative to von-Neumann-type computing and learning architectures. However, the best neuromorphic hardware is useless without suitable inference and learning algorithms that can fully exploit hardware advantages. Such algorithms often have to deal with challenging constraints posed by neuromorphic hardware such as massive parallelism, sparse asynchronous communication, and analog and/or unreliable computing elements. This Focus Issue presents advances on various aspects of algorithms for neuromorphic computing. The collection of articles covers a wide range from very fundamental questions about the computational properties of the basic computing elements in neuromorphic systems, algorithms for continual learning, semantic segmentation, and novel efficient learning paradigms, up to algorithms for a specific application domain.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"99 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134561365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Helitronics as a potential building block for classical and unconventional computing Helitronics作为经典和非常规计算的潜在构建模块
Pub Date : 2023-07-07 DOI: 10.1088/2634-4386/ace549
Nicolai Timon Bechler, J. Masell
Magnetic textures are promising candidates for unconventional computing due to their non-linear dynamics. We propose to investigate the rich variety of seemingly trivial lamellar magnetic phases, e.g. helical, spiral, stripy phase, or other one-dimensional soliton lattices. These are the natural stray field-free ground states of almost every magnet. The order parameters of these phases may be of potential interest for both classical and unconventional computing, which we refer to as helitronics. For the particular case of a chiral magnet and its helical phase, we use micromagnetic simulations to demonstrate the working principles of all-electrical (i) classical binary memory cells and (ii) memristors and artificial synapses, based on the orientation of the helical stripes.
磁性结构由于其非线性动力学特性,在非常规计算领域具有广阔的应用前景。我们建议研究丰富多样的看似平凡的片层磁相,如螺旋相、螺旋相、条纹相或其他一维孤子晶格。这是几乎所有磁铁的自然无杂散场基态。这些相的顺序参数可能对经典和非常规计算都有潜在的兴趣,我们称之为helitronics。对于手性磁体及其螺旋相的特殊情况,我们使用微磁模拟来演示基于螺旋条纹方向的全电(i)经典二进制存储单元和(ii)忆阻器和人工突触的工作原理。
{"title":"Helitronics as a potential building block for classical and unconventional computing","authors":"Nicolai Timon Bechler, J. Masell","doi":"10.1088/2634-4386/ace549","DOIUrl":"https://doi.org/10.1088/2634-4386/ace549","url":null,"abstract":"Magnetic textures are promising candidates for unconventional computing due to their non-linear dynamics. We propose to investigate the rich variety of seemingly trivial lamellar magnetic phases, e.g. helical, spiral, stripy phase, or other one-dimensional soliton lattices. These are the natural stray field-free ground states of almost every magnet. The order parameters of these phases may be of potential interest for both classical and unconventional computing, which we refer to as helitronics. For the particular case of a chiral magnet and its helical phase, we use micromagnetic simulations to demonstrate the working principles of all-electrical (i) classical binary memory cells and (ii) memristors and artificial synapses, based on the orientation of the helical stripes.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115176977","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Neuromorphic Computing and Engineering
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1