首页 > 最新文献

Neuromorphic Computing and Engineering最新文献

英文 中文
Plasticity of conducting polymer dendrites to bursts of voltage spikes in phosphate buffered saline 导电聚合物枝突对磷酸盐缓冲盐水中电压尖峰爆发的可塑性
Pub Date : 2022-10-19 DOI: 10.1088/2634-4386/ac9b85
Corentin Scholaert, Kamila Janzakova, Y. Coffinier, F. Alibart, Sébastien Pecqueur
The brain capitalizes on the complexity of both its biochemistry for neurons to encode diverse pieces of information with various neurotransmitters and its morphology at multiple scales to route different pathways for neural interconnectivity. Conducting polymer dendrites can show similar features by differentiating between cations and anions thanks to their charge accumulation profile and the asymmetry in their dendriticity that allows projecting spike signals differently. Here, we exploit such mimicry for in materio classification of bursting activity and investigate, in phosphate buffered saline, the capability of such object to sense bursts of voltage pulses of 100 mV amplitude, emitted by a local gate in the vicinity of the dendrite. The dendrite integrates the different activities with a fading memory time window that is characteristic of both the polarity of the spikes and the temporality of the burst. By this first demonstration, the ‘material-object’ definitely shows great potential to be a node halfway between the two realms of brain and electronic communication.
大脑利用其生物化学的复杂性,让神经元用不同的神经递质编码不同的信息片段,并在多个尺度上利用其形态,为神经互连提供不同的途径。导电聚合物树突可以通过区分阳离子和阴离子表现出相似的特征,这要归功于它们的电荷积累剖面和树突的不对称性,这使得它们可以投射不同的尖峰信号。在这里,我们利用这种模拟来对爆发活动进行物质分类,并研究在磷酸盐缓冲盐水中,这种物体感知由树突附近的局部门发出的100 mV振幅电压脉冲爆发的能力。树突将不同的活动与一个逐渐消失的记忆时间窗口整合在一起,该时间窗口具有尖峰的极性和爆发的时间性的特征。通过这第一次演示,“实物”绝对显示出巨大的潜力,可以成为大脑和电子通信两个领域之间的一个节点。
{"title":"Plasticity of conducting polymer dendrites to bursts of voltage spikes in phosphate buffered saline","authors":"Corentin Scholaert, Kamila Janzakova, Y. Coffinier, F. Alibart, Sébastien Pecqueur","doi":"10.1088/2634-4386/ac9b85","DOIUrl":"https://doi.org/10.1088/2634-4386/ac9b85","url":null,"abstract":"The brain capitalizes on the complexity of both its biochemistry for neurons to encode diverse pieces of information with various neurotransmitters and its morphology at multiple scales to route different pathways for neural interconnectivity. Conducting polymer dendrites can show similar features by differentiating between cations and anions thanks to their charge accumulation profile and the asymmetry in their dendriticity that allows projecting spike signals differently. Here, we exploit such mimicry for in materio classification of bursting activity and investigate, in phosphate buffered saline, the capability of such object to sense bursts of voltage pulses of 100 mV amplitude, emitted by a local gate in the vicinity of the dendrite. The dendrite integrates the different activities with a fading memory time window that is characteristic of both the polarity of the spikes and the temporality of the burst. By this first demonstration, the ‘material-object’ definitely shows great potential to be a node halfway between the two realms of brain and electronic communication.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123876333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Efficient continual learning at the edge with progressive segmented training 通过渐进式分段训练在边缘进行有效的持续学习
Pub Date : 2022-10-09 DOI: 10.1088/2634-4386/ac9899
Xiaocong Du, S. Venkataramanaiah, Zheng Li, Han-Sok Suh, Shihui Yin, Gokul Krishnan, Frank Liu, Jae-sun Seo, Yu Cao
There is an increasing need for continual learning in dynamic systems at the edge, such as self-driving vehicles, surveillance drones, and robotic systems. Such a system requires learning from the data stream, training the model to preserve previous information and adapt to a new task, and generating a single-headed vector for future inference, within a limited power budget. Different from previous continual learning algorithms with dynamic structures, this work focuses on a single network and model segmentation to mitigate catastrophic forgetting problem. Leveraging the redundant capacity of a single network, model parameters for each task are separated into two groups: one important group which is frozen to preserve current knowledge, and a secondary group to be saved (not pruned) for future learning. A fixed-size memory containing a small amount of previously seen data is further adopted to assist the training. Without additional regularization, the simple yet effective approach of progressive segmented training (PST) successfully incorporates multiple tasks and achieves state-of-the-art accuracy in the single-head evaluation on the CIFAR-10 and CIFAR-100 datasets. Moreover, the segmented training significantly improves computation efficiency in continual learning and thus, enabling efficient continual learning at the edge. On Intel Stratix-10 MX FPGA, we further demonstrate the efficiency of PST with representative CNNs trained on CIFAR-10.
在边缘动态系统中,对持续学习的需求越来越大,例如自动驾驶汽车、监视无人机和机器人系统。这样的系统需要从数据流中学习,训练模型以保留以前的信息并适应新的任务,并在有限的功率预算内生成用于未来推理的单头向量。与以往基于动态结构的连续学习算法不同,本研究侧重于单个网络和模型分割,以减轻灾难性遗忘问题。利用单个网络的冗余容量,每个任务的模型参数被分成两组:一个重要组被冻结以保存当前知识,另一个次要组被保存(而不是修剪)以供将来学习。进一步采用包含少量先前见过的数据的固定大小存储器来辅助训练。在没有额外正则化的情况下,简单而有效的渐进式分段训练(PST)方法成功地融合了多个任务,并在CIFAR-10和CIFAR-100数据集的单头部评估中达到了最先进的精度。此外,分段训练显著提高了持续学习的计算效率,从而实现了边缘的高效持续学习。在Intel Stratix-10 MX FPGA上,我们用在CIFAR-10上训练的具有代表性的cnn进一步验证了PST的效率。
{"title":"Efficient continual learning at the edge with progressive segmented training","authors":"Xiaocong Du, S. Venkataramanaiah, Zheng Li, Han-Sok Suh, Shihui Yin, Gokul Krishnan, Frank Liu, Jae-sun Seo, Yu Cao","doi":"10.1088/2634-4386/ac9899","DOIUrl":"https://doi.org/10.1088/2634-4386/ac9899","url":null,"abstract":"There is an increasing need for continual learning in dynamic systems at the edge, such as self-driving vehicles, surveillance drones, and robotic systems. Such a system requires learning from the data stream, training the model to preserve previous information and adapt to a new task, and generating a single-headed vector for future inference, within a limited power budget. Different from previous continual learning algorithms with dynamic structures, this work focuses on a single network and model segmentation to mitigate catastrophic forgetting problem. Leveraging the redundant capacity of a single network, model parameters for each task are separated into two groups: one important group which is frozen to preserve current knowledge, and a secondary group to be saved (not pruned) for future learning. A fixed-size memory containing a small amount of previously seen data is further adopted to assist the training. Without additional regularization, the simple yet effective approach of progressive segmented training (PST) successfully incorporates multiple tasks and achieves state-of-the-art accuracy in the single-head evaluation on the CIFAR-10 and CIFAR-100 datasets. Moreover, the segmented training significantly improves computation efficiency in continual learning and thus, enabling efficient continual learning at the edge. On Intel Stratix-10 MX FPGA, we further demonstrate the efficiency of PST with representative CNNs trained on CIFAR-10.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117083062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Synaptic behaviour in ferroelectric epitaxial rhombohedral Hf0.5Zr0.5O2 thin films 铁电外延菱面体Hf0.5Zr0.5O2薄膜的突触行为
Pub Date : 2022-10-03 DOI: 10.1088/2634-4386/ac970c
Yingfen Wei, G. Vats, B. Noheda
The discovery of ferroelectricity in HfO2-based thin films brings tremendous opportunities for emerging ferroelectric memories as well as for synaptic devices. The origin of ferroelectricity in this material is widely attributed to the presence of a polar orthorhombic phase. However, a new ferroelectric rhombohedral phase displaying large polarization with no need of pre-cycling, has more recently been reported in epitaxial Hf0.5Zr0.5O2 (HZO). In this work, the switching mechanism of the rhombohedral phase of HZO films is characterized by a two-stage process. In addition, the synaptic behaviour of this phase is presented, comparing it with previous reports on orthorhombic or non-epitaxial films. Unexpected similarities have been found between these structurally distinct systems. Even though the epitaxial films present a larger coercive field, the ration between the activation field for intrinsic polarization switching and the coercive field (F a/E c) has been found to be close to 2, in agreement with that reported for other hafnia samples. This is about 5 times smaller than in most other ferroelectrics, confirming this characteristic as a unique feature of hafnia-based ferroelectrics.
在hfo2基薄膜中铁电性的发现为新出现的铁电存储器以及突触器件带来了巨大的机会。这种材料中铁电性的起源被广泛地归因于极性正交相的存在。然而,最近在外延材料Hf0.5Zr0.5O2 (HZO)中发现了一种不需要预循环就能显示大极化的铁电菱形相。在这项工作中,HZO薄膜的菱面体相的开关机制是一个两阶段的过程。此外,介绍了该相的突触行为,并将其与先前关于正交或非外延薄膜的报道进行了比较。在这些结构不同的系统之间发现了意想不到的相似性。尽管外延薄膜呈现较大的矫顽力场,但本征极化开关激活场与矫顽力场的比值(F a/E c)接近于2,与其他半氧化铪样品的结果一致。这比大多数其他铁电体小约5倍,证实了这一特性是铪基铁电体的独特特征。
{"title":"Synaptic behaviour in ferroelectric epitaxial rhombohedral Hf0.5Zr0.5O2 thin films","authors":"Yingfen Wei, G. Vats, B. Noheda","doi":"10.1088/2634-4386/ac970c","DOIUrl":"https://doi.org/10.1088/2634-4386/ac970c","url":null,"abstract":"The discovery of ferroelectricity in HfO2-based thin films brings tremendous opportunities for emerging ferroelectric memories as well as for synaptic devices. The origin of ferroelectricity in this material is widely attributed to the presence of a polar orthorhombic phase. However, a new ferroelectric rhombohedral phase displaying large polarization with no need of pre-cycling, has more recently been reported in epitaxial Hf0.5Zr0.5O2 (HZO). In this work, the switching mechanism of the rhombohedral phase of HZO films is characterized by a two-stage process. In addition, the synaptic behaviour of this phase is presented, comparing it with previous reports on orthorhombic or non-epitaxial films. Unexpected similarities have been found between these structurally distinct systems. Even though the epitaxial films present a larger coercive field, the ration between the activation field for intrinsic polarization switching and the coercive field (F a/E c) has been found to be close to 2, in agreement with that reported for other hafnia samples. This is about 5 times smaller than in most other ferroelectrics, confirming this characteristic as a unique feature of hafnia-based ferroelectrics.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123376793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Biskyrmion-based artificial neuron 基于biskyrmion的人工神经元
Pub Date : 2022-09-22 DOI: 10.1088/2634-4386/acb841
Ismael Ribeiro de Assis, I. Mertig, B. Göbel
Magnetic skyrmions are nanoscale magnetic whirls that are highly stable and can be moved by currents. They have led to the prediction of a skyrmion-based artificial neuron device with leak-integrate-fire functionality. However, so far, these devices lack a refractory process, estimated to be crucial for neuronal dynamics. Here we demonstrate that a biskyrmion-based artificial neuron overcomes this insufficiency. When driven by spin-orbit torques, a single biskyrmion splits into two subskyrmions that move towards a designated location and can be detected electrically, ultimately resembling the excitation process of a neuron that fires. The attractive interaction of the two skyrmions leads to a unique trajectory: Once they reach the detector area, they automatically return to the center to reform the biskyrmion but on a different path. During this reset period, the neuron cannot fire again. Our suggested device resembles a biological neuron with the leak, integrate, fire and refractory characteristics increasing the bio-fidelity of current skyrmion-based devices.
磁skyrmions是纳米级的磁漩涡,高度稳定,可以通过电流移动。他们预测了一种基于skyrmion的人工神经元装置,具有泄漏集成功能。然而,到目前为止,这些装置缺乏一个对神经元动力学至关重要的耐火过程。在这里,我们证明了一种基于铋矿的人工神经元克服了这一不足。当受到自旋轨道扭矩的驱动时,单个双粒子分裂成两个子粒子,它们向指定位置移动,并且可以被电检测到,最终类似于神经元被激发的激励过程。这两个粒子的相互吸引导致了一条独特的轨迹:一旦它们到达探测器区域,它们就会自动返回中心,以不同的路径改造粒子。在这个重置期间,神经元不能再次放电。我们建议的装置类似于一个生物神经元,具有泄漏、集成、防火和耐火的特性,增加了当前基于skyrmic的装置的生物保真度。
{"title":"Biskyrmion-based artificial neuron","authors":"Ismael Ribeiro de Assis, I. Mertig, B. Göbel","doi":"10.1088/2634-4386/acb841","DOIUrl":"https://doi.org/10.1088/2634-4386/acb841","url":null,"abstract":"Magnetic skyrmions are nanoscale magnetic whirls that are highly stable and can be moved by currents. They have led to the prediction of a skyrmion-based artificial neuron device with leak-integrate-fire functionality. However, so far, these devices lack a refractory process, estimated to be crucial for neuronal dynamics. Here we demonstrate that a biskyrmion-based artificial neuron overcomes this insufficiency. When driven by spin-orbit torques, a single biskyrmion splits into two subskyrmions that move towards a designated location and can be detected electrically, ultimately resembling the excitation process of a neuron that fires. The attractive interaction of the two skyrmions leads to a unique trajectory: Once they reach the detector area, they automatically return to the center to reform the biskyrmion but on a different path. During this reset period, the neuron cannot fire again. Our suggested device resembles a biological neuron with the leak, integrate, fire and refractory characteristics increasing the bio-fidelity of current skyrmion-based devices.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131789042","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Editorial: Focus on disordered, self-assembled neuromorphic systems 社论:关注无序的、自组装的神经形态系统
Pub Date : 2022-09-13 DOI: 10.1088/2634-4386/ac91a0
Z. Kuncic, T. Nakayama, J. Gimzewski
This NCE Focus Issue is motivated by the intriguingly neuromorphic properties of many-body systems self-assembled from nanoscale elementary components. The rationale behind this is that biological neural networks, including in particular their nanoscale synapses, are formed by bottom-up self-assembly, rather than top-down design. Self-assembled nanosystems inherit a disordered network structure and the nonlinear interactions between the networked elements can give rise to emergent properties, as espoused by the legendary Nobel laureate Phillip W. Anderson in his famous article “More is Different” (Science 177, 393, 1972).
这个NCE焦点问题的动机是由纳米级基本组件自组装的多体系统的有趣的神经形态特性。这背后的基本原理是,生物神经网络,特别是它们的纳米级突触,是由自下而上的自组装形成的,而不是自上而下的设计。自组装纳米系统继承了无序的网络结构,网络元素之间的非线性相互作用可以产生涌现特性,正如诺贝尔奖传奇获得者Phillip W. Anderson在他著名的文章“More is Different”(Science 177, 393, 1972)中所支持的那样。
{"title":"Editorial: Focus on disordered, self-assembled neuromorphic systems","authors":"Z. Kuncic, T. Nakayama, J. Gimzewski","doi":"10.1088/2634-4386/ac91a0","DOIUrl":"https://doi.org/10.1088/2634-4386/ac91a0","url":null,"abstract":"\u0000 This NCE Focus Issue is motivated by the intriguingly neuromorphic properties of many-body systems self-assembled from nanoscale elementary components. The rationale behind this is that biological neural networks, including in particular their nanoscale synapses, are formed by bottom-up self-assembly, rather than top-down design. Self-assembled nanosystems inherit a disordered network structure and the nonlinear interactions between the networked elements can give rise to emergent properties, as espoused by the legendary Nobel laureate Phillip W. Anderson in his famous article “More is Different” (Science 177, 393, 1972).","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114619317","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
HfO2-based resistive switching memory devices for neuromorphic computing 用于神经形态计算的基于hfo2的电阻开关存储器件
Pub Date : 2022-09-07 DOI: 10.1088/2634-4386/ac9012
S. Brivio, S. Spiga, D. Ielmini
HfO2-based resistive switching memory (RRAM) combines several outstanding properties, such as high scalability, fast switching speed, low power, compatibility with complementary metal-oxide-semiconductor technology, with possible high-density or three-dimensional integration. Therefore, today, HfO2 RRAMs have attracted a strong interest for applications in neuromorphic engineering, in particular for the development of artificial synapses in neural networks. This review provides an overview of the structure, the properties and the applications of HfO2-based RRAM in neuromorphic computing. Both widely investigated applications of nonvolatile devices and pioneering works about volatile devices are reviewed. The RRAM device is first introduced, describing the switching mechanisms associated to filamentary path of HfO2 defects such as oxygen vacancies. The RRAM programming algorithms are described for high-precision multilevel operation, analog weight update in synaptic applications and for exploiting the resistance dynamics of volatile devices. Finally, the neuromorphic applications are presented, illustrating both artificial neural networks with supervised training and with multilevel, binary or stochastic weights. Spiking neural networks are then presented for applications ranging from unsupervised training to spatio-temporal recognition. From this overview, HfO2-based RRAM appears as a mature technology for a broad range of neuromorphic computing systems.
基于hfo2的电阻开关存储器(RRAM)结合了几个突出的特性,如高可扩展性,快速开关速度,低功耗,与互补金属氧化物半导体技术兼容,具有高密度或三维集成的可能。因此,HfO2 rram在神经形态工程中的应用引起了人们的强烈兴趣,特别是在神经网络中人工突触的开发方面。本文综述了基于hfo2的RRAM的结构、性能及其在神经形态计算中的应用。综述了非易失性器件广泛研究的应用和易失性器件的开创性工作。首先介绍了RRAM器件,描述了与氧空位等HfO2缺陷的丝状路径相关的开关机制。描述了RRAM编程算法用于高精度多电平操作,突触应用中的模拟权重更新以及利用易失性器件的电阻动态。最后,介绍了神经形态的应用,包括有监督训练的人工神经网络和具有多水平、二元或随机权重的人工神经网络。然后提出了从无监督训练到时空识别的脉冲神经网络的应用。从这个概述来看,基于hfo2的RRAM似乎是一种成熟的技术,适用于广泛的神经形态计算系统。
{"title":"HfO2-based resistive switching memory devices for neuromorphic computing","authors":"S. Brivio, S. Spiga, D. Ielmini","doi":"10.1088/2634-4386/ac9012","DOIUrl":"https://doi.org/10.1088/2634-4386/ac9012","url":null,"abstract":"HfO2-based resistive switching memory (RRAM) combines several outstanding properties, such as high scalability, fast switching speed, low power, compatibility with complementary metal-oxide-semiconductor technology, with possible high-density or three-dimensional integration. Therefore, today, HfO2 RRAMs have attracted a strong interest for applications in neuromorphic engineering, in particular for the development of artificial synapses in neural networks. This review provides an overview of the structure, the properties and the applications of HfO2-based RRAM in neuromorphic computing. Both widely investigated applications of nonvolatile devices and pioneering works about volatile devices are reviewed. The RRAM device is first introduced, describing the switching mechanisms associated to filamentary path of HfO2 defects such as oxygen vacancies. The RRAM programming algorithms are described for high-precision multilevel operation, analog weight update in synaptic applications and for exploiting the resistance dynamics of volatile devices. Finally, the neuromorphic applications are presented, illustrating both artificial neural networks with supervised training and with multilevel, binary or stochastic weights. Spiking neural networks are then presented for applications ranging from unsupervised training to spatio-temporal recognition. From this overview, HfO2-based RRAM appears as a mature technology for a broad range of neuromorphic computing systems.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116739439","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Bioinspired smooth neuromorphic control for robotic arms 机器人手臂的仿生平滑神经形态控制
Pub Date : 2022-09-06 DOI: 10.1088/2634-4386/acc204
Ioannis E. Polykretis, Lazar Supic, A. Danielescu
Beyond providing accurate movements, achieving smooth motion trajectories is a long-standing goal of robotics control theory for arms aiming to replicate natural human movements. Drawing inspiration from biological agents, whose reaching control networks effortlessly give rise to smooth and precise movements, can simplify these control objectives for robot arms. Neuromorphic processors, which mimic the brain’s computational principles, are an ideal platform to approximate the accuracy and smoothness of biological controllers while maximizing their energy efficiency and robustness. However, the incompatibility of conventional control methods with neuromorphic hardware limits the computational efficiency and explainability of their existing adaptations. In contrast, the neuronal subnetworks underlying smooth and accurate reaching movements are effective, minimal, and inherently compatible with neuromorphic hardware. In this work, we emulate these networks with a biologically realistic spiking neural network for motor control on neuromorphic hardware. The proposed controller incorporates experimentally-identified short-term synaptic plasticity and specialized neurons that regulate sensory feedback gain to provide smooth and accurate joint control across a wide motion range. Concurrently, it preserves the minimal complexity of its biological counterpart and is directly deployable on Intel’s neuromorphic processor. Using the joint controller as a building block and inspired by joint coordination in human arms, we scaled up this approach to control real-world robot arms. The trajectories and smooth, bell-shaped velocity profiles of the resulting motions resembled those of humans, verifying the biological relevance of the controller. Notably, the method achieved state-of-the-art control performance while decreasing the motion jerk by 19% to improve motion smoothness. Overall, this work suggests that control solutions inspired by experimentally identified neuronal architectures can provide effective, neuromorphic-controlled robots.
除了提供精确的运动之外,实现平滑的运动轨迹是机器人控制理论的长期目标,旨在复制自然的人类运动。从生物制剂中获得灵感,可以毫不费力地达到控制网络,从而产生平滑和精确的运动,从而简化机器人手臂的控制目标。神经形态处理器模仿大脑的计算原理,是一个理想的平台,可以近似生物控制器的准确性和平滑性,同时最大限度地提高它们的能量效率和鲁棒性。然而,传统控制方法与神经形态硬件的不兼容性限制了其现有适应性的计算效率和可解释性。相比之下,平滑和准确的到达运动的神经元子网络是有效的,最小的,并且与神经形态硬件固有兼容。在这项工作中,我们用生物学上真实的尖峰神经网络模拟这些网络,用于神经形态硬件上的运动控制。所提出的控制器结合了实验确定的短期突触可塑性和调节感觉反馈增益的专门神经元,以在广泛的运动范围内提供平滑和准确的关节控制。同时,它保留了其生物对等体的最小复杂性,并可直接部署在英特尔的神经形态处理器上。利用关节控制器作为构建模块,并受到人类手臂关节协调的启发,我们扩大了这种方法来控制现实世界的机器人手臂。由此产生的运动轨迹和平滑的钟形速度曲线与人类相似,验证了控制器的生物学相关性。值得注意的是,该方法实现了最先进的控制性能,同时减少了19%的运动抖动,提高了运动平滑度。总的来说,这项工作表明,由实验确定的神经元结构启发的控制解决方案可以提供有效的、神经形态控制的机器人。
{"title":"Bioinspired smooth neuromorphic control for robotic arms","authors":"Ioannis E. Polykretis, Lazar Supic, A. Danielescu","doi":"10.1088/2634-4386/acc204","DOIUrl":"https://doi.org/10.1088/2634-4386/acc204","url":null,"abstract":"Beyond providing accurate movements, achieving smooth motion trajectories is a long-standing goal of robotics control theory for arms aiming to replicate natural human movements. Drawing inspiration from biological agents, whose reaching control networks effortlessly give rise to smooth and precise movements, can simplify these control objectives for robot arms. Neuromorphic processors, which mimic the brain’s computational principles, are an ideal platform to approximate the accuracy and smoothness of biological controllers while maximizing their energy efficiency and robustness. However, the incompatibility of conventional control methods with neuromorphic hardware limits the computational efficiency and explainability of their existing adaptations. In contrast, the neuronal subnetworks underlying smooth and accurate reaching movements are effective, minimal, and inherently compatible with neuromorphic hardware. In this work, we emulate these networks with a biologically realistic spiking neural network for motor control on neuromorphic hardware. The proposed controller incorporates experimentally-identified short-term synaptic plasticity and specialized neurons that regulate sensory feedback gain to provide smooth and accurate joint control across a wide motion range. Concurrently, it preserves the minimal complexity of its biological counterpart and is directly deployable on Intel’s neuromorphic processor. Using the joint controller as a building block and inspired by joint coordination in human arms, we scaled up this approach to control real-world robot arms. The trajectories and smooth, bell-shaped velocity profiles of the resulting motions resembled those of humans, verifying the biological relevance of the controller. Notably, the method achieved state-of-the-art control performance while decreasing the motion jerk by 19% to improve motion smoothness. Overall, this work suggests that control solutions inspired by experimentally identified neuronal architectures can provide effective, neuromorphic-controlled robots.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133877880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Emulation and modelling of semiconductor optical amplifier-based all-optical photonic integrated deep neural network with arbitrary depth 基于半导体光放大器的任意深度全光光子集成深度神经网络仿真与建模
Pub Date : 2022-09-01 DOI: 10.1088/2634-4386/ac8827
B. Shi, N. Calabretta, R. Stabile
We experimentally demonstrate the emulation of scaling of the semiconductor optical amplifier (SOA) based integrated all-optical neural network in terms of number of input channels and layer cascade, with chromatic input at the neuron and monochromatic output conversion, obtained by exploiting cross-gain-modulation effect. We propose a noise model for investigating the signal degradation on the signal processing after cascades of SOAs, and we validate it via experimental results. Both experiments and simulations claim that the all-optical neuron (AON), with wavelength conversion as non-linear function, is able to compress noise for noisy optical inputs. This suggests that the use of SOA-based AON with wavelength conversion may allow for building neural networks with arbitrary depth. In fact, an arbitrarily deep neural network, built out of seven-channel input AONs, is shown to guarantee an error minor than 0.1 when operating at input power levels of −20 dBm/channel and with a 6 dB input dynamic range. Then the simulations results, extended to an arbitrary number of input channels and layers, suggest that by cascading and interconnecting multiple of these monolithically integrated AONs, it is possible to build a neural network with 12-inputs/neuron 12 neurons/layer and arbitrary depth scaling, or an 18-inputs/neuron 18-neurons/layer for single layer implementation, to maintain an output error <0.1. Further improvement in height scalability can be obtained by optimizing the input power.
利用交叉增益调制效应,仿真了基于半导体光放大器(SOA)的集成全光神经网络在输入通道数和层级联方面的缩放,并在神经元处进行了彩色输入和单色输出转换。我们提出了一个噪声模型来研究soa级联后信号处理中的信号退化,并通过实验结果对其进行了验证。实验和仿真均表明,波长转换为非线性函数的全光神经元(AON)能够压缩噪声光输入。这表明使用基于soa的AON与波长转换可能允许构建任意深度的神经网络。事实上,由7通道输入aon构建的任意深度神经网络,在输入功率水平为- 20 dBm/通道,输入动态范围为6 dB时,可以保证误差小于0.1。然后,将仿真结果扩展到任意数量的输入通道和层,表明通过将这些单片集成aon的多个级联和互连,可以构建具有12个输入/神经元12个神经元/层和任意深度缩放的神经网络,或者用于单层实现的18个输入/神经元18个神经元/层的神经网络,以保持输出误差<0.1。通过优化输入功率,可以进一步提高系统的高度可扩展性。
{"title":"Emulation and modelling of semiconductor optical amplifier-based all-optical photonic integrated deep neural network with arbitrary depth","authors":"B. Shi, N. Calabretta, R. Stabile","doi":"10.1088/2634-4386/ac8827","DOIUrl":"https://doi.org/10.1088/2634-4386/ac8827","url":null,"abstract":"We experimentally demonstrate the emulation of scaling of the semiconductor optical amplifier (SOA) based integrated all-optical neural network in terms of number of input channels and layer cascade, with chromatic input at the neuron and monochromatic output conversion, obtained by exploiting cross-gain-modulation effect. We propose a noise model for investigating the signal degradation on the signal processing after cascades of SOAs, and we validate it via experimental results. Both experiments and simulations claim that the all-optical neuron (AON), with wavelength conversion as non-linear function, is able to compress noise for noisy optical inputs. This suggests that the use of SOA-based AON with wavelength conversion may allow for building neural networks with arbitrary depth. In fact, an arbitrarily deep neural network, built out of seven-channel input AONs, is shown to guarantee an error minor than 0.1 when operating at input power levels of −20 dBm/channel and with a 6 dB input dynamic range. Then the simulations results, extended to an arbitrary number of input channels and layers, suggest that by cascading and interconnecting multiple of these monolithically integrated AONs, it is possible to build a neural network with 12-inputs/neuron 12 neurons/layer and arbitrary depth scaling, or an 18-inputs/neuron 18-neurons/layer for single layer implementation, to maintain an output error <0.1. Further improvement in height scalability can be obtained by optimizing the input power.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114877560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Characterization and modeling of spiking and bursting in experimental NbO x neuron 实验NbO x神经元的尖峰和破裂的表征和建模
Pub Date : 2022-09-01 DOI: 10.1088/2634-4386/ac969a
Marie Drouhin, Shuaifei Li, M. Grelier, S. Collin, F. Godel, R. Elliman, B. Dlubak, J. Trastoy, D. Querlioz, J. Grollier
Hardware spiking neural networks hold the promise of realizing artificial intelligence with high energy efficiency. In this context, solid-state and scalable memristors can be used to mimic biological neuron characteristics. However, these devices show limited neuronal behaviors and have to be integrated in more complex circuits to implement the rich dynamics of biological neurons. Here we studied a NbO x memristor neuron that is capable of emulating numerous neuronal dynamics, including tonic spiking, stochastic spiking, leaky-integrate-and-fire features, spike latency, temporal integration. The device also exhibits phasic bursting, a property that has scarcely been observed and studied in solid-state nano-neurons. We show that we can reproduce and understand this particular response through simulations using non-linear dynamics. These results show that a single NbO x device is sufficient to emulate a collection of rich neuronal dynamics that paves a path forward for realizing scalable and energy-efficient neuromorphic computing paradigms.
硬件脉冲神经网络有望实现高能效的人工智能。在这种情况下,固态和可扩展的记忆电阻器可以用来模拟生物神经元的特性。然而,这些设备显示有限的神经元行为,必须集成在更复杂的电路中才能实现生物神经元的丰富动态。在这里,我们研究了一个NbO x记忆电阻神经元,它能够模拟许多神经元动力学,包括强直尖峰,随机尖峰,泄漏-整合-点火特征,尖峰延迟,时间整合。该装置还表现出相爆裂,这种特性在固态纳米神经元中几乎没有被观察和研究过。我们表明,我们可以通过非线性动力学模拟来重现和理解这种特殊的反应。这些结果表明,单个NbO x设备足以模拟丰富的神经元动力学集合,为实现可扩展和节能的神经形态计算范式铺平了道路。
{"title":"Characterization and modeling of spiking and bursting in experimental NbO x neuron","authors":"Marie Drouhin, Shuaifei Li, M. Grelier, S. Collin, F. Godel, R. Elliman, B. Dlubak, J. Trastoy, D. Querlioz, J. Grollier","doi":"10.1088/2634-4386/ac969a","DOIUrl":"https://doi.org/10.1088/2634-4386/ac969a","url":null,"abstract":"Hardware spiking neural networks hold the promise of realizing artificial intelligence with high energy efficiency. In this context, solid-state and scalable memristors can be used to mimic biological neuron characteristics. However, these devices show limited neuronal behaviors and have to be integrated in more complex circuits to implement the rich dynamics of biological neurons. Here we studied a NbO x memristor neuron that is capable of emulating numerous neuronal dynamics, including tonic spiking, stochastic spiking, leaky-integrate-and-fire features, spike latency, temporal integration. The device also exhibits phasic bursting, a property that has scarcely been observed and studied in solid-state nano-neurons. We show that we can reproduce and understand this particular response through simulations using non-linear dynamics. These results show that a single NbO x device is sufficient to emulate a collection of rich neuronal dynamics that paves a path forward for realizing scalable and energy-efficient neuromorphic computing paradigms.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128320227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Polarization-controlled volatile ferroelectric and capacitive switching in Sn2P2S6 Sn2P2S6中极化控制的易失性铁电和电容开关
Pub Date : 2022-08-26 DOI: 10.1088/2634-4386/acb37e
S. Neumayer, A. Ievlev, A. Tselev, S. Basun, B. Conner, M. Susner, P. Maksymovych
Smart electronic circuits that support neuromorphic computing on the hardware level necessitate materials with memristive, memcapacitive, and neuromorphic- like functional properties; in short, the electronic response must depend on the voltage history, thus enabling learning algorithms. Here we demonstrate volatile ferroelectric switching of Sn2P2S6 at room temperature and see that initial polarization orientation strongly determines the properties of polarization switching. In particular, polarization switching hysteresis is strongly imprinted by the original polarization state, shifting the regions of non-linearity toward zero-bias. As a corollary, polarization switching also enables effective capacitive switching, approaching the sought-after regime of memcapacitance. Landau–Ginzburg–Devonshire simulations demonstrate that one mechanism by which polarization can control the shape of the hysteresis loop is the existence of charged domain walls (DWs) decorating the periphery of the repolarization nucleus. These walls oppose the growth of the switched domain and favor back-switching, thus creating a scenario of controlled volatile ferroelectric switching. Although the measurements were carried out with single crystals, prospectively volatile polarization switching can be tuned by tailoring sample thickness, DW mobility and electric fields, paving way to non-linear dielectric properties for smart electronic circuits.
在硬件层面支持神经形态计算的智能电子电路需要具有忆阻、忆容和类神经形态功能特性的材料;简而言之,电子响应必须依赖于电压历史,从而使学习算法成为可能。在这里,我们展示了Sn2P2S6在室温下的易失性铁电开关,并发现初始极化取向对极化开关的性质有很大的决定作用。特别是,极化开关迟滞被原始极化状态强烈地印记,将非线性区域移向零偏置。作为一个必然结果,极化开关也可以实现有效的电容开关,接近受欢迎的记忆电容状态。Landau-Ginzburg-Devonshire模拟表明极化控制磁滞环形状的一个机制是修饰重极化核外围的带电畴壁(DWs)的存在。这些壁反对开关畴的增长,有利于反向开关,从而创造了受控挥发性铁电开关的场景。虽然测量是用单晶进行的,但可以通过调整样品厚度、DW迁移率和电场来调节挥发性极化开关,为智能电子电路的非线性介电特性铺平道路。
{"title":"Polarization-controlled volatile ferroelectric and capacitive switching in Sn2P2S6","authors":"S. Neumayer, A. Ievlev, A. Tselev, S. Basun, B. Conner, M. Susner, P. Maksymovych","doi":"10.1088/2634-4386/acb37e","DOIUrl":"https://doi.org/10.1088/2634-4386/acb37e","url":null,"abstract":"Smart electronic circuits that support neuromorphic computing on the hardware level necessitate materials with memristive, memcapacitive, and neuromorphic- like functional properties; in short, the electronic response must depend on the voltage history, thus enabling learning algorithms. Here we demonstrate volatile ferroelectric switching of Sn2P2S6 at room temperature and see that initial polarization orientation strongly determines the properties of polarization switching. In particular, polarization switching hysteresis is strongly imprinted by the original polarization state, shifting the regions of non-linearity toward zero-bias. As a corollary, polarization switching also enables effective capacitive switching, approaching the sought-after regime of memcapacitance. Landau–Ginzburg–Devonshire simulations demonstrate that one mechanism by which polarization can control the shape of the hysteresis loop is the existence of charged domain walls (DWs) decorating the periphery of the repolarization nucleus. These walls oppose the growth of the switched domain and favor back-switching, thus creating a scenario of controlled volatile ferroelectric switching. Although the measurements were carried out with single crystals, prospectively volatile polarization switching can be tuned by tailoring sample thickness, DW mobility and electric fields, paving way to non-linear dielectric properties for smart electronic circuits.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127124429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Neuromorphic Computing and Engineering
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1