首页 > 最新文献

Neuromorphic Computing and Engineering最新文献

英文 中文
Artificial nanophotonic neuron with internal memory for biologically inspired and reservoir network computing 用于生物启发和水库网络计算的具有内部记忆的人工纳米光子神经元
Pub Date : 2023-05-01 DOI: 10.1088/2634-4386/acf684
D. Winge, Magnus Borgström, E. Lind, A. Mikkelsen
Neurons with internal memory have been proposed for biological and bio-inspired neural networks, adding important functionality. We introduce an internal time-limited charge-based memory into a III–V nanowire (NW) based optoelectronic neural node circuit designed for handling optical signals in a neural network. The new circuit can receive inhibiting and exciting light signals, store them, perform a non-linear evaluation, and emit a light signal. Using experimental values from the performance of individual III–V NWs we create a realistic computational model of the complete artificial neural node circuit. We then create a flexible neural network simulation that uses these circuits as neuronal nodes and light for communication between the nodes. This model can simulate combinations of nodes with different hardware derived memory properties and variable interconnects. Using the full model, we simulate the hardware implementation for two types of neural networks. First, we show that intentional variations in the memory decay time of the nodes can significantly improve the performance of a reservoir network. Second, we simulate the implementation in an anatomically constrained functioning model of the central complex network of the insect brain and find that it resolves an important functionality of the network even with significant variations in the node performance. Our work demonstrates the advantages of an internal memory in a concrete, nanophotonic neural node. The use of variable memory time constants in neural nodes is a general hardware derived feature and could be used in a broad range of implementations.
具有内部记忆的神经元已被提出用于生物和生物启发的神经网络,增加了重要的功能。我们在III-V纳米线(NW)光电神经节点电路中引入了一种内部限时电荷存储器,该电路设计用于处理神经网络中的光信号。该电路可以接收抑制和激励光信号,存储它们,执行非线性评估,并发出光信号。利用单个III-V NWs性能的实验值,我们创建了完整人工神经节点电路的真实计算模型。然后,我们创建了一个灵活的神经网络模拟,使用这些电路作为神经元节点,用光在节点之间进行通信。该模型可以模拟具有不同硬件派生存储属性和可变互连的节点组合。利用完整的模型,我们模拟了两种类型的神经网络的硬件实现。首先,我们表明节点的记忆衰减时间的有意变化可以显着提高存储网络的性能。其次,我们模拟了昆虫大脑中央复杂网络的解剖学约束功能模型的实现,并发现它解决了网络的一个重要功能,即使节点性能有显著变化。我们的工作证明了内部存储器在具体的纳米光子神经节点中的优势。在神经节点中使用可变记忆时间常数是一种通用的硬件派生特征,可以在广泛的实现中使用。
{"title":"Artificial nanophotonic neuron with internal memory for biologically inspired and reservoir network computing","authors":"D. Winge, Magnus Borgström, E. Lind, A. Mikkelsen","doi":"10.1088/2634-4386/acf684","DOIUrl":"https://doi.org/10.1088/2634-4386/acf684","url":null,"abstract":"Neurons with internal memory have been proposed for biological and bio-inspired neural networks, adding important functionality. We introduce an internal time-limited charge-based memory into a III–V nanowire (NW) based optoelectronic neural node circuit designed for handling optical signals in a neural network. The new circuit can receive inhibiting and exciting light signals, store them, perform a non-linear evaluation, and emit a light signal. Using experimental values from the performance of individual III–V NWs we create a realistic computational model of the complete artificial neural node circuit. We then create a flexible neural network simulation that uses these circuits as neuronal nodes and light for communication between the nodes. This model can simulate combinations of nodes with different hardware derived memory properties and variable interconnects. Using the full model, we simulate the hardware implementation for two types of neural networks. First, we show that intentional variations in the memory decay time of the nodes can significantly improve the performance of a reservoir network. Second, we simulate the implementation in an anatomically constrained functioning model of the central complex network of the insect brain and find that it resolves an important functionality of the network even with significant variations in the node performance. Our work demonstrates the advantages of an internal memory in a concrete, nanophotonic neural node. The use of variable memory time constants in neural nodes is a general hardware derived feature and could be used in a broad range of implementations.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114632416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Neuromorphic functionality of ferroelectric domain walls 铁电畴壁的神经形态功能
Pub Date : 2023-04-24 DOI: 10.1088/2634-4386/accfbb
Pankaj Sharma, J. Seidel
Mimicking and replicating the function of biological synapses with engineered materials is a challenge for the 21st century. The field of neuromorphic computing has recently seen significant developments, and new concepts are being explored. One of these approaches uses topological defects, such as domain walls in ferroic materials, especially ferroelectrics, that can naturally be addressed by electric fields to alter and tailor their intrinsic or extrinsic properties and functionality. Here, we review concepts of neuromorphic functionality found in ferroelectric domain walls and give a perspective on future developments and applications in low-energy, agile, brain-inspired electronics and computing.
用工程材料模拟和复制生物突触的功能是21世纪的一个挑战。神经形态计算领域最近有了重大的发展,新的概念正在被探索。其中一种方法是利用拓扑缺陷,如铁材料中的畴壁,特别是铁电体,可以自然地通过电场来改变和调整其内在或外在的特性和功能。在这里,我们回顾了在铁电畴壁中发现的神经形态功能的概念,并对未来在低能量、敏捷、大脑启发电子和计算方面的发展和应用进行了展望。
{"title":"Neuromorphic functionality of ferroelectric domain walls","authors":"Pankaj Sharma, J. Seidel","doi":"10.1088/2634-4386/accfbb","DOIUrl":"https://doi.org/10.1088/2634-4386/accfbb","url":null,"abstract":"Mimicking and replicating the function of biological synapses with engineered materials is a challenge for the 21st century. The field of neuromorphic computing has recently seen significant developments, and new concepts are being explored. One of these approaches uses topological defects, such as domain walls in ferroic materials, especially ferroelectrics, that can naturally be addressed by electric fields to alter and tailor their intrinsic or extrinsic properties and functionality. Here, we review concepts of neuromorphic functionality found in ferroelectric domain walls and give a perspective on future developments and applications in low-energy, agile, brain-inspired electronics and computing.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123295684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Long-term potentiation mechanism of biological postsynaptic activity in neuro-inspired halide perovskite memristors 神经激发卤化物钙钛矿记忆电阻器突触后生物活性的长期增强机制
Pub Date : 2023-04-20 DOI: 10.1088/2634-4386/accec4
E. Hernández‐Balaguera, Laura Muñoz-Díaz, A. Bou, B. Romero, B. Ilyassov, Antonio Guerrero, J. Bisquert
Perovskite memristors have emerged as leading contenders in brain-inspired neuromorphic electronics. Although these devices have been shown to accurately reproduce synaptic dynamics, they pose challenges for in-depth understanding of the underlying nonlinear phenomena. Potentiation effects on the electrical conductance of memristive devices have attracted increasing attention from the emerging neuromorphic community, demanding adequate interpretation. Here, we propose a detailed interpretation of the temporal dynamics of potentiation based on nonlinear electrical circuits that can be validated by impedance spectroscopy. The fundamental observation is that the current in a capacitor decreases with time; conversely, for an inductor, it increases with time. There is no electromagnetic effect in a halide perovskite memristor, but ionic-electronic coupling creates a chemical inductor effect that lies behind the potentiation property. Therefore, we show that beyond negative transients, the accumulation of mobile ions and the eventual penetration into the charge-transport layers constitute a bioelectrical memory feature that is the key to long-term synaptic enhancement. A quantitative dynamical electrical model formed by nonlinear differential equations explains the memory-based ionic effects to inductive phenomena associated with the slow and delayed currents, invisible during the ‘off mode’ of the presynaptic spike-based stimuli. Our work opens a new pathway for the rational development of material mimesis of neural communications across synapses, particularly the learning and memory functions in the human brain, through a Hodgkin–Huxley-style biophysical model.
钙钛矿记忆电阻器已成为脑启发神经形态电子学的主要竞争者。虽然这些装置已被证明可以准确地再现突触动力学,但它们对深入理解潜在的非线性现象提出了挑战。记忆器件电导率的增强效应引起了新兴神经形态学界越来越多的关注,需要充分的解释。在这里,我们提出了一个详细的解释,增强的时间动态基于非线性电路,可以通过阻抗谱验证。基本的观察是电容器中的电流随时间减小;相反,对于电感器,它随时间增加。在卤化物钙钛矿记忆电阻器中没有电磁效应,但离子-电子耦合产生了化学电感效应,这是增强特性背后的原因。因此,我们表明,在负瞬态之外,移动离子的积累和最终渗透到电荷传输层构成了生物电记忆特征,这是长期突触增强的关键。由非线性微分方程形成的定量动态电模型解释了基于记忆的离子效应对与缓慢和延迟电流相关的感应现象的影响,这些现象在突触前尖峰刺激的“关闭模式”期间是不可见的。我们的工作通过霍奇金-赫胥黎式的生物物理模型,为合理开发突触间神经通信的材料模拟,特别是人脑中的学习和记忆功能,开辟了一条新的途径。
{"title":"Long-term potentiation mechanism of biological postsynaptic activity in neuro-inspired halide perovskite memristors","authors":"E. Hernández‐Balaguera, Laura Muñoz-Díaz, A. Bou, B. Romero, B. Ilyassov, Antonio Guerrero, J. Bisquert","doi":"10.1088/2634-4386/accec4","DOIUrl":"https://doi.org/10.1088/2634-4386/accec4","url":null,"abstract":"Perovskite memristors have emerged as leading contenders in brain-inspired neuromorphic electronics. Although these devices have been shown to accurately reproduce synaptic dynamics, they pose challenges for in-depth understanding of the underlying nonlinear phenomena. Potentiation effects on the electrical conductance of memristive devices have attracted increasing attention from the emerging neuromorphic community, demanding adequate interpretation. Here, we propose a detailed interpretation of the temporal dynamics of potentiation based on nonlinear electrical circuits that can be validated by impedance spectroscopy. The fundamental observation is that the current in a capacitor decreases with time; conversely, for an inductor, it increases with time. There is no electromagnetic effect in a halide perovskite memristor, but ionic-electronic coupling creates a chemical inductor effect that lies behind the potentiation property. Therefore, we show that beyond negative transients, the accumulation of mobile ions and the eventual penetration into the charge-transport layers constitute a bioelectrical memory feature that is the key to long-term synaptic enhancement. A quantitative dynamical electrical model formed by nonlinear differential equations explains the memory-based ionic effects to inductive phenomena associated with the slow and delayed currents, invisible during the ‘off mode’ of the presynaptic spike-based stimuli. Our work opens a new pathway for the rational development of material mimesis of neural communications across synapses, particularly the learning and memory functions in the human brain, through a Hodgkin–Huxley-style biophysical model.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123860130","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Ferroelectric topologically configurable multilevel logic unit 铁电拓扑可配置的多层逻辑单元
Pub Date : 2023-04-19 DOI: 10.1088/2634-4386/acce61
A. Razumnaya, Y. Tikhonov, V. Vinokur, I. Luk’yanchuk
Multilevel devices demonstrating switchable polarization enable us to efficiently realize neuromorphic functionalities including synaptic plasticity and neuronal activity. Here we propose using the ferroelectric logic unit comprising multiple nanodots disposed between two electrodes and coated by the dielectric material. We devise the integration of the ferroelectric logic unit, providing topologically configurable non-binary logic into a gate stack of the field-effect transistor as an analog-like device with resistive states. By controlling the charge of the gate, we demonstrate the various routes of the topological switchings between different polarization configurations in ferroelectric nanodots. Switching routes between different logic levels are characterized by hysteresis loops with multiple branches realizing specific interconnectivity regimes. The switching between different types of hysteresis loops is achieved by the variation of external fields and temperature. The devised ferroelectric multilevel devices provide a pathway toward the novel topologically-controlled implementation of discrete synaptic states in neuromorphic computing.
显示可切换极化的多电平设备使我们能够有效地实现神经形态功能,包括突触可塑性和神经元活动。在这里,我们建议使用由多个纳米点组成的铁电逻辑单元,这些纳米点被放置在两个电极之间,并被介电材料包裹。我们设计了铁电逻辑单元的集成,将拓扑可配置的非二进制逻辑提供到场效应晶体管的门堆栈中,作为具有电阻状态的类似模拟的器件。通过控制栅极的电荷,我们展示了铁电纳米点在不同极化构型之间拓扑切换的各种途径。不同逻辑级别之间的切换路径以具有多个分支的滞回回路为特征,实现特定的互联机制。不同类型的磁滞回线之间的切换是通过外部场和温度的变化来实现的。所设计的铁电多能级器件为神经形态计算中离散突触状态的新颖拓扑控制实现提供了一条途径。
{"title":"Ferroelectric topologically configurable multilevel logic unit","authors":"A. Razumnaya, Y. Tikhonov, V. Vinokur, I. Luk’yanchuk","doi":"10.1088/2634-4386/acce61","DOIUrl":"https://doi.org/10.1088/2634-4386/acce61","url":null,"abstract":"Multilevel devices demonstrating switchable polarization enable us to efficiently realize neuromorphic functionalities including synaptic plasticity and neuronal activity. Here we propose using the ferroelectric logic unit comprising multiple nanodots disposed between two electrodes and coated by the dielectric material. We devise the integration of the ferroelectric logic unit, providing topologically configurable non-binary logic into a gate stack of the field-effect transistor as an analog-like device with resistive states. By controlling the charge of the gate, we demonstrate the various routes of the topological switchings between different polarization configurations in ferroelectric nanodots. Switching routes between different logic levels are characterized by hysteresis loops with multiple branches realizing specific interconnectivity regimes. The switching between different types of hysteresis loops is achieved by the variation of external fields and temperature. The devised ferroelectric multilevel devices provide a pathway toward the novel topologically-controlled implementation of discrete synaptic states in neuromorphic computing.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"112 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129465833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Neuromorphic computing for attitude estimation onboard quadrotors 四旋翼飞行器姿态估计的神经形态计算
Pub Date : 2023-04-18 DOI: 10.1088/2634-4386/ac7ee0
S. Stroobants, Julien Dupeyroux, G. de Croon
Compelling evidence has been given for the high energy efficiency and update rates of neuromorphic processors, with performance beyond what standard Von Neumann architectures can achieve. Such promising features could be advantageous in critical embedded systems, especially in robotics. To date, the constraints inherent in robots (e.g., size and weight, battery autonomy, available sensors, computing resources, processing time, etc), and particularly in aerial vehicles, severely hamper the performance of fully-autonomous on-board control, including sensor processing and state estimation. In this work, we propose a spiking neural network capable of estimating the pitch and roll angles of a quadrotor in highly dynamic movements from six-degree of freedom inertial measurement unit data. With only 150 neurons and a limited training dataset obtained using a quadrotor in a real world setup, the network shows competitive results as compared to state-of-the-art, non-neuromorphic attitude estimators. The proposed architecture was successfully tested on the Loihi neuromorphic processor on-board a quadrotor to estimate the attitude when flying. Our results show the robustness of neuromorphic attitude estimation and pave the way toward energy-efficient, fully autonomous control of quadrotors with dedicated neuromorphic computing systems.
令人信服的证据表明,神经形态处理器具有高能效和更新率,其性能超出了标准冯·诺伊曼架构所能达到的水平。这些有前途的特性在关键的嵌入式系统中是有利的,特别是在机器人技术中。迄今为止,机器人固有的限制(例如,尺寸和重量,电池自主性,可用传感器,计算资源,处理时间等),特别是在飞行器中,严重阻碍了完全自主的机载控制性能,包括传感器处理和状态估计。在这项工作中,我们提出了一个能够从六自由度惯性测量单元数据估计四旋翼在高动态运动中的俯仰角和滚转角的峰值神经网络。在现实世界中,只有150个神经元和使用四旋翼飞行器获得的有限训练数据集,与最先进的非神经形态姿态估计器相比,该网络显示出具有竞争力的结果。所提出的架构已成功地在四旋翼飞行器上的Loihi神经形态处理器上进行了测试,以估计飞行时的姿态。我们的研究结果显示了神经形态姿态估计的鲁棒性,并为利用专用神经形态计算系统实现节能、完全自主的四旋翼飞行器控制铺平了道路。
{"title":"Neuromorphic computing for attitude estimation onboard quadrotors","authors":"S. Stroobants, Julien Dupeyroux, G. de Croon","doi":"10.1088/2634-4386/ac7ee0","DOIUrl":"https://doi.org/10.1088/2634-4386/ac7ee0","url":null,"abstract":"Compelling evidence has been given for the high energy efficiency and update rates of neuromorphic processors, with performance beyond what standard Von Neumann architectures can achieve. Such promising features could be advantageous in critical embedded systems, especially in robotics. To date, the constraints inherent in robots (e.g., size and weight, battery autonomy, available sensors, computing resources, processing time, etc), and particularly in aerial vehicles, severely hamper the performance of fully-autonomous on-board control, including sensor processing and state estimation. In this work, we propose a spiking neural network capable of estimating the pitch and roll angles of a quadrotor in highly dynamic movements from six-degree of freedom inertial measurement unit data. With only 150 neurons and a limited training dataset obtained using a quadrotor in a real world setup, the network shows competitive results as compared to state-of-the-art, non-neuromorphic attitude estimators. The proposed architecture was successfully tested on the Loihi neuromorphic processor on-board a quadrotor to estimate the attitude when flying. Our results show the robustness of neuromorphic attitude estimation and pave the way toward energy-efficient, fully autonomous control of quadrotors with dedicated neuromorphic computing systems.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123838514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Spiking neural networks compensate for weight drift in organic neuromorphic device networks 脉冲神经网络补偿了有机神经形态设备网络中的权重漂移
Pub Date : 2023-04-17 DOI: 10.1088/2634-4386/accd90
Daniel Felder, J. Linkhorst, Matthias Wessling
Organic neuromorphic devices can accelerate neural networks and integrate with biological systems. Devices based on the biocompatible and conductive polymer PEDOT:PSS are fast, require low amounts of energy and perform well in crossbar simulations. However, parasitic electrochemical reactions lead to self-discharge and the fading of the learned conductance states over time. This limits a neural network’s operating time and requires complex compensation mechanisms. Spiking neural networks (SNNs) take inspiration from biology to implement local and always-on learning. We show that these SNNs can function on organic neuromorphic hardware and compensate for self-discharge by continuously relearning and reinforcing forgotten states. In this work, we use a high-resolution charge transport model to describe the behavior of organic neuromorphic devices and create a computationally efficient surrogate model. By integrating the surrogate model into a Brian 2 simulation, we can describe the behavior of SNNs on organic neuromorphic hardware. A biologically plausible two-layer network for recognizing 28×28 pixel MNIST images is trained and observed during self-discharge. The network achieves, for its size, competitive recognition results of up to 82.5%. Building a network with forgetful devices yields superior accuracy during training with 84.5% compared to ideal devices. However, trained networks without active spike-timing-dependent plasticity quickly lose their predictive performance. We show that online learning can keep the performance at a steady level close to the initial accuracy, even for idle rates of up to 90%. This performance is maintained when the output neuron’s labels are not revalidated for up to 24 h. These findings reconfirm the potential of organic neuromorphic devices for brain-inspired computing. Their biocompatibility and the demonstrated adaptability to SNNs open the path towards close integration with multi-electrode arrays, drug-delivery devices, and other bio-interfacing systems as either fully organic or hybrid organic-inorganic systems.
有机神经形态装置可以加速神经网络并与生物系统集成。基于生物相容性和导电聚合物PEDOT:PSS的设备速度快,需要的能量少,并且在交叉杆模拟中表现良好。然而,寄生电化学反应导致自放电和学习电导状态随着时间的推移而衰减。这限制了神经网络的运行时间,并且需要复杂的补偿机制。脉冲神经网络(snn)从生物学中获得灵感,实现了局部和永远在线的学习。我们发现这些snn可以在有机神经形态硬件上起作用,并通过不断的再学习和强化遗忘状态来补偿自放电。在这项工作中,我们使用高分辨率电荷传输模型来描述有机神经形态器件的行为,并创建了一个计算效率高的替代模型。通过将代理模型集成到Brian 2模拟中,我们可以描述snn在有机神经形态硬件上的行为。在自放电过程中,训练并观察了用于识别28×28像素MNIST图像的生物学上合理的双层网络。对于其规模,该网络的竞争识别率高达82.5%。与理想设备相比,使用健忘设备构建网络在训练期间的准确率达到了84.5%。然而,训练后的网络如果没有主动的与峰值时间相关的可塑性,就会很快失去其预测性能。我们表明,在线学习可以使性能保持在接近初始精度的稳定水平,即使空闲率高达90%。当输出神经元的标签在长达24小时内不被重新验证时,这种性能保持不变。这些发现再次证实了有机神经形态设备在脑启发计算方面的潜力。它们的生物相容性和对snn的适应性为与多电极阵列、药物输送装置和其他生物界面系统紧密结合开辟了道路,无论是作为全有机系统还是有机-无机混合系统。
{"title":"Spiking neural networks compensate for weight drift in organic neuromorphic device networks","authors":"Daniel Felder, J. Linkhorst, Matthias Wessling","doi":"10.1088/2634-4386/accd90","DOIUrl":"https://doi.org/10.1088/2634-4386/accd90","url":null,"abstract":"Organic neuromorphic devices can accelerate neural networks and integrate with biological systems. Devices based on the biocompatible and conductive polymer PEDOT:PSS are fast, require low amounts of energy and perform well in crossbar simulations. However, parasitic electrochemical reactions lead to self-discharge and the fading of the learned conductance states over time. This limits a neural network’s operating time and requires complex compensation mechanisms. Spiking neural networks (SNNs) take inspiration from biology to implement local and always-on learning. We show that these SNNs can function on organic neuromorphic hardware and compensate for self-discharge by continuously relearning and reinforcing forgotten states. In this work, we use a high-resolution charge transport model to describe the behavior of organic neuromorphic devices and create a computationally efficient surrogate model. By integrating the surrogate model into a Brian 2 simulation, we can describe the behavior of SNNs on organic neuromorphic hardware. A biologically plausible two-layer network for recognizing 28×28 pixel MNIST images is trained and observed during self-discharge. The network achieves, for its size, competitive recognition results of up to 82.5%. Building a network with forgetful devices yields superior accuracy during training with 84.5% compared to ideal devices. However, trained networks without active spike-timing-dependent plasticity quickly lose their predictive performance. We show that online learning can keep the performance at a steady level close to the initial accuracy, even for idle rates of up to 90%. This performance is maintained when the output neuron’s labels are not revalidated for up to 24 h. These findings reconfirm the potential of organic neuromorphic devices for brain-inspired computing. Their biocompatibility and the demonstrated adaptability to SNNs open the path towards close integration with multi-electrode arrays, drug-delivery devices, and other bio-interfacing systems as either fully organic or hybrid organic-inorganic systems.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124920054","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Parallel synaptic design of ferroelectric tunnel junctions for neuromorphic computing 用于神经形态计算的铁电隧道连接并行突触设计
Pub Date : 2023-04-12 DOI: 10.1088/2634-4386/accc51
Taehwan Moon, Hyun-Yong Lee, S. Nam, H. Bae, Duk-Hyun Choe, Sanghyun Jo, Yunseong Lee, Yoon-Ho Park, J. Yang, J. Heo
We propose a novel synaptic design of more efficient neuromorphic edge-computing with substantially improved linearity and extremely low variability. Specifically, a parallel arrangement of ferroelectric tunnel junctions (FTJ) with an incremental pulsing scheme provides a great improvement in linearity for synaptic weight updating by averaging weight update rates of multiple devices. To enable such design with FTJ building blocks, we have demonstrated the lowest reported variability: σ/μ = 0.036 for cycle to cycle and σ/μ = 0.032 for device among six dies across an 8 inch wafer. With such devices, we further show improved synaptic performance and pattern recognition accuracy through experiments combined with simulations.
我们提出了一种新的突触设计,更有效的神经形态边缘计算具有显著改善的线性和极低的可变性。具体而言,采用增量脉冲方案的铁电隧道结(FTJ)平行排列,通过平均多个器件的权重更新率,大大提高了突触权重更新的线性度。为了实现FTJ构建模块的这种设计,我们已经证明了最低的可变性:σ/μ = 0.036周期和σ/μ = 0.032在8英寸晶圆上的六个芯片之间的器件。利用这些装置,我们通过实验结合模拟进一步证明了突触性能和模式识别精度的提高。
{"title":"Parallel synaptic design of ferroelectric tunnel junctions for neuromorphic computing","authors":"Taehwan Moon, Hyun-Yong Lee, S. Nam, H. Bae, Duk-Hyun Choe, Sanghyun Jo, Yunseong Lee, Yoon-Ho Park, J. Yang, J. Heo","doi":"10.1088/2634-4386/accc51","DOIUrl":"https://doi.org/10.1088/2634-4386/accc51","url":null,"abstract":"We propose a novel synaptic design of more efficient neuromorphic edge-computing with substantially improved linearity and extremely low variability. Specifically, a parallel arrangement of ferroelectric tunnel junctions (FTJ) with an incremental pulsing scheme provides a great improvement in linearity for synaptic weight updating by averaging weight update rates of multiple devices. To enable such design with FTJ building blocks, we have demonstrated the lowest reported variability: σ/μ = 0.036 for cycle to cycle and σ/μ = 0.032 for device among six dies across an 8 inch wafer. With such devices, we further show improved synaptic performance and pattern recognition accuracy through experiments combined with simulations.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133263770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
System model of neuromorphic sequence learning on a memristive crossbar array 记忆记忆交叉棒阵列上的神经形态序列学习系统模型
Pub Date : 2023-04-04 DOI: 10.1088/2634-4386/acca45
Sebastian Siegel, Younes Bouhadjar, T. Tetzlaff, R. Waser, R. Dittmann, D. Wouters
Machine learning models for sequence learning and processing often suffer from high energy consumption and require large amounts of training data. The brain presents more efficient solutions to how these types of tasks can be solved. While this has inspired the conception of novel brain-inspired algorithms, their realizations remain constrained to conventional von-Neumann machines. Therefore, the potential power efficiency of the algorithm cannot be exploited due to the inherent memory bottleneck of the computing architecture. Therefore, we present in this paper a dedicated hardware implementation of a biologically plausible version of the Temporal Memory component of the Hierarchical Temporal Memory concept. Our implementation is built on a memristive crossbar array and is the result of a hardware-algorithm co-design process. Rather than using the memristive devices solely for data storage, our approach leverages their specific switching dynamics to propose a formulation of the peripheral circuitry, resulting in a more efficient design. By combining a brain-like algorithm with emerging non-volatile memristive device technology we strive for maximum energy efficiency. We present simulation results on the training of complex high-order sequences and discuss how the system is able to predict in a context-dependent manner. Finally, we investigate the energy consumption during the training and conclude with a discussion of scaling prospects.
用于序列学习和处理的机器学习模型往往能耗高,需要大量的训练数据。大脑会提出更有效的解决方案来解决这些类型的任务。虽然这激发了新的大脑启发算法的概念,但它们的实现仍然局限于传统的冯-诺伊曼机器。因此,由于计算架构固有的内存瓶颈,该算法的潜在功耗效率无法得到充分利用。因此,我们在本文中提出了一种专用的硬件实现,该硬件实现了分层时间记忆概念的时间记忆组件的生物学上合理的版本。我们的实现是建立在记忆交叉棒阵列上的,是硬件算法协同设计过程的结果。我们的方法不是仅将忆阻器件用于数据存储,而是利用其特定的开关动力学来提出外围电路的公式,从而实现更高效的设计。通过将类似大脑的算法与新兴的非易失性记忆器件技术相结合,我们力求实现最大的能源效率。我们给出了复杂高阶序列训练的仿真结果,并讨论了系统如何能够以上下文相关的方式进行预测。最后,我们研究了训练过程中的能量消耗,并对规模化前景进行了讨论。
{"title":"System model of neuromorphic sequence learning on a memristive crossbar array","authors":"Sebastian Siegel, Younes Bouhadjar, T. Tetzlaff, R. Waser, R. Dittmann, D. Wouters","doi":"10.1088/2634-4386/acca45","DOIUrl":"https://doi.org/10.1088/2634-4386/acca45","url":null,"abstract":"Machine learning models for sequence learning and processing often suffer from high energy consumption and require large amounts of training data. The brain presents more efficient solutions to how these types of tasks can be solved. While this has inspired the conception of novel brain-inspired algorithms, their realizations remain constrained to conventional von-Neumann machines. Therefore, the potential power efficiency of the algorithm cannot be exploited due to the inherent memory bottleneck of the computing architecture. Therefore, we present in this paper a dedicated hardware implementation of a biologically plausible version of the Temporal Memory component of the Hierarchical Temporal Memory concept. Our implementation is built on a memristive crossbar array and is the result of a hardware-algorithm co-design process. Rather than using the memristive devices solely for data storage, our approach leverages their specific switching dynamics to propose a formulation of the peripheral circuitry, resulting in a more efficient design. By combining a brain-like algorithm with emerging non-volatile memristive device technology we strive for maximum energy efficiency. We present simulation results on the training of complex high-order sequences and discuss how the system is able to predict in a context-dependent manner. Finally, we investigate the energy consumption during the training and conclude with a discussion of scaling prospects.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"85 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123783679","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Magnetic skyrmions and domain walls for logical and neuromorphic computing 用于逻辑和神经形态计算的磁skyrmions和域壁
Pub Date : 2023-03-23 DOI: 10.1088/2634-4386/acc6e8
Xuan Hu, Can Cui, Samuel Liu, F. García-Sánchez, Wesley H. Brigner, Benjamin W. Walker, Alexander J. Edwards, T. Xiao, C. Bennett, Naimul Hassan, M. Frank, Jean Anne C Incorvia, J. Friedman
Topological solitons are exciting candidates for the physical implementation of next-generation computing systems. As these solitons are nanoscale and can be controlled with minimal energy consumption, they are ideal to fulfill emerging needs for computing in the era of big data processing and storage. Magnetic domain walls (DWs) and magnetic skyrmions are two types of topological solitons that are particularly exciting for next-generation computing systems in light of their non-volatility, scalability, rich physical interactions, and ability to exhibit non-linear behaviors. Here we summarize the development of computing systems based on magnetic topological solitons, highlighting logical and neuromorphic computing with magnetic DWs and skyrmions.
拓扑孤子是下一代计算系统物理实现的令人兴奋的候选者。由于这些孤子是纳米级的,并且可以以最小的能耗进行控制,因此它们是满足大数据处理和存储时代新兴计算需求的理想选择。磁畴壁(DWs)和磁天幕是两种类型的拓扑孤子,由于它们的非易失性、可扩展性、丰富的物理交互和表现非线性行为的能力,它们对下一代计算系统特别令人兴奋。本文总结了基于磁拓扑孤子的计算系统的发展,重点介绍了基于磁拓扑孤子和磁孤子的逻辑和神经形态计算。
{"title":"Magnetic skyrmions and domain walls for logical and neuromorphic computing","authors":"Xuan Hu, Can Cui, Samuel Liu, F. García-Sánchez, Wesley H. Brigner, Benjamin W. Walker, Alexander J. Edwards, T. Xiao, C. Bennett, Naimul Hassan, M. Frank, Jean Anne C Incorvia, J. Friedman","doi":"10.1088/2634-4386/acc6e8","DOIUrl":"https://doi.org/10.1088/2634-4386/acc6e8","url":null,"abstract":"Topological solitons are exciting candidates for the physical implementation of next-generation computing systems. As these solitons are nanoscale and can be controlled with minimal energy consumption, they are ideal to fulfill emerging needs for computing in the era of big data processing and storage. Magnetic domain walls (DWs) and magnetic skyrmions are two types of topological solitons that are particularly exciting for next-generation computing systems in light of their non-volatility, scalability, rich physical interactions, and ability to exhibit non-linear behaviors. Here we summarize the development of computing systems based on magnetic topological solitons, highlighting logical and neuromorphic computing with magnetic DWs and skyrmions.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121790993","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
From neuromorphic to neurohybrid: transition from the emulation to the integration of neuronal networks 从神经形态到神经杂交:神经网络从仿真到集成的过渡
Pub Date : 2023-03-22 DOI: 10.1088/2634-4386/acc683
Ugo Bruno, Anna Mariano, Daniela Rana, T. Gemmeke, Simon Musall, F. Santoro
The computation of the brain relies on the highly efficient communication among billions of neurons. Such efficiency derives from the brain’s plastic and reconfigurable nature, enabling complex computations and maintenance of vital functions with a remarkably low power consumption of only ∼20 W. First efforts to leverage brain-inspired computational principles have led to the introduction of artificial neural networks that revolutionized information processing and daily life. The relentless pursuit of the definitive computing platform is now pushing researchers towards investigation of novel solutions to emulate specific brain features (such as synaptic plasticity) to allow local and energy efficient computations. The development of such devices may also be pivotal in addressing major challenges of a continuously aging world, including the treatment of neurodegenerative diseases. To date, the neuroelectronics field has been instrumental in deepening the understanding of how neurons communicate, owing to the rapid development of silicon-based platforms for neural recordings and stimulation. However, this approach still does not allow for in loco processing of biological signals. In fact, despite the success of silicon-based devices in electronic applications, they are ill-suited for directly interfacing with biological tissue. A cornucopia of solutions has therefore been proposed in the last years to obtain neuromorphic materials to create effective biointerfaces and enable reliable bidirectional communication with neurons. Organic conductive materials in particular are not only highly biocompatible and able to electrochemically transduce biological signals, but also promise to include neuromorphic features, such as neuro-transmitter mediated plasticity and learning capabilities. Furthermore, organic electronics, relying on mixed electronic/ionic conduction mechanism, can be efficiently coupled with biological neural networks, while still successfully communicating with silicon-based electronics. Here, we envision neurohybrid systems that integrate silicon-based and organic electronics-based neuromorphic technologies to create active artificial interfaces with biological tissues. We believe that this approach may pave the way towards the development of a functional bidirectional communication between biological and artificial ‘brains’, offering new potential therapeutic applications and allowing for novel approaches in prosthetics.
大脑的计算依赖于数十亿神经元之间的高效通信。这样的效率源于大脑的可塑性和可重构性,使复杂的计算和重要功能的维护具有非常低的功耗,只有~ 20w。利用受大脑启发的计算原理的第一次努力导致了人工神经网络的引入,彻底改变了信息处理和日常生活。对最终计算平台的不懈追求正在推动研究人员研究新的解决方案,以模拟特定的大脑特征(如突触可塑性),从而实现局部和节能计算。这种设备的发展也可能是解决持续老龄化世界的主要挑战的关键,包括神经退行性疾病的治疗。迄今为止,由于用于神经记录和刺激的硅基平台的快速发展,神经电子学领域在加深对神经元如何交流的理解方面发挥了重要作用。然而,这种方法仍然不允许在loco处理生物信号。事实上,尽管硅基器件在电子应用中取得了成功,但它们并不适合直接与生物组织连接。因此,在过去的几年里,人们提出了大量的解决方案来获得神经形态材料,以创建有效的生物界面,并实现与神经元的可靠双向通信。特别是有机导电材料不仅具有高度的生物相容性和电化学转导生物信号的能力,而且还有望包括神经形态特征,如神经递质介导的可塑性和学习能力。此外,有机电子学依靠混合电子/离子传导机制,可以有效地与生物神经网络耦合,同时仍能成功地与硅基电子学通信。在这里,我们设想神经混合系统集成了基于硅和有机电子的神经形态技术,以创造与生物组织的主动人工界面。我们相信,这种方法可能为生物和人工“大脑”之间功能双向交流的发展铺平道路,提供新的潜在治疗应用,并允许在假肢中使用新方法。
{"title":"From neuromorphic to neurohybrid: transition from the emulation to the integration of neuronal networks","authors":"Ugo Bruno, Anna Mariano, Daniela Rana, T. Gemmeke, Simon Musall, F. Santoro","doi":"10.1088/2634-4386/acc683","DOIUrl":"https://doi.org/10.1088/2634-4386/acc683","url":null,"abstract":"The computation of the brain relies on the highly efficient communication among billions of neurons. Such efficiency derives from the brain’s plastic and reconfigurable nature, enabling complex computations and maintenance of vital functions with a remarkably low power consumption of only ∼20 W. First efforts to leverage brain-inspired computational principles have led to the introduction of artificial neural networks that revolutionized information processing and daily life. The relentless pursuit of the definitive computing platform is now pushing researchers towards investigation of novel solutions to emulate specific brain features (such as synaptic plasticity) to allow local and energy efficient computations. The development of such devices may also be pivotal in addressing major challenges of a continuously aging world, including the treatment of neurodegenerative diseases. To date, the neuroelectronics field has been instrumental in deepening the understanding of how neurons communicate, owing to the rapid development of silicon-based platforms for neural recordings and stimulation. However, this approach still does not allow for in loco processing of biological signals. In fact, despite the success of silicon-based devices in electronic applications, they are ill-suited for directly interfacing with biological tissue. A cornucopia of solutions has therefore been proposed in the last years to obtain neuromorphic materials to create effective biointerfaces and enable reliable bidirectional communication with neurons. Organic conductive materials in particular are not only highly biocompatible and able to electrochemically transduce biological signals, but also promise to include neuromorphic features, such as neuro-transmitter mediated plasticity and learning capabilities. Furthermore, organic electronics, relying on mixed electronic/ionic conduction mechanism, can be efficiently coupled with biological neural networks, while still successfully communicating with silicon-based electronics. Here, we envision neurohybrid systems that integrate silicon-based and organic electronics-based neuromorphic technologies to create active artificial interfaces with biological tissues. We believe that this approach may pave the way towards the development of a functional bidirectional communication between biological and artificial ‘brains’, offering new potential therapeutic applications and allowing for novel approaches in prosthetics.","PeriodicalId":198030,"journal":{"name":"Neuromorphic Computing and Engineering","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125413185","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Neuromorphic Computing and Engineering
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1