{"title":"Atomically bio-plausible neuron toward complex neuromorphic applications","authors":"Song Hao, Yanfang Niu, Shancheng Han","doi":"10.1002/brx2.44","DOIUrl":null,"url":null,"abstract":"<p>Neuromorphic computing, benefitting from its integration of computing with memory, enables highly efficient parallel-computing capabilities. While artificial intelligence chips are expensive due to their large area and power consumption, neuromorphic devices have shown energy efficiency and compatibility with complementary metal-oxide-semiconductor transistor technology.<span><sup>1</sup></span> Complex neuronal circuits with feedforward and feedback topologies are the foundation for nonlinear information integration and processing in the human brain. In addition, the nonlinear integration of neuronal signals as the basic functions of the human brain's nervous system is also essential to implement machine learning. However, artificial neurons still face the challenge of nonlinearly integrating feedforward and feedback signals. It is crucial to develop bio-plausible neurons capable of those functions, including nonlinearity and integration of excitatory and inhibitory postsynaptic signals. Writing in Nature Nanotechnology, G. S. Syed and coworkers recently reported a major step toward bio-plausible optomemristive feedback neurons, enabling the simultaneous existence of separate feedforward and feedback paths within a neural network.<span><sup>2</sup></span></p><p>The authors designed a delicate capacitor-like device with a 2D vertical heterostructure in which WS<sub>2</sub>/MoS<sub>2</sub> and graphene served as the neuronal membrane and soma (Figure 1B), respectively. Generally, trapped electrons and holes in the WS<sub>2</sub>/MoS<sub>2</sub> heterostructure recombine upon a positive back gate voltage (Figure 1A). The conductance state of p-doped graphene would further increase, representing an excitatory operation. In this work, the electron-hole carriers in the WS<sub>2</sub>/MoS<sub>2</sub> heterostructure are easily separated upon illumination (Figure 1C), and the electrons are injected into graphene. The Fermi-level movement toward the Dirac point decreases the conductance of graphene, having an inhibitory effect. Specifically, graphene's gradual conductance change can be separately modulated through electrical and optical means (Figure 1D), mimicking excitatory and inhibitory functionalities. 2D memristors have been investigated to emulate leaky-integrate-and-fire feedforward neurons.<span><sup>3</sup></span> The synergistic effect of both input signals mimics a competitive neuron and enables the simultaneous existence of separate feedforward and feedback paths within the neural network.</p><p>The winner-take-all (WTA) neural network is a critical computational model for artificial neural networks, which can be used to implement unsupervised competitive learning and cooperative learning. The traditional memristors make it difficult to separately process feedforward and feedback neuronal signals, necessitating peripheral circuits or software to mimic inhibition behavior. The developed optomemristive feedback neuron can respond to both electrical and optical stimulation and broadcast inhibitory signals on neighboring neurons and nonlinear integrated neuronal signals. Therefore, the authors further created a WTA neural network to demonstrate its superiority (Figure 1E) in which WTA neurons comprise the output layer of the neural network, acting as a rectifier activation function. The WTA neural networks implement the neuronal signal accumulation and activation tasks and demonstrate the potential for unsupervised competitive learning and cooperative learning.</p><p>It has been demonstrated that 2D materials facilitate the construction of multi-terminal memtransistors for complex neuromorphic functions.<span><sup>4</sup></span> Neuromorphic perception devices such as the artificial retina could be emulated by leveraging their excellent photoresponsivity.<span><sup>5</sup></span> This work greatly advances the hardware implementation of bio-plausible neuromorphic devices and highlights important routes to solve complex tasks by developing WTA neuronal networks. The charge trapping effect is essential to realizing the negative photoresponsivity of 2D materials and the ability to process feedback neuronal signals. Treating the SiO<sub>2</sub>/Si substrate or directly depositing the Al<sub>2</sub>O<sub>3</sub> layer are two common approaches to introduce the trapping effect, which is an efficient way to realize negative photoresponsivity toward optomemristive feedback neurons. The unique device structure and vdW heterostructure innovation are also responsible for those fascinating properties.</p><p>The spatiotemporal complexity of the human brain cortex and its neural networks is the basis for the higher intelligence of humans. Despite the progress made in this work, there is a vast gap between neuromorphic computing and the human brain due to their differences, including structure, working mechanisms, and scale. In addition, we consider that a brain-like design in terms of working mechanisms, device connectivity complexity, and scale is an effective and even necessary way to achieve complex neuromorphic applications. Memristive devices with neuron-like structures and memristive mechanisms are greatly needed to faithfully emulate biological neuron functions.</p><p><b>Song Hao</b>: Conceptualization, Formal analysis, Funding acquisition, Project administration, Validation, Writing—review and editing; <b>Yanfang Niu</b>: Data curation, Funding acquisition, Resources, Writing—review and editing; <b>Shancheng Han</b>: Data curation, Writing—original draft.</p><p>The authors declare no conflicts of interest.</p><p>Ethics approval was not needed for this study.</p>","PeriodicalId":94303,"journal":{"name":"Brain-X","volume":"1 4","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/brx2.44","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Brain-X","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/brx2.44","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Neuromorphic computing, benefitting from its integration of computing with memory, enables highly efficient parallel-computing capabilities. While artificial intelligence chips are expensive due to their large area and power consumption, neuromorphic devices have shown energy efficiency and compatibility with complementary metal-oxide-semiconductor transistor technology.1 Complex neuronal circuits with feedforward and feedback topologies are the foundation for nonlinear information integration and processing in the human brain. In addition, the nonlinear integration of neuronal signals as the basic functions of the human brain's nervous system is also essential to implement machine learning. However, artificial neurons still face the challenge of nonlinearly integrating feedforward and feedback signals. It is crucial to develop bio-plausible neurons capable of those functions, including nonlinearity and integration of excitatory and inhibitory postsynaptic signals. Writing in Nature Nanotechnology, G. S. Syed and coworkers recently reported a major step toward bio-plausible optomemristive feedback neurons, enabling the simultaneous existence of separate feedforward and feedback paths within a neural network.2
The authors designed a delicate capacitor-like device with a 2D vertical heterostructure in which WS2/MoS2 and graphene served as the neuronal membrane and soma (Figure 1B), respectively. Generally, trapped electrons and holes in the WS2/MoS2 heterostructure recombine upon a positive back gate voltage (Figure 1A). The conductance state of p-doped graphene would further increase, representing an excitatory operation. In this work, the electron-hole carriers in the WS2/MoS2 heterostructure are easily separated upon illumination (Figure 1C), and the electrons are injected into graphene. The Fermi-level movement toward the Dirac point decreases the conductance of graphene, having an inhibitory effect. Specifically, graphene's gradual conductance change can be separately modulated through electrical and optical means (Figure 1D), mimicking excitatory and inhibitory functionalities. 2D memristors have been investigated to emulate leaky-integrate-and-fire feedforward neurons.3 The synergistic effect of both input signals mimics a competitive neuron and enables the simultaneous existence of separate feedforward and feedback paths within the neural network.
The winner-take-all (WTA) neural network is a critical computational model for artificial neural networks, which can be used to implement unsupervised competitive learning and cooperative learning. The traditional memristors make it difficult to separately process feedforward and feedback neuronal signals, necessitating peripheral circuits or software to mimic inhibition behavior. The developed optomemristive feedback neuron can respond to both electrical and optical stimulation and broadcast inhibitory signals on neighboring neurons and nonlinear integrated neuronal signals. Therefore, the authors further created a WTA neural network to demonstrate its superiority (Figure 1E) in which WTA neurons comprise the output layer of the neural network, acting as a rectifier activation function. The WTA neural networks implement the neuronal signal accumulation and activation tasks and demonstrate the potential for unsupervised competitive learning and cooperative learning.
It has been demonstrated that 2D materials facilitate the construction of multi-terminal memtransistors for complex neuromorphic functions.4 Neuromorphic perception devices such as the artificial retina could be emulated by leveraging their excellent photoresponsivity.5 This work greatly advances the hardware implementation of bio-plausible neuromorphic devices and highlights important routes to solve complex tasks by developing WTA neuronal networks. The charge trapping effect is essential to realizing the negative photoresponsivity of 2D materials and the ability to process feedback neuronal signals. Treating the SiO2/Si substrate or directly depositing the Al2O3 layer are two common approaches to introduce the trapping effect, which is an efficient way to realize negative photoresponsivity toward optomemristive feedback neurons. The unique device structure and vdW heterostructure innovation are also responsible for those fascinating properties.
The spatiotemporal complexity of the human brain cortex and its neural networks is the basis for the higher intelligence of humans. Despite the progress made in this work, there is a vast gap between neuromorphic computing and the human brain due to their differences, including structure, working mechanisms, and scale. In addition, we consider that a brain-like design in terms of working mechanisms, device connectivity complexity, and scale is an effective and even necessary way to achieve complex neuromorphic applications. Memristive devices with neuron-like structures and memristive mechanisms are greatly needed to faithfully emulate biological neuron functions.
Song Hao: Conceptualization, Formal analysis, Funding acquisition, Project administration, Validation, Writing—review and editing; Yanfang Niu: Data curation, Funding acquisition, Resources, Writing—review and editing; Shancheng Han: Data curation, Writing—original draft.