{"title":"利用并行计算技术建立基于晶闸管交叉棒的模拟脉冲神经网络仿真模型","authors":"A. Yu. Morozov, K. K. Abgaryan, D. L. Reviznikov","doi":"10.1134/s1063739723080024","DOIUrl":null,"url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Abstract</h3><p>The issues of simulation modeling of an analog impulse neural network based on memristive elements in the problem of pattern recognition are studied. Simulation modeling allows us to configure the network at the level of a mathematical model, and subsequently use the obtained parameters directly in the process of operation. The network model is given as a dynamic system, which can consist of tens or hundreds of thousands of ordinary differential equations. Naturally, there is a need for an efficient and parallel implementation of an appropriate simulation model. Open multiprocessing (OpenMP) is used as the technology for parallelizing calculations, since it allows us to easily create multithreaded applications in various programming languages. The efficiency of parallelization is evaluated on the problem of modeling the process of training the network to recognize a set of five images of a size of 128 by 128 pixels, which leads to the solution of about 80 000 differential equations. In this problem, the calculations are accelerated by a factor of over six. According to the experimental data, the operating character of memristors is stochastic, as shown by the scatter in the current-voltage characteristics (VACs) when switching between high-resistance and low-resistance states. To take this feature into account, a memristor model with interval parameters is used, which gives upper and lower limits on the values of interest, and encloses the experimental curves in corridors. When simulating the operation of the entire analog self-learning impulse neural network, in each epoch of training, the parameters of the memristors are set randomly from the selected intervals. This approach makes it possible to dispense with the use of a stochastic mathematical apparatus, thereby further reducing computational costs.</p>","PeriodicalId":21534,"journal":{"name":"Russian Microelectronics","volume":"71 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Simulation Modeling of an Analog Impulse Neural Network Based on a Memristor Crossbar Using Parallel Computing Technologies\",\"authors\":\"A. Yu. Morozov, K. K. Abgaryan, D. L. Reviznikov\",\"doi\":\"10.1134/s1063739723080024\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<h3 data-test=\\\"abstract-sub-heading\\\">Abstract</h3><p>The issues of simulation modeling of an analog impulse neural network based on memristive elements in the problem of pattern recognition are studied. Simulation modeling allows us to configure the network at the level of a mathematical model, and subsequently use the obtained parameters directly in the process of operation. The network model is given as a dynamic system, which can consist of tens or hundreds of thousands of ordinary differential equations. Naturally, there is a need for an efficient and parallel implementation of an appropriate simulation model. Open multiprocessing (OpenMP) is used as the technology for parallelizing calculations, since it allows us to easily create multithreaded applications in various programming languages. The efficiency of parallelization is evaluated on the problem of modeling the process of training the network to recognize a set of five images of a size of 128 by 128 pixels, which leads to the solution of about 80 000 differential equations. In this problem, the calculations are accelerated by a factor of over six. According to the experimental data, the operating character of memristors is stochastic, as shown by the scatter in the current-voltage characteristics (VACs) when switching between high-resistance and low-resistance states. To take this feature into account, a memristor model with interval parameters is used, which gives upper and lower limits on the values of interest, and encloses the experimental curves in corridors. When simulating the operation of the entire analog self-learning impulse neural network, in each epoch of training, the parameters of the memristors are set randomly from the selected intervals. This approach makes it possible to dispense with the use of a stochastic mathematical apparatus, thereby further reducing computational costs.</p>\",\"PeriodicalId\":21534,\"journal\":{\"name\":\"Russian Microelectronics\",\"volume\":\"71 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-03-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Russian Microelectronics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1134/s1063739723080024\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Engineering\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Russian Microelectronics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1134/s1063739723080024","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Engineering","Score":null,"Total":0}
Simulation Modeling of an Analog Impulse Neural Network Based on a Memristor Crossbar Using Parallel Computing Technologies
Abstract
The issues of simulation modeling of an analog impulse neural network based on memristive elements in the problem of pattern recognition are studied. Simulation modeling allows us to configure the network at the level of a mathematical model, and subsequently use the obtained parameters directly in the process of operation. The network model is given as a dynamic system, which can consist of tens or hundreds of thousands of ordinary differential equations. Naturally, there is a need for an efficient and parallel implementation of an appropriate simulation model. Open multiprocessing (OpenMP) is used as the technology for parallelizing calculations, since it allows us to easily create multithreaded applications in various programming languages. The efficiency of parallelization is evaluated on the problem of modeling the process of training the network to recognize a set of five images of a size of 128 by 128 pixels, which leads to the solution of about 80 000 differential equations. In this problem, the calculations are accelerated by a factor of over six. According to the experimental data, the operating character of memristors is stochastic, as shown by the scatter in the current-voltage characteristics (VACs) when switching between high-resistance and low-resistance states. To take this feature into account, a memristor model with interval parameters is used, which gives upper and lower limits on the values of interest, and encloses the experimental curves in corridors. When simulating the operation of the entire analog self-learning impulse neural network, in each epoch of training, the parameters of the memristors are set randomly from the selected intervals. This approach makes it possible to dispense with the use of a stochastic mathematical apparatus, thereby further reducing computational costs.
期刊介绍:
Russian Microelectronics covers physical, technological, and some VLSI and ULSI circuit-technical aspects of microelectronics and nanoelectronics; it informs the reader of new trends in submicron optical, x-ray, electron, and ion-beam lithography technology; dry processing techniques, etching, doping; and deposition and planarization technology. Significant space is devoted to problems arising in the application of proton, electron, and ion beams, plasma, etc. Consideration is given to new equipment, including cluster tools and control in situ and submicron CMOS, bipolar, and BICMOS technologies. The journal publishes papers addressing problems of molecular beam epitaxy and related processes; heterojunction devices and integrated circuits; the technology and devices of nanoelectronics; and the fabrication of nanometer scale devices, including new device structures, quantum-effect devices, and superconducting devices. The reader will find papers containing news of the diagnostics of surfaces and microelectronic structures, the modeling of technological processes and devices in micro- and nanoelectronics, including nanotransistors, and solid state qubits.