{"title":"基于ReRAM突触阵列的位神经网络神经形态计算系统","authors":"Pin-Yi Li, Cheng-Han Yang, Wei-Hao Chen, Jian-Hao Huang, Wei-Chen Wei, Je-Syu Liu, Wei-Yu Lin, Tzu-Hsiang Hsu, C. Hsieh, Ren-Shuo Liu, Meng-Fan Chang, K. Tang","doi":"10.1109/BIOCAS.2018.8584810","DOIUrl":null,"url":null,"abstract":"Recent advances in neuromorphic computing system have shown resistive random-access memory (ReRAM) can be used to efficiently implement compact parallel computing arrays, which are inherently suitable for neural networks that require large amounts of matrix-vector multiplications (MVMs). In this work, we proposed a neuromorphic computing system based on ReRAM synaptic array to implement bitwise neural networks. The system contains a ReRAM synaptic array for parallel computation of bitwise MVMs, and a field-programmable gate array for data buffering and processing. To deploy the network on the system, a customized training scheme was required to adapt the trained network to the characteristic of ReRAM synaptic array with bitwise weights and inputs. We also managed the resolution of partial sum to reduce the bit width requirement of sense amplifier, thereby reducing power consumption. The measurement results show that the ReRAM synaptic array consumed only 0.27mW at 1V supply by using 1-bit sense amplifier while the system still maintained 97.52% accuracy on MNIST dataset.","PeriodicalId":259162,"journal":{"name":"2018 IEEE Biomedical Circuits and Systems Conference (BioCAS)","volume":"138 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"A Neuromorphic Computing System for Bitwise Neural Networks Based on ReRAM Synaptic Array\",\"authors\":\"Pin-Yi Li, Cheng-Han Yang, Wei-Hao Chen, Jian-Hao Huang, Wei-Chen Wei, Je-Syu Liu, Wei-Yu Lin, Tzu-Hsiang Hsu, C. Hsieh, Ren-Shuo Liu, Meng-Fan Chang, K. Tang\",\"doi\":\"10.1109/BIOCAS.2018.8584810\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recent advances in neuromorphic computing system have shown resistive random-access memory (ReRAM) can be used to efficiently implement compact parallel computing arrays, which are inherently suitable for neural networks that require large amounts of matrix-vector multiplications (MVMs). In this work, we proposed a neuromorphic computing system based on ReRAM synaptic array to implement bitwise neural networks. The system contains a ReRAM synaptic array for parallel computation of bitwise MVMs, and a field-programmable gate array for data buffering and processing. To deploy the network on the system, a customized training scheme was required to adapt the trained network to the characteristic of ReRAM synaptic array with bitwise weights and inputs. We also managed the resolution of partial sum to reduce the bit width requirement of sense amplifier, thereby reducing power consumption. The measurement results show that the ReRAM synaptic array consumed only 0.27mW at 1V supply by using 1-bit sense amplifier while the system still maintained 97.52% accuracy on MNIST dataset.\",\"PeriodicalId\":259162,\"journal\":{\"name\":\"2018 IEEE Biomedical Circuits and Systems Conference (BioCAS)\",\"volume\":\"138 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 IEEE Biomedical Circuits and Systems Conference (BioCAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/BIOCAS.2018.8584810\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 IEEE Biomedical Circuits and Systems Conference (BioCAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/BIOCAS.2018.8584810","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Neuromorphic Computing System for Bitwise Neural Networks Based on ReRAM Synaptic Array
Recent advances in neuromorphic computing system have shown resistive random-access memory (ReRAM) can be used to efficiently implement compact parallel computing arrays, which are inherently suitable for neural networks that require large amounts of matrix-vector multiplications (MVMs). In this work, we proposed a neuromorphic computing system based on ReRAM synaptic array to implement bitwise neural networks. The system contains a ReRAM synaptic array for parallel computation of bitwise MVMs, and a field-programmable gate array for data buffering and processing. To deploy the network on the system, a customized training scheme was required to adapt the trained network to the characteristic of ReRAM synaptic array with bitwise weights and inputs. We also managed the resolution of partial sum to reduce the bit width requirement of sense amplifier, thereby reducing power consumption. The measurement results show that the ReRAM synaptic array consumed only 0.27mW at 1V supply by using 1-bit sense amplifier while the system still maintained 97.52% accuracy on MNIST dataset.