Design and implementation of a charge-sharing in-memory-computing macro with sparse feature for quantized neural network

IF 1.9 3区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Microelectronics Journal Pub Date : 2024-11-12 DOI:10.1016/j.mejo.2024.106470
Yihe Liu , Junjie Wang , Shuang Liu , Mingyuan Sun , Xiaoyang Zhang , Jingtao Zhou , Shiqin Yan , RuiCheng Pan , Hao Hu , Yang Liu
{"title":"Design and implementation of a charge-sharing in-memory-computing macro with sparse feature for quantized neural network","authors":"Yihe Liu ,&nbsp;Junjie Wang ,&nbsp;Shuang Liu ,&nbsp;Mingyuan Sun ,&nbsp;Xiaoyang Zhang ,&nbsp;Jingtao Zhou ,&nbsp;Shiqin Yan ,&nbsp;RuiCheng Pan ,&nbsp;Hao Hu ,&nbsp;Yang Liu","doi":"10.1016/j.mejo.2024.106470","DOIUrl":null,"url":null,"abstract":"<div><div>With the rapid development of artificial intelligence technology, in-memory computing has become a research hotspot. In this article, we propose an in-memory computing (IMC) architecture that achieves high energy efficiency and performance. Our work is based on the working mechanism of charge sharing, enabling configurable multi-bit Multiply-Accumulate operations. This work employs a unique bit-cell structure to implement sparse strategies at the bit-level in IMC arrays and compensates for errors caused by non-ideal effects, thus achieving better energy efficiency and performance. A hardware-aware quantification method and a hardware simulation model based on Pytorch have been proposed to evaluate the hardware mapping and compare with other charge domain IMC works. The MNIST and CIFAR-10 datasets have been used to validate algorithm models and chip performance, achieving accuracy rates of 97.6% and 90.5%<!--> <!-->respectively. The IMC chip was fabricated with a 180 nm CMOS process. The measurement shows that the chip achieves an energy efficiency of 41.8 TOPS/W.</div></div>","PeriodicalId":49818,"journal":{"name":"Microelectronics Journal","volume":"154 ","pages":"Article 106470"},"PeriodicalIF":1.9000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Microelectronics Journal","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1879239124001747","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

With the rapid development of artificial intelligence technology, in-memory computing has become a research hotspot. In this article, we propose an in-memory computing (IMC) architecture that achieves high energy efficiency and performance. Our work is based on the working mechanism of charge sharing, enabling configurable multi-bit Multiply-Accumulate operations. This work employs a unique bit-cell structure to implement sparse strategies at the bit-level in IMC arrays and compensates for errors caused by non-ideal effects, thus achieving better energy efficiency and performance. A hardware-aware quantification method and a hardware simulation model based on Pytorch have been proposed to evaluate the hardware mapping and compare with other charge domain IMC works. The MNIST and CIFAR-10 datasets have been used to validate algorithm models and chip performance, achieving accuracy rates of 97.6% and 90.5% respectively. The IMC chip was fabricated with a 180 nm CMOS process. The measurement shows that the chip achieves an energy efficiency of 41.8 TOPS/W.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
为量化神经网络设计和实现具有稀疏特征的电荷共享内存计算宏
随着人工智能技术的飞速发展,内存计算已成为研究热点。本文提出了一种内存计算(IMC)架构,可实现高能效和高性能。我们的工作基于电荷共享的工作机制,实现了可配置的多位乘累加操作。这项工作采用独特的位元结构,在 IMC 阵列的位元级实施稀疏策略,并补偿非理想效应造成的误差,从而实现更高的能效和性能。为了评估硬件映射并与其他电荷域 IMC 作品进行比较,提出了一种基于 Pytorch 的硬件感知量化方法和硬件仿真模型。MNIST 和 CIFAR-10 数据集用于验证算法模型和芯片性能,准确率分别达到 97.6% 和 90.5%。IMC 芯片采用 180 纳米 CMOS 工艺制造。测量结果表明,该芯片的能效达到了 41.8 TOPS/W。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Microelectronics Journal
Microelectronics Journal 工程技术-工程:电子与电气
CiteScore
4.00
自引率
27.30%
发文量
222
审稿时长
43 days
期刊介绍: Published since 1969, the Microelectronics Journal is an international forum for the dissemination of research and applications of microelectronic systems, circuits, and emerging technologies. Papers published in the Microelectronics Journal have undergone peer review to ensure originality, relevance, and timeliness. The journal thus provides a worldwide, regular, and comprehensive update on microelectronic circuits and systems. The Microelectronics Journal invites papers describing significant research and applications in all of the areas listed below. Comprehensive review/survey papers covering recent developments will also be considered. The Microelectronics Journal covers circuits and systems. This topic includes but is not limited to: Analog, digital, mixed, and RF circuits and related design methodologies; Logic, architectural, and system level synthesis; Testing, design for testability, built-in self-test; Area, power, and thermal analysis and design; Mixed-domain simulation and design; Embedded systems; Non-von Neumann computing and related technologies and circuits; Design and test of high complexity systems integration; SoC, NoC, SIP, and NIP design and test; 3-D integration design and analysis; Emerging device technologies and circuits, such as FinFETs, SETs, spintronics, SFQ, MTJ, etc. Application aspects such as signal and image processing including circuits for cryptography, sensors, and actuators including sensor networks, reliability and quality issues, and economic models are also welcome.
期刊最新文献
Narrowband ladder-type MEMS filter based on high-Q thin-film piezoelectric-on-silicon MEMS resonators An 85.6-dB SNDR 1.5 MHz-BW NS-pipelined SAR ADC employing the gain-error-shaping technique to enhance the ADC linearity Analysis and design of high-performance liquid crystal phase shifter based on nanowire filled membrane and spoof surface plasmon polaritons A chaotic strong transition effect ring oscillator PUF with effective immunity to modeling attacks An 88 dB SNDR second-order CIFF delta-sigma modulator with 3-bit quantizer and capacitor sharing circuit
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1