A physics-based predictive model for pulse design to realize high-performance memristive neural networks

Haoyue Deng, Zhen Fan, Shuai Dong, Zhiwei Chen, Wenjie Li, Yihong Chen, Kun Liu, Ruiqiang Tao, G. Tian, Deyang Chen, M. Qin, Min Zeng, Xubing Lu, G. Zhou, Xingsen Gao, Junming Liu
{"title":"A physics-based predictive model for pulse design to realize high-performance memristive neural networks","authors":"Haoyue Deng, Zhen Fan, Shuai Dong, Zhiwei Chen, Wenjie Li, Yihong Chen, Kun Liu, Ruiqiang Tao, G. Tian, Deyang Chen, M. Qin, Min Zeng, Xubing Lu, G. Zhou, Xingsen Gao, Junming Liu","doi":"10.1063/5.0180346","DOIUrl":null,"url":null,"abstract":"Memristive neural networks have extensively been investigated for their capability in handling various artificial intelligence tasks. The training performance of memristive neural networks depends on the pulse scheme applied to the constituent memristors. However, the design of the pulse scheme in most previous studies was approached in an empirical manner or through a trial-and-error method. Here, we choose ferroelectric tunnel junction (FTJ) as a model memristor and demonstrate a physics-based predictive model for the pulse design to achieve high training performance. This predictive model comprises a physical model for FTJ that can adequately describe the polarization switching and memristive switching behaviors of the FTJ and an FTJ-based neural network that uses the long-term potentiation (LTP)/long-term depression (LTD) characteristics of the FTJ for the weight update. Simulation results based on the predictive model demonstrate that the LTP/LTD characteristics with a good trade-off between ON/OFF ratio, nonlinearity, and asymmetry can lead to high training accuracies for the FTJ-based neural network. Moreover, it is revealed that an amplitude-increasing pulse scheme may be the most favorable pulse scheme as it offers the widest ranges of pulse amplitudes and widths for achieving high accuracies. This study may provide useful guidance for the pulse design in the experimental development of high-performance memristive neural networks.","PeriodicalId":502250,"journal":{"name":"APL Machine Learning","volume":"78 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"APL Machine Learning","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1063/5.0180346","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Memristive neural networks have extensively been investigated for their capability in handling various artificial intelligence tasks. The training performance of memristive neural networks depends on the pulse scheme applied to the constituent memristors. However, the design of the pulse scheme in most previous studies was approached in an empirical manner or through a trial-and-error method. Here, we choose ferroelectric tunnel junction (FTJ) as a model memristor and demonstrate a physics-based predictive model for the pulse design to achieve high training performance. This predictive model comprises a physical model for FTJ that can adequately describe the polarization switching and memristive switching behaviors of the FTJ and an FTJ-based neural network that uses the long-term potentiation (LTP)/long-term depression (LTD) characteristics of the FTJ for the weight update. Simulation results based on the predictive model demonstrate that the LTP/LTD characteristics with a good trade-off between ON/OFF ratio, nonlinearity, and asymmetry can lead to high training accuracies for the FTJ-based neural network. Moreover, it is revealed that an amplitude-increasing pulse scheme may be the most favorable pulse scheme as it offers the widest ranges of pulse amplitudes and widths for achieving high accuracies. This study may provide useful guidance for the pulse design in the experimental development of high-performance memristive neural networks.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于物理学的脉冲设计预测模型,实现高性能记忆神经网络
忆阻式神经网络在处理各种人工智能任务方面的能力已得到广泛研究。忆阻器神经网络的训练性能取决于应用于组成忆阻器的脉冲方案。然而,在以往的研究中,脉冲方案的设计大多是以经验方式或通过试错法进行的。在这里,我们选择铁电隧道结(FTJ)作为忆阻器模型,并展示了一种基于物理的脉冲设计预测模型,以实现较高的训练性能。该预测模型包括一个能充分描述 FTJ 极化开关和忆阻开关行为的 FTJ 物理模型和一个基于 FTJ 的神经网络,后者利用 FTJ 的长期电位(LTP)/长期抑制(LTD)特性进行权值更新。基于预测模型的仿真结果表明,LTP/LTD 特性在 ON/OFF 比率、非线性和不对称性之间具有良好的权衡,可为基于 FTJ 的神经网络带来较高的训练精确度。此外,研究还发现,幅度递增脉冲方案可能是最有利的脉冲方案,因为它能提供最宽的脉冲幅度和宽度范围,以实现高精确度。这项研究可为高性能记忆神经网络实验开发中的脉冲设计提供有益的指导。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Computational experiments with cellular-automata generated images reveal intrinsic limitations of convolutional neural networks on pattern recognition tasks Simulation-trained machine learning models for Lorentz transmission electron microscopy Enhanced spectrum prediction using deep learning models with multi-frequency supplementary inputs Cell detection with convolutional spiking neural network for neuromorphic cytometry The development of thermodynamically consistent and physics-informed equation-of-state model through machine learning
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1