High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network.

IF 14.7 1区 综合性期刊 Q1 MULTIDISCIPLINARY SCIENCES Nature Communications Pub Date : 2024-03-19 DOI:10.1038/s41467-024-46867-8
Tian Zhang, Xin Guo, Pan Wang, Xinyi Fan, Zichen Wang, Yan Tong, Decheng Wang, Limin Tong, Linjun Li
{"title":"High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network.","authors":"Tian Zhang, Xin Guo, Pan Wang, Xinyi Fan, Zichen Wang, Yan Tong, Decheng Wang, Limin Tong, Linjun Li","doi":"10.1038/s41467-024-46867-8","DOIUrl":null,"url":null,"abstract":"<p><p>The development of neuromorphic visual systems has recently gained momentum due to their potential in areas such as autonomous vehicles and robotics. However, current machine visual systems based on silicon technology usually contain photosensor arrays, format conversion, memory and processing modules. As a result, the redundant data shuttling between each unit, resulting in large latency and high-power consumption, seriously limits the performance of neuromorphic vision chips. Here, we demonstrate an artificial neural network (ANN) architecture based on an integrated 2D MoS<sub>2</sub>/Ag nanograting phototransistor array, which can simultaneously sense, pre-process and recognize optical images without latency. The pre-processing function of the device under photoelectric synergy ensures considerable improvement of efficiency and accuracy of subsequent image recognition. The comprehensive performance of the proof-of-concept device demonstrates great potential for machine vision applications in terms of large dynamic range (180 dB), high speed (500 ns) and low energy consumption per spike (2.4 × 10<sup>-17 </sup>J).</p>","PeriodicalId":19066,"journal":{"name":"Nature Communications","volume":"15 1","pages":"2471"},"PeriodicalIF":14.7000,"publicationDate":"2024-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10951348/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature Communications","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1038/s41467-024-46867-8","RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

The development of neuromorphic visual systems has recently gained momentum due to their potential in areas such as autonomous vehicles and robotics. However, current machine visual systems based on silicon technology usually contain photosensor arrays, format conversion, memory and processing modules. As a result, the redundant data shuttling between each unit, resulting in large latency and high-power consumption, seriously limits the performance of neuromorphic vision chips. Here, we demonstrate an artificial neural network (ANN) architecture based on an integrated 2D MoS2/Ag nanograting phototransistor array, which can simultaneously sense, pre-process and recognize optical images without latency. The pre-processing function of the device under photoelectric synergy ensures considerable improvement of efficiency and accuracy of subsequent image recognition. The comprehensive performance of the proof-of-concept device demonstrates great potential for machine vision applications in terms of large dynamic range (180 dB), high speed (500 ns) and low energy consumption per spike (2.4 × 10-17 J).

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用等离子体增强型二维材料神经网络实现高性能人工视觉感知和识别。
由于神经形态视觉系统在自动驾驶汽车和机器人等领域的潜力,其发展势头近来日益强劲。然而,目前基于硅技术的机器视觉系统通常包含光传感器阵列、格式转换、内存和处理模块。因此,每个单元之间的冗余数据穿梭导致了较大的延迟和高能耗,严重限制了神经形态视觉芯片的性能。在此,我们展示了一种基于集成二维 MoS2/Ag 纳米光电晶体管阵列的人工神经网络(ANN)架构,该架构可同时感测、预处理和识别光学图像,且无延迟。该设备在光电协同作用下的预处理功能可确保大幅提高后续图像识别的效率和准确性。概念验证设备的综合性能显示了其在机器视觉应用方面的巨大潜力,包括大动态范围(180 dB)、高速度(500 ns)和低能耗(2.4 × 10-17 J)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Nature Communications
Nature Communications Biological Science Disciplines-
CiteScore
24.90
自引率
2.40%
发文量
6928
审稿时长
3.7 months
期刊介绍: Nature Communications, an open-access journal, publishes high-quality research spanning all areas of the natural sciences. Papers featured in the journal showcase significant advances relevant to specialists in each respective field. With a 2-year impact factor of 16.6 (2022) and a median time of 8 days from submission to the first editorial decision, Nature Communications is committed to rapid dissemination of research findings. As a multidisciplinary journal, it welcomes contributions from biological, health, physical, chemical, Earth, social, mathematical, applied, and engineering sciences, aiming to highlight important breakthroughs within each domain.
期刊最新文献
Bacteria encode post-mortem protein catabolism that enables altruistic nutrient recycling Natural variation of indels in the CTB3 promoter confers cold tolerance in japonica rice Molecular elucidation of cement hydration inhibition by silane coupling agents Semiconductor-to-metal surface reconstruction in copper selenide/copper heterostructures steered by photoinduced interlayer atom migration How people think about being alone shapes their experience of loneliness
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1