集成光子神经网络中的新兴自适应,实现无反向传播学习

IF 14.3 1区 材料科学 Q1 CHEMISTRY, MULTIDISCIPLINARY Advanced Science Pub Date : 2024-11-20 DOI:10.1002/advs.202404920
Alessio Lugnan, Samarth Aggarwal, Frank Brückerhoff-Plückelmann, C David Wright, Wolfram H P Pernice, Harish Bhaskaran, Peter Bienstman
{"title":"集成光子神经网络中的新兴自适应,实现无反向传播学习","authors":"Alessio Lugnan, Samarth Aggarwal, Frank Brückerhoff-Plückelmann, C David Wright, Wolfram H P Pernice, Harish Bhaskaran, Peter Bienstman","doi":"10.1002/advs.202404920","DOIUrl":null,"url":null,"abstract":"<p><p>Plastic self-adaptation, nonlinear recurrent dynamics and multi-scale memory are desired features in hardware implementations of neural networks, because they enable them to learn, adapt, and process information similarly to the way biological brains do. In this work, these properties occurring in arrays of photonic neurons are experimentally demonstrated. Importantly, this is realized autonomously in an emergent fashion, without the need for an external controller setting weights and without explicit feedback of a global reward signal. Using a hierarchy of such arrays coupled to a backpropagation-free training algorithm based on simple logistic regression, a performance of 98.2% is achieved on the MNIST task, a popular benchmark task looking at classification of written digits. The plastic nodes consist of silicon photonics microring resonators covered by a patch of phase-change material that implements nonvolatile memory. The system is compact, robust, and straightforward to scale up through the use of multiple wavelengths. Moreover, it constitutes a unique platform to test and efficiently implement biologically plausible learning schemes at a high processing speed.</p>","PeriodicalId":117,"journal":{"name":"Advanced Science","volume":" ","pages":"e2404920"},"PeriodicalIF":14.3000,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Emergent Self-Adaptation in an Integrated Photonic Neural Network for Backpropagation-Free Learning.\",\"authors\":\"Alessio Lugnan, Samarth Aggarwal, Frank Brückerhoff-Plückelmann, C David Wright, Wolfram H P Pernice, Harish Bhaskaran, Peter Bienstman\",\"doi\":\"10.1002/advs.202404920\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Plastic self-adaptation, nonlinear recurrent dynamics and multi-scale memory are desired features in hardware implementations of neural networks, because they enable them to learn, adapt, and process information similarly to the way biological brains do. In this work, these properties occurring in arrays of photonic neurons are experimentally demonstrated. Importantly, this is realized autonomously in an emergent fashion, without the need for an external controller setting weights and without explicit feedback of a global reward signal. Using a hierarchy of such arrays coupled to a backpropagation-free training algorithm based on simple logistic regression, a performance of 98.2% is achieved on the MNIST task, a popular benchmark task looking at classification of written digits. The plastic nodes consist of silicon photonics microring resonators covered by a patch of phase-change material that implements nonvolatile memory. The system is compact, robust, and straightforward to scale up through the use of multiple wavelengths. Moreover, it constitutes a unique platform to test and efficiently implement biologically plausible learning schemes at a high processing speed.</p>\",\"PeriodicalId\":117,\"journal\":{\"name\":\"Advanced Science\",\"volume\":\" \",\"pages\":\"e2404920\"},\"PeriodicalIF\":14.3000,\"publicationDate\":\"2024-11-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Science\",\"FirstCategoryId\":\"88\",\"ListUrlMain\":\"https://doi.org/10.1002/advs.202404920\",\"RegionNum\":1,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CHEMISTRY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Science","FirstCategoryId":"88","ListUrlMain":"https://doi.org/10.1002/advs.202404920","RegionNum":1,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

可塑性自适应、非线性递归动力学和多尺度记忆是神经网络硬件实现所需的特性,因为它们能使神经网络以类似于生物大脑的方式学习、适应和处理信息。在这项工作中,我们通过实验证明了光子神经元阵列的这些特性。重要的是,这些特性是以突发方式自主实现的,不需要外部控制器设置权重,也没有明确的全局奖励信号反馈。利用这种阵列的层次结构和基于简单逻辑回归的无反向传播训练算法,在 MNIST 任务(一项研究书面数字分类的流行基准任务)上实现了 98.2% 的性能。塑料节点由硅光子微oring 谐振器组成,上面覆盖着一片实现非易失性存储器的相变材料。该系统结构紧凑、坚固耐用,可通过使用多个波长直接进行扩展。此外,它还是一个独特的平台,可以在高速处理过程中测试并有效实施生物学上可行的学习方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Emergent Self-Adaptation in an Integrated Photonic Neural Network for Backpropagation-Free Learning.

Plastic self-adaptation, nonlinear recurrent dynamics and multi-scale memory are desired features in hardware implementations of neural networks, because they enable them to learn, adapt, and process information similarly to the way biological brains do. In this work, these properties occurring in arrays of photonic neurons are experimentally demonstrated. Importantly, this is realized autonomously in an emergent fashion, without the need for an external controller setting weights and without explicit feedback of a global reward signal. Using a hierarchy of such arrays coupled to a backpropagation-free training algorithm based on simple logistic regression, a performance of 98.2% is achieved on the MNIST task, a popular benchmark task looking at classification of written digits. The plastic nodes consist of silicon photonics microring resonators covered by a patch of phase-change material that implements nonvolatile memory. The system is compact, robust, and straightforward to scale up through the use of multiple wavelengths. Moreover, it constitutes a unique platform to test and efficiently implement biologically plausible learning schemes at a high processing speed.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Advanced Science
Advanced Science CHEMISTRY, MULTIDISCIPLINARYNANOSCIENCE &-NANOSCIENCE & NANOTECHNOLOGY
CiteScore
18.90
自引率
2.60%
发文量
1602
审稿时长
1.9 months
期刊介绍: Advanced Science is a prestigious open access journal that focuses on interdisciplinary research in materials science, physics, chemistry, medical and life sciences, and engineering. The journal aims to promote cutting-edge research by employing a rigorous and impartial review process. It is committed to presenting research articles with the highest quality production standards, ensuring maximum accessibility of top scientific findings. With its vibrant and innovative publication platform, Advanced Science seeks to revolutionize the dissemination and organization of scientific knowledge.
期刊最新文献
Emergent Self-Adaptation in an Integrated Photonic Neural Network for Backpropagation-Free Learning. Integrated Transcriptome Analysis Reveals Novel Molecular Signatures for Schizophrenia Characterization. Osteoblast-Derived ECM1 Promotes Anti-Androgen Resistance in Bone Metastatic Prostate Cancer. Free Cholesterol-Induced Liver Injury in Non-Alcoholic Fatty Liver Disease: Mechanisms and a Therapeutic Intervention Using Dihydrotanshinone I. Ginkgetin Alleviates Inflammation and Senescence by Targeting STING.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1