Kang Jun Bai, Clare Thiem, Jack Lombardi, Yibin Liang, Yang Yi
{"title":"储层计算的设计策略与应用:最新趋势与前景 [特写]","authors":"Kang Jun Bai, Clare Thiem, Jack Lombardi, Yibin Liang, Yang Yi","doi":"10.1109/mcas.2023.3325496","DOIUrl":null,"url":null,"abstract":"Reservoir computing (RC) is a neural computing paradigm especially well-suited for learning dynamical systems by leveraging an untrained reservoir layer, providing high-dimensional input encoding with fading memory property. Since only the readout weights are trained under RC, linear regression learning algorithms are sufficient, leading to significant improvements in computational complexity and energy efficiency as compared to other deep neural networks (DNNs). RC offers an alternative solution to sidestep the shortcomings of data scarcity and the vanishing gradient problem. More importantly, such a network structure is amenable to hardware implementation using a variety of devices, circuits, and systems, making RC a good candidate to replace sophisticated DNNs as a lightweight classifier at the edge for internet of things (IoT) applications. In this article, we provide an overview of recent advances in RC hardware and their applications for mobile edge intelligence. Specifically, we will demonstrate the design strategies of RC in opto-electronic configuration, fully digital system, and silicon with the mixed-signal integrated circuit approach. Moreover, we will expose a novel implementation approach using emerging materials, designing the way for RC to be used in the next-generation neuromorphic computing systems. Building upon these efficient RC models, their applicability and effectiveness against the state-of-the-art are then demonstrated through diverse machine learning benchmarks spanning the area of IoT, communication networks, and healthcare.","PeriodicalId":55038,"journal":{"name":"IEEE Circuits and Systems Magazine","volume":null,"pages":null},"PeriodicalIF":5.6000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Design Strategies and Applications of Reservoir Computing: Recent Trends and Prospects [Feature]\",\"authors\":\"Kang Jun Bai, Clare Thiem, Jack Lombardi, Yibin Liang, Yang Yi\",\"doi\":\"10.1109/mcas.2023.3325496\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Reservoir computing (RC) is a neural computing paradigm especially well-suited for learning dynamical systems by leveraging an untrained reservoir layer, providing high-dimensional input encoding with fading memory property. Since only the readout weights are trained under RC, linear regression learning algorithms are sufficient, leading to significant improvements in computational complexity and energy efficiency as compared to other deep neural networks (DNNs). RC offers an alternative solution to sidestep the shortcomings of data scarcity and the vanishing gradient problem. More importantly, such a network structure is amenable to hardware implementation using a variety of devices, circuits, and systems, making RC a good candidate to replace sophisticated DNNs as a lightweight classifier at the edge for internet of things (IoT) applications. In this article, we provide an overview of recent advances in RC hardware and their applications for mobile edge intelligence. Specifically, we will demonstrate the design strategies of RC in opto-electronic configuration, fully digital system, and silicon with the mixed-signal integrated circuit approach. Moreover, we will expose a novel implementation approach using emerging materials, designing the way for RC to be used in the next-generation neuromorphic computing systems. Building upon these efficient RC models, their applicability and effectiveness against the state-of-the-art are then demonstrated through diverse machine learning benchmarks spanning the area of IoT, communication networks, and healthcare.\",\"PeriodicalId\":55038,\"journal\":{\"name\":\"IEEE Circuits and Systems Magazine\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2024-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Circuits and Systems Magazine\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1109/mcas.2023.3325496\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Circuits and Systems Magazine","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1109/mcas.2023.3325496","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Design Strategies and Applications of Reservoir Computing: Recent Trends and Prospects [Feature]
Reservoir computing (RC) is a neural computing paradigm especially well-suited for learning dynamical systems by leveraging an untrained reservoir layer, providing high-dimensional input encoding with fading memory property. Since only the readout weights are trained under RC, linear regression learning algorithms are sufficient, leading to significant improvements in computational complexity and energy efficiency as compared to other deep neural networks (DNNs). RC offers an alternative solution to sidestep the shortcomings of data scarcity and the vanishing gradient problem. More importantly, such a network structure is amenable to hardware implementation using a variety of devices, circuits, and systems, making RC a good candidate to replace sophisticated DNNs as a lightweight classifier at the edge for internet of things (IoT) applications. In this article, we provide an overview of recent advances in RC hardware and their applications for mobile edge intelligence. Specifically, we will demonstrate the design strategies of RC in opto-electronic configuration, fully digital system, and silicon with the mixed-signal integrated circuit approach. Moreover, we will expose a novel implementation approach using emerging materials, designing the way for RC to be used in the next-generation neuromorphic computing systems. Building upon these efficient RC models, their applicability and effectiveness against the state-of-the-art are then demonstrated through diverse machine learning benchmarks spanning the area of IoT, communication networks, and healthcare.
期刊介绍:
The IEEE Circuits and Systems Magazine covers the subject areas represented by the Society's transactions, including: analog, passive, switch capacitor, and digital filters; electronic circuits, networks, graph theory, and RF communication circuits; system theory; discrete, IC, and VLSI circuit design; multidimensional circuits and systems; large-scale systems and power networks; nonlinear circuits and systems, wavelets, filter banks, and applications; neural networks; and signal processing. Content also covers the areas represented by the Society technical committees: analog signal processing, cellular neural networks and array computing, circuits and systems for communications, computer-aided network design, digital signal processing, multimedia systems and applications, neural systems and applications, nonlinear circuits and systems, power systems and power electronics and circuits, sensors and micromaching, visual signal processing and communication, and VLSI systems and applications. Lastly, the magazine covers the interests represented by the widespread conference activity of the IEEE Circuits and Systems Society. In addition to the technical articles, the magazine also covers Society administrative activities, as for instance the meetings of the Board of Governors, Society People, as for instance the stories of award winners-fellows, medalists, and so forth, and Places reached by the Society, including readable reports from the Society's conferences around the world.