首页 > 最新文献

Advanced Intelligent Systems最新文献

英文 中文
Development of a Cell‐Loading Microrobot with Simultaneously Improved Degradability and Mechanical Strength for Performing In Vivo Delivery Tasks 一种细胞装载微型机器人的开发,同时提高了可降解性和机械强度,用于执行体内递送任务
Pub Date : 2021-07-07 DOI: 10.1002/aisy.202100052
Tanyong Wei, Junyang Li, Liushuai Zheng, Cheng Wang, Feng Li, Hua Tian, Dong Sun
Microrobots with simultaneously improved degradability and mechanical strength are highly demanded in performing in vivo delivery tasks in clinical applications. The properties of degradability and mechanical strength are contradictory for many materials used to make microrobots. This article proposes a new design that can result in 3D cell culture microrobots with improved degradability and mechanical strength from the following perspectives. First, the mechanical strength of a microrobot is improved using triangle patterns to replace hexagon pattern in the microrobot structure, which can provide more supporting grids to obtain increased mechanical strength. Second, the relationship between structural design and material composition in relation to the mechanical strength of microrobot is investigated. The study reveals that triangle‐patterned microrobots have increased mechanical strength compared with hexagon‐patterned microrobots, thereby allowing high composition of degradable material that leads to the fast degradation of the microrobot. It is also shown that the triangle‐patterned microrobots can maintain the same structural integrity and cell capacity as hexagon‐patterned microrobots. Finally, the demonstration shows that the triangle‐patterned microrobot can be precisely navigated in microfluidic channels. This article successfully demonstrates that the degradability and mechanical strength can be improved simultaneously through the microrobot structural design.
同时提高可降解性和机械强度的微型机器人在临床应用中执行体内递送任务时被高度要求。许多用于制造微型机器人的材料的可降解性和机械强度是相互矛盾的。本文从以下几个方面提出了一种新的设计方法,可以使三维细胞培养微型机器人具有更好的可降解性和机械强度。首先,用三角形图案代替微机器人结构中的六边形图案,提高微机器人的机械强度,可以提供更多的支撑网格,从而获得更高的机械强度。其次,研究了结构设计和材料组成与微型机器人机械强度的关系。研究表明,三角形图案的微型机器人比六边形图案的微型机器人具有更高的机械强度,从而允许高成分的可降解材料,从而导致微型机器人的快速降解。研究还表明,三角形微机器人可以保持与六边形微机器人相同的结构完整性和细胞容量。最后,演示表明,三角形图案的微型机器人可以在微流体通道中精确导航。本文成功地证明了通过微机器人结构设计可以同时提高微机器人的可降解性和机械强度。
{"title":"Development of a Cell‐Loading Microrobot with Simultaneously Improved Degradability and Mechanical Strength for Performing In Vivo Delivery Tasks","authors":"Tanyong Wei, Junyang Li, Liushuai Zheng, Cheng Wang, Feng Li, Hua Tian, Dong Sun","doi":"10.1002/aisy.202100052","DOIUrl":"https://doi.org/10.1002/aisy.202100052","url":null,"abstract":"Microrobots with simultaneously improved degradability and mechanical strength are highly demanded in performing in vivo delivery tasks in clinical applications. The properties of degradability and mechanical strength are contradictory for many materials used to make microrobots. This article proposes a new design that can result in 3D cell culture microrobots with improved degradability and mechanical strength from the following perspectives. First, the mechanical strength of a microrobot is improved using triangle patterns to replace hexagon pattern in the microrobot structure, which can provide more supporting grids to obtain increased mechanical strength. Second, the relationship between structural design and material composition in relation to the mechanical strength of microrobot is investigated. The study reveals that triangle‐patterned microrobots have increased mechanical strength compared with hexagon‐patterned microrobots, thereby allowing high composition of degradable material that leads to the fast degradation of the microrobot. It is also shown that the triangle‐patterned microrobots can maintain the same structural integrity and cell capacity as hexagon‐patterned microrobots. Finally, the demonstration shows that the triangle‐patterned microrobot can be precisely navigated in microfluidic channels. This article successfully demonstrates that the degradability and mechanical strength can be improved simultaneously through the microrobot structural design.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-07-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88223192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Direct Gradient Calculation: Simple and Variation‐Tolerant On‐Chip Training Method for Neural Networks 直接梯度计算:简单和变化容忍芯片上的神经网络训练方法
Pub Date : 2021-07-05 DOI: 10.1002/aisy.202100064
Hyungyo Kim, Joon Hwang, D. Kwon, Jangsaeng Kim, Min-Kyu Park, Ji-Young Im, Byung-Gook Park, Jong-Ho Lee
On‐chip training of neural networks (NNs) is regarded as a promising training method for neuromorphic systems with analog synaptic devices. Herein, a novel on‐chip training method called direct gradient calculation (DGC) is proposed to substitute conventional backpropagation (BP). In this method, the gradients of a cost function with respect to the weights are calculated directly by sequentially applying a small temporal change to each weight and then measuring the change in cost value. DGC achieves a similar accuracy to that of BP while performing a handwritten digit classification task, validating its training feasibility. In particular, DGC can be applied to analog hardware‐based convolutional NNs (CNNs), which is considered to be a challenging task, enabling appropriate on‐chip training. A hybrid method is also proposed that efficiently combines DGC and BP for training CNNs, and the method achieves a similar accuracy to that of BP and DGC while enhancing the training speed. Furthermore, networks utilizing DGC maintain a higher level of accuracy than those using BP in the presence of variations in hardware (such as synaptic device conductance and neuron circuit component variations) while requiring fewer circuit components.
在芯片上训练神经网络(NNs)被认为是具有模拟突触装置的神经形态系统的一种很有前途的训练方法。本文提出了一种新的片上训练方法,称为直接梯度计算(DGC),以取代传统的反向传播(BP)方法。在这种方法中,成本函数相对于权重的梯度是通过顺序地对每个权重施加一个小的时间变化,然后测量成本值的变化来直接计算的。在执行手写数字分类任务时,DGC达到了与BP相似的准确率,验证了其训练的可行性。特别是,DGC可以应用于基于模拟硬件的卷积神经网络(cnn),这被认为是一项具有挑战性的任务,可以实现适当的片上训练。提出了一种将DGC和BP有效地结合起来训练cnn的混合方法,该方法在提高训练速度的同时获得了与BP和DGC相似的精度。此外,在硬件变化(如突触装置电导和神经元电路组件变化)的情况下,使用DGC的网络比使用BP的网络保持更高的准确性,同时需要更少的电路组件。
{"title":"Direct Gradient Calculation: Simple and Variation‐Tolerant On‐Chip Training Method for Neural Networks","authors":"Hyungyo Kim, Joon Hwang, D. Kwon, Jangsaeng Kim, Min-Kyu Park, Ji-Young Im, Byung-Gook Park, Jong-Ho Lee","doi":"10.1002/aisy.202100064","DOIUrl":"https://doi.org/10.1002/aisy.202100064","url":null,"abstract":"On‐chip training of neural networks (NNs) is regarded as a promising training method for neuromorphic systems with analog synaptic devices. Herein, a novel on‐chip training method called direct gradient calculation (DGC) is proposed to substitute conventional backpropagation (BP). In this method, the gradients of a cost function with respect to the weights are calculated directly by sequentially applying a small temporal change to each weight and then measuring the change in cost value. DGC achieves a similar accuracy to that of BP while performing a handwritten digit classification task, validating its training feasibility. In particular, DGC can be applied to analog hardware‐based convolutional NNs (CNNs), which is considered to be a challenging task, enabling appropriate on‐chip training. A hybrid method is also proposed that efficiently combines DGC and BP for training CNNs, and the method achieves a similar accuracy to that of BP and DGC while enhancing the training speed. Furthermore, networks utilizing DGC maintain a higher level of accuracy than those using BP in the presence of variations in hardware (such as synaptic device conductance and neuron circuit component variations) while requiring fewer circuit components.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"11 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89587468","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Smart Textiles that Teach: Fabric‐Based Haptic Device Improves the Rate of Motor Learning 用于教学的智能纺织品:基于织物的触觉设备提高了运动学习的速度
Pub Date : 2021-06-11 DOI: 10.1002/aisy.202100043
V. Ramachandran, Fabian Schilling, A. Wu, D. Floreano
People learn motor activities best when they are conscious of their errors and make a concerted effort to correct them. While haptic interfaces can facilitate motor training, existing interfaces are often bulky and do not always ensure post‐training skill retention. Herein, a programmable haptic sleeve composed of textile‐based electroadhesive clutches for skill acquisition and retention is described. Its functionality in a motor learning study where users control a drone's movement using elbow joint rotation is shown. Haptic feedback is used to restrain elbow motion and make users aware of their errors. This helps users consciously learn to avoid errors from occurring. While all subjects exhibited similar performance during the baseline phase of motor learning, those subjects who received haptic feedback from the haptic sleeve committed 23.5% fewer errors than subjects in the control group during the evaluation phase. The results show that the sleeve helps users retain and transfer motor skills better than visual feedback alone. This work shows the potential for fabric‐based haptic interfaces as a training aid for motor tasks in the fields of rehabilitation and teleoperation.
当人们意识到自己的错误并努力改正时,他们学习运动的效果最好。虽然触觉界面可以促进运动训练,但现有的界面通常体积庞大,并且不能总是确保训练后的技能保留。本文描述了一种可编程触觉套,该套由基于纺织品的电粘合离合器组成,用于技能获取和保留。它在运动学习研究中的功能显示,用户使用肘关节旋转来控制无人机的运动。触觉反馈被用来限制肘部的运动,让用户意识到自己的错误。这有助于用户有意识地学习避免错误的发生。虽然所有被试在运动学习的基线阶段都表现出相似的表现,但在评估阶段,接受触觉套触觉反馈的被试比对照组的被试犯的错误少23.5%。结果表明,与单独的视觉反馈相比,套筒能更好地帮助用户保留和转移运动技能。这项工作显示了基于织物的触觉界面在康复和远程操作领域作为运动任务训练辅助的潜力。
{"title":"Smart Textiles that Teach: Fabric‐Based Haptic Device Improves the Rate of Motor Learning","authors":"V. Ramachandran, Fabian Schilling, A. Wu, D. Floreano","doi":"10.1002/aisy.202100043","DOIUrl":"https://doi.org/10.1002/aisy.202100043","url":null,"abstract":"People learn motor activities best when they are conscious of their errors and make a concerted effort to correct them. While haptic interfaces can facilitate motor training, existing interfaces are often bulky and do not always ensure post‐training skill retention. Herein, a programmable haptic sleeve composed of textile‐based electroadhesive clutches for skill acquisition and retention is described. Its functionality in a motor learning study where users control a drone's movement using elbow joint rotation is shown. Haptic feedback is used to restrain elbow motion and make users aware of their errors. This helps users consciously learn to avoid errors from occurring. While all subjects exhibited similar performance during the baseline phase of motor learning, those subjects who received haptic feedback from the haptic sleeve committed 23.5% fewer errors than subjects in the control group during the evaluation phase. The results show that the sleeve helps users retain and transfer motor skills better than visual feedback alone. This work shows the potential for fabric‐based haptic interfaces as a training aid for motor tasks in the fields of rehabilitation and teleoperation.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"4 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84281360","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Progress and Benchmark of Spiking Neuron Devices and Circuits 脉冲神经元装置与电路的研究进展与基准
Pub Date : 2021-06-03 DOI: 10.1002/aisy.202100007
Fu-Xiang Liang, I-Ting Wang, T. Hou
The sustainability of ever more sophisticated artificial intelligence relies on the continual development of highly energy‐efficient and compact computing hardware that mimics the biological neural networks. Recently, the neural firing properties have been widely explored in various spiking neuron devices, which could emerge as the fundamental building blocks of future neuromorphic/in‐memory computing hardware. By leveraging the intrinsic device characteristics, the device‐based spiking neuron has the potential advantage of a compact circuit area for implementing neural networks with high density and high parallelism. However, a comprehensive benchmark that considers not only the device but also the peripheral circuit necessary for realizing complete neural functions is still lacking. Herein, the recent progress of emerging spiking neuron devices and circuits is reviewed. By implementing peripheral analog circuits for supporting various spiking neuron devices in the in‐memory computing architecture, the advantages and challenges in area and energy efficiency are discussed by benchmarking various technologies. A small or even no membrane capacitor, a self‐reset property, and a high spiking frequency are highly desirable.
越来越复杂的人工智能的可持续性依赖于高能效和紧凑型计算硬件的持续发展,这些硬件模仿生物神经网络。最近,神经放电特性在各种尖峰神经元装置中得到了广泛的探索,这些装置可能成为未来神经形态/内存计算硬件的基本组成部分。通过利用器件的固有特性,基于器件的尖峰神经元具有电路面积紧凑的潜在优势,可以实现高密度和高并行性的神经网络。然而,目前还缺乏一个全面的基准,既考虑设备,也考虑实现完整神经功能所需的外围电路。本文综述了近年来新兴的尖峰神经元装置和电路的研究进展。通过在内存计算架构中实现支持各种尖峰神经元器件的外围模拟电路,通过对各种技术进行基准测试,讨论了在面积和能源效率方面的优势和挑战。一个小的甚至没有膜电容器,一个自复位的性质,和高尖峰频率是非常可取的。
{"title":"Progress and Benchmark of Spiking Neuron Devices and Circuits","authors":"Fu-Xiang Liang, I-Ting Wang, T. Hou","doi":"10.1002/aisy.202100007","DOIUrl":"https://doi.org/10.1002/aisy.202100007","url":null,"abstract":"The sustainability of ever more sophisticated artificial intelligence relies on the continual development of highly energy‐efficient and compact computing hardware that mimics the biological neural networks. Recently, the neural firing properties have been widely explored in various spiking neuron devices, which could emerge as the fundamental building blocks of future neuromorphic/in‐memory computing hardware. By leveraging the intrinsic device characteristics, the device‐based spiking neuron has the potential advantage of a compact circuit area for implementing neural networks with high density and high parallelism. However, a comprehensive benchmark that considers not only the device but also the peripheral circuit necessary for realizing complete neural functions is still lacking. Herein, the recent progress of emerging spiking neuron devices and circuits is reviewed. By implementing peripheral analog circuits for supporting various spiking neuron devices in the in‐memory computing architecture, the advantages and challenges in area and energy efficiency are discussed by benchmarking various technologies. A small or even no membrane capacitor, a self‐reset property, and a high spiking frequency are highly desirable.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"23 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73181130","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Bioinspired Robotic Vision with Online Learning Capability and Rotation‐Invariant Properties 具有在线学习能力和旋转不变性的仿生机器人视觉
Pub Date : 2021-06-02 DOI: 10.1002/aisy.202100025
D. Berco, D. Ang
Reliable image perception is critical for living organisms. Biologic sensory organs and nervous systems evolved interdependently to allow apprehension of visual information regardless of spatial orientation. By contrast, convolutional neural networks usually have limited tolerance to rotational transformations. There are software‐based approaches used to address this issue, such as artificial rotation of training data or preliminary image processing. However, these workarounds require a large computational effort and are mostly done offline. This work presents a bioinspired, robotic vision system with inherent rotation‐invariant properties that may be taught either offline or in real time by feeding back error indications. It is successfully trained to counter the move of a human player in a game of Paper Scissors Stone. The architecture and operation principles are first discussed alongside the experimental setup. This is followed by performance analysis of pattern recognition under misaligned and rotated conditions. Finally, the process of online, supervised learning is demonstrated and analyzed.
可靠的图像感知对生物体至关重要。生物感觉器官和神经系统相互依赖地进化,使视觉信息的理解与空间方向无关。相比之下,卷积神经网络通常对旋转变换的容忍度有限。有基于软件的方法用于解决这个问题,例如人工旋转训练数据或初步图像处理。然而,这些解决方法需要大量的计算工作,并且大多是离线完成的。这项工作提出了一个生物启发的机器人视觉系统,具有固有的旋转不变特性,可以离线或通过反馈误差指示实时教授。它被成功地训练成在剪刀布石头游戏中对抗人类玩家的移动。首先讨论了该系统的结构和工作原理,并进行了实验设置。其次是在不对齐和旋转条件下模式识别的性能分析。最后,对在线监督学习的过程进行了演示和分析。
{"title":"Bioinspired Robotic Vision with Online Learning Capability and Rotation‐Invariant Properties","authors":"D. Berco, D. Ang","doi":"10.1002/aisy.202100025","DOIUrl":"https://doi.org/10.1002/aisy.202100025","url":null,"abstract":"Reliable image perception is critical for living organisms. Biologic sensory organs and nervous systems evolved interdependently to allow apprehension of visual information regardless of spatial orientation. By contrast, convolutional neural networks usually have limited tolerance to rotational transformations. There are software‐based approaches used to address this issue, such as artificial rotation of training data or preliminary image processing. However, these workarounds require a large computational effort and are mostly done offline. This work presents a bioinspired, robotic vision system with inherent rotation‐invariant properties that may be taught either offline or in real time by feeding back error indications. It is successfully trained to counter the move of a human player in a game of Paper Scissors Stone. The architecture and operation principles are first discussed alongside the experimental setup. This is followed by performance analysis of pattern recognition under misaligned and rotated conditions. Finally, the process of online, supervised learning is demonstrated and analyzed.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"140 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86590398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Recent Progress in 3D Printing of Smart Structures: Classification, Challenges, and Trends 智能结构3D打印的最新进展:分类、挑战和趋势
Pub Date : 2021-05-30 DOI: 10.1002/aisy.202000271
Yuyang Ji, Congcong Luan, Xinhua Yao, Jianzhong Fu, Yong He
Recently, considerable achievements have been made with the advancements of smart structures, which are known for their controlled deformation, self‐repair, and sensing characteristics. Such capabilities have significant potential in the field of bionics. 3D printing methods have revolutionized the high‐resolution integrated manufacturing of complex smart structures, resulting in new types of soft robots, actuators, wearable flexible electronics, and biomedical equipment. There is therefore a need for academia and industry to receive an update on the status of these tools. For this reason, herein, a comprehensive overview of the latest progress in printing methods, materials, and applications of various smart structures is provided. Temperature‐ and electromagnetic‐responsive smart structures are highlighted, in addition to self‐healing and smart‐sensing devices. Current exigencies and future development trends of 3D printing methods and smart structures are also summarized.
最近,随着智能结构的进步,人们取得了相当大的成就,智能结构以其控制变形、自我修复和传感特性而闻名。这种能力在仿生学领域具有巨大的潜力。3D打印技术彻底改变了复杂智能结构的高分辨率集成制造,导致了新型软机器人、执行器、可穿戴柔性电子产品和生物医学设备的出现。因此,学术界和工业界有必要了解这些工具的最新状况。为此,本文全面概述了各种智能结构在打印方法、材料和应用方面的最新进展。除了自我修复和智能传感设备外,还强调了温度和电磁响应智能结构。总结了3D打印方法和智能结构的现状和未来发展趋势。
{"title":"Recent Progress in 3D Printing of Smart Structures: Classification, Challenges, and Trends","authors":"Yuyang Ji, Congcong Luan, Xinhua Yao, Jianzhong Fu, Yong He","doi":"10.1002/aisy.202000271","DOIUrl":"https://doi.org/10.1002/aisy.202000271","url":null,"abstract":"Recently, considerable achievements have been made with the advancements of smart structures, which are known for their controlled deformation, self‐repair, and sensing characteristics. Such capabilities have significant potential in the field of bionics. 3D printing methods have revolutionized the high‐resolution integrated manufacturing of complex smart structures, resulting in new types of soft robots, actuators, wearable flexible electronics, and biomedical equipment. There is therefore a need for academia and industry to receive an update on the status of these tools. For this reason, herein, a comprehensive overview of the latest progress in printing methods, materials, and applications of various smart structures is provided. Temperature‐ and electromagnetic‐responsive smart structures are highlighted, in addition to self‐healing and smart‐sensing devices. Current exigencies and future development trends of 3D printing methods and smart structures are also summarized.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"10 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90978156","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 18
Ex Situ Transfer of Bayesian Neural Networks to Resistive Memory‐Based Inference Hardware 贝叶斯神经网络在基于电阻记忆的推理硬件上的非原位转移
Pub Date : 2021-05-20 DOI: 10.1002/aisy.202000103
T. Dalgaty, E. Esmanhotto, N. Castellani, D. Querlioz, E. Vianello
Neural networks cannot typically be trained locally in edge‐computing systems due to severe energy constraints. It has, therefore, become commonplace to train them “ex situ” and transfer the resulting model to a dedicated inference hardware. Resistive memory arrays are of particular interest for realizing such inference hardware, because they offer an extremely low‐power implementation of the dot‐product operation. However, the transfer of high‐precision software parameters to the imprecise and random conductance states of resistive memories poses significant challenges. Here, it is proposed that Bayesian neural networks can be more suitable for model transfer, because, such as device conductance states, their parameters are described by random variables. The ex situ training of a Bayesian neural network is performed, and then, the resulting software model is transferred in a single programming step to an array of 16 384 resistive memory devices. On an illustrative classification task, it is observed that the transferred decision boundaries and the prediction uncertainties of the software model are well preserved. This work demonstrates that resistive memory‐based Bayesian neural networks are a promising direction in the development of resistive memory compatible edge inference hardware.
由于严重的能量限制,神经网络通常不能在边缘计算系统中进行局部训练。因此,对它们进行“非原位”训练并将结果模型转移到专用的推理硬件上已经变得司空见惯。电阻式存储阵列对于实现这种推理硬件是特别有意义的,因为它们提供了极低功耗的点积运算实现。然而,将高精度软件参数转移到电阻存储器的不精确和随机电导状态提出了重大挑战。本文提出贝叶斯神经网络更适合模型传递,因为器件电导状态等参数是由随机变量描述的。首先对贝叶斯神经网络进行非原位训练,然后将得到的软件模型通过单个编程步骤传输到由16384个电阻存储器组成的阵列中。在一个说明性分类任务中,观察到软件模型的迁移决策边界和预测不确定性得到了很好的保留。这项工作表明,基于电阻性记忆的贝叶斯神经网络是开发电阻性记忆兼容边缘推理硬件的一个有前途的方向。
{"title":"Ex Situ Transfer of Bayesian Neural Networks to Resistive Memory‐Based Inference Hardware","authors":"T. Dalgaty, E. Esmanhotto, N. Castellani, D. Querlioz, E. Vianello","doi":"10.1002/aisy.202000103","DOIUrl":"https://doi.org/10.1002/aisy.202000103","url":null,"abstract":"Neural networks cannot typically be trained locally in edge‐computing systems due to severe energy constraints. It has, therefore, become commonplace to train them “ex situ” and transfer the resulting model to a dedicated inference hardware. Resistive memory arrays are of particular interest for realizing such inference hardware, because they offer an extremely low‐power implementation of the dot‐product operation. However, the transfer of high‐precision software parameters to the imprecise and random conductance states of resistive memories poses significant challenges. Here, it is proposed that Bayesian neural networks can be more suitable for model transfer, because, such as device conductance states, their parameters are described by random variables. The ex situ training of a Bayesian neural network is performed, and then, the resulting software model is transferred in a single programming step to an array of 16 384 resistive memory devices. On an illustrative classification task, it is observed that the transferred decision boundaries and the prediction uncertainties of the software model are well preserved. This work demonstrates that resistive memory‐based Bayesian neural networks are a promising direction in the development of resistive memory compatible edge inference hardware.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"95 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80465352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Neural Functional Connectivity Reconstruction with Second‐Order Memristor Network 基于二阶忆阻网络的神经功能连接重建
Pub Date : 2021-05-20 DOI: 10.1002/aisy.202000276
Yuting Wu, John Moon, Xiaojian Zhu, W. Lu
The advances of neural recording techniques have fostered rapid growth of the number of simultaneously recorded neurons, opening up new possibilities to investigate the interactions and dynamics inside neural circuitry. The high recording channel counts, however, pose significant challenges for data analysis because the required time and computational resources grow superlinearly with the data volume. Herein, the feasibility of real‐time reconstruction of neural functional connectivity using a second‐order memristor network is analyzed. Spike‐timing‐dependent plasticity, natively implemented by the internal dynamics of the memristor device, leads to the successful discovery of temporal correlations between pre‐ and postsynaptic spikes of the simulated neural circuits in an unsupervised fashion. The proposed system demonstrates high classification accuracy under a wide range of parameter settings considering indirect connections, synaptic weights, transmission delays, connection density, and so on, and enables the capturing of dynamic connectivity evolutions. The influence of device nonideal factors on detection accuracy is systematically evaluated, and the system shows robustness to initial weight randomness, and cycle‐to‐cycle and device‐to‐device variations. The proposed method allows direct mapping of neural connectivity onto the artificial memristor network and can lead to efficient front‐end data analysis of high‐density neural recording systems and potentially directly coupled bioartificial networks.
神经记录技术的进步促进了同时记录神经元数量的快速增长,为研究神经回路内部的相互作用和动力学开辟了新的可能性。然而,高记录通道计数对数据分析提出了重大挑战,因为所需的时间和计算资源随着数据量超线性增长。本文分析了利用二阶忆阻网络实时重建神经功能连通性的可行性。由忆阻器内部动力学固有实现的峰值时间依赖的可塑性,导致以无监督的方式成功发现模拟神经回路突触前和突触后峰值之间的时间相关性。该系统在考虑间接连接、突触权重、传输延迟、连接密度等多种参数的情况下,具有较高的分类精度,并能够捕获动态连接演化。系统地评估了设备非理想因素对检测精度的影响,系统对初始权重随机性、周期对周期和设备对设备变化具有鲁棒性。所提出的方法允许将神经连通性直接映射到人工忆阻器网络上,并且可以导致高密度神经记录系统和潜在的直接耦合生物人工网络的高效前端数据分析。
{"title":"Neural Functional Connectivity Reconstruction with Second‐Order Memristor Network","authors":"Yuting Wu, John Moon, Xiaojian Zhu, W. Lu","doi":"10.1002/aisy.202000276","DOIUrl":"https://doi.org/10.1002/aisy.202000276","url":null,"abstract":"The advances of neural recording techniques have fostered rapid growth of the number of simultaneously recorded neurons, opening up new possibilities to investigate the interactions and dynamics inside neural circuitry. The high recording channel counts, however, pose significant challenges for data analysis because the required time and computational resources grow superlinearly with the data volume. Herein, the feasibility of real‐time reconstruction of neural functional connectivity using a second‐order memristor network is analyzed. Spike‐timing‐dependent plasticity, natively implemented by the internal dynamics of the memristor device, leads to the successful discovery of temporal correlations between pre‐ and postsynaptic spikes of the simulated neural circuits in an unsupervised fashion. The proposed system demonstrates high classification accuracy under a wide range of parameter settings considering indirect connections, synaptic weights, transmission delays, connection density, and so on, and enables the capturing of dynamic connectivity evolutions. The influence of device nonideal factors on detection accuracy is systematically evaluated, and the system shows robustness to initial weight randomness, and cycle‐to‐cycle and device‐to‐device variations. The proposed method allows direct mapping of neural connectivity onto the artificial memristor network and can lead to efficient front‐end data analysis of high‐density neural recording systems and potentially directly coupled bioartificial networks.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"22 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84542996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Self‐Programming Synaptic Resistor Circuit for Intelligent Systems 智能系统的自编程突触电阻电路
Pub Date : 2021-05-18 DOI: 10.1002/aisy.202100016
Christopher M. Shaffer, Atharva Deo, Andrew Tudor, Rahul Shenoy, Cameron D. Danesh, Dhruva Nathan, Lawren L. Gamble, D. Inman, Yong Chen
Unlike artificial intelligent systems based on computers which have to be programmed for specific tasks, the human brain “self‐programs” in real time to create new tactics and adapt to arbitrary environments. Computers embedded in artificial intelligent systems execute arbitrary signal‐processing algorithms to outperform humans at specific tasks, but without the real‐time self‐programming functionality, they are preprogrammed by humans, fail in unpredictable environments beyond their preprogrammed domains, and lack general intelligence in arbitrary environments. Herein, a synaptic resistor circuit that self‐programs in arbitrary and unpredictable environments in real time is demonstrated. By integrating the synaptic signal processing, memory, and correlative learning functions in each synaptic resistor, the synaptic resistor circuit processes signals and self‐programs the circuit concurrently in real time with an energy efficiency about six orders higher than those of computers. In comparison with humans and a preprogrammed computer, the self‐programming synaptic resistor circuit dynamically modifies its algorithm to control a morphing wing in an unpredictable aerodynamic environment to improve its performance function with superior self‐programming speeds and accuracy. The synaptic resistor circuits potentially circumvent the fundamental limitations of computers, leading to a new intelligent platform with real‐time self‐programming functionality for artificial general intelligence.
与基于计算机的人工智能系统不同,人工智能系统必须为特定的任务编程,而人脑可以实时“自我编程”,以创造新的策略并适应任意的环境。嵌入人工智能系统的计算机执行任意信号处理算法,以在特定任务中超越人类,但没有实时自我编程功能,它们是由人类预编程的,在超出预编程域的不可预测环境中失败,并且在任意环境中缺乏通用智能。本文演示了一种在任意和不可预测的环境中实时自编程的突触电阻电路。通过在每个突触电阻器中集成突触信号处理、记忆和相关学习功能,突触电阻器电路实时处理信号并同时对电路进行自编程,其能量效率比计算机高约6个数量级。与人类和预编程计算机相比,自编程突触电阻电路动态修改其算法,以在不可预测的空气动力学环境中控制变形机翼,从而以优越的自编程速度和精度提高其性能功能。突触电阻电路有可能绕过计算机的基本限制,为人工通用智能提供一个具有实时自编程功能的新智能平台。
{"title":"Self‐Programming Synaptic Resistor Circuit for Intelligent Systems","authors":"Christopher M. Shaffer, Atharva Deo, Andrew Tudor, Rahul Shenoy, Cameron D. Danesh, Dhruva Nathan, Lawren L. Gamble, D. Inman, Yong Chen","doi":"10.1002/aisy.202100016","DOIUrl":"https://doi.org/10.1002/aisy.202100016","url":null,"abstract":"Unlike artificial intelligent systems based on computers which have to be programmed for specific tasks, the human brain “self‐programs” in real time to create new tactics and adapt to arbitrary environments. Computers embedded in artificial intelligent systems execute arbitrary signal‐processing algorithms to outperform humans at specific tasks, but without the real‐time self‐programming functionality, they are preprogrammed by humans, fail in unpredictable environments beyond their preprogrammed domains, and lack general intelligence in arbitrary environments. Herein, a synaptic resistor circuit that self‐programs in arbitrary and unpredictable environments in real time is demonstrated. By integrating the synaptic signal processing, memory, and correlative learning functions in each synaptic resistor, the synaptic resistor circuit processes signals and self‐programs the circuit concurrently in real time with an energy efficiency about six orders higher than those of computers. In comparison with humans and a preprogrammed computer, the self‐programming synaptic resistor circuit dynamically modifies its algorithm to control a morphing wing in an unpredictable aerodynamic environment to improve its performance function with superior self‐programming speeds and accuracy. The synaptic resistor circuits potentially circumvent the fundamental limitations of computers, leading to a new intelligent platform with real‐time self‐programming functionality for artificial general intelligence.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"24 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90378610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
High‐Density Force and Temperature Sensing Skin Using Micropillar Array with Image Sensor 使用带有图像传感器的微柱阵列的高密度力和温度传感皮肤
Pub Date : 2021-05-13 DOI: 10.1002/aisy.202000280
Xiaochen Shi, Yan Chen, Hong-Lan Jiang, Du-Li Yu, Xiaoliang Guo
Driving toward the goal of gaining a high level of intelligence and agility that mimics or surpasses that of humans, sensing systems have been widely investigated. As a complex network, tactile sense converts environmental stimuli into electrical impulses through various sensory receptors, which has been exploited in a large number of revolutionary applications, including robotics, prosthetics, and health‐monitoring devices. However, it remains significantly difficult to mimic all the functionalities of human skin. Herein, a machine tactile sensing system is proposed based on machine vision, which is commonly referred to as “electronic skin” or “e‐skin.” With a high density of 625 sensing points per square centimeter similar to that of human skin, the proposed sensing system can successfully measure 3D force and temperature distribution simultaneously. Based on this information, the shape, weight, texture, stiffness, and viscosity of objects can be obtained, comprehensively mimicking the human tactile system. Moreover, the experimental results show that the proposed e‐skin achieves excellent repeatability, reproducibility, and stability compared to those based on other principles such as the piezoresistive effect and capacitive effect.
为了获得模仿或超越人类的高水平智能和敏捷性,传感系统得到了广泛的研究。作为一个复杂的网络,触觉通过各种感觉受体将环境刺激转化为电脉冲,这已经在机器人、假肢和健康监测设备等大量革命性应用中得到了利用。然而,模仿人类皮肤的所有功能仍然非常困难。本文提出了一种基于机器视觉的机器触觉传感系统,通常被称为“电子皮肤”或“e - skin”。该传感系统具有与人体皮肤相似的每平方厘米625个传感点的高密度,可以成功地同时测量三维力和温度分布。基于这些信息,可以获得物体的形状、重量、纹理、刚度和粘度,全面模仿人类的触觉系统。此外,实验结果表明,与基于压阻效应和电容效应等其他原理的电子皮肤相比,所提出的电子皮肤具有优异的重复性、再现性和稳定性。
{"title":"High‐Density Force and Temperature Sensing Skin Using Micropillar Array with Image Sensor","authors":"Xiaochen Shi, Yan Chen, Hong-Lan Jiang, Du-Li Yu, Xiaoliang Guo","doi":"10.1002/aisy.202000280","DOIUrl":"https://doi.org/10.1002/aisy.202000280","url":null,"abstract":"Driving toward the goal of gaining a high level of intelligence and agility that mimics or surpasses that of humans, sensing systems have been widely investigated. As a complex network, tactile sense converts environmental stimuli into electrical impulses through various sensory receptors, which has been exploited in a large number of revolutionary applications, including robotics, prosthetics, and health‐monitoring devices. However, it remains significantly difficult to mimic all the functionalities of human skin. Herein, a machine tactile sensing system is proposed based on machine vision, which is commonly referred to as “electronic skin” or “e‐skin.” With a high density of 625 sensing points per square centimeter similar to that of human skin, the proposed sensing system can successfully measure 3D force and temperature distribution simultaneously. Based on this information, the shape, weight, texture, stiffness, and viscosity of objects can be obtained, comprehensively mimicking the human tactile system. Moreover, the experimental results show that the proposed e‐skin achieves excellent repeatability, reproducibility, and stability compared to those based on other principles such as the piezoresistive effect and capacitive effect.","PeriodicalId":7187,"journal":{"name":"Advanced Intelligent Systems","volume":"55 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86080596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
Advanced Intelligent Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1