Addressing Gap between Training Data and Deployed Environment by On-Device Learning

IF 2.8 3区 计算机科学 Q2 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE IEEE Micro Pub Date : 2023-11-01 DOI:10.1109/mm.2023.3314711
Kazuki Sunaga, Masaaki Kondo, Hiroki Matsutani
{"title":"Addressing Gap between Training Data and Deployed Environment by On-Device Learning","authors":"Kazuki Sunaga, Masaaki Kondo, Hiroki Matsutani","doi":"10.1109/mm.2023.3314711","DOIUrl":null,"url":null,"abstract":"The accuracy of tinyML applications is often affected by various environmental factors, such as noises, location/calibration of sensors, and time-related changes. This article introduces a neural network based on-device learning (ODL) approach to address this issue by retraining in deployed environments. Our approach relies on semi-supervised sequential training of multiple neural networks tailored for low-end edge devices. This article introduces its algorithm and implementation on wireless sensor nodes consisting of a Raspberry Pi Pico and low-power wireless module. Experiments using vibration patterns of rotating machines demonstrate that retraining by ODL improves anomaly detection accuracy compared with a prediction-only deep neural network in a noisy environment. The results also show that the ODL approach can save communication cost and energy consumption for battery-powered Internet of Things devices.","PeriodicalId":13100,"journal":{"name":"IEEE Micro","volume":"200 ","pages":"0"},"PeriodicalIF":2.8000,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Micro","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/mm.2023.3314711","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

Abstract

The accuracy of tinyML applications is often affected by various environmental factors, such as noises, location/calibration of sensors, and time-related changes. This article introduces a neural network based on-device learning (ODL) approach to address this issue by retraining in deployed environments. Our approach relies on semi-supervised sequential training of multiple neural networks tailored for low-end edge devices. This article introduces its algorithm and implementation on wireless sensor nodes consisting of a Raspberry Pi Pico and low-power wireless module. Experiments using vibration patterns of rotating machines demonstrate that retraining by ODL improves anomaly detection accuracy compared with a prediction-only deep neural network in a noisy environment. The results also show that the ODL approach can save communication cost and energy consumption for battery-powered Internet of Things devices.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
通过设备上学习解决训练数据与部署环境之间的差距
tinyML应用程序的准确性经常受到各种环境因素的影响,例如噪声、传感器的位置/校准以及与时间相关的变化。本文介绍了一种基于设备学习(ODL)的神经网络方法,通过在部署环境中进行再训练来解决这个问题。我们的方法依赖于为低端边缘设备量身定制的多个神经网络的半监督顺序训练。本文介绍了其算法及其在由树莓派Pico和低功耗无线模块组成的无线传感器节点上的实现。利用旋转机器的振动模式进行的实验表明,在噪声环境下,与仅预测的深度神经网络相比,ODL再训练提高了异常检测的精度。结果还表明,ODL方法可以为电池供电的物联网设备节省通信成本和能耗。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Micro
IEEE Micro 工程技术-计算机:软件工程
CiteScore
7.50
自引率
0.00%
发文量
164
审稿时长
>12 weeks
期刊介绍: IEEE Micro addresses users and designers of microprocessors and microprocessor systems, including managers, engineers, consultants, educators, and students involved with computers and peripherals, components and subassemblies, communications, instrumentation and control equipment, and guidance systems. Contributions should relate to the design, performance, or application of microprocessors and microcomputers. Tutorials, review papers, and discussions are also welcome. Sample topic areas include architecture, communications, data acquisition, control, hardware and software design/implementation, algorithms (including program listings), digital signal processing, microprocessor support hardware, operating systems, computer aided design, languages, application software, and development systems.
期刊最新文献
On-device Customization of Tiny Deep Learning Models for Keyword Spotting with Few Examples Addressing Gap between Training Data and Deployed Environment by On-Device Learning Hardware-Software co-design for real-time latency-accuracy navigation in tinyML applications Making Machine Learning More Energy Efficient by Bringing it Closer to the Sensor A 10.7-µJ/frame 88% Accuracy CIFAR-10 Single-chip Neuromorphic FPGA Processor Featuring Various Nonlinear Functions of Dendrites in Human Cerebrum
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1