Lan Mei, Thorir Mar Ingolfsson, Cristian Cioflan, Victor Kartsch, Andrea Cossettini, Xiaying Wang, Luca Benini
{"title":"An Ultra-Low Power Wearable BMI System with Continual Learning Capabilities","authors":"Lan Mei, Thorir Mar Ingolfsson, Cristian Cioflan, Victor Kartsch, Andrea Cossettini, Xiaying Wang, Luca Benini","doi":"arxiv-2409.10654","DOIUrl":null,"url":null,"abstract":"Driven by the progress in efficient embedded processing, there is an\naccelerating trend toward running machine learning models directly on wearable\nBrain-Machine Interfaces (BMIs) to improve portability and privacy and maximize\nbattery life. However, achieving low latency and high classification\nperformance remains challenging due to the inherent variability of\nelectroencephalographic (EEG) signals across sessions and the limited onboard\nresources. This work proposes a comprehensive BMI workflow based on a CNN-based\nContinual Learning (CL) framework, allowing the system to adapt to\ninter-session changes. The workflow is deployed on a wearable, parallel\nultra-low power BMI platform (BioGAP). Our results based on two in-house\ndatasets, Dataset A and Dataset B, show that the CL workflow improves average\naccuracy by up to 30.36% and 10.17%, respectively. Furthermore, when\nimplementing the continual learning on a Parallel Ultra-Low Power (PULP)\nmicrocontroller (GAP9), it achieves an energy consumption as low as 0.45mJ per\ninference and an adaptation time of only 21.5ms, yielding around 25h of battery\nlife with a small 100mAh, 3.7V battery on BioGAP. Our setup, coupled with the\ncompact CNN model and on-device CL capabilities, meets users' needs for\nimproved privacy, reduced latency, and enhanced inter-session performance,\noffering good promise for smart embedded real-world BMIs.","PeriodicalId":501175,"journal":{"name":"arXiv - EE - Systems and Control","volume":"26 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - EE - Systems and Control","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.10654","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Driven by the progress in efficient embedded processing, there is an
accelerating trend toward running machine learning models directly on wearable
Brain-Machine Interfaces (BMIs) to improve portability and privacy and maximize
battery life. However, achieving low latency and high classification
performance remains challenging due to the inherent variability of
electroencephalographic (EEG) signals across sessions and the limited onboard
resources. This work proposes a comprehensive BMI workflow based on a CNN-based
Continual Learning (CL) framework, allowing the system to adapt to
inter-session changes. The workflow is deployed on a wearable, parallel
ultra-low power BMI platform (BioGAP). Our results based on two in-house
datasets, Dataset A and Dataset B, show that the CL workflow improves average
accuracy by up to 30.36% and 10.17%, respectively. Furthermore, when
implementing the continual learning on a Parallel Ultra-Low Power (PULP)
microcontroller (GAP9), it achieves an energy consumption as low as 0.45mJ per
inference and an adaptation time of only 21.5ms, yielding around 25h of battery
life with a small 100mAh, 3.7V battery on BioGAP. Our setup, coupled with the
compact CNN model and on-device CL capabilities, meets users' needs for
improved privacy, reduced latency, and enhanced inter-session performance,
offering good promise for smart embedded real-world BMIs.