Lan Mei, Cristian Cioflan, Thorir Mar Ingolfsson, Victor Kartsch, Andrea Cossettini, Xiaying Wang, Luca Benini
{"title":"按需训练:用于自适应真实世界脑机接口的设备上持续学习工作流程","authors":"Lan Mei, Cristian Cioflan, Thorir Mar Ingolfsson, Victor Kartsch, Andrea Cossettini, Xiaying Wang, Luca Benini","doi":"arxiv-2409.09161","DOIUrl":null,"url":null,"abstract":"Brain-machine interfaces (BMIs) are expanding beyond clinical settings thanks\nto advances in hardware and algorithms. However, they still face challenges in\nuser-friendliness and signal variability. Classification models need periodic\nadaptation for real-life use, making an optimal re-training strategy essential\nto maximize user acceptance and maintain high performance. We propose TOR, a\ntrain-on-request workflow that enables user-specific model adaptation to novel\nconditions, addressing signal variability over time. Using continual learning,\nTOR preserves knowledge across sessions and mitigates inter-session\nvariability. With TOR, users can refine, on demand, the model through on-device\nlearning (ODL) to enhance accuracy adapting to changing conditions. We evaluate\nthe proposed methodology on a motor-movement dataset recorded with a\nnon-stigmatizing wearable BMI headband, achieving up to 92% accuracy and a\nre-calibration time as low as 1.6 minutes, a 46% reduction compared to a naive\ntransfer learning workflow. We additionally demonstrate that TOR is suitable\nfor ODL in extreme edge settings by deploying the training procedure on a\nRISC-V ultra-low-power SoC (GAP9), resulting in 21.6 ms of latency and 1 mJ of\nenergy consumption per training step. To the best of our knowledge, this work\nis the first demonstration of an online, energy-efficient, dynamic adaptation\nof a BMI model to the intrinsic variability of EEG signals in real-time\nsettings.","PeriodicalId":501034,"journal":{"name":"arXiv - EE - Signal Processing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Train-On-Request: An On-Device Continual Learning Workflow for Adaptive Real-World Brain Machine Interfaces\",\"authors\":\"Lan Mei, Cristian Cioflan, Thorir Mar Ingolfsson, Victor Kartsch, Andrea Cossettini, Xiaying Wang, Luca Benini\",\"doi\":\"arxiv-2409.09161\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Brain-machine interfaces (BMIs) are expanding beyond clinical settings thanks\\nto advances in hardware and algorithms. However, they still face challenges in\\nuser-friendliness and signal variability. Classification models need periodic\\nadaptation for real-life use, making an optimal re-training strategy essential\\nto maximize user acceptance and maintain high performance. We propose TOR, a\\ntrain-on-request workflow that enables user-specific model adaptation to novel\\nconditions, addressing signal variability over time. Using continual learning,\\nTOR preserves knowledge across sessions and mitigates inter-session\\nvariability. With TOR, users can refine, on demand, the model through on-device\\nlearning (ODL) to enhance accuracy adapting to changing conditions. We evaluate\\nthe proposed methodology on a motor-movement dataset recorded with a\\nnon-stigmatizing wearable BMI headband, achieving up to 92% accuracy and a\\nre-calibration time as low as 1.6 minutes, a 46% reduction compared to a naive\\ntransfer learning workflow. We additionally demonstrate that TOR is suitable\\nfor ODL in extreme edge settings by deploying the training procedure on a\\nRISC-V ultra-low-power SoC (GAP9), resulting in 21.6 ms of latency and 1 mJ of\\nenergy consumption per training step. To the best of our knowledge, this work\\nis the first demonstration of an online, energy-efficient, dynamic adaptation\\nof a BMI model to the intrinsic variability of EEG signals in real-time\\nsettings.\",\"PeriodicalId\":501034,\"journal\":{\"name\":\"arXiv - EE - Signal Processing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - EE - Signal Processing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.09161\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - EE - Signal Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.09161","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Train-On-Request: An On-Device Continual Learning Workflow for Adaptive Real-World Brain Machine Interfaces
Brain-machine interfaces (BMIs) are expanding beyond clinical settings thanks
to advances in hardware and algorithms. However, they still face challenges in
user-friendliness and signal variability. Classification models need periodic
adaptation for real-life use, making an optimal re-training strategy essential
to maximize user acceptance and maintain high performance. We propose TOR, a
train-on-request workflow that enables user-specific model adaptation to novel
conditions, addressing signal variability over time. Using continual learning,
TOR preserves knowledge across sessions and mitigates inter-session
variability. With TOR, users can refine, on demand, the model through on-device
learning (ODL) to enhance accuracy adapting to changing conditions. We evaluate
the proposed methodology on a motor-movement dataset recorded with a
non-stigmatizing wearable BMI headband, achieving up to 92% accuracy and a
re-calibration time as low as 1.6 minutes, a 46% reduction compared to a naive
transfer learning workflow. We additionally demonstrate that TOR is suitable
for ODL in extreme edge settings by deploying the training procedure on a
RISC-V ultra-low-power SoC (GAP9), resulting in 21.6 ms of latency and 1 mJ of
energy consumption per training step. To the best of our knowledge, this work
is the first demonstration of an online, energy-efficient, dynamic adaptation
of a BMI model to the intrinsic variability of EEG signals in real-time
settings.