基于卷积神经网络和度量学习的与主体无关的可穿戴 P300 脑机接口

IF 4.8 2区 医学 Q2 ENGINEERING, BIOMEDICAL IEEE Transactions on Neural Systems and Rehabilitation Engineering Pub Date : 2024-09-10 DOI:10.1109/TNSRE.2024.3457502
Li Hu;Wei Gao;Zilin Lu;Chun Shan;Haiwei Ma;Wenyu Zhang;Yuanqing Li
{"title":"基于卷积神经网络和度量学习的与主体无关的可穿戴 P300 脑机接口","authors":"Li Hu;Wei Gao;Zilin Lu;Chun Shan;Haiwei Ma;Wenyu Zhang;Yuanqing Li","doi":"10.1109/TNSRE.2024.3457502","DOIUrl":null,"url":null,"abstract":"The calibration procedure for a wearable P300 brain-computer interface (BCI) greatly impact the user experience of the system. Each user needs to spend additional time establishing a decoder adapted to their own brainwaves. Therefore, achieving subject independent is an urgent issue for wearable P300 BCI needs to be addressed. A dataset of electroencephalogram (EEG) signals was constructed from 100 individuals by conducting a P300 speller task with a wearable EEG amplifier. A framework is proposed that initially improves cross- subject consistency of EEG features through a common feature extractor. Subsequently, a simple and compact convolutional neural network (CNN) architecture is employed to learn an embedding sub-space, where the mapped EEG features are maximally separated, while pursuing the minimum distance within the same class and the maximum distance between different classes. Finally, the model’s generalization capability was further optimized through fine-tuning. Results: The proposed method significantly boosts the average accuracy of wearable P300 BCI to \n<inline-formula> <tex-math>$73.23\\pm 7.62$ </tex-math></inline-formula>\n% without calibration and \n<inline-formula> <tex-math>$78.75\\pm 6.37$ </tex-math></inline-formula>\n% with fine-tuning. The results demonstrate the feasibility and excellent performance of our dataset and framework. A calibration-free wearable P300 BCI system is feasible, suggesting significant potential for practical applications of the wearable P300 BCI system.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"32 ","pages":"3543-3553"},"PeriodicalIF":4.8000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10672519","citationCount":"0","resultStr":"{\"title\":\"Subject-Independent Wearable P300 Brain–Computer Interface Based on Convolutional Neural Network and Metric Learning\",\"authors\":\"Li Hu;Wei Gao;Zilin Lu;Chun Shan;Haiwei Ma;Wenyu Zhang;Yuanqing Li\",\"doi\":\"10.1109/TNSRE.2024.3457502\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The calibration procedure for a wearable P300 brain-computer interface (BCI) greatly impact the user experience of the system. Each user needs to spend additional time establishing a decoder adapted to their own brainwaves. Therefore, achieving subject independent is an urgent issue for wearable P300 BCI needs to be addressed. A dataset of electroencephalogram (EEG) signals was constructed from 100 individuals by conducting a P300 speller task with a wearable EEG amplifier. A framework is proposed that initially improves cross- subject consistency of EEG features through a common feature extractor. Subsequently, a simple and compact convolutional neural network (CNN) architecture is employed to learn an embedding sub-space, where the mapped EEG features are maximally separated, while pursuing the minimum distance within the same class and the maximum distance between different classes. Finally, the model’s generalization capability was further optimized through fine-tuning. Results: The proposed method significantly boosts the average accuracy of wearable P300 BCI to \\n<inline-formula> <tex-math>$73.23\\\\pm 7.62$ </tex-math></inline-formula>\\n% without calibration and \\n<inline-formula> <tex-math>$78.75\\\\pm 6.37$ </tex-math></inline-formula>\\n% with fine-tuning. The results demonstrate the feasibility and excellent performance of our dataset and framework. A calibration-free wearable P300 BCI system is feasible, suggesting significant potential for practical applications of the wearable P300 BCI system.\",\"PeriodicalId\":13419,\"journal\":{\"name\":\"IEEE Transactions on Neural Systems and Rehabilitation Engineering\",\"volume\":\"32 \",\"pages\":\"3543-3553\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2024-09-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10672519\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Neural Systems and Rehabilitation Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10672519/\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10672519/","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

摘要

可穿戴 P300 脑机接口(BCI)的校准程序极大地影响了系统的用户体验。每个用户都需要花费额外的时间来建立适合自己脑电波的解码器。因此,实现主体独立是可穿戴 P300 脑机接口亟待解决的问题。通过使用可穿戴脑电图放大器进行 P300 拼写任务,构建了 100 人的脑电图(EEG)信号数据集。本文提出了一个框架,首先通过一个通用的特征提取器提高脑电图特征的跨受试者一致性。随后,采用简单紧凑的卷积神经网络(CNN)架构来学习嵌入子空间,在该子空间中,映射的脑电图特征被最大程度地分离,同时追求同一类别内的最小距离和不同类别间的最大距离。最后,通过微调进一步优化了模型的泛化能力。结果所提出的方法大大提高了可穿戴 P300 BCI 的平均准确率,在没有校准的情况下达到 73.23 /pm 7.62$ %,在微调的情况下达到 78.75 /pm 6.37$ %。这些结果证明了我们的数据集和框架的可行性和卓越性能。无需校准的可穿戴 P300 BCI 系统是可行的,这表明可穿戴 P300 BCI 系统的实际应用潜力巨大。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Subject-Independent Wearable P300 Brain–Computer Interface Based on Convolutional Neural Network and Metric Learning
The calibration procedure for a wearable P300 brain-computer interface (BCI) greatly impact the user experience of the system. Each user needs to spend additional time establishing a decoder adapted to their own brainwaves. Therefore, achieving subject independent is an urgent issue for wearable P300 BCI needs to be addressed. A dataset of electroencephalogram (EEG) signals was constructed from 100 individuals by conducting a P300 speller task with a wearable EEG amplifier. A framework is proposed that initially improves cross- subject consistency of EEG features through a common feature extractor. Subsequently, a simple and compact convolutional neural network (CNN) architecture is employed to learn an embedding sub-space, where the mapped EEG features are maximally separated, while pursuing the minimum distance within the same class and the maximum distance between different classes. Finally, the model’s generalization capability was further optimized through fine-tuning. Results: The proposed method significantly boosts the average accuracy of wearable P300 BCI to $73.23\pm 7.62$ % without calibration and $78.75\pm 6.37$ % with fine-tuning. The results demonstrate the feasibility and excellent performance of our dataset and framework. A calibration-free wearable P300 BCI system is feasible, suggesting significant potential for practical applications of the wearable P300 BCI system.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
8.60
自引率
8.20%
发文量
479
审稿时长
6-12 weeks
期刊介绍: Rehabilitative and neural aspects of biomedical engineering, including functional electrical stimulation, acoustic dynamics, human performance measurement and analysis, nerve stimulation, electromyography, motor control and stimulation; and hardware and software applications for rehabilitation engineering and assistive devices.
期刊最新文献
Semi-Autonomous Continuous Robotic Arm Control Using an Augmented Reality Brain-Computer Interface Low-Intensity Focused Ultrasound Stimulation on Fingertip Can Evoke Fine Tactile Sensations and Different Local Hemodynamic Responses The Neural Basis of the Effect of Transcutaneous Auricular Vagus Nerve Stimulation on Emotion Regulation Related Brain Regions: An rs-fMRI Study An Asynchronous Training-free SSVEP-BCI Detection Algorithm for Non-Equal Prior Probability Scenarios. A Swing-Assist Controller for Enhancing Knee Flexion in a Semi-Powered Transfemoral Prosthesis
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1