基于脑电图的运动图像分类的一维卷积多分支融合网络

IF 5.6 4区 医学 Q1 ENGINEERING, BIOMEDICAL Irbm Pub Date : 2023-11-14 DOI:10.1016/j.irbm.2023.100812
Xiaoguang Liu , Mingjin Zhang , Shicheng Xiong , Xiaodong Wang , Tie Liang , Jun Li , Peng Xiong , Hongrui Wang , Xiuling Liu
{"title":"基于脑电图的运动图像分类的一维卷积多分支融合网络","authors":"Xiaoguang Liu ,&nbsp;Mingjin Zhang ,&nbsp;Shicheng Xiong ,&nbsp;Xiaodong Wang ,&nbsp;Tie Liang ,&nbsp;Jun Li ,&nbsp;Peng Xiong ,&nbsp;Hongrui Wang ,&nbsp;Xiuling Liu","doi":"10.1016/j.irbm.2023.100812","DOIUrl":null,"url":null,"abstract":"<div><p>The Brain-Computer Interface (BCI) system based on motor imagery (MI) is a hot research topic nowadays, which can control external devices through the brain and has a wide range of applications in rehabilitation, gaming, and entertainment. Due to the non-smooth, non-linear, and low signal-to-noise ratio of the MI EEG signal, it is challenging to accurately decode the MI task intention. A new end-to-end deep learning method is proposed to decode raw MI EEG signals without preprocessing, such as filtering and feature reinforcement. The 1D convolution is used to learn the time-frequency features in MI signals, and a four-branch fusion network is used as the main body to add a 1D CNN-AE block and 1D SE-block to enhance the algorithm's performance. Experiments on two publicly available datasets demonstrate that our proposed algorithm outperforms the current state-of-the-art methods. It achieves 86.11% and 89.51% on the BCI Competition IV-2a and the BCI Competition IV-2b datasets, respectively, and a 6.9% improvement in the generalizability test. The proposed data enhancement method can effectively alleviate the overfitting of the algorithm and improve the decoding performance. Further analysis shows that 1D convolution can effectively extract the features associated with the MI task.</p></div>","PeriodicalId":14605,"journal":{"name":"Irbm","volume":null,"pages":null},"PeriodicalIF":5.6000,"publicationDate":"2023-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"One-Dimensional Convolutional Multi-branch Fusion Network for EEG-Based Motor Imagery Classification\",\"authors\":\"Xiaoguang Liu ,&nbsp;Mingjin Zhang ,&nbsp;Shicheng Xiong ,&nbsp;Xiaodong Wang ,&nbsp;Tie Liang ,&nbsp;Jun Li ,&nbsp;Peng Xiong ,&nbsp;Hongrui Wang ,&nbsp;Xiuling Liu\",\"doi\":\"10.1016/j.irbm.2023.100812\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The Brain-Computer Interface (BCI) system based on motor imagery (MI) is a hot research topic nowadays, which can control external devices through the brain and has a wide range of applications in rehabilitation, gaming, and entertainment. Due to the non-smooth, non-linear, and low signal-to-noise ratio of the MI EEG signal, it is challenging to accurately decode the MI task intention. A new end-to-end deep learning method is proposed to decode raw MI EEG signals without preprocessing, such as filtering and feature reinforcement. The 1D convolution is used to learn the time-frequency features in MI signals, and a four-branch fusion network is used as the main body to add a 1D CNN-AE block and 1D SE-block to enhance the algorithm's performance. Experiments on two publicly available datasets demonstrate that our proposed algorithm outperforms the current state-of-the-art methods. It achieves 86.11% and 89.51% on the BCI Competition IV-2a and the BCI Competition IV-2b datasets, respectively, and a 6.9% improvement in the generalizability test. The proposed data enhancement method can effectively alleviate the overfitting of the algorithm and improve the decoding performance. Further analysis shows that 1D convolution can effectively extract the features associated with the MI task.</p></div>\",\"PeriodicalId\":14605,\"journal\":{\"name\":\"Irbm\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2023-11-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Irbm\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1959031823000611\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Irbm","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1959031823000611","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

摘要

基于运动意象(MI)的脑机接口(BCI)系统是目前研究的热点,它可以通过大脑控制外部设备,在康复、游戏、娱乐等领域有着广泛的应用。由于脑电信号具有非光滑、非线性、低信噪比等特点,对脑电任务意图的准确解码具有一定的挑战性。提出了一种新的端到端深度学习方法来对原始脑电信号进行解码,而不需要进行滤波和特征强化等预处理。采用一维卷积学习MI信号的时频特征,采用四分支融合网络为主体,增加一维CNN-AE块和一维se块,增强算法性能。在两个公开可用的数据集上的实验表明,我们提出的算法优于当前最先进的方法。在BCI Competition IV-2a和BCI Competition IV-2b数据集上分别达到86.11%和89.51%,在泛化性测试中提高了6.9%。所提出的数据增强方法可以有效地缓解算法的过拟合,提高解码性能。进一步分析表明,一维卷积可以有效地提取与MI任务相关的特征。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
One-Dimensional Convolutional Multi-branch Fusion Network for EEG-Based Motor Imagery Classification

The Brain-Computer Interface (BCI) system based on motor imagery (MI) is a hot research topic nowadays, which can control external devices through the brain and has a wide range of applications in rehabilitation, gaming, and entertainment. Due to the non-smooth, non-linear, and low signal-to-noise ratio of the MI EEG signal, it is challenging to accurately decode the MI task intention. A new end-to-end deep learning method is proposed to decode raw MI EEG signals without preprocessing, such as filtering and feature reinforcement. The 1D convolution is used to learn the time-frequency features in MI signals, and a four-branch fusion network is used as the main body to add a 1D CNN-AE block and 1D SE-block to enhance the algorithm's performance. Experiments on two publicly available datasets demonstrate that our proposed algorithm outperforms the current state-of-the-art methods. It achieves 86.11% and 89.51% on the BCI Competition IV-2a and the BCI Competition IV-2b datasets, respectively, and a 6.9% improvement in the generalizability test. The proposed data enhancement method can effectively alleviate the overfitting of the algorithm and improve the decoding performance. Further analysis shows that 1D convolution can effectively extract the features associated with the MI task.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Irbm
Irbm ENGINEERING, BIOMEDICAL-
CiteScore
10.30
自引率
4.20%
发文量
81
审稿时长
57 days
期刊介绍: IRBM is the journal of the AGBM (Alliance for engineering in Biology an Medicine / Alliance pour le génie biologique et médical) and the SFGBM (BioMedical Engineering French Society / Société française de génie biologique médical) and the AFIB (French Association of Biomedical Engineers / Association française des ingénieurs biomédicaux). As a vehicle of information and knowledge in the field of biomedical technologies, IRBM is devoted to fundamental as well as clinical research. Biomedical engineering and use of new technologies are the cornerstones of IRBM, providing authors and users with the latest information. Its six issues per year propose reviews (state-of-the-art and current knowledge), original articles directed at fundamental research and articles focusing on biomedical engineering. All articles are submitted to peer reviewers acting as guarantors for IRBM''s scientific and medical content. The field covered by IRBM includes all the discipline of Biomedical engineering. Thereby, the type of papers published include those that cover the technological and methodological development in: -Physiological and Biological Signal processing (EEG, MEG, ECG…)- Medical Image processing- Biomechanics- Biomaterials- Medical Physics- Biophysics- Physiological and Biological Sensors- Information technologies in healthcare- Disability research- Computational physiology- …
期刊最新文献
Mechanical Work and Metabolic Cost of Walking with Knee-Foot Prostheses: A Study with a Prosthesis Simulator Corrigendum to “Transition Network-Based Analysis of Electrodermal Activity Signals for Emotion Recognition” [IRBM 45 (2024) 100849] Editorial Board Contents An Ensemble Learning System Based on Stacking Strategy for Survival Risk Prediction of Patients with Esophageal Cancer
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1