Wei Liang , Brendan Z. Allison , Ren Xu , Xinjie He , Xingyu Wang , Andrzej Cichocki , Jing Jin
{"title":"SecNet:用于MI-EEG的二阶神经网络","authors":"Wei Liang , Brendan Z. Allison , Ren Xu , Xinjie He , Xingyu Wang , Andrzej Cichocki , Jing Jin","doi":"10.1016/j.ipm.2024.104012","DOIUrl":null,"url":null,"abstract":"<div><div>Motor imagery-based brain-computer interfaces (MI-BCIs) hold significant potential for individuals with severe paralysis who are aware and alert by but unable to reliably control their muscles. MI-BCIs have garnered increasing attention from researchers in the field of motor function rehabilitation as a healthcare technology. However, the variability of inter-session and the difficulty in extracting energy features bring huge challenges to the information processing of such systems. To overcome this, we propose a novel architecture called SecNet, designed to capture relationships between convolutional features. SecNet utilizes multiple branches to learn spatio-temporal features of EEG signals and then pools them into a covariance. We integrate regularization and attention mechanisms to enhance the learning efficiency of features, followed by the adoption of a second order pooling method. Lastly, we employ Riemannian geometry learning to map features derived from symmetric positive definite covariance matrices. Evaluation experiments are conducted on a dataset from stroke patients and further compared its performance on two public datasets. Experimental results show that the SecNet is superior to the benchmark methods and achieves accuracy rates of 72.90%, 87.08% and 74.28% on the Stroke dataset, BCI IV 2a dataset and OpenBMI dataset, respectively. These results demonstrate its efficacy and robustness in inter-session decoding for MI-BCI, showing its practical utility for application. Our code is available at <span><span>https://github.com/SecNet-mi/SecNet</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50365,"journal":{"name":"Information Processing & Management","volume":"62 3","pages":"Article 104012"},"PeriodicalIF":8.1000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"SecNet: A second order neural network for MI-EEG\",\"authors\":\"Wei Liang , Brendan Z. Allison , Ren Xu , Xinjie He , Xingyu Wang , Andrzej Cichocki , Jing Jin\",\"doi\":\"10.1016/j.ipm.2024.104012\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Motor imagery-based brain-computer interfaces (MI-BCIs) hold significant potential for individuals with severe paralysis who are aware and alert by but unable to reliably control their muscles. MI-BCIs have garnered increasing attention from researchers in the field of motor function rehabilitation as a healthcare technology. However, the variability of inter-session and the difficulty in extracting energy features bring huge challenges to the information processing of such systems. To overcome this, we propose a novel architecture called SecNet, designed to capture relationships between convolutional features. SecNet utilizes multiple branches to learn spatio-temporal features of EEG signals and then pools them into a covariance. We integrate regularization and attention mechanisms to enhance the learning efficiency of features, followed by the adoption of a second order pooling method. Lastly, we employ Riemannian geometry learning to map features derived from symmetric positive definite covariance matrices. Evaluation experiments are conducted on a dataset from stroke patients and further compared its performance on two public datasets. Experimental results show that the SecNet is superior to the benchmark methods and achieves accuracy rates of 72.90%, 87.08% and 74.28% on the Stroke dataset, BCI IV 2a dataset and OpenBMI dataset, respectively. These results demonstrate its efficacy and robustness in inter-session decoding for MI-BCI, showing its practical utility for application. Our code is available at <span><span>https://github.com/SecNet-mi/SecNet</span><svg><path></path></svg></span>.</div></div>\",\"PeriodicalId\":50365,\"journal\":{\"name\":\"Information Processing & Management\",\"volume\":\"62 3\",\"pages\":\"Article 104012\"},\"PeriodicalIF\":8.1000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Processing & Management\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0306457324003716\",\"RegionNum\":1,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/12/6 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Processing & Management","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306457324003716","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/12/6 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
基于运动图像的脑机接口(mi - bci)对于严重瘫痪的人来说具有重要的潜力,这些人通过肌肉来意识和警觉,但无法可靠地控制他们的肌肉。mi - bci作为一种医疗保健技术越来越受到运动功能康复领域研究者的关注。然而,时段间的可变性和能量特征提取的难度给此类系统的信息处理带来了巨大的挑战。为了克服这个问题,我们提出了一种名为SecNet的新架构,旨在捕捉卷积特征之间的关系。SecNet利用多个分支来学习脑电图信号的时空特征,并将其集合成一个协方差。我们结合正则化和关注机制来提高特征的学习效率,然后采用二阶池化方法。最后,我们使用黎曼几何学习来映射由对称正定协方差矩阵导出的特征。在脑卒中患者数据集上进行了评估实验,并进一步比较了其在两个公共数据集上的性能。实验结果表明,SecNet在Stroke数据集、BCI IV 2a数据集和OpenBMI数据集上的准确率分别达到72.90%、87.08%和74.28%,优于基准方法。实验结果证明了该算法在MI-BCI会话间解码中的有效性和鲁棒性,显示了该算法的实际应用价值。我们的代码可在https://github.com/SecNet-mi/SecNet上获得。
Motor imagery-based brain-computer interfaces (MI-BCIs) hold significant potential for individuals with severe paralysis who are aware and alert by but unable to reliably control their muscles. MI-BCIs have garnered increasing attention from researchers in the field of motor function rehabilitation as a healthcare technology. However, the variability of inter-session and the difficulty in extracting energy features bring huge challenges to the information processing of such systems. To overcome this, we propose a novel architecture called SecNet, designed to capture relationships between convolutional features. SecNet utilizes multiple branches to learn spatio-temporal features of EEG signals and then pools them into a covariance. We integrate regularization and attention mechanisms to enhance the learning efficiency of features, followed by the adoption of a second order pooling method. Lastly, we employ Riemannian geometry learning to map features derived from symmetric positive definite covariance matrices. Evaluation experiments are conducted on a dataset from stroke patients and further compared its performance on two public datasets. Experimental results show that the SecNet is superior to the benchmark methods and achieves accuracy rates of 72.90%, 87.08% and 74.28% on the Stroke dataset, BCI IV 2a dataset and OpenBMI dataset, respectively. These results demonstrate its efficacy and robustness in inter-session decoding for MI-BCI, showing its practical utility for application. Our code is available at https://github.com/SecNet-mi/SecNet.
期刊介绍:
Information Processing and Management is dedicated to publishing cutting-edge original research at the convergence of computing and information science. Our scope encompasses theory, methods, and applications across various domains, including advertising, business, health, information science, information technology marketing, and social computing.
We aim to cater to the interests of both primary researchers and practitioners by offering an effective platform for the timely dissemination of advanced and topical issues in this interdisciplinary field. The journal places particular emphasis on original research articles, research survey articles, research method articles, and articles addressing critical applications of research. Join us in advancing knowledge and innovation at the intersection of computing and information science.