{"title":"一种基于非稳态注意力的跨会期运动图像分类方法,具有无批判域适应性","authors":"Shuai Guo , Yi Wang , Xin Zhang , Baoping Tang","doi":"10.1016/j.bspc.2024.107122","DOIUrl":null,"url":null,"abstract":"<div><div>Recent studies increasingly employ deep learning to decode electroencephalogram (EEG) signals. While deep learning has improved the performance of motor imagery (MI) classification to some extent, challenges remain due to significant variances in EEG data across sessions and the limitations of convolutional neural networks (CNNs). EEG signals are inherently non-stationary, traditional multi-head attention typically uses normalization methods to reduce non-stationarity and improve performance. However, non-stationary factors are crucial inherent properties of EEG signals and provide valuable guidance for decoding temporal dependencies in EEG signals. In this paper, we introduce a novel CNN combined with the Non-stationary Attention (NSA) and Critic-free Domain Adaptation Network (NSDANet), tailored for decoding MI signals. This network starts with temporal–spatial convolution devised to extract spatial–temporal features from EEG signals. It then obtains multi-modal information from average and variance perspectives. We devise a new self-attention module, the Non-stationary Attention (NSA), to capture the non-stationary temporal dependencies of MI-EEG signals. Furthermore, to align feature distributions between the source and target domains, we propose a critic-free domain adaptation network that uses the Nuclear-norm Wasserstein discrepancy (NWD) to minimize the inter-domain differences. NWD complements the original classifier by acting as a critic without a gradient penalty. This integration leverages discriminative information for feature alignment, thus enhancing EEG decoding performance. We conducted extensive cross-session experiments on both BCIC IV 2a and BCIC IV 2b dataset. Results demonstrate that the proposed method outperforms some existing approaches.</div></div>","PeriodicalId":55362,"journal":{"name":"Biomedical Signal Processing and Control","volume":"100 ","pages":"Article 107122"},"PeriodicalIF":4.9000,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A cross-session non-stationary attention-based motor imagery classification method with critic-free domain adaptation\",\"authors\":\"Shuai Guo , Yi Wang , Xin Zhang , Baoping Tang\",\"doi\":\"10.1016/j.bspc.2024.107122\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Recent studies increasingly employ deep learning to decode electroencephalogram (EEG) signals. While deep learning has improved the performance of motor imagery (MI) classification to some extent, challenges remain due to significant variances in EEG data across sessions and the limitations of convolutional neural networks (CNNs). EEG signals are inherently non-stationary, traditional multi-head attention typically uses normalization methods to reduce non-stationarity and improve performance. However, non-stationary factors are crucial inherent properties of EEG signals and provide valuable guidance for decoding temporal dependencies in EEG signals. In this paper, we introduce a novel CNN combined with the Non-stationary Attention (NSA) and Critic-free Domain Adaptation Network (NSDANet), tailored for decoding MI signals. This network starts with temporal–spatial convolution devised to extract spatial–temporal features from EEG signals. It then obtains multi-modal information from average and variance perspectives. We devise a new self-attention module, the Non-stationary Attention (NSA), to capture the non-stationary temporal dependencies of MI-EEG signals. Furthermore, to align feature distributions between the source and target domains, we propose a critic-free domain adaptation network that uses the Nuclear-norm Wasserstein discrepancy (NWD) to minimize the inter-domain differences. NWD complements the original classifier by acting as a critic without a gradient penalty. This integration leverages discriminative information for feature alignment, thus enhancing EEG decoding performance. We conducted extensive cross-session experiments on both BCIC IV 2a and BCIC IV 2b dataset. Results demonstrate that the proposed method outperforms some existing approaches.</div></div>\",\"PeriodicalId\":55362,\"journal\":{\"name\":\"Biomedical Signal Processing and Control\",\"volume\":\"100 \",\"pages\":\"Article 107122\"},\"PeriodicalIF\":4.9000,\"publicationDate\":\"2024-11-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biomedical Signal Processing and Control\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1746809424011807\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Signal Processing and Control","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1746809424011807","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
摘要
最近的研究越来越多地采用深度学习来解码脑电图(EEG)信号。虽然深度学习在一定程度上提高了运动图像(MI)分类的性能,但由于不同时段的脑电图数据存在显著差异以及卷积神经网络(CNN)的局限性,挑战依然存在。脑电信号本身具有非平稳性,传统的多头注意力通常使用归一化方法来减少非平稳性并提高性能。然而,非稳态因素是脑电信号的重要固有属性,可为解码脑电信号中的时间依赖性提供有价值的指导。在本文中,我们介绍了一种结合了非稳态注意(NSA)和无批判域自适应网络(NSDANet)的新型 CNN,专门用于解码 MI 信号。该网络从时间-空间卷积开始,旨在从脑电图信号中提取空间-时间特征。然后,它从平均值和方差角度获取多模态信息。我们设计了一个新的自我注意模块--非稳态注意(NSA),以捕捉 MI-EEG 信号的非稳态时间依赖性。此外,为了调整源域和目标域之间的特征分布,我们提出了一种无批评域适应网络,它使用核正态分布差异(Nuclear-norm Wasserstein discrepancy,NWD)来最小化域间差异。NWD 作为无梯度惩罚的批判者,对原始分类器进行了补充。这种整合利用了特征对齐的判别信息,从而提高了脑电图解码性能。我们在 BCIC IV 2a 和 BCIC IV 2b 数据集上进行了广泛的跨时段实验。结果表明,所提出的方法优于一些现有方法。
A cross-session non-stationary attention-based motor imagery classification method with critic-free domain adaptation
Recent studies increasingly employ deep learning to decode electroencephalogram (EEG) signals. While deep learning has improved the performance of motor imagery (MI) classification to some extent, challenges remain due to significant variances in EEG data across sessions and the limitations of convolutional neural networks (CNNs). EEG signals are inherently non-stationary, traditional multi-head attention typically uses normalization methods to reduce non-stationarity and improve performance. However, non-stationary factors are crucial inherent properties of EEG signals and provide valuable guidance for decoding temporal dependencies in EEG signals. In this paper, we introduce a novel CNN combined with the Non-stationary Attention (NSA) and Critic-free Domain Adaptation Network (NSDANet), tailored for decoding MI signals. This network starts with temporal–spatial convolution devised to extract spatial–temporal features from EEG signals. It then obtains multi-modal information from average and variance perspectives. We devise a new self-attention module, the Non-stationary Attention (NSA), to capture the non-stationary temporal dependencies of MI-EEG signals. Furthermore, to align feature distributions between the source and target domains, we propose a critic-free domain adaptation network that uses the Nuclear-norm Wasserstein discrepancy (NWD) to minimize the inter-domain differences. NWD complements the original classifier by acting as a critic without a gradient penalty. This integration leverages discriminative information for feature alignment, thus enhancing EEG decoding performance. We conducted extensive cross-session experiments on both BCIC IV 2a and BCIC IV 2b dataset. Results demonstrate that the proposed method outperforms some existing approaches.
期刊介绍:
Biomedical Signal Processing and Control aims to provide a cross-disciplinary international forum for the interchange of information on research in the measurement and analysis of signals and images in clinical medicine and the biological sciences. Emphasis is placed on contributions dealing with the practical, applications-led research on the use of methods and devices in clinical diagnosis, patient monitoring and management.
Biomedical Signal Processing and Control reflects the main areas in which these methods are being used and developed at the interface of both engineering and clinical science. The scope of the journal is defined to include relevant review papers, technical notes, short communications and letters. Tutorial papers and special issues will also be published.