{"title":"用于提高 SSVEP-EEG 分类性能的高阶时空卷积网络","authors":"Jianli Yang, Songlei Zhao, Wei Zhang, Xiuling Liu","doi":"10.1016/j.irbm.2024.100830","DOIUrl":null,"url":null,"abstract":"<div><h3>Background and objective</h3><p>Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) aim to detect target frequencies corresponding to specific commands in electroencephalographic (EEG) signals by classification algorithms to achieve the desired control. However, SSVEP signals suffer from low signal-to-noise ratio and large differences in brain activity. Moreover, the existing CNN models have small receptive fields, which make it difficult to receive large range of feature information and limit the effectiveness of classification algorithms.</p></div><div><h3>Methods</h3><p>To this end, we proposed a high-order temporal convolutional neural network (HOT-CNN) model for enhancing the performance of SSVEP target recognition. Specifically, the SSVEP-EEG signals was divided into equal-length time segments and a time-slice attention module was designed to capture the correlation between time slices. The module improves the local characterization of signals and reduces biological noise interference by automatically assigning high weights to locally relevant temporal sampling cues and lower weights to other temporal cues. Moreover, for global features, a temporal convolutional network module was designed to increases the receptive field of the network and to extract more comprehensive time domain features by using dilated causal convolution. Finally, the fusion and analysis of local and global features are achieved by designing a feature fusion and classification module to accomplish accurate classification of SSVEP signals.</p></div><div><h3>Results</h3><p>Our method was evaluated on large publicly available datasets containing 35 subjects and 40 categories. Experimental results indicated that HOT-CNN achieved encouraging performance compared with other advanced methods: the highest information transfer rate of 241.01bits/min was obtained using 0.5s stimuli, and the highest average accuracy of 96.39% was obtained using 1.0s stimuli.</p></div><div><h3>Conclusions</h3><p>The method effectively reinforced the global and local time-domain information and improved the classification performance of SSVEP, which has wide application prospects.</p></div>","PeriodicalId":14605,"journal":{"name":"Irbm","volume":"45 2","pages":"Article 100830"},"PeriodicalIF":5.6000,"publicationDate":"2024-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"High-Order Temporal Convolutional Network for Improving Classification Performance of SSVEP-EEG\",\"authors\":\"Jianli Yang, Songlei Zhao, Wei Zhang, Xiuling Liu\",\"doi\":\"10.1016/j.irbm.2024.100830\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background and objective</h3><p>Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) aim to detect target frequencies corresponding to specific commands in electroencephalographic (EEG) signals by classification algorithms to achieve the desired control. However, SSVEP signals suffer from low signal-to-noise ratio and large differences in brain activity. Moreover, the existing CNN models have small receptive fields, which make it difficult to receive large range of feature information and limit the effectiveness of classification algorithms.</p></div><div><h3>Methods</h3><p>To this end, we proposed a high-order temporal convolutional neural network (HOT-CNN) model for enhancing the performance of SSVEP target recognition. Specifically, the SSVEP-EEG signals was divided into equal-length time segments and a time-slice attention module was designed to capture the correlation between time slices. The module improves the local characterization of signals and reduces biological noise interference by automatically assigning high weights to locally relevant temporal sampling cues and lower weights to other temporal cues. Moreover, for global features, a temporal convolutional network module was designed to increases the receptive field of the network and to extract more comprehensive time domain features by using dilated causal convolution. Finally, the fusion and analysis of local and global features are achieved by designing a feature fusion and classification module to accomplish accurate classification of SSVEP signals.</p></div><div><h3>Results</h3><p>Our method was evaluated on large publicly available datasets containing 35 subjects and 40 categories. Experimental results indicated that HOT-CNN achieved encouraging performance compared with other advanced methods: the highest information transfer rate of 241.01bits/min was obtained using 0.5s stimuli, and the highest average accuracy of 96.39% was obtained using 1.0s stimuli.</p></div><div><h3>Conclusions</h3><p>The method effectively reinforced the global and local time-domain information and improved the classification performance of SSVEP, which has wide application prospects.</p></div>\",\"PeriodicalId\":14605,\"journal\":{\"name\":\"Irbm\",\"volume\":\"45 2\",\"pages\":\"Article 100830\"},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2024-03-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Irbm\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1959031824000113\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Irbm","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1959031824000113","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
High-Order Temporal Convolutional Network for Improving Classification Performance of SSVEP-EEG
Background and objective
Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) aim to detect target frequencies corresponding to specific commands in electroencephalographic (EEG) signals by classification algorithms to achieve the desired control. However, SSVEP signals suffer from low signal-to-noise ratio and large differences in brain activity. Moreover, the existing CNN models have small receptive fields, which make it difficult to receive large range of feature information and limit the effectiveness of classification algorithms.
Methods
To this end, we proposed a high-order temporal convolutional neural network (HOT-CNN) model for enhancing the performance of SSVEP target recognition. Specifically, the SSVEP-EEG signals was divided into equal-length time segments and a time-slice attention module was designed to capture the correlation between time slices. The module improves the local characterization of signals and reduces biological noise interference by automatically assigning high weights to locally relevant temporal sampling cues and lower weights to other temporal cues. Moreover, for global features, a temporal convolutional network module was designed to increases the receptive field of the network and to extract more comprehensive time domain features by using dilated causal convolution. Finally, the fusion and analysis of local and global features are achieved by designing a feature fusion and classification module to accomplish accurate classification of SSVEP signals.
Results
Our method was evaluated on large publicly available datasets containing 35 subjects and 40 categories. Experimental results indicated that HOT-CNN achieved encouraging performance compared with other advanced methods: the highest information transfer rate of 241.01bits/min was obtained using 0.5s stimuli, and the highest average accuracy of 96.39% was obtained using 1.0s stimuli.
Conclusions
The method effectively reinforced the global and local time-domain information and improved the classification performance of SSVEP, which has wide application prospects.
期刊介绍:
IRBM is the journal of the AGBM (Alliance for engineering in Biology an Medicine / Alliance pour le génie biologique et médical) and the SFGBM (BioMedical Engineering French Society / Société française de génie biologique médical) and the AFIB (French Association of Biomedical Engineers / Association française des ingénieurs biomédicaux).
As a vehicle of information and knowledge in the field of biomedical technologies, IRBM is devoted to fundamental as well as clinical research. Biomedical engineering and use of new technologies are the cornerstones of IRBM, providing authors and users with the latest information. Its six issues per year propose reviews (state-of-the-art and current knowledge), original articles directed at fundamental research and articles focusing on biomedical engineering. All articles are submitted to peer reviewers acting as guarantors for IRBM''s scientific and medical content. The field covered by IRBM includes all the discipline of Biomedical engineering. Thereby, the type of papers published include those that cover the technological and methodological development in:
-Physiological and Biological Signal processing (EEG, MEG, ECG…)-
Medical Image processing-
Biomechanics-
Biomaterials-
Medical Physics-
Biophysics-
Physiological and Biological Sensors-
Information technologies in healthcare-
Disability research-
Computational physiology-
…