{"title":"A multi-feature fusion graph attention network for decoding motor imagery intention in spinal cord injury patients.","authors":"Jiancai Leng, Licai Gao, Xiuquan Jiang, Yitai Lou, Yuan Sun, Chen Wang, Jun Li, Heng Zhao, Feng Chao, Fangzhou Xu, Yang Zhang, Tzyy-Ping Jung","doi":"10.1088/1741-2552/ad9403","DOIUrl":null,"url":null,"abstract":"<p><p>Electroencephalogram (EEG) signals exhibit multi-domain features, and electrode distributions follow non-Euclidean topology. To fully resolve the EEG signals, this study proposes a Temporal-Frequency-Spatial multi-domain feature fusion Graph Attention Network (TFSGAT) for motor imagery (MI) intention recognition in spinal cord injury (SCI) patients. The proposed model uses phase-locked value (PLV) to extract spatial phase connectivity information between EEG channels and continuous wavelet transform to extract valid EEG information in the time-frequency domain. It then models a graph data structure containing multi-domain information. The gated recurrent unit and GAT learn EEG's dynamic temporal-spatial information. Finally, the fully connected layer outputs the MI intention recognition results. After 10 times 10-fold cross-validation, the proposed model can achieve an average accuracy of 95.82%. Furthermore, this study analyzes the Event-Related Desynchronization/Event-Related Synchronization and PLV brain network to explore the brain activity of SCI patients during MI. This study confirms the potential of the proposed model in terms of EEG decoding performance and provides a reference for the mechanism of neural activity in SCI patients.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of neural engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1088/1741-2552/ad9403","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Electroencephalogram (EEG) signals exhibit multi-domain features, and electrode distributions follow non-Euclidean topology. To fully resolve the EEG signals, this study proposes a Temporal-Frequency-Spatial multi-domain feature fusion Graph Attention Network (TFSGAT) for motor imagery (MI) intention recognition in spinal cord injury (SCI) patients. The proposed model uses phase-locked value (PLV) to extract spatial phase connectivity information between EEG channels and continuous wavelet transform to extract valid EEG information in the time-frequency domain. It then models a graph data structure containing multi-domain information. The gated recurrent unit and GAT learn EEG's dynamic temporal-spatial information. Finally, the fully connected layer outputs the MI intention recognition results. After 10 times 10-fold cross-validation, the proposed model can achieve an average accuracy of 95.82%. Furthermore, this study analyzes the Event-Related Desynchronization/Event-Related Synchronization and PLV brain network to explore the brain activity of SCI patients during MI. This study confirms the potential of the proposed model in terms of EEG decoding performance and provides a reference for the mechanism of neural activity in SCI patients.