首页 > 最新文献

Brain Science Advances最新文献

英文 中文
Overview of recognition methods for SSVEP-based BCIs in World Robot Contest 2022: MATLAB undergraduate group 2022年世界机器人大赛基于ssvep的脑机接口识别方法综述:MATLAB本科组
Pub Date : 2023-09-01 DOI: 10.26599/BSA.2023.9050018
Chengzhi Yi, Yuxuan Wu, Fan Ye, Xinchen Zhang, Jingjing Chen
The steady-state visual evoked potential (SSVEP)-based speller has emerged as a widely adopted paradigm in current brain–computer interface (BCI) systems due to its rapid processing and consistent performance across different individuals. Calibration-free SSVEP algorithms, as opposed to their calibration-based counterparts, offer clear and intuitive mathematical principles, making them accessible to novice developers. During the World Robot Contest (WRC) 2022, participants in the undergraduate category utilized various approaches to accomplish target detection in the calibration-free setting, successfully implementing the algorithms using MATLAB. The winning approach achieved an average information transfer rate of 198.94 bits/min in the final test, which is notably high given the calibration-free scenario. This paper presents an introduction to the underlying principles of the selected methods, accompanied by a comparison of their effectiveness through analysis of results from both the final test and offline experiments. Additionally, we propose that the youth competition of WRC could serve as an ideal starting point for beginners interested in studying and developing their own BCI systems.
基于稳态视觉诱发电位(SSVEP)的拼写方法因其快速处理和在不同个体间的一致表现而成为当前脑机接口(BCI)系统中广泛采用的一种范式。与基于校准的SSVEP算法相反,无需校准的SSVEP算法提供了清晰直观的数学原理,使新手开发人员可以访问它们。在2022年世界机器人大赛(WRC)期间,本科生组的参与者利用各种方法在无校准设置下完成目标检测,并成功地使用MATLAB实现了算法。在最后的测试中,获胜的方法实现了198.94 bit /min的平均信息传输速率,在无校准的情况下,这是非常高的。本文介绍了所选方法的基本原理,并通过分析最终测试和离线实验的结果对其有效性进行了比较。此外,我们建议WRC的青少年比赛可以作为对研究和开发自己的BCI系统感兴趣的初学者的理想起点。
{"title":"Overview of recognition methods for SSVEP-based BCIs in World Robot Contest 2022: MATLAB undergraduate group","authors":"Chengzhi Yi, Yuxuan Wu, Fan Ye, Xinchen Zhang, Jingjing Chen","doi":"10.26599/BSA.2023.9050018","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050018","url":null,"abstract":"The steady-state visual evoked potential (SSVEP)-based speller has emerged as a widely adopted paradigm in current brain–computer interface (BCI) systems due to its rapid processing and consistent performance across different individuals. Calibration-free SSVEP algorithms, as opposed to their calibration-based counterparts, offer clear and intuitive mathematical principles, making them accessible to novice developers. During the World Robot Contest (WRC) 2022, participants in the undergraduate category utilized various approaches to accomplish target detection in the calibration-free setting, successfully implementing the algorithms using MATLAB. The winning approach achieved an average information transfer rate of 198.94 bits/min in the final test, which is notably high given the calibration-free scenario. This paper presents an introduction to the underlying principles of the selected methods, accompanied by a comparison of their effectiveness through analysis of results from both the final test and offline experiments. Additionally, we propose that the youth competition of WRC could serve as an ideal starting point for beginners interested in studying and developing their own BCI systems.","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43871430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A review of deep learning methods for cross-subject rapid serial visual presentation detection in World Robot Contest 2022 2022年世界机器人大赛中跨学科快速连续视觉呈现检测的深度学习方法综述
Pub Date : 2023-09-01 DOI: 10.26599/BSA.2023.9050013
Zehui Wang, Hongfei Zhang, Zhouyu Ji, Yuliang Yang, Hongtao Wang
The rapid serial visual presentation (RSVP) paradigm has garnered considerable attention in brain–computer interface (BCI) systems. Studies have focused on using cross-subject electroencephalogram data to train cross-subject RSVP detection models. In this study, we performed a comparative analysis of the top 5 deep learning algorithms used by various teams in the event-related potential competition of the BCI Controlled Robot Contest in World Robot Contest 2022. We evaluated these algorithms on the final data set and compared their performance in cross-subject RSVP detection. The results revealed that deep learning models can achieve excellent results with appropriate training methods when applied to cross-subject detection tasks. We discussed the limitations of existing deep learning algorithms in cross-subject RSVP detection and highlighted potential research directions.
快速序列视觉呈现(RSVP)范式在脑机接口(BCI)系统中引起了相当大的关注。研究的重点是使用跨受试者脑电图数据来训练跨受试人呼吸道合胞病毒检测模型。在这项研究中,我们对2022年世界机器人大赛脑机接口控制机器人大赛项目相关潜力竞赛中各团队使用的前5种深度学习算法进行了比较分析。我们在最终数据集上评估了这些算法,并比较了它们在跨受试者RSVP检测中的性能。结果表明,深度学习模型在应用于跨学科检测任务时,通过适当的训练方法可以取得优异的结果。我们讨论了现有深度学习算法在跨学科RSVP检测中的局限性,并强调了潜在的研究方向。
{"title":"A review of deep learning methods for cross-subject rapid serial visual presentation detection in World Robot Contest 2022","authors":"Zehui Wang, Hongfei Zhang, Zhouyu Ji, Yuliang Yang, Hongtao Wang","doi":"10.26599/BSA.2023.9050013","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050013","url":null,"abstract":"The rapid serial visual presentation (RSVP) paradigm has garnered considerable attention in brain–computer interface (BCI) systems. Studies have focused on using cross-subject electroencephalogram data to train cross-subject RSVP detection models. In this study, we performed a comparative analysis of the top 5 deep learning algorithms used by various teams in the event-related potential competition of the BCI Controlled Robot Contest in World Robot Contest 2022. We evaluated these algorithms on the final data set and compared their performance in cross-subject RSVP detection. The results revealed that deep learning models can achieve excellent results with appropriate training methods when applied to cross-subject detection tasks. We discussed the limitations of existing deep learning algorithms in cross-subject RSVP detection and highlighted potential research directions.","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42960946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Overview of the winning approaches in 2022 World Robot Contest Championship–Asynchronous SSVEP 2022年世界机器人大赛锦标赛获奖方法综述——异步SSVEP
Pub Date : 2023-09-01 DOI: 10.26599/BSA.2023.9050010
Zhenbang Du, Rui Bian, Dongrui Wu
In recent years, the steady-state visual evoked potential (SSVEP) electroencephalogram paradigm has gained considerable attention owing to its high information transfer rate. Several approaches have been proposed to improve the performance of SSVEP-based brain–computer interface (BCI) systems. In SSVEP-based BCIs, the asynchronous scenario poses a challenge as the subjects stare at the screen without synchronization signals from the system. The algorithm must distinguish whether the subject is being stimulated or not, which presents a significant challenge for accurate classification. In the 2022 World Robot Contest Championship, several effective algorithm frameworks were proposed by participating teams to address this issue in the SSVEP competition. The efficacy of the approaches employed by five teams in the final round is demonstrated in this study, and an overview of their methods is provided. Based on the final score, this paper presents a comparative analysis of five algorithms that propose distinct asynchronous recognition frameworks via diverse statistical methods to differentiate between intentional control state and non-control state based on dynamic window strategies. These algorithms achieve an impressive information transfer rate of 89.833 and a low false positive rate of 0.073. This study provides an overview of the algorithms employed by different teams to address asynchronous scenarios in SSVEP-based BCIs and identifies potential future avenues for research in this area.
近年来,稳态视觉诱发电位(SSVEP)脑电图范式由于其较高的信息传递率而引起了人们的广泛关注。已经提出了几种方法来提高基于SSVEP的脑机接口(BCI)系统的性能。在基于SSVEP的脑机接口中,异步场景带来了挑战,因为受试者在没有来自系统的同步信号的情况下盯着屏幕看。该算法必须区分受试者是否受到刺激,这对准确分类提出了重大挑战。在2022年世界机器人大赛锦标赛上,参赛团队提出了几个有效的算法框架,以解决SSVEP比赛中的这一问题。本研究展示了五个团队在最后一轮中采用的方法的有效性,并对其方法进行了概述。基于最终得分,本文对五种算法进行了比较分析,这些算法通过不同的统计方法提出了不同的异步识别框架,以区分基于动态窗口策略的有意控制状态和非控制状态。这些算法实现了89.833的令人印象深刻的信息传输率和0.073的低误报率。本研究概述了不同团队在基于SSVEP的脑机接口中处理异步场景所使用的算法,并确定了该领域未来研究的潜在途径。
{"title":"Overview of the winning approaches in 2022 World Robot Contest Championship–Asynchronous SSVEP","authors":"Zhenbang Du, Rui Bian, Dongrui Wu","doi":"10.26599/BSA.2023.9050010","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050010","url":null,"abstract":"In recent years, the steady-state visual evoked potential (SSVEP) electroencephalogram paradigm has gained considerable attention owing to its high information transfer rate. Several approaches have been proposed to improve the performance of SSVEP-based brain–computer interface (BCI) systems. In SSVEP-based BCIs, the asynchronous scenario poses a challenge as the subjects stare at the screen without synchronization signals from the system. The algorithm must distinguish whether the subject is being stimulated or not, which presents a significant challenge for accurate classification. In the 2022 World Robot Contest Championship, several effective algorithm frameworks were proposed by participating teams to address this issue in the SSVEP competition. The efficacy of the approaches employed by five teams in the final round is demonstrated in this study, and an overview of their methods is provided. Based on the final score, this paper presents a comparative analysis of five algorithms that propose distinct asynchronous recognition frameworks via diverse statistical methods to differentiate between intentional control state and non-control state based on dynamic window strategies. These algorithms achieve an impressive information transfer rate of 89.833 and a low false positive rate of 0.073. This study provides an overview of the algorithms employed by different teams to address asynchronous scenarios in SSVEP-based BCIs and identifies potential future avenues for research in this area.","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49450719","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Algorithm contest of motor imagery BCI in the World Robot Contest 2022: A survey 2022年世界机器人大赛运动图像脑机接口算法竞赛:调查
Pub Date : 2023-09-01 DOI: 10.26599/BSA.2023.9050011
Jiayu An, Xinru Chen, Dongrui Wu
From August 19 to 21, 2022, the BCI Controlled Robot Contest finals in the World Robot Contest 2022 were held in Beijing, China. Fifteen teams participated in the finals in the Algorithm Contest of Motor Imagery BCI. This paper introduces the algorithms in the motor imagery (MI) classification area, describes the competition content and set, and summarizes the algorithms and results of the top five teams in the finals. First, the MI paradigm and the overview of the existing motor imagery brain–computer interface classification algorithms are introduced, followed by the introduction of the algorithms of the top five teams in the final step by step, including electroencephalography channel selection, data length selection, data preprocessing, data augmentation, classification network, training, and testing settings. Finally, the highlights and results of each algorithm are discussed.
2022年8月19日至21日,2022年世界机器人大赛BCI控制机器人大赛决赛在中国北京举行。15支队伍参加了运动意象BCI算法大赛的决赛。本文介绍了运动意象(MI)分类领域的算法,描述了比赛内容和设置,总结了决赛前五名队伍的算法和结果。首先介绍MI范式和现有运动图像脑机接口分类算法概述,最后一步介绍前五名团队的算法,包括脑电图通道选择、数据长度选择、数据预处理、数据增强、分类网络、训练和测试设置。最后,讨论了各算法的重点和结果。
{"title":"Algorithm contest of motor imagery BCI in the World Robot Contest 2022: A survey","authors":"Jiayu An, Xinru Chen, Dongrui Wu","doi":"10.26599/BSA.2023.9050011","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050011","url":null,"abstract":"From August 19 to 21, 2022, the BCI Controlled Robot Contest finals in the World Robot Contest 2022 were held in Beijing, China. Fifteen teams participated in the finals in the Algorithm Contest of Motor Imagery BCI. This paper introduces the algorithms in the motor imagery (MI) classification area, describes the competition content and set, and summarizes the algorithms and results of the top five teams in the finals. First, the MI paradigm and the overview of the existing motor imagery brain–computer interface classification algorithms are introduced, followed by the introduction of the algorithms of the top five teams in the final step by step, including electroencephalography channel selection, data length selection, data preprocessing, data augmentation, classification network, training, and testing settings. Finally, the highlights and results of each algorithm are discussed.","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46695210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Winning algorithms in BCI Controlled Robot Contest in World Robot Contest 2022: BCI Turing Test 2022年世界机器人大赛脑机接口控制机器人竞赛获胜算法:脑机接口-图灵测试
Pub Date : 2023-09-01 DOI: 10.26599/BSA.2023.9050012
Hangjie Yi, Dongjun Liu, Xuanyu Jin, Han-mei Zhang, Wanzeng Kong
The Turing Test is a method of testing whether a machine has human intelligence. A novel brain–computer interface (BCI) Turing Test was proposed in the BCI Controlled Robot Contest in World Robot Contest 2022. Contestants developed algorithms that can distinguish if an instruction is issued by a human. Participants collaborated with an electroencephalogram-based BCI to play a soccer game in a virtual scenario. Participants were asked to perform steady-state visual evoked potential (SSVEP) tasks or motor imagery (MI) tasks to control the robots or be in an idle state to mimic the system giving instructions on behalf of the participants. Several algorithms proposed in this competition are developed based on the concept that the idle state is a category in multiclass classification problems. This paper details the algorithms of the top five teams with the best performance in the final, lists the popular classification models and algorithms for MI and SSVEP, and discusses the effectiveness of each approach in improving classification performance and reducing the computation time.
图灵测试是一种测试机器是否具有人类智能的方法。在2022年世界机器人大赛的脑机接口控制机器人竞赛中,提出了一种新的脑机界面图灵测试方法。参赛者开发了算法,可以区分指令是否由人类发出。参与者与基于脑电图的脑机接口合作,在虚拟场景中玩足球游戏。参与者被要求执行稳态视觉诱发电位(SSVEP)任务或运动图像(MI)任务来控制机器人,或处于空闲状态以模仿代表参与者发出指令的系统。基于空闲状态是多类分类问题中的一个类别的概念,开发了本次竞赛中提出的几种算法。本文详细介绍了决赛中表现最好的前五支队伍的算法,列出了MI和SSVEP的流行分类模型和算法,并讨论了每种方法在提高分类性能和减少计算时间方面的有效性。
{"title":"Winning algorithms in BCI Controlled Robot Contest in World Robot Contest 2022: BCI Turing Test","authors":"Hangjie Yi, Dongjun Liu, Xuanyu Jin, Han-mei Zhang, Wanzeng Kong","doi":"10.26599/BSA.2023.9050012","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050012","url":null,"abstract":"The Turing Test is a method of testing whether a machine has human intelligence. A novel brain–computer interface (BCI) Turing Test was proposed in the BCI Controlled Robot Contest in World Robot Contest 2022. Contestants developed algorithms that can distinguish if an instruction is issued by a human. Participants collaborated with an electroencephalogram-based BCI to play a soccer game in a virtual scenario. Participants were asked to perform steady-state visual evoked potential (SSVEP) tasks or motor imagery (MI) tasks to control the robots or be in an idle state to mimic the system giving instructions on behalf of the participants. Several algorithms proposed in this competition are developed based on the concept that the idle state is a category in multiclass classification problems. This paper details the algorithms of the top five teams with the best performance in the final, lists the popular classification models and algorithms for MI and SSVEP, and discusses the effectiveness of each approach in improving classification performance and reducing the computation time.","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46756984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multimodal biofeedback for Parkinson’s disease motor and nonmotor symptoms 帕金森病运动和非运动症状的多模式生物反馈
Pub Date : 2023-06-01 DOI: 10.26599/BSA.2023.9050015
Zhongyan Shi, Lei Ding, Xingyu Han, Bo Jiang, Jiangtao Zhang, Dingjie Suo, Jinglong Wu, Guangying Pei, Boyan Fang, Tianyi Yan
Parkinson’s disease (PD) is a neurodegenerative disorder characterized by motor retardation, myotonia, quiescent tremor, and postural gait abnormality, as well as nonmotor symptoms such as anxiety and depression. Biofeedback improves motor and nonmotor functions of patients by regulating abnormal electroencephalogram (EEG), electrocardiogram (ECG), photoplethysmography (PPG), electromyography (EMG), respiration (RSP), or other physiological signals. Given that multimodal signals are closely related to PD states, the clinical effect of multimodal biofeedback on patients with PD is worth exploring. Twenty-one patients with PD in Beijing Rehabilitation Hospital were enrolled and divided into three groups: multimodal (EEG, ECG, PPG, and RSP feedback signal), EEG (EEG feedback signal), and sham (random feedback signal), and they received biofeedback training five times in two weeks. The combined clinical scale and multimodal signal analysis results revealed that the EEG group significantly improved motor symptoms and increased Berg balance scale scores by regulating β band activity; the multimodal group significantly improved nonmotor symptoms and reduced Hamilton rating scale for depression scores by improving θ band activity. Our preliminary results revealed that multimodal biofeedback can improve the clinical symptoms of PD, but the regulation effect on motor symptoms is weaker than that of EEG biofeedback.
帕金森病(PD)是一种神经退行性疾病,其特征是运动迟缓、肌强直、静止性震颤和姿势步态异常,以及焦虑和抑郁等非运动症状。生物反馈通过调节异常脑电图(EEG)、心电图(ECG)、光体积描记术(PPG)、肌电图(EMG)、呼吸(RSP)或其他生理信号来改善患者的运动和非运动功能。鉴于多模式信号与PD状态密切相关,多模式生物反馈对PD患者的临床效果值得探索。将北京康复医院的21例帕金森病患者分为三组:多模式(EEG、ECG、PPG和RSP反馈信号)、EEG(EEG反馈信号)和sham(随机反馈信号),并在两周内接受5次生物反馈训练。综合临床量表和多模式信号分析结果显示,EEG组通过调节β带活动显著改善运动症状,增加Berg平衡量表评分;多模式组通过改善θ带活动,显著改善了非运动症状,并降低了抑郁评分的汉密尔顿评分。我们的初步结果表明,多模式生物反馈可以改善帕金森病的临床症状,但对运动症状的调节作用弱于脑电图生物反馈。
{"title":"Multimodal biofeedback for Parkinson’s disease motor and nonmotor symptoms","authors":"Zhongyan Shi, Lei Ding, Xingyu Han, Bo Jiang, Jiangtao Zhang, Dingjie Suo, Jinglong Wu, Guangying Pei, Boyan Fang, Tianyi Yan","doi":"10.26599/BSA.2023.9050015","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050015","url":null,"abstract":"Parkinson’s disease (PD) is a neurodegenerative disorder characterized by motor retardation, myotonia, quiescent tremor, and postural gait abnormality, as well as nonmotor symptoms such as anxiety and depression. Biofeedback improves motor and nonmotor functions of patients by regulating abnormal electroencephalogram (EEG), electrocardiogram (ECG), photoplethysmography (PPG), electromyography (EMG), respiration (RSP), or other physiological signals. Given that multimodal signals are closely related to PD states, the clinical effect of multimodal biofeedback on patients with PD is worth exploring. Twenty-one patients with PD in Beijing Rehabilitation Hospital were enrolled and divided into three groups: multimodal (EEG, ECG, PPG, and RSP feedback signal), EEG (EEG feedback signal), and sham (random feedback signal), and they received biofeedback training five times in two weeks. The combined clinical scale and multimodal signal analysis results revealed that the EEG group significantly improved motor symptoms and increased Berg balance scale scores by regulating β band activity; the multimodal group significantly improved nonmotor symptoms and reduced Hamilton rating scale for depression scores by improving θ band activity. Our preliminary results revealed that multimodal biofeedback can improve the clinical symptoms of PD, but the regulation effect on motor symptoms is weaker than that of EEG biofeedback.","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49075938","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Transformer-based ensemble deep learning model for EEG-based emotion recognition 基于变压器的集成深度学习模型用于基于脑电图的情感识别
Pub Date : 2023-06-01 DOI: 10.26599/BSA.2023.9050016
Xiaopeng Si, Dong Huang, Yulin Sun, Shudi Huang, He Huang, Dong Ming
Emotion recognition is one of the most important research directions in the field of brain–computer interface (BCI). However, to conduct electroencephalogram (EEG)-based emotion recognition, there exist difficulties regarding EEG signal processing; moreover, the performance of classification models in this regard is restricted. To counter these issues, the 2022 World Robot Contest successfully held an affective BCI competition, thus promoting the innovation of EEG-based emotion recognition. In this paper, we propose the Transformer-based ensemble (TBEM) deep learning model. TBEM comprises two models: a pure convolutional neural network (CNN) model and a cascaded CNN-Transformer hybrid model. The proposed model won the abovementioned affective BCI competition’s final championship in the 2022 World Robot Contest, demonstrating the effectiveness of the proposed TBEM deep learning model for EEG-based emotion recognition.
情绪识别是脑机接口领域最重要的研究方向之一。然而,要进行基于脑电图的情绪识别,在脑电信号处理方面存在困难;此外,分类模型在这方面的性能受到限制。为了应对这些问题,2022年世界机器人大赛成功举办了情感脑机接口比赛,从而推动了基于脑电的情感识别的创新。在本文中,我们提出了基于Transformer的集成(TBEM)深度学习模型。TBEM包括两个模型:纯卷积神经网络(CNN)模型和级联CNNTransformer混合模型。所提出的模型在2022年世界机器人大赛中赢得了上述情感脑机接口竞赛的最终冠军,证明了所提出的TBEM深度学习模型在基于脑电的情感识别中的有效性。
{"title":"Transformer-based ensemble deep learning model for EEG-based emotion recognition","authors":"Xiaopeng Si, Dong Huang, Yulin Sun, Shudi Huang, He Huang, Dong Ming","doi":"10.26599/BSA.2023.9050016","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050016","url":null,"abstract":"Emotion recognition is one of the most important research directions in the field of brain–computer interface (BCI). However, to conduct electroencephalogram (EEG)-based emotion recognition, there exist difficulties regarding EEG signal processing; moreover, the performance of classification models in this regard is restricted. To counter these issues, the 2022 World Robot Contest successfully held an affective BCI competition, thus promoting the innovation of EEG-based emotion recognition. In this paper, we propose the Transformer-based ensemble (TBEM) deep learning model. TBEM comprises two models: a pure convolutional neural network (CNN) model and a cascaded CNN-Transformer hybrid model. The proposed model won the abovementioned affective BCI competition’s final championship in the 2022 World Robot Contest, demonstrating the effectiveness of the proposed TBEM deep learning model for EEG-based emotion recognition.","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44751864","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multi-modal neuroimaging technique: Innovations and applications 多模态神经成像技术的创新与应用
Pub Date : 2023-06-01 DOI: 10.26599/BSA.2023.9050017
Bin Wang, Tianyi Yan
1 College of Computer Science and Technology, Taiyuan University of Technology, Jinzhong 030600, Shanxi, China 2 School of Life Science, Beijing Institute of Technology, Beijing 100081, China In the last two decades, neuroimaging techniques have made quite a splash in not only our general understanding of healthy brain working mechanisms but also in gaining a better understanding of cognitive system alterations in brain disorders, such as Alzheimer’s disease (AD), Parkinson’s disease (PD) and schizophrenia (SZ), bipolar disorder (BD), etc. Multi-modal neuroimaging techniques usually includes electroencephalography (EEG), magnetic resonance imaging (MRI), magnetoencephalography (MEG), positron emission tomography (PET), near-infrared spectroscopy (NIRS). Compared with singlemodal neuroimaging technique, multi-modal neuroimaging techniques should significantly contribute to the brain working mechanisms, and promote to identify more valuable information of potential neurobiological markers, and improve the diagnosis accuracy of neurological diseases. The special session includes five papers contributed by experts who have been studying the conceptual and methodological innovations as well as practical applications of the multimodal neuroimaging techniques. Niu and his colleague [1] focused on how the network complexity changes driving spontaneous functional MRI (fMRI) activity in SZ and BD patients. Functional entropy (FE) is a novel way of measuring the dispersion (or spread) of functional connectivities inside the brain. The FE of SZ and BD patients was considerably lower than that of normal control (NC). At the intramodule level, the FE of SZ was substantially higher than that of BD in the cingulo-opercular network. Moreover, a strong negative association between FE and clinical measures was discovered in patient groups. This paper proposed that network connectivity’s complexity analyses using FE can provide important insights for the diagnosis of mental illness. Top-down attention mechanisms require the selection of specific objects or locations; however, the brain mechanism involved when attention is allocated across different modalities is not well understood. Guan and his colleague [2] define the neural mechanisms underlying divided and selective spatial attention by fMRI and Posner paradigm with concurrent audiovisual. They explored the audiovisual top-down allocation of attention and observed the differences in neural mechanisms under endogenous attention modes, which revealed the differences in cross-modal expression in visual and auditory attention under attentional modulation. Specially, the differences in the activation level of the frontoparietal network, visual/auditory cortex, the putamen and the
1太原理工大学计算机科学与技术学院,山西晋中030600 2北京理工大学生命科学学院,北京100081在过去的二十年中,神经成像技术不仅在我们对健康大脑工作机制的一般认识方面取得了相当大的成就,而且在更好地了解大脑疾病(如阿尔茨海默病(AD))的认知系统改变方面取得了很大的进展。帕金森病(PD)、精神分裂症(SZ)、双相情感障碍(BD)等。多模态神经成像技术通常包括脑电图(EEG)、磁共振成像(MRI)、脑磁图(MEG)、正电子发射断层扫描(PET)、近红外光谱(NIRS)。与单模态神经成像技术相比,多模态神经成像技术应能显著促进大脑工作机制的研究,有助于发现更多有价值的潜在神经生物学标志物信息,提高神经系统疾病的诊断准确性。专题会议包括由研究多模态神经成像技术的概念和方法创新以及实际应用的专家撰写的五篇论文。Niu和他的同事[1]专注于网络复杂性变化如何驱动SZ和BD患者的自发功能MRI (fMRI)活动。功能熵(Functional entropy, FE)是一种测量大脑内部功能连接分散(或扩散)的新方法。SZ和BD患者的FE明显低于正常对照(NC)。在模内水平,SZ在扣膜-眼窝网络中的FE明显高于BD。此外,在患者组中发现FE与临床措施之间存在强烈的负相关。本文提出利用有限元分析网络连通性的复杂性可以为精神疾病的诊断提供重要的见解。自上而下的注意机制要求选择特定的对象或位置;然而,当注意力被分配到不同的模式时,所涉及的大脑机制还没有得到很好的理解。Guan和他的同事[2]通过fMRI和Posner范式定义了具有并发视听的分裂和选择性空间注意的神经机制。他们探讨了视听自上而下的注意分配,并观察了内源性注意模式下神经机制的差异,揭示了注意调节下视觉和听觉注意跨模态表达的差异。特别是,大脑额顶叶网络、视觉/听觉皮层、壳核和脑皮层的激活水平差异
{"title":"Multi-modal neuroimaging technique: Innovations and applications","authors":"Bin Wang, Tianyi Yan","doi":"10.26599/BSA.2023.9050017","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050017","url":null,"abstract":"1 College of Computer Science and Technology, Taiyuan University of Technology, Jinzhong 030600, Shanxi, China 2 School of Life Science, Beijing Institute of Technology, Beijing 100081, China In the last two decades, neuroimaging techniques have made quite a splash in not only our general understanding of healthy brain working mechanisms but also in gaining a better understanding of cognitive system alterations in brain disorders, such as Alzheimer’s disease (AD), Parkinson’s disease (PD) and schizophrenia (SZ), bipolar disorder (BD), etc. Multi-modal neuroimaging techniques usually includes electroencephalography (EEG), magnetic resonance imaging (MRI), magnetoencephalography (MEG), positron emission tomography (PET), near-infrared spectroscopy (NIRS). Compared with singlemodal neuroimaging technique, multi-modal neuroimaging techniques should significantly contribute to the brain working mechanisms, and promote to identify more valuable information of potential neurobiological markers, and improve the diagnosis accuracy of neurological diseases. The special session includes five papers contributed by experts who have been studying the conceptual and methodological innovations as well as practical applications of the multimodal neuroimaging techniques. Niu and his colleague [1] focused on how the network complexity changes driving spontaneous functional MRI (fMRI) activity in SZ and BD patients. Functional entropy (FE) is a novel way of measuring the dispersion (or spread) of functional connectivities inside the brain. The FE of SZ and BD patients was considerably lower than that of normal control (NC). At the intramodule level, the FE of SZ was substantially higher than that of BD in the cingulo-opercular network. Moreover, a strong negative association between FE and clinical measures was discovered in patient groups. This paper proposed that network connectivity’s complexity analyses using FE can provide important insights for the diagnosis of mental illness. Top-down attention mechanisms require the selection of specific objects or locations; however, the brain mechanism involved when attention is allocated across different modalities is not well understood. Guan and his colleague [2] define the neural mechanisms underlying divided and selective spatial attention by fMRI and Posner paradigm with concurrent audiovisual. They explored the audiovisual top-down allocation of attention and observed the differences in neural mechanisms under endogenous attention modes, which revealed the differences in cross-modal expression in visual and auditory attention under attentional modulation. Specially, the differences in the activation level of the frontoparietal network, visual/auditory cortex, the putamen and the","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47594131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Neural mechanisms of top-down divided and selective spatial attention in visual and auditory perception 视觉和听觉自上而下分割和选择性空间注意的神经机制
Pub Date : 2023-06-01 DOI: 10.26599/BSA.2023.9050008
Zhongtian Guan, Meng Lin, Qiong Wu, Jinglong Wu, Kewei Chen, Hongbin Han, D. Chui, Xu Zhang, Chunlin Li
Top-down attention mechanisms require the selection of specific objects or locations; however, the brain mechanism involved when attention is allocated across different modalities is not well understood. The aim of this study was to use functional magnetic resonance imaging to define the neural mechanisms underlying divided and selective spatial attention. A concurrent audiovisual stimulus was used, and subjects were prompted to focus on a visual, auditory and audiovisual stimulus in a Posner paradigm. Our behavioral results confirmed the better performance of selective attention compared to devided attention. We found differences in the activation level of the frontoparietal network, visual/auditory cortex, the putamen and the salience network under different attention conditions. We further used Granger causality (GC) to explore effective connectivity differences between tasks. Differences in GC connectivity between visual and auditory selective tasks reflected the visual dominance effect under spatial attention. In addition, our results supported the role of the putamen in redistributing attention and the functional separation of the salience network. In summary, we explored the audiovisual top-down allocation of attention and observed the differences in neural mechanisms under endogenous attention modes, which revealed the differences in cross-modal expression in visual and auditory attention under attentional modulation.
自上而下的注意力机制需要选择特定的对象或位置;然而,当注意力被分配到不同的模式时,所涉及的大脑机制还没有得到很好的理解。本研究的目的是使用功能性磁共振成像来定义划分和选择性空间注意力的神经机制。同时使用视听刺激,并提示受试者在波斯纳范式中专注于视觉、听觉和视听刺激。我们的行为结果证实了选择性注意力与非选择性注意力相比有更好的表现。我们发现,在不同的注意条件下,额顶顶网络、视觉/听觉皮层、壳核和显著性网络的激活水平存在差异。我们进一步使用格兰杰因果关系(GC)来探索任务之间的有效连通性差异。视觉和听觉选择性任务之间GC连接的差异反映了空间注意下的视觉优势效应。此外,我们的研究结果支持了壳核在注意力再分配和显著性网络功能分离中的作用。总之,我们探索了视听自上而下的注意力分配,并观察了内源性注意力模式下神经机制的差异,揭示了注意力调节下视觉和听觉注意力跨模态表达的差异。
{"title":"Neural mechanisms of top-down divided and selective spatial attention in visual and auditory perception","authors":"Zhongtian Guan, Meng Lin, Qiong Wu, Jinglong Wu, Kewei Chen, Hongbin Han, D. Chui, Xu Zhang, Chunlin Li","doi":"10.26599/BSA.2023.9050008","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050008","url":null,"abstract":"Top-down attention mechanisms require the selection of specific objects or locations; however, the brain mechanism involved when attention is allocated across different modalities is not well understood. The aim of this study was to use functional magnetic resonance imaging to define the neural mechanisms underlying divided and selective spatial attention. A concurrent audiovisual stimulus was used, and subjects were prompted to focus on a visual, auditory and audiovisual stimulus in a Posner paradigm. Our behavioral results confirmed the better performance of selective attention compared to devided attention. We found differences in the activation level of the frontoparietal network, visual/auditory cortex, the putamen and the salience network under different attention conditions. We further used Granger causality (GC) to explore effective connectivity differences between tasks. Differences in GC connectivity between visual and auditory selective tasks reflected the visual dominance effect under spatial attention. In addition, our results supported the role of the putamen in redistributing attention and the functional separation of the salience network. In summary, we explored the audiovisual top-down allocation of attention and observed the differences in neural mechanisms under endogenous attention modes, which revealed the differences in cross-modal expression in visual and auditory attention under attentional modulation.","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48345525","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Brain asymmetry: a novel perspective on hemispheric network 大脑不对称:半球网络的新视角
Pub Date : 2023-06-01 DOI: 10.26599/BSA.2023.9050014
Bin Wang, Lan Yang, Wenjie Yan, Weichao An, Jie Xiang, Dandan Li
Brain asymmetry, involving structural and functional differences between the two hemispheres, is a major organizational principle of the human brain. The structural and functional connectivity within each hemisphere defines the hemispheric network or connectome. Elucidating left-right differences of the hemispheric network provides opportunities for brain asymmetry exploration. This review examines the asymmetry in the hemispheric white matter and functional network to assess health and brain disorders. In this article, the brain asymmetry in structural and functional connectivity including network topologies of healthy individuals, involving brain cognitive systems and the development trend, is highlighted. Moreover, the abnormal asymmetry of the hemispheric network related to cognition changes in brain disorders, such as Alzheimer’s disease, schizophrenia, autism spectrum disorder, attention deficit hyperactivity disorder, and bipolar disorder, is presented. This review suggests that the hemispheric network is highly conserved for measuring human brain asymmetries and has potential in the study of the cognitive system and brain disorders.
大脑不对称,涉及到两个半球的结构和功能差异,是人类大脑的一个主要组织原则。每个半球的结构和功能连接定义了半球网络或连接体。阐明左右半球网络的差异为探索大脑不对称性提供了机会。本文综述了半球白质和功能网络的不对称性,以评估健康和大脑疾病。本文重点介绍了健康个体大脑认知系统在结构和功能连接(包括网络拓扑)方面的不对称性及其发展趋势。此外,在阿尔茨海默病、精神分裂症、自闭症谱系障碍、注意缺陷多动障碍和双相情感障碍等脑部疾病中,与认知变化相关的半球网络异常不对称也被提出。这一综述表明,半球网络在测量人类大脑不对称性方面是高度保守的,在认知系统和大脑疾病的研究中具有潜力。
{"title":"Brain asymmetry: a novel perspective on hemispheric network","authors":"Bin Wang, Lan Yang, Wenjie Yan, Weichao An, Jie Xiang, Dandan Li","doi":"10.26599/BSA.2023.9050014","DOIUrl":"https://doi.org/10.26599/BSA.2023.9050014","url":null,"abstract":"Brain asymmetry, involving structural and functional differences between the two hemispheres, is a major organizational principle of the human brain. The structural and functional connectivity within each hemisphere defines the hemispheric network or connectome. Elucidating left-right differences of the hemispheric network provides opportunities for brain asymmetry exploration. This review examines the asymmetry in the hemispheric white matter and functional network to assess health and brain disorders. In this article, the brain asymmetry in structural and functional connectivity including network topologies of healthy individuals, involving brain cognitive systems and the development trend, is highlighted. Moreover, the abnormal asymmetry of the hemispheric network related to cognition changes in brain disorders, such as Alzheimer’s disease, schizophrenia, autism spectrum disorder, attention deficit hyperactivity disorder, and bipolar disorder, is presented. This review suggests that the hemispheric network is highly conserved for measuring human brain asymmetries and has potential in the study of the cognitive system and brain disorders.","PeriodicalId":67062,"journal":{"name":"Brain Science Advances","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47768989","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Brain Science Advances
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1