Pub Date : 2024-08-31DOI: 10.1007/s11571-024-10169-y
Heng Li, Yong Xie
Over the past decade, most of researches on the communication between the neurons are based on synapses. However, the changes in action potentials in neurons may produce complex electromagnetic fields in the media, which may also have an impact on the electrical activity of neurons. To explore this factor, we construct a two-layer neuronal network composed of identical Hindmarsh–Rose neurons. Each neuron is connected with its neighbors in the layer via magnetic connections and a neuron in the corresponding position of the other layer via electrical synapse. By adjusting the electrical coupling strength and magnetic coupling strength, we find the appearance of alternating chimera states and transient chimera states whenever the intralayer coupling is nonlocal and local, respectively. According to our study, these phenomena have not been studied in multilayer networks of this structure. And it is found that the transient chimera states only could occur when the number of coupled neighbors is small. In addition, the states of two independent networks will affect the final states of networks applying the same sufficiently large interlayer coupling strength. Our study reveals a possible effect of electrical coupling and ephaptic coupling produced together on the dynamic behavior of the neuronal networks. Meanwhile, our results suggest that it makes sense to take electromagnetic induction into neuronal models.
{"title":"Alternating chimera states and synchronization in multilayer neuronal networks with ephaptic intralayer coupling","authors":"Heng Li, Yong Xie","doi":"10.1007/s11571-024-10169-y","DOIUrl":"https://doi.org/10.1007/s11571-024-10169-y","url":null,"abstract":"<p>Over the past decade, most of researches on the communication between the neurons are based on synapses. However, the changes in action potentials in neurons may produce complex electromagnetic fields in the media, which may also have an impact on the electrical activity of neurons. To explore this factor, we construct a two-layer neuronal network composed of identical Hindmarsh–Rose neurons. Each neuron is connected with its neighbors in the layer via magnetic connections and a neuron in the corresponding position of the other layer via electrical synapse. By adjusting the electrical coupling strength and magnetic coupling strength, we find the appearance of alternating chimera states and transient chimera states whenever the intralayer coupling is nonlocal and local, respectively. According to our study, these phenomena have not been studied in multilayer networks of this structure. And it is found that the transient chimera states only could occur when the number of coupled neighbors is small. In addition, the states of two independent networks will affect the final states of networks applying the same sufficiently large interlayer coupling strength. Our study reveals a possible effect of electrical coupling and ephaptic coupling produced together on the dynamic behavior of the neuronal networks. Meanwhile, our results suggest that it makes sense to take electromagnetic induction into neuronal models.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"13 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142206391","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-29DOI: 10.1007/s11571-024-10150-9
Quynh-Anh Nguyen, Leonid L. Rubchinsky
Synchronization of neural activity in the gamma frequency band is associated with various cognitive phenomena. Abnormalities of gamma synchronization may underlie symptoms of several neurological and psychiatric disorders such as schizophrenia and autism spectrum disorder. Properties of neural oscillations in the gamma band depend critically on the synaptic properties of the underlying circuits. This study explores how synaptic properties in pyramidal-interneuronal circuits affect not only the average synchronization strength but also the fine temporal patterning of neural synchrony. If two signals show only moderate synchrony strength, it may be possible to consider these dynamics as alternating between synchronized and desynchronized states. We use a model of connected circuits that produces pyramidal-interneuronal gamma oscillations to explore the temporal patterning of synchronized and desynchronized intervals. Changes in synaptic strength may alter the temporal patterning of synchronized dynamics (even if the average synchrony strength is not changed). Larger values of local synaptic connections promote longer desynchronization durations, while larger values of long-range synaptic connections promote shorter desynchronization durations. Furthermore, we show that circuits with different temporal patterning of synchronization may have different sensitivity to synaptic input. Thus, the alterations of synaptic strength may mediate physiological properties of neural circuits not only through change in the average synchrony level of gamma oscillations, but also through change in how synchrony is patterned in time over very short time scales.
{"title":"Synaptic effects on the intermittent synchronization of gamma rhythms","authors":"Quynh-Anh Nguyen, Leonid L. Rubchinsky","doi":"10.1007/s11571-024-10150-9","DOIUrl":"https://doi.org/10.1007/s11571-024-10150-9","url":null,"abstract":"<p>Synchronization of neural activity in the gamma frequency band is associated with various cognitive phenomena. Abnormalities of gamma synchronization may underlie symptoms of several neurological and psychiatric disorders such as schizophrenia and autism spectrum disorder. Properties of neural oscillations in the gamma band depend critically on the synaptic properties of the underlying circuits. This study explores how synaptic properties in pyramidal-interneuronal circuits affect not only the average synchronization strength but also the fine temporal patterning of neural synchrony. If two signals show only moderate synchrony strength, it may be possible to consider these dynamics as alternating between synchronized and desynchronized states. We use a model of connected circuits that produces pyramidal-interneuronal gamma oscillations to explore the temporal patterning of synchronized and desynchronized intervals. Changes in synaptic strength may alter the temporal patterning of synchronized dynamics (even if the average synchrony strength is not changed). Larger values of local synaptic connections promote longer desynchronization durations, while larger values of long-range synaptic connections promote shorter desynchronization durations. Furthermore, we show that circuits with different temporal patterning of synchronization may have different sensitivity to synaptic input. Thus, the alterations of synaptic strength may mediate physiological properties of neural circuits not only through change in the average synchrony level of gamma oscillations, but also through change in how synchrony is patterned in time over very short time scales.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"28 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142206392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-29DOI: 10.1007/s11571-024-10166-1
Erik D. Fagerholm, Robert Leech, Federico E. Turkheimer, Gregory Scott, Milan Brázdil
There is, at present, a lack of consensus regarding precisely what is meant by the term 'energy' across the sub-disciplines of neuroscience. Definitions range from deficits in the rate of glucose metabolism in consciousness research to regional changes in neuronal activity in cognitive neuroscience. In computational neuroscience virtually all models define the energy of neuronal regions as a quantity that is in a continual process of dissipation to its surroundings. This, however, is at odds with the definition of energy used across all sub-disciplines of physics: a quantity that does not change as a dynamical system evolves in time. Here, we bridge this gap between the dissipative models used in computational neuroscience and the energy-conserving models of physics using a mathematical technique first proposed in the context of fluid dynamics. We go on to derive an expression for the energy of the linear time-invariant (LTI) state space equation. We then use resting-state fMRI data obtained from the human connectome project to show that LTI energy is associated with glucose uptake metabolism. Our hope is that this work paves the way for an increased understanding of energy in the brain, from both a theoretical as well as an experimental perspective.
{"title":"Estimating the energy of dissipative neural systems","authors":"Erik D. Fagerholm, Robert Leech, Federico E. Turkheimer, Gregory Scott, Milan Brázdil","doi":"10.1007/s11571-024-10166-1","DOIUrl":"https://doi.org/10.1007/s11571-024-10166-1","url":null,"abstract":"<p>There is, at present, a lack of consensus regarding precisely what is meant by the term 'energy' across the sub-disciplines of neuroscience. Definitions range from deficits in the rate of glucose metabolism in consciousness research to regional changes in neuronal activity in cognitive neuroscience. In computational neuroscience virtually all models define the energy of neuronal regions as a quantity that is in a continual process of dissipation to its surroundings. This, however, is at odds with the definition of energy used across all sub-disciplines of physics: a quantity that does not change as a dynamical system evolves in time. Here, we bridge this gap between the dissipative models used in computational neuroscience and the energy-conserving models of physics using a mathematical technique first proposed in the context of fluid dynamics. We go on to derive an expression for the energy of the linear time-invariant (LTI) state space equation. We then use resting-state fMRI data obtained from the human connectome project to show that LTI energy is associated with glucose uptake metabolism. Our hope is that this work paves the way for an increased understanding of energy in the brain, from both a theoretical as well as an experimental perspective.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"71 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142206389","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-20DOI: 10.1007/s11571-024-10160-7
Zhongrui Li, Rongkai Zhang, Li Tong, Ying Zeng, Yuanlong Gao, Kai Yang, Bin Yan
EEG signals play a crucial role in assessing cognitive load, which is a key element in ensuring the secure operation of human–computer interaction systems. However, the variability of EEG signals across different subjects poses a challenge in applying the pre-trained cognitive load assessment model to new subjects. Moreover, previous domain adaptation research has primarily focused on developing complex network architectures to learn more domain-invariant features, overlooking the noise introduced by pseudo-labels and the challenges posed by domain migration problems. Therefore, this study proposes a novel cross-attention swin-transformer network for cross-subject cognitive load assessment, which achieves inter-domain feature alignment through parameter sharing in cross attention mechanism without using pseudo-labels, and utilizes maximum mean discrepancy (MMD) to measure the difference between the feature distributions of the source and target domains, further promoting feature alignment between domains. This method aims to leverage the advantages of cross-attention mechanism and MMD to better mitigate individual differences among subjects in cross-subject cognitive workload assessment. To validate the classification performance of the proposed network, two datasets of image recognition task and N-back task were employed for testing. Results show that, the proposed model outperformed advanced methods with cross-subject classification results of 88.13% and 81.27% on the on local and public datasets. The ablation experiment results reveal that using either the cross-attention mechanism or the MMD strategy alone improves cross-subject classification performance by 2.11% and 2.95% on the local dataset, respectively. Furthermore, the results of the EEG features distribution differences between all subjects before and after network training showed a significant reduction in feature distribution differences between subjects, further confirming the network’s effectiveness in minimizing inter-subject differences.
{"title":"A cross-attention swin transformer network for EEG-based subject-independent cognitive load assessment","authors":"Zhongrui Li, Rongkai Zhang, Li Tong, Ying Zeng, Yuanlong Gao, Kai Yang, Bin Yan","doi":"10.1007/s11571-024-10160-7","DOIUrl":"https://doi.org/10.1007/s11571-024-10160-7","url":null,"abstract":"<p>EEG signals play a crucial role in assessing cognitive load, which is a key element in ensuring the secure operation of human–computer interaction systems. However, the variability of EEG signals across different subjects poses a challenge in applying the pre-trained cognitive load assessment model to new subjects. Moreover, previous domain adaptation research has primarily focused on developing complex network architectures to learn more domain-invariant features, overlooking the noise introduced by pseudo-labels and the challenges posed by domain migration problems. Therefore, this study proposes a novel cross-attention swin-transformer network for cross-subject cognitive load assessment, which achieves inter-domain feature alignment through parameter sharing in cross attention mechanism without using pseudo-labels, and utilizes maximum mean discrepancy (MMD) to measure the difference between the feature distributions of the source and target domains, further promoting feature alignment between domains. This method aims to leverage the advantages of cross-attention mechanism and MMD to better mitigate individual differences among subjects in cross-subject cognitive workload assessment. To validate the classification performance of the proposed network, two datasets of image recognition task and N-back task were employed for testing. Results show that, the proposed model outperformed advanced methods with cross-subject classification results of 88.13% and 81.27% on the on local and public datasets. The ablation experiment results reveal that using either the cross-attention mechanism or the MMD strategy alone improves cross-subject classification performance by 2.11% and 2.95% on the local dataset, respectively. Furthermore, the results of the EEG features distribution differences between all subjects before and after network training showed a significant reduction in feature distribution differences between subjects, further confirming the network’s effectiveness in minimizing inter-subject differences.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"57 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142206393","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-19DOI: 10.1007/s11571-024-10159-0
Chenyao Wu, Yu Wang, Shuang Qiu, Huiguang He
Motor imagery (MI) is an important brain-computer interface (BCI) paradigm. The traditional MI paradigm (imagining different limbs) limits the intuitive control of the outer devices, while fine MI paradigm (imagining different joint movements from the same limb) can control the mechanical arm without cognitive disconnection. However, the decoding performance of fine MI limits its application. Electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) are widely used in BCI systems because of their portability and easy operation. In this study, a fine MI paradigm including four classes (hand, wrist, shoulder and rest) was designed, and the data of EEG-fNIRS bimodal brain activity was collected from 12 subjects. Event-related desynchronization (ERD) from EEG signals shows a contralateral dominant phenomenon, and there is difference between the ERD of the four classes. For fNIRS signal in the time dimension, the time periods with significant difference can be observed in the activation patterns of four MI tasks. Spatially, the signal peak based brain topographic map also shows difference of these four MI tasks. The EEG signal and fNIRS signal of these four classes are distinguishable. In this study, a bimodal fusion network is proposed to improve the fine MI tasks decoding performance. The features of these two modalities are extracted separately by two feature extractors based on convolutional neural networks (CNN). The recognition performance was significantly improved by the bimodal method proposed in this study, compared with the performance of the single-modal network. The proposed method outperformed all comparison methods, and achieved a four-class accuracy of 58.96%. This paper demonstrates the feasibility of EEG and fNIRS bimodal BCI systems for fine MI, and shows the effectiveness of the proposed bimodal fusion method. This research is supposed to support fine MI-based BCI systems with theories and techniques.
运动想象(MI)是一种重要的脑机接口(BCI)范式。传统的运动想象范式(想象不同的肢体)限制了对外部设备的直观控制,而精细的运动想象范式(想象同一肢体的不同关节运动)可以在不切断认知的情况下控制机械臂。然而,精细 MI 的解码性能限制了其应用。脑电图(EEG)和功能性近红外光谱(fNIRS)因其便携性和易操作性被广泛应用于生物识别(BCI)系统。本研究设计了包括手部、腕部、肩部和静息四类的精细 MI 范式,并收集了 12 名受试者的脑电图-近红外双模态脑活动数据。脑电图信号的事件相关不同步(ERD)显示出对侧优势现象,且四个等级的ERD存在差异。对于时间维度的 fNIRS 信号,可以观察到四种 MI 任务的激活模式存在显著差异的时间段。在空间维度上,基于信号峰值的脑地形图也显示出这四种 MI 任务的差异。这四类任务的脑电图信号和 fNIRS 信号是可以区分的。本研究提出了一种双模态融合网络,以提高精细 MI 任务的解码性能。基于卷积神经网络(CNN)的两个特征提取器分别提取这两种模态的特征。与单模态网络相比,本研究提出的双模态方法明显提高了识别性能。所提出的方法优于所有比较方法,四类准确率达到 58.96%。本文证明了脑电图和 fNIRS 双模 BCI 系统用于精细 MI 的可行性,并展示了所提出的双模融合方法的有效性。该研究为基于精细 MI 的 BCI 系统提供了理论和技术上的支持。
{"title":"A bimodal deep learning network based on CNN for fine motor imagery","authors":"Chenyao Wu, Yu Wang, Shuang Qiu, Huiguang He","doi":"10.1007/s11571-024-10159-0","DOIUrl":"https://doi.org/10.1007/s11571-024-10159-0","url":null,"abstract":"<p>Motor imagery (MI) is an important brain-computer interface (BCI) paradigm. The traditional MI paradigm (imagining different limbs) limits the intuitive control of the outer devices, while fine MI paradigm (imagining different joint movements from the same limb) can control the mechanical arm without cognitive disconnection. However, the decoding performance of fine MI limits its application. Electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) are widely used in BCI systems because of their portability and easy operation. In this study, a fine MI paradigm including four classes (hand, wrist, shoulder and rest) was designed, and the data of EEG-fNIRS bimodal brain activity was collected from 12 subjects. Event-related desynchronization (ERD) from EEG signals shows a contralateral dominant phenomenon, and there is difference between the ERD of the four classes. For fNIRS signal in the time dimension, the time periods with significant difference can be observed in the activation patterns of four MI tasks. Spatially, the signal peak based brain topographic map also shows difference of these four MI tasks. The EEG signal and fNIRS signal of these four classes are distinguishable. In this study, a bimodal fusion network is proposed to improve the fine MI tasks decoding performance. The features of these two modalities are extracted separately by two feature extractors based on convolutional neural networks (CNN). The recognition performance was significantly improved by the bimodal method proposed in this study, compared with the performance of the single-modal network. The proposed method outperformed all comparison methods, and achieved a four-class accuracy of 58.96%. This paper demonstrates the feasibility of EEG and fNIRS bimodal BCI systems for fine MI, and shows the effectiveness of the proposed bimodal fusion method. This research is supposed to support fine MI-based BCI systems with theories and techniques.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"11 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142206394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-17DOI: 10.1007/s11571-024-10161-6
Bing Hu, Weiting Zhou, Xunfu Ma
The output of the basal ganglia to the corticothalamic system plays an important role in regulating absence seizures. Inspired by experiments, we systematically study the crucial roles of two newly identified direct inhibitory striatal-cortical projections that project from the striatal D1 nucleus (SD1) and striatal D2 nucleus (SD2) to the cerebral cortex, in controlling absence seizures. Through computational simulation, we observe that typical 2–4 Hz spike and wave discharges (SWDs) can be induced through the pathological mechanism of cortical circuits, and both enhancing the inhibitory coupling weight on the striatal-cortical projections and improving the discharge activation level of striatal populations can effectively control typical SWDs. Furthermore, typical SWDs can be suppressed by appropriately adjusting several input projections directly related to the striatum, through regulating the activation level of striatal populations. Interestingly, several indirect striatum-related basal ganglia projections also have significant effects on the inhibition of typical SWDs, through the direct inhibitory striatal-cortical projections. Both the unidirectional control mode and bidirectional control mode for typical SWDs exist in our modified model. Importantly, the enhancement of coupling strengths on inhibitory striatal-cortical projections is beneficial for suppressing SWDs and may play a decisive regulatory role in the formation of control modes. Therefore, our study suggests that striatum may be potential effective targets for the treatment of absence seizures, through two newly identified direct inhibitory striatal-cortical projections. Interestingly, we find that external stimuli simultaneously targeting the striatum and another basal ganglia nucleus have a better control effect on SWDs than targeting a single basal ganglia nucleus, and the obtained results provide testable hypotheses for future experiments.
{"title":"Striatum is the potential target for treating absence epilepsy: a theoretical evidence","authors":"Bing Hu, Weiting Zhou, Xunfu Ma","doi":"10.1007/s11571-024-10161-6","DOIUrl":"https://doi.org/10.1007/s11571-024-10161-6","url":null,"abstract":"<p>The output of the basal ganglia to the corticothalamic system plays an important role in regulating absence seizures. Inspired by experiments, we systematically study the crucial roles of two newly identified direct inhibitory striatal-cortical projections that project from the striatal D1 nucleus (SD1) and striatal D2 nucleus (SD2) to the cerebral cortex, in controlling absence seizures. Through computational simulation, we observe that typical 2–4 Hz spike and wave discharges (SWDs) can be induced through the pathological mechanism of cortical circuits, and both enhancing the inhibitory coupling weight on the striatal-cortical projections and improving the discharge activation level of striatal populations can effectively control typical SWDs. Furthermore, typical SWDs can be suppressed by appropriately adjusting several input projections directly related to the striatum, through regulating the activation level of striatal populations. Interestingly, several indirect striatum-related basal ganglia projections also have significant effects on the inhibition of typical SWDs, through the direct inhibitory striatal-cortical projections. Both the unidirectional control mode and bidirectional control mode for typical SWDs exist in our modified model. Importantly, the enhancement of coupling strengths on inhibitory striatal-cortical projections is beneficial for suppressing SWDs and may play a decisive regulatory role in the formation of control modes. Therefore, our study suggests that striatum may be potential effective targets for the treatment of absence seizures, through two newly identified direct inhibitory striatal-cortical projections. Interestingly, we find that external stimuli simultaneously targeting the striatum and another basal ganglia nucleus have a better control effect on SWDs than targeting a single basal ganglia nucleus, and the obtained results provide testable hypotheses for future experiments.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"10 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142206239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-14DOI: 10.1007/s11571-024-10162-5
Chenyu Pan, Huimin Lu, Chenglin Lin, Zeyi Zhong, Bing Liu
The utilization of Electroencephalography (EEG) for emotion recognition has emerged as the primary tool in the field of affective computing. Traditional supervised learning methods are typically constrained by the availability of labeled data, which can result in weak generalizability of learned features. Additionally, EEG signals are highly correlated with human emotional states across temporal, spatial, and spectral dimensions. In this paper, we propose a Spatial-spEctral-Temporal based parallel Masked Autoencoder (SET-pMAE) model for EEG emotion recognition. SET-pMAE learns generic representations of spatial-temporal features and spatial-spectral features through a dual-branch self-supervised task. The reconstruction task of the spatial-temporal branch aims to capture the spatial-temporal contextual dependencies of EEG signals, while the reconstruction task of the spatial-spectral branch focuses on capturing the intrinsic spatial associations of the spectral domain across different brain regions. By learning from both tasks simultaneously, SET-pMAE can capture the generalized representations of features from the both tasks, thereby reducing the risk of overfitting. In order to verify the effectiveness of the proposed model, a series of experiments are conducted on the DEAP and DREAMER datasets. Results from experiments reveal that by employing self-supervised learning, the proposed model effectively captures more discriminative and generalized features, thereby attaining excellent performance.
{"title":"Set-pMAE: spatial-spEctral-temporal based parallel masked autoEncoder for EEG emotion recognition","authors":"Chenyu Pan, Huimin Lu, Chenglin Lin, Zeyi Zhong, Bing Liu","doi":"10.1007/s11571-024-10162-5","DOIUrl":"https://doi.org/10.1007/s11571-024-10162-5","url":null,"abstract":"<p>The utilization of Electroencephalography (EEG) for emotion recognition has emerged as the primary tool in the field of affective computing. Traditional supervised learning methods are typically constrained by the availability of labeled data, which can result in weak generalizability of learned features. Additionally, EEG signals are highly correlated with human emotional states across temporal, spatial, and spectral dimensions. In this paper, we propose a Spatial-spEctral-Temporal based parallel Masked Autoencoder (SET-pMAE) model for EEG emotion recognition. SET-pMAE learns generic representations of spatial-temporal features and spatial-spectral features through a dual-branch self-supervised task. The reconstruction task of the spatial-temporal branch aims to capture the spatial-temporal contextual dependencies of EEG signals, while the reconstruction task of the spatial-spectral branch focuses on capturing the intrinsic spatial associations of the spectral domain across different brain regions. By learning from both tasks simultaneously, SET-pMAE can capture the generalized representations of features from the both tasks, thereby reducing the risk of overfitting. In order to verify the effectiveness of the proposed model, a series of experiments are conducted on the DEAP and DREAMER datasets. Results from experiments reveal that by employing self-supervised learning, the proposed model effectively captures more discriminative and generalized features, thereby attaining excellent performance.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"4 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142206395","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-12DOI: 10.1007/s11571-024-10139-4
Jing Zhang, Hui Tang, Lijun Zuo, Hao Liu, Chang Liu, Zixiao Li, Jing Jing, Yongjun Wang, Tao Liu
Altered connectivity within complex functional networks has been observed in individuals with post-stroke cognitive impairment (PSCI) and during cognitive tasks. This study aimed to identify a cognitive function network that is responsive to cognitive changes during cognitive tasks and also sensitive to PSCI. To explore the network, we analyzed resting-state fMRI data from 20 PSCI patients and task-state fMRI data from 100 unrelated healthy young adults using functional connectivity analysis. We further employed spectral dynamic causal modeling to examine the effective connectivity among the pivotal regions within the network. Our findings revealed a common cognitive network that encompassed the hub regions 231 in the Subcortical network (SC), 70, 199, 242 in the Frontoparietal network (FP), 214 in the Visual II network, and 253 in the Cerebellum network (CBL). These hubs’ effective connectivity, which showed reliable but slight changes during different cognitive tasks, exhibited notable alterations when comparing post-stroke cognitive impairment and improvement statuses. Decreased coupling strengths were observed in effective connections to CBL253 and from SC231 and FP70 in the improvement status. Increased connections to SC231 and FP70, from CBL253 and FP242, as well as from FP199 and FP242 to FP242 were observed in this status. These alterations exhibited a high sensitivity to signs of recovery, ranging from 80 to 100%. The effective connectivity pattern in both post-stroke cognitive statuses also reflected the influence of the MoCA score. This research succeeded in identifying a cognitive network with sensitive effective connectivity to cognitive changes after stroke, presenting a potential neuroimaging biomarker for forthcoming interventional studies.
{"title":"Identification of a cognitive network with effective connectivity to post-stroke cognitive impairment","authors":"Jing Zhang, Hui Tang, Lijun Zuo, Hao Liu, Chang Liu, Zixiao Li, Jing Jing, Yongjun Wang, Tao Liu","doi":"10.1007/s11571-024-10139-4","DOIUrl":"https://doi.org/10.1007/s11571-024-10139-4","url":null,"abstract":"<p>Altered connectivity within complex functional networks has been observed in individuals with post-stroke cognitive impairment (PSCI) and during cognitive tasks. This study aimed to identify a cognitive function network that is responsive to cognitive changes during cognitive tasks and also sensitive to PSCI. To explore the network, we analyzed resting-state fMRI data from 20 PSCI patients and task-state fMRI data from 100 unrelated healthy young adults using functional connectivity analysis. We further employed spectral dynamic causal modeling to examine the effective connectivity among the pivotal regions within the network. Our findings revealed a common cognitive network that encompassed the hub regions 231 in the Subcortical network (SC), 70, 199, 242 in the Frontoparietal network (FP), 214 in the Visual II network, and 253 in the Cerebellum network (CBL). These hubs’ effective connectivity, which showed reliable but slight changes during different cognitive tasks, exhibited notable alterations when comparing post-stroke cognitive impairment and improvement statuses. Decreased coupling strengths were observed in effective connections to CBL253 and from SC231 and FP70 in the improvement status. Increased connections to SC231 and FP70, from CBL253 and FP242, as well as from FP199 and FP242 to FP242 were observed in this status. These alterations exhibited a high sensitivity to signs of recovery, ranging from 80 to 100%. The effective connectivity pattern in both post-stroke cognitive statuses also reflected the influence of the MoCA score. This research succeeded in identifying a cognitive network with sensitive effective connectivity to cognitive changes after stroke, presenting a potential neuroimaging biomarker for forthcoming interventional studies.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"3 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142206240","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Functional corticomuscular coupling (FCMC), a phenomenon describing the information interaction between the cortex and muscles, plays an important role in assessing hand movements. However, related studies mainly focused on specific actions by one-to-one mapping between the brain and muscles, ignoring the global synchronization across the motor system. Little research has been done on the FCMC difference between the brain and different muscle groups in terms of precise grip tasks. This study combined the maximum information coefficient (MIC) and the S estimation method and constructed a multivariate global synchronization index (MGSI) to measure the FCMC by analyzing the multichannel electroencephalogram (EEG) and electromyogram (EMG) during precise grip tasks. Both signals were collected from 12 healthy subjects while performing different weight object tasks. Our results on Hilbert-Huang spectral entropy (HHSE) of signals showed differences in task stages in both β (13–30 Hz) and γ (31–45 Hz) bands. The weight difference was reflected in the HHSE of channel CP5 and muscles at both ends of the upper limb. The one-to-one mapping with MIC between EEG and the muscle pair AD-FDI showed larger MIC values than the muscle pair B-CED; the same trend was seen on the MGSI values. However, the difference in weight of static tasks was not significant. Both MGSI values and the connect ratio of EEG were related to HHSE values. This work investigated the changes in the cortex and muscles during precise grip tasks from different perspectives, contributing to a better understanding of human motor control.
{"title":"Global synchronization of functional corticomuscular coupling under precise grip tasks using multichannel EEG and EMG signals","authors":"Xiaoling Chen, Tingting Shen, Yingying Hao, Jinyuan Zhang, Ping Xie","doi":"10.1007/s11571-024-10157-2","DOIUrl":"https://doi.org/10.1007/s11571-024-10157-2","url":null,"abstract":"<p>Functional corticomuscular coupling (FCMC), a phenomenon describing the information interaction between the cortex and muscles, plays an important role in assessing hand movements. However, related studies mainly focused on specific actions by one-to-one mapping between the brain and muscles, ignoring the global synchronization across the motor system. Little research has been done on the FCMC difference between the brain and different muscle groups in terms of precise grip tasks. This study combined the maximum information coefficient (MIC) and the S estimation method and constructed a multivariate global synchronization index (MGSI) to measure the FCMC by analyzing the multichannel electroencephalogram (EEG) and electromyogram (EMG) during precise grip tasks. Both signals were collected from 12 healthy subjects while performing different weight object tasks. Our results on Hilbert-Huang spectral entropy (HHSE) of signals showed differences in task stages in both<i> β</i> (13–30 Hz) and <i>γ</i> (31–45 Hz) bands. The weight difference was reflected in the HHSE of channel CP5 and muscles at both ends of the upper limb. The one-to-one mapping with MIC between EEG and the muscle pair AD-FDI showed larger MIC values than the muscle pair B-CED; the same trend was seen on the MGSI values. However, the difference in weight of static tasks was not significant. Both MGSI values and the connect ratio of EEG were related to HHSE values. This work investigated the changes in the cortex and muscles during precise grip tasks from different perspectives, contributing to a better understanding of human motor control.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"29 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141949153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-30DOI: 10.1007/s11571-024-10151-8
Chunyu Ma, Yimeng Jin, Johan Lauwereyns
In human perceptual decision-making, the speed-accuracy tradeoff establishes a causal link between urgency and reduced accuracy. Less is known about how speed relates to the subjective evaluation of visual images. Here, we conducted a set of four experiments to tease apart two alternative hypotheses for the relation between speed and subjective evaluation. The hypothesis of “Speed-Polarization Tradeoff” implies that urgency causes more polarized evaluations. In contrast, the “Ease-of-Processing” hypothesis suggests that any association between speed and polarization is due to the salience of evaluation-relevant image content. The more salient the content, the easier to process, and therefore the faster and more extreme the evaluation. In each experiment, we asked participants to evaluate images on a continuous scale from − 10 to + 10 and measured their response times; in Experiments 1–3, the participants rated real-world images in terms of morality (from “very immoral,” -10, to “very moral,” +10); in Experiment 4, the participants rated food images in terms of appetitiveness (from “very disgusting,” -10, to “very attractive,” +10). In Experiments 1, 3, and 4, we used a cueing procedure to inform the participants on a trial-by-trial basis whether they could make a self-paced (SP) evaluation or whether they had to perform a time-limited (TL) evaluation within 2 s. In Experiment 2, we asked participants to rate the easiness of their SP moral evaluations. Compared to the SP conditions, the responses in the TL condition were consistently much faster, indicating that our urgency manipulation was successful. However, comparing the SP versus TL conditions, we found no significant differences in any of the evaluations. Yet, the reported ease of processing of moral evaluation covaried strongly with both the response speed and the polarization of evaluation. The overall pattern of data indicated that, while speed is associated with polarization, urgency does not cause participants to make more extreme evaluations. Instead, the association between speed and polarization reflects the ease of processing. Images that are easy to evaluate evoke faster and more extreme scores than images for which the interpretation is uncertain.
{"title":"Speed is associated with polarization during subjective evaluation: no tradeoff, but an effect of the ease of processing","authors":"Chunyu Ma, Yimeng Jin, Johan Lauwereyns","doi":"10.1007/s11571-024-10151-8","DOIUrl":"https://doi.org/10.1007/s11571-024-10151-8","url":null,"abstract":"<p>In human perceptual decision-making, the speed-accuracy tradeoff establishes a causal link between urgency and reduced accuracy. Less is known about how speed relates to the subjective evaluation of visual images. Here, we conducted a set of four experiments to tease apart two alternative hypotheses for the relation between speed and subjective evaluation. The hypothesis of “Speed-Polarization Tradeoff” implies that urgency causes more polarized evaluations. In contrast, the “Ease-of-Processing” hypothesis suggests that any association between speed and polarization is due to the salience of evaluation-relevant image content. The more salient the content, the easier to process, and therefore the faster and more extreme the evaluation. In each experiment, we asked participants to evaluate images on a continuous scale from − 10 to + 10 and measured their response times; in Experiments 1–3, the participants rated real-world images in terms of morality (from “very immoral,” -10, to “very moral,” +10); in Experiment 4, the participants rated food images in terms of appetitiveness (from “very disgusting,” -10, to “very attractive,” +10). In Experiments 1, 3, and 4, we used a cueing procedure to inform the participants on a trial-by-trial basis whether they could make a self-paced (SP) evaluation or whether they had to perform a time-limited (TL) evaluation within 2 s. In Experiment 2, we asked participants to rate the easiness of their SP moral evaluations. Compared to the SP conditions, the responses in the TL condition were consistently much faster, indicating that our urgency manipulation was successful. However, comparing the SP versus TL conditions, we found no significant differences in any of the evaluations. Yet, the reported ease of processing of moral evaluation covaried strongly with both the response speed and the polarization of evaluation. The overall pattern of data indicated that, while speed is associated with polarization, urgency does not cause participants to make more extreme evaluations. Instead, the association between speed and polarization reflects the ease of processing. Images that are easy to evaluate evoke faster and more extreme scores than images for which the interpretation is uncertain.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"20 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141870581","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}