首页 > 最新文献

Cognitive Neurodynamics最新文献

英文 中文
Investigating the impact of hearing loss on attentional networks among older individuals: an event-related potential study 调查听力损失对老年人注意力网络的影响:事件相关电位研究
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-06-21 DOI: 10.1007/s11571-024-10140-x
Sankalpa Madashetty, Hari Prakash Palaniswamy, Bellur Rajashekhar

Attention is a core cognitive domain crucial in facilitating day-to-day life. Using an attention network test (ANT) along with event-related potentials (ERPs) in older individuals with hearing loss would provide excellent information about the impact of hearing loss on attentional processes. Thus, the current study aims to understand the attentional deficits and its cortical dynamics in older individuals with and without hearing loss. The study recruited 40 participants, 20 older individuals with hearing loss and 20 age and education-matched controls with normal hearing. All the participants underwent cognitive assessment using ANT with simultaneous 32-channel EEG recording. Results revealed significant impairment in executive attention and subtle alterations in alerting and orienting attention among older individuals with hearing loss compared to their normal-hearing counterparts. These findings suggest the negative impact of hearing loss on attentional networks. In addition, ANT and ERPs provide insight into the underlying neural mechanisms in specific attention network deficits associated with hearing loss.

注意力是对日常生活至关重要的核心认知领域。在老年听力损失患者中使用注意力网络测试(ANT)和事件相关电位(ERPs),可以很好地了解听力损失对注意力过程的影响。因此,本研究旨在了解有听力损失和无听力损失的老年人的注意力缺陷及其皮层动态变化。本研究共招募了 40 名参与者,其中 20 名是听力损失的老年人,20 名是与年龄和教育程度相匹配的听力正常的对照组。所有参与者都接受了使用 ANT 进行的认知评估,并同时进行了 32 通道脑电图记录。结果显示,与听力正常的老年人相比,听力损失老年人的执行注意力明显受损,警觉和定向注意力也发生了细微变化。这些研究结果表明,听力损失对注意力网络有负面影响。此外,ANT和ERPs还有助于深入了解与听力损失相关的特定注意网络缺陷的潜在神经机制。
{"title":"Investigating the impact of hearing loss on attentional networks among older individuals: an event-related potential study","authors":"Sankalpa Madashetty, Hari Prakash Palaniswamy, Bellur Rajashekhar","doi":"10.1007/s11571-024-10140-x","DOIUrl":"https://doi.org/10.1007/s11571-024-10140-x","url":null,"abstract":"<p>Attention is a core cognitive domain crucial in facilitating day-to-day life. Using an attention network test (ANT) along with event-related potentials (ERPs) in older individuals with hearing loss would provide excellent information about the impact of hearing loss on attentional processes. Thus, the current study aims to understand the attentional deficits and its cortical dynamics in older individuals with and without hearing loss. The study recruited 40 participants, 20 older individuals with hearing loss and 20 age and education-matched controls with normal hearing. All the participants underwent cognitive assessment using ANT with simultaneous 32-channel EEG recording. Results revealed significant impairment in executive attention and subtle alterations in alerting and orienting attention among older individuals with hearing loss compared to their normal-hearing counterparts. These findings suggest the negative impact of hearing loss on attentional networks. In addition, ANT and ERPs provide insight into the underlying neural mechanisms in specific attention network deficits associated with hearing loss.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"197 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141509912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Memristive leaky integrate-and-fire neuron and learnable straight-through estimator in spiking neural networks 尖峰神经网络中的 Memristive 渗漏整合发射神经元和可学习直通估计器
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-06-20 DOI: 10.1007/s11571-024-10133-w
Tao Chen, Chunyan She, Lidan Wang, Shukai Duan

Compared to artificial neural networks (ANNs), spiking neural networks (SNNs) present a more biologically plausible model of neural system dynamics. They rely on sparse binary spikes to communicate information and operate in an asynchronous, event-driven manner. Despite the high heterogeneity of the neural system at the neuronal level, most current SNNs employ the widely used leaky integrate-and-fire (LIF) neuron model, which assumes uniform membrane-related parameters throughout the entire network. This approach hampers the expressiveness of spiking neurons and restricts the diversity of neural dynamics. In this paper, we propose replacing the resistor in the LIF model with a discrete memristor to obtain the heterogeneous memristive LIF (MLIF) model. The memristance of the discrete memristor is determined by the voltage and flux at its terminals, leading to dynamic changes in the membrane time parameter of the MLIF model. SNNs composed of MLIF neurons can not only learn synaptic weights but also adaptively change membrane time parameters according to the membrane potential of the neuron, enhancing the learning ability and expression of SNNs. Furthermore, since the proper threshold of spiking neurons can improve the information capacity of SNNs, a learnable straight-through estimator (LSTE) is proposed. The LSTE, based on the straight-through estimator (STE) surrogate function, features a learnable threshold that facilitates the backward propagation of gradients through neurons firing spikes. Extensive experiments on several popular static and neuromorphic benchmark datasets demonstrate the effectiveness of the proposed MLIF and LSTE, especially on the DVS-CIFAR10 dataset, where we achieved the top-1 accuracy of 84.40(%).

与人工神经网络(ANN)相比,尖峰神经网络(SNN)提出了一种更符合生物学原理的神经系统动力学模型。它们依靠稀疏的二进制尖峰来传递信息,并以异步、事件驱动的方式运行。尽管神经系统在神经元层面具有高度异质性,但目前大多数 SNNs 采用的是广泛使用的泄漏整合-发射(LIF)神经元模型,该模型假定整个网络中与膜相关的参数是统一的。这种方法阻碍了尖峰神经元的表现力,限制了神经动态的多样性。在本文中,我们建议用离散忆阻器取代 LIF 模型中的电阻器,从而获得异质忆阻器 LIF(MLIF)模型。离散忆阻器的忆阻值由其终端的电压和通量决定,从而导致 MLIF 模型的膜时间参数发生动态变化。由 MLIF 神经元组成的 SNN 不仅能学习突触权重,还能根据神经元的膜电位自适应地改变膜时间参数,从而增强 SNN 的学习能力和表达能力。此外,由于尖峰神经元的适当阈值可以提高 SNN 的信息容量,因此提出了一种可学习的直通估计器(LSTE)。LSTE 基于直通估计器(STE)代理函数,具有可学习阈值,有利于梯度通过发射尖峰的神经元向后传播。在几个流行的静态和神经形态基准数据集上进行的广泛实验证明了所提出的MLIF和LSTE的有效性,尤其是在DVS-CIFAR10数据集上,我们取得了84.40(%)的top-1准确率。
{"title":"Memristive leaky integrate-and-fire neuron and learnable straight-through estimator in spiking neural networks","authors":"Tao Chen, Chunyan She, Lidan Wang, Shukai Duan","doi":"10.1007/s11571-024-10133-w","DOIUrl":"https://doi.org/10.1007/s11571-024-10133-w","url":null,"abstract":"<p>Compared to artificial neural networks (ANNs), spiking neural networks (SNNs) present a more biologically plausible model of neural system dynamics. They rely on sparse binary spikes to communicate information and operate in an asynchronous, event-driven manner. Despite the high heterogeneity of the neural system at the neuronal level, most current SNNs employ the widely used leaky integrate-and-fire (LIF) neuron model, which assumes uniform membrane-related parameters throughout the entire network. This approach hampers the expressiveness of spiking neurons and restricts the diversity of neural dynamics. In this paper, we propose replacing the resistor in the LIF model with a discrete memristor to obtain the heterogeneous memristive LIF (MLIF) model. The memristance of the discrete memristor is determined by the voltage and flux at its terminals, leading to dynamic changes in the membrane time parameter of the MLIF model. SNNs composed of MLIF neurons can not only learn synaptic weights but also adaptively change membrane time parameters according to the membrane potential of the neuron, enhancing the learning ability and expression of SNNs. Furthermore, since the proper threshold of spiking neurons can improve the information capacity of SNNs, a learnable straight-through estimator (LSTE) is proposed. The LSTE, based on the straight-through estimator (STE) surrogate function, features a learnable threshold that facilitates the backward propagation of gradients through neurons firing spikes. Extensive experiments on several popular static and neuromorphic benchmark datasets demonstrate the effectiveness of the proposed MLIF and LSTE, especially on the DVS-CIFAR10 dataset, where we achieved the top-1 accuracy of 84.40<span>(%)</span>.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"23 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141509910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Time–frequency–space transformer EEG decoding for spinal cord injury 用于脊髓损伤的时频空间变压器脑电图解码
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-06-18 DOI: 10.1007/s11571-024-10135-8
Fangzhou Xu, Ming Liu, Xinyi Chen, Yihao Yan, Jinzhao Zhao, Yanbing Liu, Jiaqi Zhao, Shaopeng Pang, Sen Yin, Jiancai Leng, Yang Zhang

Transformer neural networks based on multi-head self-attention are effective in several fields. To capture brain activity on electroencephalographic (EEG) signals and construct an effective pattern recognition model, this paper explores the multi-channel deep feature decoding method utilizing the self-attention mechanism. By integrating inter-channel features with intra-channel features, the self-attention mechanism generates a deep feature vector that encompasses information from all brain activities. In this paper, a time-frequency-spatial domain analysis of motor imagery (MI) based EEG signals from spinal cord injury patients is performed to construct a transformer neural network-based MI classification model. The proposed algorithm is named time-frequency-spatial transformer. The time-frequency and spatial domain feature vectors extracted from the EEG signals are input into the transformer neural network for multiple self-attention depth feature encoding, a peak classification accuracy of 93.56% is attained through the fully connected layer. By constructing the attention matrix brain network, it can be inferred that the channel connections constructed by the attention heads have similarities to the brain networks constructed by the EEG raw signals. The experimental results reveal that the self-attention coefficient brain network holds significant potential for brain activity analysis. The self-attention coefficient brain network can better illustrate correlated connections and show sample differences. Attention coefficient brain networks can provide a more discriminative approach for analyzing brain activity in clinical settings.

基于多头自注意的变压器神经网络在多个领域都很有效。为了捕捉脑电图(EEG)信号上的大脑活动并构建有效的模式识别模型,本文探讨了利用自注意机制的多通道深度特征解码方法。通过将信道间特征与信道内特征相结合,自注意机制生成了一个包含所有脑活动信息的深度特征向量。本文对脊髓损伤患者基于运动意象(MI)的脑电信号进行了时频空间域分析,构建了基于变压器神经网络的运动意象分类模型。所提出的算法被命名为时频空间变换器。将从脑电信号中提取的时频和空间域特征向量输入变压器神经网络,进行多重自注意深度特征编码,通过全连接层,分类准确率达到 93.56%。通过构建注意力矩阵脑网络,可以推断注意力头构建的通道连接与脑电图原始信号构建的脑网络具有相似性。实验结果表明,自我注意力系数脑网络在脑活动分析方面具有巨大潜力。自我注意力系数脑网络能更好地说明相关连接并显示样本差异。注意力系数脑网络可以为临床环境中的脑活动分析提供一种更具鉴别性的方法。
{"title":"Time–frequency–space transformer EEG decoding for spinal cord injury","authors":"Fangzhou Xu, Ming Liu, Xinyi Chen, Yihao Yan, Jinzhao Zhao, Yanbing Liu, Jiaqi Zhao, Shaopeng Pang, Sen Yin, Jiancai Leng, Yang Zhang","doi":"10.1007/s11571-024-10135-8","DOIUrl":"https://doi.org/10.1007/s11571-024-10135-8","url":null,"abstract":"<p>Transformer neural networks based on multi-head self-attention are effective in several fields. To capture brain activity on electroencephalographic (EEG) signals and construct an effective pattern recognition model, this paper explores the multi-channel deep feature decoding method utilizing the self-attention mechanism. By integrating inter-channel features with intra-channel features, the self-attention mechanism generates a deep feature vector that encompasses information from all brain activities. In this paper, a time-frequency-spatial domain analysis of motor imagery (MI) based EEG signals from spinal cord injury patients is performed to construct a transformer neural network-based MI classification model. The proposed algorithm is named time-frequency-spatial transformer. The time-frequency and spatial domain feature vectors extracted from the EEG signals are input into the transformer neural network for multiple self-attention depth feature encoding, a peak classification accuracy of 93.56% is attained through the fully connected layer. By constructing the attention matrix brain network, it can be inferred that the channel connections constructed by the attention heads have similarities to the brain networks constructed by the EEG raw signals. The experimental results reveal that the self-attention coefficient brain network holds significant potential for brain activity analysis. The self-attention coefficient brain network can better illustrate correlated connections and show sample differences. Attention coefficient brain networks can provide a more discriminative approach for analyzing brain activity in clinical settings.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"68 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141509911","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data-driven natural computational psychophysiology in class 课堂上的数据驱动自然计算心理生理学
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-06-04 DOI: 10.1007/s11571-024-10126-9
Yong Huang, Yuxiang Huan, Zhuo Zou, Yijun Wang, Xiaorong Gao, Lirong Zheng

Objective. The assessment of mental fatigue (MF) and attention span in educational and healthcare settings frequently relies on subjective scales or methods such as induced-task interruption tools. However, these approaches are deficient in real-time evaluation and dynamic definitions. To address this gap, this paper proposes a Continuous Quantitative Scale (CQS) that allows for the natural and real-time measurement of MF based on group-synchronized electroencephalogram (EEG) data. Approach. In this study, computational psychophysiology was used to measure MF scores during a realistic class. Our methodology continuously monitored participants’ psychological states without interrupting their regular routines, providing an objective evaluation. By analyzing multi-subject brain-computer interface (mBCI) data with a collaborative computing approach, the group-synchronized data were obtained from 10 healthy participants to assess MF levels. Each participant wore an EEG headset for only 10 min of preparation before performing a sustained task for 80 min. Main results. Our findings indicate that a lecture duration of 18.9 min is most effective, while a duration of 43.1 min leads to heightened MF levels. By focusing on the group-level simultaneous data analysis, the effects of individual variability were mitigated and the efficiency of cognitive computing was improved. From the perspective of a neurocomputational measure, these results confirm previous research. Significance. The proposed CQS provides a reliable, objective, memory- and emotion-free approach to the assessment of MF and attention span. These findings have significant implications not only for education, but also for the study of group cognitive mechanisms and for improving the quality of mental healthcare.

目的。在教育和医疗机构中,对精神疲劳(MF)和注意力集中时间的评估通常依赖于主观量表或诱导任务中断工具等方法。然而,这些方法在实时评估和动态定义方面存在不足。为了弥补这一不足,本文提出了一种连续定量量表(CQS),可根据群体同步脑电图(EEG)数据自然、实时地测量精神疲劳度。方法。在本研究中,计算心理生理学被用于测量现实课堂中的 MF 分数。我们的方法能在不影响参与者正常作息的情况下持续监测他们的心理状态,从而提供客观的评估。通过使用协同计算方法分析多主体脑机接口(mBCI)数据,从 10 名健康参与者那里获得了群体同步数据,以评估中频水平。每位参与者在执行一项持续 80 分钟的任务之前,只需佩戴脑电图耳机进行 10 分钟的准备工作。主要结果。我们的研究结果表明,18.9 分钟的授课时间最有效,而 43.1 分钟的授课时间则会导致中频水平的提高。通过侧重于群体层面的同步数据分析,减轻了个体差异的影响,提高了认知计算的效率。从神经计算测量的角度来看,这些结果证实了之前的研究。意义重大。所提出的 CQS 提供了一种可靠、客观、无记忆和无情绪的方法来评估中频和注意广度。这些发现不仅对教育,而且对研究群体认知机制和提高心理保健质量都具有重要意义。
{"title":"Data-driven natural computational psychophysiology in class","authors":"Yong Huang, Yuxiang Huan, Zhuo Zou, Yijun Wang, Xiaorong Gao, Lirong Zheng","doi":"10.1007/s11571-024-10126-9","DOIUrl":"https://doi.org/10.1007/s11571-024-10126-9","url":null,"abstract":"<p><i>Objective.</i> The assessment of mental fatigue (MF) and attention span in educational and healthcare settings frequently relies on subjective scales or methods such as induced-task interruption tools. However, these approaches are deficient in real-time evaluation and dynamic definitions. To address this gap, this paper proposes a Continuous Quantitative Scale (CQS) that allows for the natural and real-time measurement of MF based on group-synchronized electroencephalogram (EEG) data. <i>Approach.</i> In this study, computational psychophysiology was used to measure MF scores during a realistic class. Our methodology continuously monitored participants’ psychological states without interrupting their regular routines, providing an objective evaluation. By analyzing multi-subject brain-computer interface (mBCI) data with a collaborative computing approach, the group-synchronized data were obtained from 10 healthy participants to assess MF levels. Each participant wore an EEG headset for only 10 min of preparation before performing a sustained task for 80 min. <i>Main results.</i> Our findings indicate that a lecture duration of 18.9 min is most effective, while a duration of 43.1 min leads to heightened MF levels. By focusing on the group-level simultaneous data analysis, the effects of individual variability were mitigated and the efficiency of cognitive computing was improved. From the perspective of a neurocomputational measure, these results confirm previous research. <i>Significance.</i> The proposed CQS provides a reliable, objective, memory- and emotion-free approach to the assessment of MF and attention span. These findings have significant implications not only for education, but also for the study of group cognitive mechanisms and for improving the quality of mental healthcare.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"12 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141252742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
GABA receptors mediate adaptation and sensitization processes in mouse retinal ganglion cells. GABA受体介导小鼠视网膜神经节细胞的适应和致敏过程
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-06-01 Epub Date: 2023-04-08 DOI: 10.1007/s11571-023-09950-2
Min Dai, Pei-Ji Liang

Two coordinated dynamic properties (adaptation and sensitization) are observed in retinal ganglion cells (RGCs) under the contrast stimulation. During sustained high-contrast period, adaptation decreases RGCs' responses while sensitization increases RGCs' responses. In mouse retina, adaptation and sensitization respectively show OFF- and ON-pathway-dominance. However, the mechanisms which drive the differentiation between adaptation and sensitization remain unclear. In the present study, multi-electrode recordings were conducted on isolated mouse retina under full-field contrast stimulation. Dynamic property was quantified based on the trend of RGC's firing rate during high-contrast period, light sensitivity was estimated by linear-nonlinear analysis and coding ability was estimated through stimulus reconstruction algorism. γ-Aminobutyric acid (GABA) receptors were pharmacologically blocked to explore the relation between RGCs' dynamic property and the activity of GABA receptors. It was found that GABAA and GABAC receptors respectively mediated the adaptation and sensitization processes in RGCs' responses. RGCs' dynamic property changes occurred after the blockage of GABA receptors were related to the modulation of the cells' light sensitivity. Further, the blockage of GABAA (GABAC) receptor significantly decreased RGCs' overall coding ability and eliminated the functional benefits of adaptation (sensitization). Our work suggests that the dynamic property of individual RGC is related to the balance between its GABAA-receptor-mediated inputs and GABAC-receptor-mediated inputs. Blockage of GABA receptors breaks the balance of retinal circuitry for signal processing, and down-regulates the visual information coding ability.

Supplementary information: The online version contains supplementary material available at 10.1007/s11571-023-09950-2.

在对比度刺激下,在视网膜神经节细胞(RGCs)中观察到两种协调的动态特性(适应和敏化)。在持续的高对比度时期,适应会降低视网膜神经节细胞的反应,而敏化则会增加视网膜神经节细胞的反应。在小鼠视网膜中,适应和敏化分别表现为关闭和开启通路主导。然而,驱动适应和敏化分化的机制仍不清楚。本研究在全场对比刺激下对离体小鼠视网膜进行了多电极记录。根据高对比度时期 RGC 的发射率趋势量化动态特性,通过线性-非线性分析估计光敏感性,并通过刺激重建算法估计编码能力。通过药理阻断γ-氨基丁酸(GABA)受体来探讨RGCs的动态特性与GABA受体活性之间的关系。结果发现,GABAA和GABAC受体分别介导了RGCs反应的适应和敏化过程。阻断GABA受体后,RGCs的动态特性发生了变化,这与细胞对光的敏感性的调节有关。此外,阻断GABAA(GABAC)受体会显著降低RGCs的整体编码能力,并消除适应(敏化)的功能益处。我们的研究表明,单个 RGC 的动态特性与其 GABAA 受体介导的输入和 GABAC 受体介导的输入之间的平衡有关。阻断 GABA 受体会打破视网膜信号处理电路的平衡,并下调视觉信息编码能力:在线版本包含补充材料,可查阅 10.1007/s11571-023-09950-2。
{"title":"GABA receptors mediate adaptation and sensitization processes in mouse retinal ganglion cells.","authors":"Min Dai, Pei-Ji Liang","doi":"10.1007/s11571-023-09950-2","DOIUrl":"10.1007/s11571-023-09950-2","url":null,"abstract":"<p><p>Two coordinated dynamic properties (adaptation and sensitization) are observed in retinal ganglion cells (RGCs) under the contrast stimulation. During sustained high-contrast period, adaptation decreases RGCs' responses while sensitization increases RGCs' responses. In mouse retina, adaptation and sensitization respectively show OFF- and ON-pathway-dominance. However, the mechanisms which drive the differentiation between adaptation and sensitization remain unclear. In the present study, multi-electrode recordings were conducted on isolated mouse retina under full-field contrast stimulation. Dynamic property was quantified based on the trend of RGC's firing rate during high-contrast period, light sensitivity was estimated by linear-nonlinear analysis and coding ability was estimated through stimulus reconstruction algorism. γ-Aminobutyric acid (GABA) receptors were pharmacologically blocked to explore the relation between RGCs' dynamic property and the activity of GABA receptors. It was found that GABA<sub>A</sub> and GABA<sub>C</sub> receptors respectively mediated the adaptation and sensitization processes in RGCs' responses. RGCs' dynamic property changes occurred after the blockage of GABA receptors were related to the modulation of the cells' light sensitivity. Further, the blockage of GABA<sub>A</sub> (GABA<sub>C</sub>) receptor significantly decreased RGCs' overall coding ability and eliminated the functional benefits of adaptation (sensitization). Our work suggests that the dynamic property of individual RGC is related to the balance between its GABA<sub>A</sub>-receptor-mediated inputs and GABA<sub>C</sub>-receptor-mediated inputs. Blockage of GABA receptors breaks the balance of retinal circuitry for signal processing, and down-regulates the visual information coding ability.</p><p><strong>Supplementary information: </strong>The online version contains supplementary material available at 10.1007/s11571-023-09950-2.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"1 1","pages":"1021-1032"},"PeriodicalIF":3.7,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11143098/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41430758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction to: Population and individual firing behaviors in sparsely synchronized rhythms in the hippocampal dentate gyrus. Correction to:海马齿状回稀疏同步节律中的群体和个体点火行为
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-06-01 Epub Date: 2023-03-29 DOI: 10.1007/s11571-023-09949-9
Sang-Yoon Kim, Woochang Lim

[This corrects the article DOI: 10.1007/s11571-021-09728-4.].

[此处更正了文章 DOI:10.1007/s11571-021-09728-4]。
{"title":"Correction to: Population and individual firing behaviors in sparsely synchronized rhythms in the hippocampal dentate gyrus.","authors":"Sang-Yoon Kim, Woochang Lim","doi":"10.1007/s11571-023-09949-9","DOIUrl":"10.1007/s11571-023-09949-9","url":null,"abstract":"<p><p>[This corrects the article DOI: 10.1007/s11571-021-09728-4.].</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"1 1","pages":"1417"},"PeriodicalIF":3.7,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11143152/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"52867040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Short-length SSVEP data extension by a novel generative adversarial networks based framework 通过基于生成式对抗网络的新型框架扩展短时长 SSVEP 数据
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-05-31 DOI: 10.1007/s11571-024-10134-9
Yudong Pan, Ning Li, Yangsong Zhang, Peng Xu, Dezhong Yao

Steady-state visual evoked potentials (SSVEPs) based brain–computer interface (BCI) has received considerable attention due to its high information transfer rate (ITR) and available quantity of targets. However, the performance of frequency identification methods heavily hinges on the amount of user calibration data and data length, which hinders the deployment in real-world applications. Recently, generative adversarial networks (GANs)-based data generation methods have been widely adopted to create synthetic electroencephalography data, holds promise to address these issues. In this paper, we proposed a GAN-based end-to-end signal transformation network for Time-window length Extension, termed as TEGAN. TEGAN transforms short-length SSVEP signals into long-length artificial SSVEP signals. Additionally, we introduced a two-stage training strategy and the LeCam-divergence regularization term to regularize the training process of GAN during the network implementation. The proposed TEGAN was evaluated on two public SSVEP datasets (a 4-class and 12-class dataset). With the assistance of TEGAN, the performance of traditional frequency recognition methods and deep learning-based methods have been significantly improved under limited calibration data. And the classification performance gap of various frequency recognition methods has been narrowed. This study substantiates the feasibility of the proposed method to extend the data length for short-time SSVEP signals for developing a high-performance BCI system. The proposed GAN-based methods have the great potential of shortening the calibration time and cutting down the budget for various real-world BCI-based applications.

基于稳态视觉诱发电位(SSVEPs)的脑机接口(BCI)因其高信息传输率(ITR)和可用目标数量而受到广泛关注。然而,频率识别方法的性能在很大程度上取决于用户校准数据量和数据长度,这阻碍了其在实际应用中的部署。最近,基于生成式对抗网络(GANs)的数据生成方法被广泛用于创建合成脑电图数据,有望解决这些问题。本文提出了一种基于生成式对抗网络(GAN)的端到端信号转换网络,用于时间窗口长度扩展(Time-window length Extension),称为 TEGAN。TEGAN 可将短时长的 SSVEP 信号转换成长时长的人工 SSVEP 信号。此外,我们还引入了两阶段训练策略和 LeCam-发散正则化项,以便在网络实施过程中对 GAN 的训练过程进行正则化。我们在两个公开的 SSVEP 数据集(4 级和 12 级数据集)上对所提出的 TEGAN 进行了评估。在 TEGAN 的帮助下,传统频率识别方法和基于深度学习的方法在有限的校准数据下的性能得到了显著提高。各种频率识别方法的分类性能差距也有所缩小。本研究证实了所提出的方法在延长短时 SSVEP 信号的数据长度以开发高性能 BCI 系统方面的可行性。所提出的基于 GAN 的方法在缩短校准时间和削减各种基于 BCI 的实际应用预算方面具有巨大潜力。
{"title":"Short-length SSVEP data extension by a novel generative adversarial networks based framework","authors":"Yudong Pan, Ning Li, Yangsong Zhang, Peng Xu, Dezhong Yao","doi":"10.1007/s11571-024-10134-9","DOIUrl":"https://doi.org/10.1007/s11571-024-10134-9","url":null,"abstract":"<p>Steady-state visual evoked potentials (SSVEPs) based brain–computer interface (BCI) has received considerable attention due to its high information transfer rate (ITR) and available quantity of targets. However, the performance of frequency identification methods heavily hinges on the amount of user calibration data and data length, which hinders the deployment in real-world applications. Recently, generative adversarial networks (GANs)-based data generation methods have been widely adopted to create synthetic electroencephalography data, holds promise to address these issues. In this paper, we proposed a GAN-based end-to-end signal transformation network for Time-window length Extension, termed as TEGAN. TEGAN transforms short-length SSVEP signals into long-length artificial SSVEP signals. Additionally, we introduced a two-stage training strategy and the LeCam-divergence regularization term to regularize the training process of GAN during the network implementation. The proposed TEGAN was evaluated on two public SSVEP datasets (a 4-class and 12-class dataset). With the assistance of TEGAN, the performance of traditional frequency recognition methods and deep learning-based methods have been significantly improved under limited calibration data. And the classification performance gap of various frequency recognition methods has been narrowed. This study substantiates the feasibility of the proposed method to extend the data length for short-time SSVEP signals for developing a high-performance BCI system. The proposed GAN-based methods have the great potential of shortening the calibration time and cutting down the budget for various real-world BCI-based applications.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"101 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141190568","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Break-up and recovery of harmony between direct and indirect pathways in the basal ganglia: Huntington’s disease and treatment 基底神经节直接和间接通路之间和谐关系的打破和恢复:亨廷顿氏病与治疗
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-05-30 DOI: 10.1007/s11571-024-10125-w
Sang-Yoon Kim, Woochang Lim

The basal ganglia (BG) in the brain exhibit diverse functions for motor, cognition, and emotion. Such BG functions could be made via competitive harmony between the two competing pathways, direct pathway (DP) (facilitating movement) and indirect pathway (IP) (suppressing movement). As a result of break-up of harmony between DP and IP, there appear pathological states with disorder for movement, cognition, and psychiatry. In this paper, we are concerned about the Huntington’s disease (HD), which is a genetic neurodegenerative disorder causing involuntary movement and severe cognitive and psychiatric symptoms. For the HD, the number of D2 SPNs ((N_{rm D2})) is decreased due to degenerative loss, and hence, by decreasing (x_{rm D2}) (fraction of (N_{rm D2})), we investigate break-up of harmony between DP and IP in terms of their competition degree (mathcal{C}_d), given by the ratio of strength of DP ((mathcal{S}_{DP})) to strength of IP ((mathcal{S}_{IP})) (i.e., (mathcal{C}_d = mathcal{S}_{DP} / mathcal{S}_{IP})). In the case of HD, the IP is under-active, in contrast to the case of Parkinson’s disease with over-active IP, which results in increase in (mathcal{C}_d) (from the normal value). Thus, hyperkinetic dyskinesia such as chorea (involuntary jerky movement) occurs. We also investigate treatment of HD, based on optogenetics and GP ablation, by increasing strength of IP, resulting in recovery of harmony between DP and IP. Finally, we study effect of loss of healthy synapses of all the BG cells on HD. Due to loss of healthy synapses, disharmony between DP and IP increases, leading to worsen symptoms of the HD.

大脑基底神经节(BG)在运动、认知和情感方面具有多种功能。基底节的这些功能可以通过直接通路(DP)(促进运动)和间接通路(IP)(抑制运动)这两条相互竞争的通路之间的竞争性和谐来实现。由于 DP 和 IP 之间的和谐被打破,出现了运动、认知和精神紊乱的病理状态。本文关注的亨廷顿氏病(Huntington's disease,HD)是一种遗传性神经退行性疾病,会导致不自主运动以及严重的认知和精神症状。对于 HD,D2 SPNs 的数量((N_{rm D2}))会因退行性丧失而减少,因此,通过减少 (x_{rm D2})((N_{rm D2})的一部分)、我们从 DP 和 IP 的竞争度 (mathcal{C}_d)来研究 DP 和 IP 之间和谐的破裂,该竞争度由 DP 的强度((mathcal{S}_{DP}))与 IP 的强度((mathcal{S}_{IP}))之比给出(即:DP 的强度((mathcal{S}_{DP}))。e.,(mathcal{C}_d = mathcal{S}_{DP} / mathcal{S}_{IP}))。在 HD 的情况下,IP 是不活跃的,而帕金森病的情况下,IP 过度活跃,导致 (mathcal{C}_d)(与正常值相比)增加。因此,就会出现运动障碍,如舞蹈症(不自主的抽搐运动)。我们还研究了基于光遗传学和 GP 消融的 HD 治疗方法,即通过增加 IP 的强度来恢复 DP 和 IP 之间的和谐。最后,我们研究了失去所有 BG 细胞的健康突触对 HD 的影响。由于失去了健康的突触,DP 和 IP 之间的不协调性增加,导致 HD 症状恶化。
{"title":"Break-up and recovery of harmony between direct and indirect pathways in the basal ganglia: Huntington’s disease and treatment","authors":"Sang-Yoon Kim, Woochang Lim","doi":"10.1007/s11571-024-10125-w","DOIUrl":"https://doi.org/10.1007/s11571-024-10125-w","url":null,"abstract":"<p>The basal ganglia (BG) in the brain exhibit diverse functions for motor, cognition, and emotion. Such BG functions could be made via competitive harmony between the two competing pathways, direct pathway (DP) (facilitating movement) and indirect pathway (IP) (suppressing movement). As a result of break-up of harmony between DP and IP, there appear pathological states with disorder for movement, cognition, and psychiatry. In this paper, we are concerned about the Huntington’s disease (HD), which is a genetic neurodegenerative disorder causing involuntary movement and severe cognitive and psychiatric symptoms. For the HD, the number of D2 SPNs (<span>(N_{rm D2})</span>) is decreased due to degenerative loss, and hence, by decreasing <span>(x_{rm D2})</span> (fraction of <span>(N_{rm D2})</span>), we investigate break-up of harmony between DP and IP in terms of their competition degree <span>(mathcal{C}_d)</span>, given by the ratio of strength of DP (<span>(mathcal{S}_{DP})</span>) to strength of IP (<span>(mathcal{S}_{IP})</span>) (i.e., <span>(mathcal{C}_d = mathcal{S}_{DP} / mathcal{S}_{IP})</span>). In the case of HD, the IP is under-active, in contrast to the case of Parkinson’s disease with over-active IP, which results in increase in <span>(mathcal{C}_d)</span> (from the normal value). Thus, hyperkinetic dyskinesia such as chorea (involuntary jerky movement) occurs. We also investigate treatment of HD, based on optogenetics and GP ablation, by increasing strength of IP, resulting in recovery of harmony between DP and IP. Finally, we study effect of loss of healthy synapses of all the BG cells on HD. Due to loss of healthy synapses, disharmony between DP and IP increases, leading to worsen symptoms of the HD.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"53 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141190676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Affective EEG-based cross-session person identification using hierarchical graph embedding 利用分层图嵌入进行基于情感脑电图的跨会期人员识别
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-05-29 DOI: 10.1007/s11571-024-10132-x
Honggang Liu, Xuanyu Jin, Dongjun Liu, Wanzeng Kong, Jiajia Tang, Yong Peng

The electroencephalogram (EEG) signal is being investigated as a more confidential biometric for person identification. Despite recent advancements, a persistent challenge lies in the influence of variations in affective states. Affective states consistently exist during data collection, regardless of the protocol used. Additionally, the inherently non-stationary nature of EEG makes it susceptible to fluctuations in affective states over time. Therefore, it would be highly crucial to perform precise EEG-based person identification under varying affective states. This paper employed an integrated Multi-scale Convolution and Graph Pooling network (MCGP) to mitigate the impact of affective state variations. MCGP utilized multiple 1D convolutions at different scales to dynamically extract and fuse features. Additionally, a graph pooling layer with an attention mechanism was incorporated to generate hierarchical graph embeddings. These embeddings were concatenated as inputs for a fully connected classification layer. Experiments were conducted on the SEED and SEED-V dataset, revealing that MCGP achieved an average accuracy of 85.51% for SEED and 88.69% for SEED-V in cross-session conditions involving mixed affective states. Under single affective state cross-session scenario, MCGP achieved an average accuracy of 85.75% for SEED and 88.06% for SEED-V for the same affective states, while obtaining 79.57% for SEED and 84.52% for SEED-V for different affective states. Results indicated that, compared to the baseline methods, MCGP effectively mitigated the impact of variations in affective states across different sessions. In single affective state cross-session scenario, identification performance for the same affective states was slightly higher than that for different affective states.

脑电图(EEG)信号作为一种更保密的生物识别技术,正在被研究用于人员识别。尽管最近取得了进步,但持续存在的挑战在于情感状态变化的影响。在数据采集过程中,无论使用何种协议,情绪状态都会持续存在。此外,脑电图固有的非稳态特性使其容易受到情感状态随时间波动的影响。因此,在不同情感状态下进行基于脑电图的精确人员识别至关重要。本文采用了一个集成的多尺度卷积和图池化网络(MCGP)来减轻情感状态变化的影响。MCGP 利用不同尺度的多个一维卷积来动态提取和融合特征。此外,还加入了具有注意力机制的图池层,以生成分层图嵌入。这些嵌入被串联起来,作为全连接分类层的输入。在 SEED 和 SEED-V 数据集上进行的实验表明,在涉及混合情感状态的交叉会话条件下,MCGP 对 SEED 的平均准确率为 85.51%,对 SEED-V 的平均准确率为 88.69%。在单一情感状态交叉会话情况下,对于相同情感状态,MCGP 的 SEED 平均准确率为 85.75%,SEED-V 平均准确率为 88.06%;对于不同情感状态,MCGP 的 SEED 平均准确率为 79.57%,SEED-V 平均准确率为 84.52%。结果表明,与基线方法相比,MCGP 有效地减轻了不同会话中情感状态变化的影响。在单一情感状态跨时段情景下,相同情感状态的识别性能略高于不同情感状态的识别性能。
{"title":"Affective EEG-based cross-session person identification using hierarchical graph embedding","authors":"Honggang Liu, Xuanyu Jin, Dongjun Liu, Wanzeng Kong, Jiajia Tang, Yong Peng","doi":"10.1007/s11571-024-10132-x","DOIUrl":"https://doi.org/10.1007/s11571-024-10132-x","url":null,"abstract":"<p>The electroencephalogram (EEG) signal is being investigated as a more confidential biometric for person identification. Despite recent advancements, a persistent challenge lies in the influence of variations in affective states. Affective states consistently exist during data collection, regardless of the protocol used. Additionally, the inherently non-stationary nature of EEG makes it susceptible to fluctuations in affective states over time. Therefore, it would be highly crucial to perform precise EEG-based person identification under varying affective states. This paper employed an integrated Multi-scale Convolution and Graph Pooling network (MCGP) to mitigate the impact of affective state variations. MCGP utilized multiple 1D convolutions at different scales to dynamically extract and fuse features. Additionally, a graph pooling layer with an attention mechanism was incorporated to generate hierarchical graph embeddings. These embeddings were concatenated as inputs for a fully connected classification layer. Experiments were conducted on the SEED and SEED-V dataset, revealing that MCGP achieved an average accuracy of 85.51% for SEED and 88.69% for SEED-V in cross-session conditions involving mixed affective states. Under single affective state cross-session scenario, MCGP achieved an average accuracy of 85.75% for SEED and 88.06% for SEED-V for the same affective states, while obtaining 79.57% for SEED and 84.52% for SEED-V for different affective states. Results indicated that, compared to the baseline methods, MCGP effectively mitigated the impact of variations in affective states across different sessions. In single affective state cross-session scenario, identification performance for the same affective states was slightly higher than that for different affective states.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"23 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141190677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
PSPN: Pseudo-Siamese Pyramid Network for multimodal emotion analysis PSPN:用于多模态情感分析的伪暹罗金字塔网络
IF 3.7 3区 工程技术 Q2 NEUROSCIENCES Pub Date : 2024-05-28 DOI: 10.1007/s11571-024-10123-y
Yanyan Yin, Wanzeng Kong, Jiajia Tang, Jinghao Li, Fabio Babiloni

Emotion recognition plays an important role in human life and healthcare. The EEG has been extensively researched as an objective indicator of intense emotions. However, current existing methods lack sufficient analysis of shallow and deep EEG features. In addition, human emotions are complex and variable, making it difficult to comprehensively represent emotions using a single-modal signal. As a signal associated with gaze tracking and eye movement detection, Eye-related signals provide various forms of supplementary information for multimodal emotion analysis. Therefore, we propose a Pseudo-Siamese Pyramid Network (PSPN) for multimodal emotion analysis. The PSPN model employs a Depthwise Separable Convolutional Pyramid (DSCP) to extract and integrate intrinsic emotional features at various levels and scales from EEG signals. Simultaneously, we utilize a fully connected subnetwork to extract the external emotional features from eye-related signals. Finally, we introduce a Pseudo-Siamese network that integrates a flexible cross-modal dual-branch subnetwork to collaboratively utilize EEG emotional features and eye-related behavioral features, achieving consistency and complementarity in multimodal emotion recognition. For evaluation, we conducted experiments on the DEAP and SEED-IV public datasets. The experimental results demonstrate that multimodal fusion significantly improves the accuracy of emotion recognition compared to single-modal approaches. Our PSPN model achieved the best accuracy of 96.02% and 96.45% on the valence and arousal dimensions of the DEAP dataset, and 77.81% on the SEED-IV dataset, respectively. Our code link is: https://github.com/Yinyanyan003/PSPN.git.

情绪识别在人类生活和医疗保健中发挥着重要作用。脑电图作为强烈情绪的客观指标已被广泛研究。然而,现有方法缺乏对浅层和深层脑电图特征的充分分析。此外,人类的情绪复杂多变,很难通过单一模态信号来全面表达情绪。作为一种与注视跟踪和眼动检测相关的信号,眼动相关信号为多模态情绪分析提供了多种形式的补充信息。因此,我们提出了一种用于多模态情感分析的伪暹罗金字塔网络(PSPN)。PSPN 模型采用深度可分离卷积金字塔(DSCP)从脑电信号中提取并整合不同层次和尺度的内在情绪特征。同时,我们利用全连接子网络从眼部相关信号中提取外部情绪特征。最后,我们引入了一个伪连通网络(Pseudo-Siamese network),该网络整合了一个灵活的跨模态双分支子网络,协同利用脑电图情感特征和眼部相关行为特征,实现多模态情感识别的一致性和互补性。为了进行评估,我们在 DEAP 和 SEED-IV 公共数据集上进行了实验。实验结果表明,与单模态方法相比,多模态融合能显著提高情绪识别的准确性。我们的 PSPN 模型在 DEAP 数据集的情感维度和唤醒维度上分别达到了 96.02% 和 96.45% 的最佳准确率,在 SEED-IV 数据集上达到了 77.81% 的最佳准确率。我们的代码链接是:https://github.com/Yinyanyan003/PSPN.git。
{"title":"PSPN: Pseudo-Siamese Pyramid Network for multimodal emotion analysis","authors":"Yanyan Yin, Wanzeng Kong, Jiajia Tang, Jinghao Li, Fabio Babiloni","doi":"10.1007/s11571-024-10123-y","DOIUrl":"https://doi.org/10.1007/s11571-024-10123-y","url":null,"abstract":"<p>Emotion recognition plays an important role in human life and healthcare. The EEG has been extensively researched as an objective indicator of intense emotions. However, current existing methods lack sufficient analysis of shallow and deep EEG features. In addition, human emotions are complex and variable, making it difficult to comprehensively represent emotions using a single-modal signal. As a signal associated with gaze tracking and eye movement detection, Eye-related signals provide various forms of supplementary information for multimodal emotion analysis. Therefore, we propose a Pseudo-Siamese Pyramid Network (PSPN) for multimodal emotion analysis. The PSPN model employs a Depthwise Separable Convolutional Pyramid (DSCP) to extract and integrate intrinsic emotional features at various levels and scales from EEG signals. Simultaneously, we utilize a fully connected subnetwork to extract the external emotional features from eye-related signals. Finally, we introduce a Pseudo-Siamese network that integrates a flexible cross-modal dual-branch subnetwork to collaboratively utilize EEG emotional features and eye-related behavioral features, achieving consistency and complementarity in multimodal emotion recognition. For evaluation, we conducted experiments on the DEAP and SEED-IV public datasets. The experimental results demonstrate that multimodal fusion significantly improves the accuracy of emotion recognition compared to single-modal approaches. Our PSPN model achieved the best accuracy of 96.02% and 96.45% on the valence and arousal dimensions of the DEAP dataset, and 77.81% on the SEED-IV dataset, respectively. Our code link is: https://github.com/Yinyanyan003/PSPN.git.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":"65 1","pages":""},"PeriodicalIF":3.7,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141169350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Cognitive Neurodynamics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1