首页 > 最新文献

International journal of neural systems最新文献

英文 中文
A few-shot transfer learning approach for motion intention decoding from electroencephalographic signals 基于脑电图信号的动作意图解码的短时迁移学习方法
Pub Date : 2023-11-03 DOI: 10.1142/s0129065723500685
Nadia Mammone, Cosimo Ieracitano, Rossella Spataro, Christoph Guger, Woosang Cho, Francesco Carlo Morabito
{"title":"A few-shot transfer learning approach for motion intention decoding from electroencephalographic signals","authors":"Nadia Mammone, Cosimo Ieracitano, Rossella Spataro, Christoph Guger, Woosang Cho, Francesco Carlo Morabito","doi":"10.1142/s0129065723500685","DOIUrl":"https://doi.org/10.1142/s0129065723500685","url":null,"abstract":"","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":"33 19","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135873431","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Human Gait Activity Recognition Using Multimodal Sensors. 使用多模式传感器的人类步态活动识别。
Pub Date : 2023-11-01 Epub Date: 2023-09-30 DOI: 10.1142/S0129065723500582
Diego Teran-Pineda, Karl Thurnhofer-Hemsi, Enrique Domínguez

Human activity recognition is an application of machine learning with the aim of identifying activities from the gathered activity raw data acquired by different sensors. In medicine, human gait is commonly analyzed by doctors to detect abnormalities and determine possible treatments for the patient. Monitoring the patient's activity is paramount in evaluating the treatment's evolution. This type of classification is still not enough precise, which may lead to unfavorable reactions and responses. A novel methodology that reduces the complexity of extracting features from multimodal sensors is proposed to improve human activity classification based on accelerometer data. A sliding window technique is used to demarcate the first dominant spectral amplitude, decreasing dimensionality and improving feature extraction. In this work, we compared several state-of-art machine learning classifiers evaluated on the HuGaDB dataset and validated on our dataset. Several configurations to reduce features and training time were analyzed using multimodal sensors: all-axis spectrum, single-axis spectrum, and sensor reduction.

人类活动识别是机器学习的一种应用,目的是从不同传感器采集的活动原始数据中识别活动。在医学中,医生通常会分析人体步态,以检测异常情况并确定患者的可能治疗方法。监测患者的活动对于评估治疗进展至关重要。这种类型的分类仍然不够精确,这可能会导致不利的反应和反应。为了改进基于加速度计数据的人类活动分类,提出了一种降低多模式传感器特征提取复杂性的新方法。使用滑动窗口技术来标定第一主谱幅度,降低维数并改进特征提取。在这项工作中,我们比较了在HuGaDB数据集上评估的几种最先进的机器学习分类器,并在我们的数据集上进行了验证。使用多模式传感器分析了几种减少特征和训练时间的配置:全轴谱、单轴谱和传感器缩减。
{"title":"Human Gait Activity Recognition Using Multimodal Sensors.","authors":"Diego Teran-Pineda,&nbsp;Karl Thurnhofer-Hemsi,&nbsp;Enrique Domínguez","doi":"10.1142/S0129065723500582","DOIUrl":"10.1142/S0129065723500582","url":null,"abstract":"<p><p>Human activity recognition is an application of machine learning with the aim of identifying activities from the gathered activity raw data acquired by different sensors. In medicine, human gait is commonly analyzed by doctors to detect abnormalities and determine possible treatments for the patient. Monitoring the patient's activity is paramount in evaluating the treatment's evolution. This type of classification is still not enough precise, which may lead to unfavorable reactions and responses. A novel methodology that reduces the complexity of extracting features from multimodal sensors is proposed to improve human activity classification based on accelerometer data. A sliding window technique is used to demarcate the first dominant spectral amplitude, decreasing dimensionality and improving feature extraction. In this work, we compared several state-of-art machine learning classifiers evaluated on the HuGaDB dataset and validated on our dataset. Several configurations to reduce features and training time were analyzed using multimodal sensors: all-axis spectrum, single-axis spectrum, and sensor reduction.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2350058"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41151065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Integrated Neurorobotics Model of the Cerebellar-Basal Ganglia Circuitry. 小脑基底神经节回路的集成神经机器人模型。
Pub Date : 2023-11-01 Epub Date: 2023-10-04 DOI: 10.1142/S0129065723500594
Jhielson M Pimentel, Renan C Moioli, Mariana F P De Araujo, Patricia A Vargas

This work presents a neurorobotics model of the brain that integrates the cerebellum and the basal ganglia regions to coordinate movements in a humanoid robot. This cerebellar-basal ganglia circuitry is well known for its relevance to the motor control used by most mammals. Other computational models have been designed for similar applications in the robotics field. However, most of them completely ignore the interplay between neurons from the basal ganglia and cerebellum. Recently, neuroscientists indicated that neurons from both regions communicate not only at the level of the cerebral cortex but also at the subcortical level. In this work, we built an integrated neurorobotics model to assess the capacity of the network to predict and adjust the motion of the hands of a robot in real time. Our model was capable of performing different movements in a humanoid robot by respecting the sensorimotor loop of the robot and the biophysical features of the neuronal circuitry. The experiments were executed in simulation and the real world. We believe that our proposed neurorobotics model can be an important tool for new studies on the brain and a reference toward new robot motor controllers.

这项工作提出了一个大脑神经机器人模型,该模型集成了小脑和基底神经节区域,以协调人形机器人的运动。众所周知,这种小脑基底神经节回路与大多数哺乳动物使用的运动控制有关。已经为机器人领域的类似应用设计了其他计算模型。然而,它们中的大多数完全忽略了基底神经节和小脑神经元之间的相互作用。最近,神经科学家指出,这两个区域的神经元不仅在大脑皮层水平上交流,而且在皮层下水平上交流。在这项工作中,我们建立了一个集成的神经机器人模型,以评估网络实时预测和调整机器人手部运动的能力。我们的模型能够通过尊重机器人的感觉运动回路和神经元回路的生物物理特征,在人形机器人中进行不同的运动。实验是在模拟和现实世界中进行的。我们相信,我们提出的神经机器人模型可以成为对大脑进行新研究的重要工具,并为新的机器人运动控制器提供参考。
{"title":"An Integrated Neurorobotics Model of the Cerebellar-Basal Ganglia Circuitry.","authors":"Jhielson M Pimentel,&nbsp;Renan C Moioli,&nbsp;Mariana F P De Araujo,&nbsp;Patricia A Vargas","doi":"10.1142/S0129065723500594","DOIUrl":"10.1142/S0129065723500594","url":null,"abstract":"<p><p>This work presents a neurorobotics model of the brain that integrates the cerebellum and the basal ganglia regions to coordinate movements in a humanoid robot. This cerebellar-basal ganglia circuitry is well known for its relevance to the motor control used by most mammals. Other computational models have been designed for similar applications in the robotics field. However, most of them completely ignore the interplay between neurons from the basal ganglia and cerebellum. Recently, neuroscientists indicated that neurons from both regions communicate not only at the level of the cerebral cortex but also at the subcortical level. In this work, we built an integrated neurorobotics model to assess the capacity of the network to predict and adjust the motion of the hands of a robot in real time. Our model was capable of performing different movements in a humanoid robot by respecting the sensorimotor loop of the robot and the biophysical features of the neuronal circuitry. The experiments were executed in simulation and the real world. We believe that our proposed neurorobotics model can be an important tool for new studies on the brain and a reference toward new robot motor controllers.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2350059"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41143843","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Unsupervised Domain Adaptive Dose Prediction via Cross-Attention Transformer and Target-Specific Knowledge Preservation. 通过交叉注意力变换器和目标特定知识保存的无监督域自适应剂量预测。
Pub Date : 2023-11-01 Epub Date: 2023-09-29 DOI: 10.1142/S0129065723500570
Jiaqi Cui, Jianghong Xiao, Yun Hou, Xi Wu, Jiliu Zhou, Xingchen Peng, Yan Wang

Radiotherapy is one of the leading treatments for cancer. To accelerate the implementation of radiotherapy in clinic, various deep learning-based methods have been developed for automatic dose prediction. However, the effectiveness of these methods heavily relies on the availability of a substantial amount of data with labels, i.e. the dose distribution maps, which cost dosimetrists considerable time and effort to acquire. For cancers of low-incidence, such as cervical cancer, it is often a luxury to collect an adequate amount of labeled data to train a well-performing deep learning (DL) model. To mitigate this problem, in this paper, we resort to the unsupervised domain adaptation (UDA) strategy to achieve accurate dose prediction for cervical cancer (target domain) by leveraging the well-labeled high-incidence rectal cancer (source domain). Specifically, we introduce the cross-attention mechanism to learn the domain-invariant features and develop a cross-attention transformer-based encoder to align the two different cancer domains. Meanwhile, to preserve the target-specific knowledge, we employ multiple domain classifiers to enforce the network to extract more discriminative target features. In addition, we employ two independent convolutional neural network (CNN) decoders to compensate for the lack of spatial inductive bias in the pure transformer and generate accurate dose maps for both domains. Furthermore, to enhance the performance, two additional losses, i.e. a knowledge distillation loss (KDL) and a domain classification loss (DCL), are incorporated to transfer the domain-invariant features while preserving domain-specific information. Experimental results on a rectal cancer dataset and a cervical cancer dataset have demonstrated that our method achieves the best quantitative results with [Formula: see text], [Formula: see text], and HI of 1.446, 1.231, and 0.082, respectively, and outperforms other methods in terms of qualitative assessment.

放射治疗是癌症的主要治疗方法之一。为了加快放射治疗在临床上的实施,已经开发了各种基于深度学习的自动剂量预测方法。然而,这些方法的有效性在很大程度上取决于大量带有标签的数据的可用性,即剂量分布图,这需要剂量测量学家花费大量的时间和精力来获取。对于低发病率的癌症,如癌症,收集足够数量的标记数据来训练性能良好的深度学习(DL)模型通常是一种奢侈。为了缓解这一问题,在本文中,我们采用无监督领域自适应(UDA)策略,通过利用标记良好的高发病率癌症(源领域)来实现宫颈癌症(目标领域)的准确剂量预测。具体来说,我们引入了交叉注意机制来学习域内变异特征,并开发了一种基于交叉注意变换器的编码器来对齐两个不同的癌症域。同时,为了保留目标特定的知识,我们使用多个领域分类器来增强网络,以提取更具鉴别性的目标特征。此外,我们使用两个独立的卷积神经网络(CNN)解码器来补偿纯变换器中空间感应偏置的不足,并为两个域生成准确的剂量图。此外,为了提高性能,引入了两个额外的损失,即知识提取损失(KDL)和领域分类损失(DCL),以在保留领域特定信息的同时转移领域不变特征。直肠癌症数据集和癌症数据集的实验结果表明,我们的方法在[公式:见正文]、[公式:看正文]和HI分别为1.446、1.231和0.082的情况下获得了最佳的定量结果,并在定性评估方面优于其他方法。
{"title":"Unsupervised Domain Adaptive Dose Prediction via Cross-Attention Transformer and Target-Specific Knowledge Preservation.","authors":"Jiaqi Cui,&nbsp;Jianghong Xiao,&nbsp;Yun Hou,&nbsp;Xi Wu,&nbsp;Jiliu Zhou,&nbsp;Xingchen Peng,&nbsp;Yan Wang","doi":"10.1142/S0129065723500570","DOIUrl":"10.1142/S0129065723500570","url":null,"abstract":"<p><p>Radiotherapy is one of the leading treatments for cancer. To accelerate the implementation of radiotherapy in clinic, various deep learning-based methods have been developed for automatic dose prediction. However, the effectiveness of these methods heavily relies on the availability of a substantial amount of data with labels, i.e. the dose distribution maps, which cost dosimetrists considerable time and effort to acquire. For cancers of low-incidence, such as cervical cancer, it is often a luxury to collect an adequate amount of labeled data to train a well-performing deep learning (DL) model. To mitigate this problem, in this paper, we resort to the unsupervised domain adaptation (UDA) strategy to achieve accurate dose prediction for cervical cancer (target domain) by leveraging the well-labeled high-incidence rectal cancer (source domain). Specifically, we introduce the cross-attention mechanism to learn the domain-invariant features and develop a cross-attention transformer-based encoder to align the two different cancer domains. Meanwhile, to preserve the target-specific knowledge, we employ multiple domain classifiers to enforce the network to extract more discriminative target features. In addition, we employ two independent convolutional neural network (CNN) decoders to compensate for the lack of spatial inductive bias in the pure transformer and generate accurate dose maps for both domains. Furthermore, to enhance the performance, two additional losses, i.e. a knowledge distillation loss (KDL) and a domain classification loss (DCL), are incorporated to transfer the domain-invariant features while preserving domain-specific information. Experimental results on a rectal cancer dataset and a cervical cancer dataset have demonstrated that our method achieves the best quantitative results with [Formula: see text], [Formula: see text], and HI of 1.446, 1.231, and 0.082, respectively, and outperforms other methods in terms of qualitative assessment.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2350057"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41177765","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hierarchical Bayesian Causality Network to Extract High-Level Semantic Information in Visual Cortex 层次贝叶斯因果网络提取视觉皮层高级语义信息
Pub Date : 2023-10-27 DOI: 10.1142/s0129065724500023
Ma Yongqiang, Zhang Wen, Du Ming, Jing Haodong, Zheng Nanning
{"title":"Hierarchical Bayesian Causality Network to Extract High-Level Semantic Information in Visual Cortex","authors":"Ma Yongqiang, Zhang Wen, Du Ming, Jing Haodong, Zheng Nanning","doi":"10.1142/s0129065724500023","DOIUrl":"https://doi.org/10.1142/s0129065724500023","url":null,"abstract":"","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":"121 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136312444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Variable projection support vector machines and some applications using adaptive Hermite expansions 可变投影支持向量机和一些应用自适应Hermite展开
Pub Date : 2023-10-27 DOI: 10.1142/s0129065724500047
Tamas Dozsa, Federico Deuschle, Bram Cornelis, Peter Kovacs
Summary: We introduce an extension of the classical support vector machine classification algorithm with adaptive orthogonal transformations. The proposed transformations are realized through so-called variable projection operators. This approach allows the classifier to learn an informative representation of the data during the training process. Furthermore, choosing the underlying adaptive transformations correctly allows for learning interpretable parameters. Since the gradients of the proposed transformations are known with respect to the learnable parameters, we focus on training the primal form the modified SVM objectives using a stochastic subgradient method. We consider the possibility of using Mercer kernels with the proposed algorithms. We construct a case study using the linear combinations of adaptive Hermite functions where the proposed classification scheme outperforms the classical support vector machine approach. The proposed variable projection support vector machines provide a lightweight alternative to deep learning methods which incorporate automatic feature extraction.
{"title":"Variable projection support vector machines and some applications using adaptive Hermite expansions","authors":"Tamas Dozsa, Federico Deuschle, Bram Cornelis, Peter Kovacs","doi":"10.1142/s0129065724500047","DOIUrl":"https://doi.org/10.1142/s0129065724500047","url":null,"abstract":"Summary: We introduce an extension of the classical support vector machine classification algorithm with adaptive orthogonal transformations. The proposed transformations are realized through so-called variable projection operators. This approach allows the classifier to learn an informative representation of the data during the training process. Furthermore, choosing the underlying adaptive transformations correctly allows for learning interpretable parameters. Since the gradients of the proposed transformations are known with respect to the learnable parameters, we focus on training the primal form the modified SVM objectives using a stochastic subgradient method. We consider the possibility of using Mercer kernels with the proposed algorithms. We construct a case study using the linear combinations of adaptive Hermite functions where the proposed classification scheme outperforms the classical support vector machine approach. The proposed variable projection support vector machines provide a lightweight alternative to deep learning methods which incorporate automatic feature extraction.","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":"191 5","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136312493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Neonatal White Matter Damage Analysis using DTI Super-resolution and Multi-modality Image Registration 使用DTI超分辨率和多模态图像配准分析新生儿白质损伤
Pub Date : 2023-10-27 DOI: 10.1142/s0129065724500011
Yi Wang, Yuan Zhang, Chi Ma, Rui Wang, Zhe Guo, Yu Shen, Miaomiao Wang, Hongying Meng
Punctate White Matter Damage (PWMD) is a common neonatal brain disease, which can easily cause neurological disorder and strongly affect life quality in terms of neuromotor and cognitive performance. Especially, at the neonatal stage, the best cure time can be easily missed because PWMD is not conducive to the diagnosis based on current existing methods. The lesion of PWMD is relatively straightforward on T1-weighted Magnetic Resonance Imaging (T1 MRI), showing semi-oval, cluster or linear high signals. Diffusion Tensor Magnetic Resonance Image (DT-MRI, referred to as DTI) is a noninvasive technique that can be used to study brain microstructures in vivo, and provide information on movement and cognition-related nerve fiber tracts. Therefore, a new method was proposed to use T1 MRI combined with DTI for better neonatal PWMD analysis based on DTI super-resolution and multi-modality image registration. First, after preprocessing, neonatal DTI super-resolution was performed with the three times B-spline interpolation algorithm based on the Log-Euclidean space to improve DTIs' resolution to fit the T1 MRIs and facilitate nerve fiber tractography. Second, the symmetric diffeomorphic registration algorithm and inverse b0 image were selected for multi-modality image registration of DTI and T1 MRI. Finally, the 3D lesion models were combined with fiber tractography results to analyze and predict the degree of PWMD lesions affecting fiber tracts. Extensive experiments demonstrated the effectiveness and super performance of our proposed method. This streamlined technique can play an essential auxiliary role in diagnosing and treating neonatal PWMD.
{"title":"Neonatal White Matter Damage Analysis using DTI Super-resolution and Multi-modality Image Registration","authors":"Yi Wang, Yuan Zhang, Chi Ma, Rui Wang, Zhe Guo, Yu Shen, Miaomiao Wang, Hongying Meng","doi":"10.1142/s0129065724500011","DOIUrl":"https://doi.org/10.1142/s0129065724500011","url":null,"abstract":"Punctate White Matter Damage (PWMD) is a common neonatal brain disease, which can easily cause neurological disorder and strongly affect life quality in terms of neuromotor and cognitive performance. Especially, at the neonatal stage, the best cure time can be easily missed because PWMD is not conducive to the diagnosis based on current existing methods. The lesion of PWMD is relatively straightforward on T1-weighted Magnetic Resonance Imaging (T1 MRI), showing semi-oval, cluster or linear high signals. Diffusion Tensor Magnetic Resonance Image (DT-MRI, referred to as DTI) is a noninvasive technique that can be used to study brain microstructures in vivo, and provide information on movement and cognition-related nerve fiber tracts. Therefore, a new method was proposed to use T1 MRI combined with DTI for better neonatal PWMD analysis based on DTI super-resolution and multi-modality image registration. First, after preprocessing, neonatal DTI super-resolution was performed with the three times B-spline interpolation algorithm based on the Log-Euclidean space to improve DTIs' resolution to fit the T1 MRIs and facilitate nerve fiber tractography. Second, the symmetric diffeomorphic registration algorithm and inverse b0 image were selected for multi-modality image registration of DTI and T1 MRI. Finally, the 3D lesion models were combined with fiber tractography results to analyze and predict the degree of PWMD lesions affecting fiber tracts. Extensive experiments demonstrated the effectiveness and super performance of our proposed method. This streamlined technique can play an essential auxiliary role in diagnosing and treating neonatal PWMD.","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":"148 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136312439","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multi-Level Laser Induced Pain Measurement With Wasserstein Generative Adversarial Network - Gradient Penalty Model 基于Wasserstein生成对抗网络-梯度惩罚模型的多层次激光诱导疼痛测量
Pub Date : 2023-10-20 DOI: 10.1142/s0129065723500673
Jiancai Leng, Jianqun Zhu, Yihao Yan, Xin Yu, Ming Liu, Yitai Lou, Yanbing Liu, Licai Gao, Yuan Sun, Tianzheng He, Qingbo Yang, Chao Feng, Dezheng Wang, Yang Zhang, Qing Xu, Fangzhou Xu
{"title":"Multi-Level Laser Induced Pain Measurement With Wasserstein Generative Adversarial Network - Gradient Penalty Model","authors":"Jiancai Leng, Jianqun Zhu, Yihao Yan, Xin Yu, Ming Liu, Yitai Lou, Yanbing Liu, Licai Gao, Yuan Sun, Tianzheng He, Qingbo Yang, Chao Feng, Dezheng Wang, Yang Zhang, Qing Xu, Fangzhou Xu","doi":"10.1142/s0129065723500673","DOIUrl":"https://doi.org/10.1142/s0129065723500673","url":null,"abstract":"","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135567100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effect of Action Units, Viewpoint and Immersion on Emotion Recognition Using Dynamic Virtual Faces. 动作单元、视点和沉浸对动态虚拟人脸情感识别的影响。
Pub Date : 2023-10-01 DOI: 10.1142/S0129065723500533
Miguel A Vicente-Querol, Antonio Fernández-Caballero, Pascual González, Luz M González-Gualda, Patricia Fernández-Sotos, José P Molina, Arturo S García

Facial affect recognition is a critical skill in human interactions that is often impaired in psychiatric disorders. To address this challenge, tests have been developed to measure and train this skill. Recently, virtual human (VH) and virtual reality (VR) technologies have emerged as novel tools for this purpose. This study investigates the unique contributions of different factors in the communication and perception of emotions conveyed by VHs. Specifically, it examines the effects of the use of action units (AUs) in virtual faces, the positioning of the VH (frontal or mid-profile), and the level of immersion in the VR environment (desktop screen versus immersive VR). Thirty-six healthy subjects participated in each condition. Dynamic virtual faces (DVFs), VHs with facial animations, were used to represent the six basic emotions and the neutral expression. The results highlight the important role of the accurate implementation of AUs in virtual faces for emotion recognition. Furthermore, it is observed that frontal views outperform mid-profile views in both test conditions, while immersive VR shows a slight improvement in emotion recognition. This study provides novel insights into the influence of these factors on emotion perception and advances the understanding and application of these technologies for effective facial emotion recognition training.

面部情感识别是人类互动中的一项关键技能,在精神疾病中往往会受到损害。为了应对这一挑战,已经开发了测试来衡量和培训这一技能。最近,虚拟人(VH)和虚拟现实(VR)技术已经成为实现这一目的的新颖工具。本研究调查了不同因素在VHs传达的情感交流和感知中的独特贡献。具体而言,它考察了在虚拟人脸中使用动作单元(AU)的效果、VH的定位(正面或中间轮廓)以及在VR环境中的沉浸水平(桌面屏幕与沉浸式VR)。36名健康受试者参与了每种情况。动态虚拟人脸(DVF),即带有面部动画的VH,用于表示六种基本情绪和中性表情。研究结果突出了AU在虚拟人脸情感识别中的准确实现的重要作用。此外,观察到,在两种测试条件下,正面视图都优于中间视图,而沉浸式VR在情绪识别方面略有改善。这项研究为这些因素对情绪感知的影响提供了新的见解,并促进了对这些技术的理解和应用,以进行有效的面部情绪识别训练。
{"title":"Effect of Action Units, Viewpoint and Immersion on Emotion Recognition Using Dynamic Virtual Faces.","authors":"Miguel A Vicente-Querol,&nbsp;Antonio Fernández-Caballero,&nbsp;Pascual González,&nbsp;Luz M González-Gualda,&nbsp;Patricia Fernández-Sotos,&nbsp;José P Molina,&nbsp;Arturo S García","doi":"10.1142/S0129065723500533","DOIUrl":"https://doi.org/10.1142/S0129065723500533","url":null,"abstract":"<p><p>Facial affect recognition is a critical skill in human interactions that is often impaired in psychiatric disorders. To address this challenge, tests have been developed to measure and train this skill. Recently, virtual human (VH) and virtual reality (VR) technologies have emerged as novel tools for this purpose. This study investigates the unique contributions of different factors in the communication and perception of emotions conveyed by VHs. Specifically, it examines the effects of the use of action units (AUs) in virtual faces, the positioning of the VH (frontal or mid-profile), and the level of immersion in the VR environment (desktop screen versus immersive VR). Thirty-six healthy subjects participated in each condition. Dynamic virtual faces (DVFs), VHs with facial animations, were used to represent the six basic emotions and the neutral expression. The results highlight the important role of the accurate implementation of AUs in virtual faces for emotion recognition. Furthermore, it is observed that frontal views outperform mid-profile views in both test conditions, while immersive VR shows a slight improvement in emotion recognition. This study provides novel insights into the influence of these factors on emotion perception and advances the understanding and application of these technologies for effective facial emotion recognition training.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":"33 10","pages":"2350053"},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41155867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Self-supervised eeg representation learning with contrastive predictive coding for post-stroke 基于对比预测编码的脑卒中后自监督脑电表征学习
Pub Date : 2023-09-29 DOI: 10.1142/s0129065723500661
Fangzhou Xu, Yihao Yan, Jianqun Zhu, Xinyi Chen, Licai Gao, Yanbing Liu, Weiyou Shi, Yitai Lou, Wei Wang, Jiancai Leng, Yang Zhang
Stroke patients are prone to fatigue during the EEG acquisition procedure, and experiments have high requirements on cognition and physical limitations of subjects. Therefore, how to learn effective feature representation is very important. Deep learning networks have been widely used in motor imagery (MI) based brain-computer interface (BCI). This paper proposes a contrast predictive coding (CPC) framework based on the modified s-transform (MST) to generate MST-CPC feature representations. MST is used to acquire the temporal-frequency feature to improve the decoding performance for MI task recognition. EEG2Image is used to convert multi-channel one-dimensional EEG into two-dimensional EEG topography. High-level feature representations are generated by CPC which consists of an encoder and autoregressive model. Finally, the effectiveness of generated features is verified by the k-means clustering algorithm. It can be found that our model generates features with high efficiency and a good clustering effect. After classification performance evaluation, the average classification accuracy of MI tasks is 89% based on 40 subjects. The proposed method can obtain effective feature representations and improve the performance of MI-BCI systems. By comparing several self-supervised methods on the public dataset, it can be concluded that the MST-CPC model has the highest average accuracy. This is a breakthrough in the combination of self-supervised learning and image processing of EEG signals. It is helpful to provide effective rehabilitation training for stroke patients to promote motor function recovery.
{"title":"Self-supervised eeg representation learning with contrastive predictive coding for post-stroke","authors":"Fangzhou Xu, Yihao Yan, Jianqun Zhu, Xinyi Chen, Licai Gao, Yanbing Liu, Weiyou Shi, Yitai Lou, Wei Wang, Jiancai Leng, Yang Zhang","doi":"10.1142/s0129065723500661","DOIUrl":"https://doi.org/10.1142/s0129065723500661","url":null,"abstract":"Stroke patients are prone to fatigue during the EEG acquisition procedure, and experiments have high requirements on cognition and physical limitations of subjects. Therefore, how to learn effective feature representation is very important. Deep learning networks have been widely used in motor imagery (MI) based brain-computer interface (BCI). This paper proposes a contrast predictive coding (CPC) framework based on the modified s-transform (MST) to generate MST-CPC feature representations. MST is used to acquire the temporal-frequency feature to improve the decoding performance for MI task recognition. EEG2Image is used to convert multi-channel one-dimensional EEG into two-dimensional EEG topography. High-level feature representations are generated by CPC which consists of an encoder and autoregressive model. Finally, the effectiveness of generated features is verified by the k-means clustering algorithm. It can be found that our model generates features with high efficiency and a good clustering effect. After classification performance evaluation, the average classification accuracy of MI tasks is 89% based on 40 subjects. The proposed method can obtain effective feature representations and improve the performance of MI-BCI systems. By comparing several self-supervised methods on the public dataset, it can be concluded that the MST-CPC model has the highest average accuracy. This is a breakthrough in the combination of self-supervised learning and image processing of EEG signals. It is helpful to provide effective rehabilitation training for stroke patients to promote motor function recovery.","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135132847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International journal of neural systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1