首页 > 最新文献

International journal of neural systems最新文献

英文 中文
An Efficient Group Federated Learning Framework for Large-Scale EEG-Based Driver Drowsiness Detection. 基于脑电图的大规模驾驶员困倦检测的高效组联邦学习框架。
Pub Date : 2024-01-01 Epub Date: 2023-11-15 DOI: 10.1142/S0129065724500035
Xinyuan Chen, Yi Niu, Yanna Zhao, Xue Qin

To avoid traffic accidents, monitoring the driver's electroencephalogram (EEG) signals to assess drowsiness is an effective solution. However, aggregating the personal data of these drivers may lead to insufficient data usage and pose a risk of privacy breaches. To address these issues, a framework called Group Federated Learning (Group-FL) for large-scale driver drowsiness detection is proposed, which can efficiently utilize diverse client data while protecting privacy. First, by arranging the clients into different levels of groups and gradually aggregating their model parameters from low-level groups to high-level groups, communication and time costs are reduced. In addition, to solve the problem of notable variations in EEG signals among different clients, a global-personalized deep neural network is designed. The global model extracts shared features from various clients, while the personalized model extracts fine-grained features from each client and outputs classification results. Finally, to address special issues such as scale/category imbalance and data pollution, three checking modules are designed for adjusting grouping, evaluating client data, and effectively applying personalized models. Through extensive experimentation, the effectiveness of each component within the framework was validated, and a mean accuracy, F1-score, and Area Under Curve (AUC) of 81.0%, 82.0%, and 87.9% was achieved, respectively, on a publicly available dataset comprising 11 subjects.

为了避免交通事故的发生,监测驾驶员的脑电图信号来评估困倦程度是一种有效的解决方案。然而,汇总这些司机的个人数据可能会导致数据使用不足,并带来隐私泄露的风险。为了解决这些问题,提出了一种用于大规模驾驶员困倦检测的小组联邦学习(Group- fl)框架,该框架可以在保护隐私的同时有效地利用各种客户端数据。首先,通过将客户端划分到不同层次的群组中,并将其模型参数从低级群组逐步聚合到高级群组,减少通信成本和时间成本。此外,针对不同客户端脑电信号差异较大的问题,设计了全局个性化的深度神经网络。全局模型从各个客户端提取共享特征,个性化模型从每个客户端提取细粒度特征并输出分类结果。最后,针对规模/类别失衡、数据污染等特殊问题,设计了三个检查模块,用于调整分组、评估客户数据和有效应用个性化模型。通过广泛的实验,验证了框架内每个组件的有效性,在包含11个受试者的公开数据集上,平均准确率、f1得分和曲线下面积(AUC)分别达到81.0%、82.0%和87.9%。
{"title":"An Efficient Group Federated Learning Framework for Large-Scale EEG-Based Driver Drowsiness Detection.","authors":"Xinyuan Chen, Yi Niu, Yanna Zhao, Xue Qin","doi":"10.1142/S0129065724500035","DOIUrl":"10.1142/S0129065724500035","url":null,"abstract":"<p><p>To avoid traffic accidents, monitoring the driver's electroencephalogram (EEG) signals to assess drowsiness is an effective solution. However, aggregating the personal data of these drivers may lead to insufficient data usage and pose a risk of privacy breaches. To address these issues, a framework called Group Federated Learning (Group-FL) for large-scale driver drowsiness detection is proposed, which can efficiently utilize diverse client data while protecting privacy. First, by arranging the clients into different levels of groups and gradually aggregating their model parameters from low-level groups to high-level groups, communication and time costs are reduced. In addition, to solve the problem of notable variations in EEG signals among different clients, a global-personalized deep neural network is designed. The global model extracts shared features from various clients, while the personalized model extracts fine-grained features from each client and outputs classification results. Finally, to address special issues such as scale/category imbalance and data pollution, three checking modules are designed for adjusting grouping, evaluating client data, and effectively applying personalized models. Through extensive experimentation, the effectiveness of each component within the framework was validated, and a mean accuracy, <i>F</i>1-score, and Area Under Curve (AUC) of 81.0%, 82.0%, and 87.9% was achieved, respectively, on a publicly available dataset comprising 11 subjects.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2450003"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"107593148","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Unsupervised Neural Manifold Alignment for Stable Decoding of Movement from Cortical Signals. 从皮层信号对运动进行稳定解码的无监督神经簇对齐。
Pub Date : 2024-01-01 Epub Date: 2023-12-06 DOI: 10.1142/S0129065724500060
Mohammadali Ganjali, Alireza Mehridehnavi, Sajed Rakhshani, Abed Khorasani

The stable decoding of movement parameters using neural activity is crucial for the success of brain-machine interfaces (BMIs). However, neural activity can be unstable over time, leading to changes in the parameters used for decoding movement, which can hinder accurate movement decoding. To tackle this issue, one approach is to transfer neural activity to a stable, low-dimensional manifold using dimensionality reduction techniques and align manifolds across sessions by maximizing correlations of the manifolds. However, the practical use of manifold stabilization techniques requires knowledge of the true subject intentions such as target direction or behavioral state. To overcome this limitation, an automatic unsupervised algorithm is proposed that determines movement target intention before manifold alignment in the presence of manifold rotation and scaling across sessions. This unsupervised algorithm is combined with a dimensionality reduction and alignment method to overcome decoder instabilities. The effectiveness of the BMI stabilizer method is represented by decoding the two-dimensional (2D) hand velocity of two rhesus macaque monkeys during a center-out-reaching movement task. The performance of the proposed method is evaluated using correlation coefficient and R-squared measures, demonstrating higher decoding performance compared to a state-of-the-art unsupervised BMI stabilizer. The results offer benefits for the automatic determination of movement intents in long-term BMI decoding. Overall, the proposed method offers a promising automatic solution for achieving stable and accurate movement decoding in BMI applications.

利用神经活动对运动参数进行稳定解码对于脑机接口(BMI)的成功至关重要。然而,神经活动可能随着时间的推移而不稳定,导致用于解码运动的参数发生变化,从而阻碍准确的运动解码。为解决这一问题,一种方法是利用降维技术将神经活动转移到稳定的低维流形中,并通过最大化流形的相关性来调整各次会话中的流形。然而,流形稳定技术的实际使用需要了解真实的主体意图,如目标方向或行为状态。为了克服这一局限性,我们提出了一种自动无监督算法,该算法可在流形跨时段旋转和缩放的情况下,在流形对齐前确定运动目标意图。这种无监督算法与降维和对齐方法相结合,克服了解码器的不稳定性。BMI 稳定器方法的有效性通过解码两只猕猴在中心向外伸展运动任务中的二维(2D)手速来体现。使用相关系数和 R 平方度量评估了所提方法的性能,结果表明,与最先进的无监督 BMI 稳定器相比,该方法具有更高的解码性能。这些结果有利于在长期 BMI 解码中自动确定运动意图。总之,所提出的方法为在 BMI 应用中实现稳定、准确的运动解码提供了一种很有前途的自动解决方案。
{"title":"Unsupervised Neural Manifold Alignment for Stable Decoding of Movement from Cortical Signals.","authors":"Mohammadali Ganjali, Alireza Mehridehnavi, Sajed Rakhshani, Abed Khorasani","doi":"10.1142/S0129065724500060","DOIUrl":"10.1142/S0129065724500060","url":null,"abstract":"<p><p>The stable decoding of movement parameters using neural activity is crucial for the success of brain-machine interfaces (BMIs). However, neural activity can be unstable over time, leading to changes in the parameters used for decoding movement, which can hinder accurate movement decoding. To tackle this issue, one approach is to transfer neural activity to a stable, low-dimensional manifold using dimensionality reduction techniques and align manifolds across sessions by maximizing correlations of the manifolds. However, the practical use of manifold stabilization techniques requires knowledge of the true subject intentions such as target direction or behavioral state. To overcome this limitation, an automatic unsupervised algorithm is proposed that determines movement target intention before manifold alignment in the presence of manifold rotation and scaling across sessions. This unsupervised algorithm is combined with a dimensionality reduction and alignment method to overcome decoder instabilities. The effectiveness of the BMI stabilizer method is represented by decoding the two-dimensional (2D) hand velocity of two rhesus macaque monkeys during a center-out-reaching movement task. The performance of the proposed method is evaluated using correlation coefficient and <i>R</i>-squared measures, demonstrating higher decoding performance compared to a state-of-the-art unsupervised BMI stabilizer. The results offer benefits for the automatic determination of movement intents in long-term BMI decoding. Overall, the proposed method offers a promising automatic solution for achieving stable and accurate movement decoding in BMI applications.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2450006"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138815299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Lightweight Seizure Detection Based on Multi-Scale Channel Attention. 基于多尺度通道注意力的轻型癫痫检测。
Pub Date : 2023-12-01 Epub Date: 2023-10-17 DOI: 10.1142/S0129065723500612
Ziwei Wang, Sujuan Hou, Tiantian Xiao, Yongfeng Zhang, Hongbin Lv, Jiacheng Li, Shanshan Zhao, Yanna Zhao

Epilepsy is one kind of neurological disease characterized by recurring seizures. Recurrent seizures can cause ongoing negative mental and cognitive damage to the patient. Therefore, timely diagnosis and treatment of epilepsy are crucial for patients. Manual electroencephalography (EEG) signals analysis is time and energy consuming, making automatic detection using EEG signals particularly important. Many deep learning algorithms have thus been proposed to detect seizures. These methods rely on expensive and bulky hardware, which makes them unsuitable for deployment on devices with limited resources due to their high demands on computer resources. In this paper, we propose a novel lightweight neural network for seizure detection using pure convolutions, which is composed of inverted residual structure and multi-scale channel attention mechanism. Compared with other methods, our approach significantly reduces the computational complexity, making it possible to deploy on low-cost portable devices for seizures detection. We conduct experiments on the CHB-MIT dataset and achieves 98.7% accuracy, 98.3% sensitivity and 99.1% specificity with 2.68[Formula: see text]M multiply-accumulate operations (MACs) and only 88[Formula: see text]K parameters.

癫痫是一种以反复发作为特征的神经系统疾病。反复发作会对患者造成持续的负面精神和认知损伤。因此,癫痫的及时诊断和治疗对患者来说至关重要。手工脑电图(EEG)信号分析耗时耗能,使得利用EEG信号进行自动检测尤为重要。因此,已经提出了许多深度学习算法来检测癫痫发作。这些方法依赖于昂贵且庞大的硬件,这使得它们由于对计算机资源的高需求而不适合部署在资源有限的设备上。在本文中,我们提出了一种新的轻量级神经网络,用于使用纯卷积的癫痫检测,该网络由倒置残差结构和多尺度通道注意机制组成。与其他方法相比,我们的方法显著降低了计算复杂性,使其能够部署在低成本的便携式设备上进行癫痫发作检测。我们在CHB-MIT数据集上进行了实验,获得了98.7%的准确率、98.3%的灵敏度和99.1%的特异性,参数为2.68[公式:见正文]M乘累加运算(MAC)和仅88[公式:参见正文]K。
{"title":"Lightweight Seizure Detection Based on Multi-Scale Channel Attention.","authors":"Ziwei Wang, Sujuan Hou, Tiantian Xiao, Yongfeng Zhang, Hongbin Lv, Jiacheng Li, Shanshan Zhao, Yanna Zhao","doi":"10.1142/S0129065723500612","DOIUrl":"10.1142/S0129065723500612","url":null,"abstract":"<p><p>Epilepsy is one kind of neurological disease characterized by recurring seizures. Recurrent seizures can cause ongoing negative mental and cognitive damage to the patient. Therefore, timely diagnosis and treatment of epilepsy are crucial for patients. Manual electroencephalography (EEG) signals analysis is time and energy consuming, making automatic detection using EEG signals particularly important. Many deep learning algorithms have thus been proposed to detect seizures. These methods rely on expensive and bulky hardware, which makes them unsuitable for deployment on devices with limited resources due to their high demands on computer resources. In this paper, we propose a novel lightweight neural network for seizure detection using pure convolutions, which is composed of inverted residual structure and multi-scale channel attention mechanism. Compared with other methods, our approach significantly reduces the computational complexity, making it possible to deploy on low-cost portable devices for seizures detection. We conduct experiments on the CHB-MIT dataset and achieves 98.7% accuracy, 98.3% sensitivity and 99.1% specificity with 2.68[Formula: see text]M multiply-accumulate operations (MACs) and only 88[Formula: see text]K parameters.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2350061"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41242618","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Eye State Detection Using Frequency Features from 1 or 2-Channel EEG. 使用来自1或2通道EEG的频率特征的眼睛状态检测。
Pub Date : 2023-12-01 Epub Date: 2023-10-12 DOI: 10.1142/S0129065723500624
Francisco Laport, Adriana Dapena, Paula M Castro, Daniel I Iglesias, Francisco J Vazquez-Araujo

Brain-computer interfaces (BCIs) establish a direct communication channel between the human brain and external devices. Among various methods, electroencephalography (EEG) stands out as the most popular choice for BCI design due to its non-invasiveness, ease of use, and cost-effectiveness. This paper aims to present and compare the accuracy and robustness of an EEG system employing one or two channels. We present both hardware and algorithms for the detection of open and closed eyes. Firstly, we utilize a low-cost hardware device to capture EEG activity from one or two channels. Next, we apply the discrete Fourier transform to analyze the signals in the frequency domain, extracting features from each channel. For classification, we test various well-known techniques, including Linear Discriminant Analysis (LDA), Support Vector Machine (SVM), Decision Tree (DT), or Logistic Regression (LR). To evaluate the system, we conduct experiments, acquiring signals associated with open and closed eyes, and compare the performance between one and two channels. The results demonstrate that employing a system with two channels and using SVM, DT, or LR classifiers enhances robustness compared to a single-channel setup and allows us to achieve an accuracy percentage greater than 95% for both eye states.

脑机接口(BCI)建立了人脑与外部设备之间的直接通信通道。在各种方法中,脑电图(EEG)因其非侵入性、易用性和成本效益而成为脑机接口设计中最受欢迎的选择。本文旨在介绍和比较使用一个或两个通道的脑电图系统的准确性和稳健性。我们介绍了用于检测睁开和闭合眼睛的硬件和算法。首先,我们利用低成本的硬件设备从一个或两个通道捕获脑电图活动。接下来,我们应用离散傅立叶变换在频域中分析信号,从每个通道中提取特征。对于分类,我们测试了各种众所周知的技术,包括线性判别分析(LDA)、支持向量机(SVM)、决策树(DT)或逻辑回归(LR)。为了评估该系统,我们进行了实验,获取了与睁开和闭合眼睛相关的信号,并比较了一个和两个通道之间的性能。结果表明,与单通道设置相比,采用具有两个通道的系统并使用SVM、DT或LR分类器可以增强鲁棒性,并使我们能够实现两种眼睛状态都大于95%的准确率。
{"title":"Eye State Detection Using Frequency Features from 1 or 2-Channel EEG.","authors":"Francisco Laport, Adriana Dapena, Paula M Castro, Daniel I Iglesias, Francisco J Vazquez-Araujo","doi":"10.1142/S0129065723500624","DOIUrl":"10.1142/S0129065723500624","url":null,"abstract":"<p><p>Brain-computer interfaces (BCIs) establish a direct communication channel between the human brain and external devices. Among various methods, electroencephalography (EEG) stands out as the most popular choice for BCI design due to its non-invasiveness, ease of use, and cost-effectiveness. This paper aims to present and compare the accuracy and robustness of an EEG system employing one or two channels. We present both hardware and algorithms for the detection of open and closed eyes. Firstly, we utilize a low-cost hardware device to capture EEG activity from one or two channels. Next, we apply the discrete Fourier transform to analyze the signals in the frequency domain, extracting features from each channel. For classification, we test various well-known techniques, including Linear Discriminant Analysis (LDA), Support Vector Machine (SVM), Decision Tree (DT), or Logistic Regression (LR). To evaluate the system, we conduct experiments, acquiring signals associated with open and closed eyes, and compare the performance between one and two channels. The results demonstrate that employing a system with two channels and using SVM, DT, or LR classifiers enhances robustness compared to a single-channel setup and allows us to achieve an accuracy percentage greater than 95% for both eye states.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2350062"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41224086","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Hybrid Online Off-Policy Reinforcement Learning Agent Framework Supported by Transformers. 一个由Transformers支持的混合在线-离线策略强化学习代理框架。
Pub Date : 2023-12-01 Epub Date: 2023-10-20 DOI: 10.1142/S012906572350065X
Enrique Adrian Villarrubia-Martin, Luis Rodriguez-Benitez, Luis Jimenez-Linares, David Muñoz-Valero, Jun Liu

Reinforcement learning (RL) is a powerful technique that allows agents to learn optimal decision-making policies through interactions with an environment. However, traditional RL algorithms suffer from several limitations such as the need for large amounts of data and long-term credit assignment, i.e. the problem of determining which actions actually produce a certain reward. Recently, Transformers have shown their capacity to address these constraints in this area of learning in an offline setting. This paper proposes a framework that uses Transformers to enhance the training of online off-policy RL agents and address the challenges described above through self-attention. The proposal introduces a hybrid agent with a mixed policy that combines an online off-policy agent with an offline Transformer agent using the Decision Transformer architecture. By sequentially exchanging the experience replay buffer between the agents, the agent's learning training efficiency is improved in the first iterations and so is the training of Transformer-based RL agents in situations with limited data availability or unknown environments.

强化学习(RL)是一种强大的技术,它允许代理通过与环境的交互来学习最优决策策略。然而,传统的RL算法受到一些限制,例如需要大量数据和长期的信用分配,即确定哪些行为实际上产生了一定的奖励的问题。最近,变形金刚已经显示出他们有能力在离线环境中解决这一学习领域的这些限制。本文提出了一个框架,该框架使用Transformers来加强在线策略外RL代理的培训,并通过自我关注来解决上述挑战。该提案引入了一种具有混合策略的混合代理,该混合策略使用Decision Transformer架构将在线策略外代理与离线Transformer代理相结合。通过在代理之间顺序交换经验回放缓冲区,在第一次迭代中提高了代理的学习训练效率,在数据可用性有限或环境未知的情况下,基于Transformer的RL代理的训练也提高了效率。
{"title":"A Hybrid Online Off-Policy Reinforcement Learning Agent Framework Supported by Transformers.","authors":"Enrique Adrian Villarrubia-Martin, Luis Rodriguez-Benitez, Luis Jimenez-Linares, David Muñoz-Valero, Jun Liu","doi":"10.1142/S012906572350065X","DOIUrl":"10.1142/S012906572350065X","url":null,"abstract":"<p><p>Reinforcement learning (RL) is a powerful technique that allows agents to learn optimal decision-making policies through interactions with an environment. However, traditional RL algorithms suffer from several limitations such as the need for large amounts of data and long-term credit assignment, i.e. the problem of determining which actions actually produce a certain reward. Recently, Transformers have shown their capacity to address these constraints in this area of learning in an offline setting. This paper proposes a framework that uses Transformers to enhance the training of online off-policy RL agents and address the challenges described above through self-attention. The proposal introduces a hybrid agent with a mixed policy that combines an online off-policy agent with an offline Transformer agent using the Decision Transformer architecture. By sequentially exchanging the experience replay buffer between the agents, the agent's learning training efficiency is improved in the first iterations and so is the training of Transformer-based RL agents in situations with limited data availability or unknown environments.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2350065"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49686651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Announcement: The 2023 Hojjat Adeli Award for Outstanding Contributions in Neural Systems. 公告:2023年霍贾特·阿德利神经系统杰出贡献奖。
Pub Date : 2023-12-01 Epub Date: 2023-10-13 DOI: 10.1142/S0129065723820014
{"title":"Announcement: The 2023 Hojjat Adeli Award for Outstanding Contributions in Neural Systems.","authors":"","doi":"10.1142/S0129065723820014","DOIUrl":"10.1142/S0129065723820014","url":null,"abstract":"","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2382001"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41224084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing Robustness of Medical Image Segmentation Model with Neural Memory Ordinary Differential Equation. 用神经记忆常微分方程增强医学图像分割模型的鲁棒性。
Pub Date : 2023-12-01 Epub Date: 2023-09-23 DOI: 10.1142/S0129065723500600
Junjie Hu, Chengrong Yu, Zhang Yi, Haixian Zhang

Deep neural networks (DNNs) have emerged as a prominent model in medical image segmentation, achieving remarkable advancements in clinical practice. Despite the promising results reported in the literature, the effectiveness of DNNs necessitates substantial quantities of high-quality annotated training data. During experiments, we observe a significant decline in the performance of DNNs on the test set when there exists disruption in the labels of the training dataset, revealing inherent limitations in the robustness of DNNs. In this paper, we find that the neural memory ordinary differential equation (nmODE), a recently proposed model based on ordinary differential equations (ODEs), not only addresses the robustness limitation but also enhances performance when trained by the clean training dataset. However, it is acknowledged that the ODE-based model tends to be less computationally efficient compared to the conventional discrete models due to the multiple function evaluations required by the ODE solver. Recognizing the efficiency limitation of the ODE-based model, we propose a novel approach called the nmODE-based knowledge distillation (nmODE-KD). The proposed method aims to transfer knowledge from the continuous nmODE to a discrete layer, simultaneously enhancing the model's robustness and efficiency. The core concept of nmODE-KD revolves around enforcing the discrete layer to mimic the continuous nmODE by minimizing the KL divergence between them. Experimental results on 18 organs-at-risk segmentation tasks demonstrate that nmODE-KD exhibits improved robustness compared to ODE-based models while also mitigating the efficiency limitation.

深度神经网络(DNN)已成为医学图像分割中的一个突出模型,在临床实践中取得了显著进展。尽管文献中报道了有希望的结果,但DNN的有效性需要大量高质量的注释训练数据。在实验过程中,当训练数据集的标签存在中断时,我们观察到DNN在测试集上的性能显著下降,这揭示了DNN鲁棒性的内在局限性。在本文中,我们发现神经记忆常微分方程(nmODE)是最近提出的一种基于常微分方程的模型,当使用干净的训练数据集进行训练时,它不仅解决了鲁棒性的限制,而且提高了性能。然而,众所周知,与传统离散模型相比,基于ODE的模型往往计算效率较低,这是因为ODE求解器需要进行多个函数评估。认识到基于ODE的模型的效率限制,我们提出了一种新的方法,称为基于nmODE的知识提取(nmODE-KD)。该方法旨在将知识从连续nmODE转移到离散层,同时提高模型的鲁棒性和效率。nmODE-KD的核心概念围绕着通过最小化离散层之间的KL发散来强制离散层模拟连续nmODE。在18个有风险的器官分割任务上的实验结果表明,与基于ODE的模型相比,nmODE-KD表现出更好的鲁棒性,同时也减轻了效率限制。
{"title":"Enhancing Robustness of Medical Image Segmentation Model with Neural Memory Ordinary Differential Equation.","authors":"Junjie Hu, Chengrong Yu, Zhang Yi, Haixian Zhang","doi":"10.1142/S0129065723500600","DOIUrl":"10.1142/S0129065723500600","url":null,"abstract":"<p><p>Deep neural networks (DNNs) have emerged as a prominent model in medical image segmentation, achieving remarkable advancements in clinical practice. Despite the promising results reported in the literature, the effectiveness of DNNs necessitates substantial quantities of high-quality annotated training data. During experiments, we observe a significant decline in the performance of DNNs on the test set when there exists disruption in the labels of the training dataset, revealing inherent limitations in the robustness of DNNs. In this paper, we find that the neural memory ordinary differential equation (nmODE), a recently proposed model based on ordinary differential equations (ODEs), not only addresses the robustness limitation but also enhances performance when trained by the clean training dataset. However, it is acknowledged that the ODE-based model tends to be less computationally efficient compared to the conventional discrete models due to the multiple function evaluations required by the ODE solver. Recognizing the efficiency limitation of the ODE-based model, we propose a novel approach called the nmODE-based knowledge distillation (nmODE-KD). The proposed method aims to transfer knowledge from the continuous nmODE to a discrete layer, simultaneously enhancing the model's robustness and efficiency. The core concept of nmODE-KD revolves around enforcing the discrete layer to mimic the continuous nmODE by minimizing the KL divergence between them. Experimental results on 18 organs-at-risk segmentation tasks demonstrate that nmODE-KD exhibits improved robustness compared to ODE-based models while also mitigating the efficiency limitation.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2350060"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41180733","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Learning-Based Classification of Epileptic Electroencephalography Signals Using a Concentrated Time-Frequency Approach. 使用集中时频方法对癫痫脑电图信号进行基于深度学习的分类。
Pub Date : 2023-12-01 Epub Date: 2023-10-13 DOI: 10.1142/S0129065723500648
Mosab A A Yousif, Mahmut Ozturk

ConceFT (concentration of frequency and time) is a new time-frequency (TF) analysis method which combines multitaper technique and synchrosqueezing transform (SST). This combination produces highly concentrated TF representations with approximately perfect time and frequency resolutions. In this paper, it is aimed to show the TF representation performance and robustness of ConceFT by using it for the classification of the epileptic electroencephalography (EEG) signals. Therefore, a signal classification algorithm which uses TF images obtained with ConceFT to feed the transfer learning structure has been presented. Epilepsy is a common neurological disorder that millions of people suffer worldwide. Daily lives of the patients are quite difficult because of the unpredictable time of seizures. EEG signals monitoring the electrical activity of the brain can be used to detect approaching seizures and make possible to warn the patient before the attack. GoogLeNet which is a well-known deep learning model has been preferred to classify TF images. Classification performance is directly related to the TF representation accuracy of the ConceFT. The proposed method has been tested for various classification scenarios and obtained accuracies between 95.83% and 99.58% for two and three-class classification scenarios. High results show that ConceFT is a successful and promising TF analysis method for non-stationary biomedical signals.

ConceFT(频率和时间的集中)是一种新的时频分析方法,它结合了多任务技术和同步压缩变换(SST)。这种组合产生了具有近似完美的时间和频率分辨率的高度集中的TF表示。本文旨在通过将ConceFT用于癫痫脑电图(EEG)信号的分类来展示其TF表示性能和鲁棒性。因此,已经提出了一种信号分类算法,该算法使用通过ConceFT获得的TF图像来馈送转移学习结构。癫痫是一种常见的神经系统疾病,全世界有数百万人患有。由于癫痫发作的时间不可预测,患者的日常生活相当困难。监测大脑电活动的EEG信号可以用来检测即将到来的癫痫发作,并有可能在发作前警告患者。GoogLeNet是一种众所周知的深度学习模型,它已被首选用于对TF图像进行分类。分类性能直接关系到ConceFT的TF表示精度。所提出的方法已经在各种分类场景中进行了测试,在两类和三类分类场景中获得了95.83%和99.58%的准确率。高结果表明,ConceFT是一种成功且有前景的非平稳生物医学信号TF分析方法。
{"title":"Deep Learning-Based Classification of Epileptic Electroencephalography Signals Using a Concentrated Time-Frequency Approach.","authors":"Mosab A A Yousif, Mahmut Ozturk","doi":"10.1142/S0129065723500648","DOIUrl":"10.1142/S0129065723500648","url":null,"abstract":"<p><p>ConceFT (concentration of frequency and time) is a new time-frequency (TF) analysis method which combines multitaper technique and synchrosqueezing transform (SST). This combination produces highly concentrated TF representations with approximately perfect time and frequency resolutions. In this paper, it is aimed to show the TF representation performance and robustness of ConceFT by using it for the classification of the epileptic electroencephalography (EEG) signals. Therefore, a signal classification algorithm which uses TF images obtained with ConceFT to feed the transfer learning structure has been presented. Epilepsy is a common neurological disorder that millions of people suffer worldwide. Daily lives of the patients are quite difficult because of the unpredictable time of seizures. EEG signals monitoring the electrical activity of the brain can be used to detect approaching seizures and make possible to warn the patient before the attack. GoogLeNet which is a well-known deep learning model has been preferred to classify TF images. Classification performance is directly related to the TF representation accuracy of the ConceFT. The proposed method has been tested for various classification scenarios and obtained accuracies between 95.83% and 99.58% for two and three-class classification scenarios. High results show that ConceFT is a successful and promising TF analysis method for non-stationary biomedical signals.</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2350064"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41224085","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bimodal Feature Analysis with Deep Learning for Autism Spectrum Disorder Detection 基于深度学习的双峰特征分析用于自闭症谱系障碍检测
Pub Date : 2023-11-07 DOI: 10.1142/s0129065724500059
Federica Colonnese, Francesco Di Luzio, Antonello Rosato, Massimo Panella
{"title":"Bimodal Feature Analysis with Deep Learning for Autism Spectrum Disorder Detection","authors":"Federica Colonnese, Francesco Di Luzio, Antonello Rosato, Massimo Panella","doi":"10.1142/s0129065724500059","DOIUrl":"https://doi.org/10.1142/s0129065724500059","url":null,"abstract":"","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":"71 10","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135545030","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Discriminative Power of Handwriting and Drawing Features in Depression 抑郁症患者笔迹与绘画特征的辨别力
Pub Date : 2023-11-07 DOI: 10.1142/s0129065723500697
Claudia Greco, Gennaro Raimo, Terry Amorese, Marialucia Cuciniello, Gavin Mcconvey, Gennaro Cordasco, Marcos Faundez-Zanuy, Alessandro Vinciarelli, Zoraida Callejas-Carrion, Anna Esposito
This study contributes knowledge on the detection of depression through handwriting/drawing features, to identify quantitative and noninvasive indicators of the disorder for implementing algorithms for its automatic detection. For this purpose, an original online approach was adopted to provide a dynamic evaluation of handwriting/drawing performance of healthy participants with no history of any psychiatric disorders ([Formula: see text]), and patients with a clinical diagnosis of depression ([Formula: see text]). Both groups were asked to complete seven tasks requiring either the writing or drawing on a paper while five handwriting/drawing features' categories (i.e. pressure on the paper, time, ductus, space among characters, and pen inclination) were recorded by using a digitalized tablet. The collected records were statistically analyzed. Results showed that, except for pressure, all the considered features, successfully discriminate between depressed and nondepressed subjects. In addition, it was observed that depression affects different writing/drawing functionalities. These findings suggest the adoption of writing/drawing tasks in the clinical practice as tools to support the current depression detection methods. This would have important repercussions on reducing the diagnostic times and treatment formulation.
{"title":"Discriminative Power of Handwriting and Drawing Features in Depression","authors":"Claudia Greco, Gennaro Raimo, Terry Amorese, Marialucia Cuciniello, Gavin Mcconvey, Gennaro Cordasco, Marcos Faundez-Zanuy, Alessandro Vinciarelli, Zoraida Callejas-Carrion, Anna Esposito","doi":"10.1142/s0129065723500697","DOIUrl":"https://doi.org/10.1142/s0129065723500697","url":null,"abstract":"This study contributes knowledge on the detection of depression through handwriting/drawing features, to identify quantitative and noninvasive indicators of the disorder for implementing algorithms for its automatic detection. For this purpose, an original online approach was adopted to provide a dynamic evaluation of handwriting/drawing performance of healthy participants with no history of any psychiatric disorders ([Formula: see text]), and patients with a clinical diagnosis of depression ([Formula: see text]). Both groups were asked to complete seven tasks requiring either the writing or drawing on a paper while five handwriting/drawing features' categories (i.e. pressure on the paper, time, ductus, space among characters, and pen inclination) were recorded by using a digitalized tablet. The collected records were statistically analyzed. Results showed that, except for pressure, all the considered features, successfully discriminate between depressed and nondepressed subjects. In addition, it was observed that depression affects different writing/drawing functionalities. These findings suggest the adoption of writing/drawing tasks in the clinical practice as tools to support the current depression detection methods. This would have important repercussions on reducing the diagnostic times and treatment formulation.","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":"71 9","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135545032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International journal of neural systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1