首页 > 最新文献

Journal of neural engineering最新文献

英文 中文
Successful transfer of myoelectric skill from virtual interface to prosthesis control. 成功地将肌电技能从虚拟界面转移到假肢控制。
IF 3.8 Pub Date : 2025-12-23 DOI: 10.1088/1741-2552/ae2803
Sigrid Dupan, Simon Stuttaford, Matthew Dyson

Objective.Prosthesis control can be seen as a new skill to be learned. To enhance learning, both internal and augmented feedback are exploited. The latter represents external feedback sources that can be designed to enhance learning, e.g. biofeedback. Previous research has shown that augmented feedback protocols can be designed to induce retention by adhering to the guidance hypothesis, but it is not clear yet if that also results in transfer of those skills to prosthesis control. In this study, we test if a training paradigm optimised for retention allows for the transfer of myoelectric skill to prosthesis control.Approach.Twelve limb-intact participants learned a novel myoelectric skill during five one-hour training sessions. To induce retention of the novel myoelectric skill, we used a delayed feedback paradigm. Prosthesis transfer was tested through pre-and post-tests with a prosthesis. Prosthesis control tests included a grasp matching task, the modified box and blocks test, and an object manipulation task, requiring five grasps in total ('power', 'tripod', 'pointer', 'lateral grip', and 'hand open').Main results.We found that prosthesis control improved significantly following five days of training. Importantly, the prosthesis control metrics were significantly related to the retention metric during training, but not to the prosthesis performance during the pre-test.Significance.This study shows that transfer of novel, abstract myoelectric control from a computer interface to prosthetic control is possible if the training paradigm is designed to induce retention. These results highlight the importance of approaching myoelectric and prosthetic skills from a skill acquisition standpoint, and open up new avenues for the design of prosthetic training protocols.

目的:义肢控制是一门值得学习的新技能。为了加强学习,内部反馈和增强反馈都被利用。后者代表可用于增强学习的外部反馈源,例如生物反馈。先前的研究表明,增强反馈协议可以通过遵循引导假设来诱导保留,但目前尚不清楚这是否也会导致这些技能转移到假肢控制上。在这项研究中,我们测试了一种优化的训练模式是否允许将肌电技能转移到假肢控制中。12名四肢完好的参与者在5次1小时的训练中学习了一种新的肌电技能。为了诱导新肌电技能的保留,我们使用了延迟反馈范式。通过假体的前后测试来测试假体转移。假肢控制测试包括抓握匹配任务、改进的盒子和块测试和物体操作任务,总共需要五个抓握(“动力”、“三脚架”、“指针”、“横向抓握”和“手张开”)。我们发现在5天的训练后,义肢的控制能力有了显著的提高。重要的是,假体控制指标与训练期间的保持指标显著相关,而与预测试期间的假体表现无关。 ;这项研究表明,如果训练模式被设计成诱导保留,那么将新颖的、抽象的肌电控制从计算机界面转移到假肢控制是可能的。这些结果强调了从技能习得的角度接近肌电和假肢技能的重要性,并为假肢训练方案的设计开辟了新的途径。
{"title":"Successful transfer of myoelectric skill from virtual interface to prosthesis control.","authors":"Sigrid Dupan, Simon Stuttaford, Matthew Dyson","doi":"10.1088/1741-2552/ae2803","DOIUrl":"10.1088/1741-2552/ae2803","url":null,"abstract":"<p><p><i>Objective.</i>Prosthesis control can be seen as a new skill to be learned. To enhance learning, both internal and augmented feedback are exploited. The latter represents external feedback sources that can be designed to enhance learning, e.g. biofeedback. Previous research has shown that augmented feedback protocols can be designed to induce retention by adhering to the guidance hypothesis, but it is not clear yet if that also results in transfer of those skills to prosthesis control. In this study, we test if a training paradigm optimised for retention allows for the transfer of myoelectric skill to prosthesis control.<i>Approach.</i>Twelve limb-intact participants learned a novel myoelectric skill during five one-hour training sessions. To induce retention of the novel myoelectric skill, we used a delayed feedback paradigm. Prosthesis transfer was tested through pre-and post-tests with a prosthesis. Prosthesis control tests included a grasp matching task, the modified box and blocks test, and an object manipulation task, requiring five grasps in total ('power', 'tripod', 'pointer', 'lateral grip', and 'hand open').<i>Main results.</i>We found that prosthesis control improved significantly following five days of training. Importantly, the prosthesis control metrics were significantly related to the retention metric during training, but not to the prosthesis performance during the pre-test.<i>Significance.</i>This study shows that transfer of novel, abstract myoelectric control from a computer interface to prosthetic control is possible if the training paradigm is designed to induce retention. These results highlight the importance of approaching myoelectric and prosthetic skills from a skill acquisition standpoint, and open up new avenues for the design of prosthetic training protocols.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145679375","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An augmented preference-based Bayesian approach for optimizing neuromodulation stimulation parameters using meta learning. 利用元学习优化神经调节刺激参数的增强偏好贝叶斯方法。
IF 3.8 Pub Date : 2025-12-23 DOI: 10.1088/1741-2552/ae2ba7
Hafsa Farooqi, Zixi Zhao, David Darrow, Andrew Lamperski, Théoden I Netoff

Background.Electrical neuromodulation is increasingly used in the treatment of neurological disorders; however, the selection of stimulation parameters that provide optimal therapeutic benefits remains a major challenge. Moreover, identifying pathological biomarkers linking the effect of stimulation parameters to alleviating symptoms, and hence required for optimizing stimulation parameters, might not always be possible.Objective.We present an augmented, preference-based Bayesian optimization algorithm to optimize stimulation parameters for participants undergoing neuromodulation. This algorithm incorporates two key features: I) It prioritizes the participant's preferences for stimulation parameters, making it independent of the need for pathological biomarkers. II) It leverages meta learning, using historical participant data to guide the initial optimization for new participants and overcome initial data sparsity. This approach improves both prediction accuracy and convergence speed.Approach.Consider preference training data collected from a set of historical participants who share the same neurological disorder as a new (target) participant. Within that population, there may be different response phenotypes. The goal is to identify historical participants whose stimulation-response phenotype is most similar to the target participant, and leverage their data to accelerate and improve parameter optimization for the target participant. To achieve this, the algorithm iteratively performs a two-step process:(I) a novel, iterative weighting procedure that identifies historical participants with stimulation preferences closest to the target participant, and (II) meta learning that combines the training data of the identified participants with the limited training data of the target participant to train novel, augmented preference learning models. These models are then used to predict the stimulation parameters expected to maximize the target participant's preference.Mainresults.The proposed algorithm has been validated using synthetically generated data sets that simulate participant preference behavior during neuromodulation.Significance.This approach holds promise for improving personalized neuromodulation therapies and advancing treatment outcomes for neurological disorders without the need for a tedious data collection process and disease-specific pathological biomarkers.

背景:神经电调节越来越多地用于神经系统疾病的治疗;然而,选择能提供最佳治疗效果的刺激参数仍然是一个主要挑战。此外,识别将刺激参数的效果与缓解症状联系起来的病理生物标志物,因此需要优化刺激参数,可能并不总是可能的。目的:我们提出了一种增强的、基于偏好的贝叶斯优化算法,以优化接受神经调节的参与者的刺激参数。该算法包含两个关键特征:1)它优先考虑参与者对刺激参数的偏好,使其独立于对病理生物标志物的需求。II)利用元学习,利用历史参与者数据指导新参与者的初始优化,克服初始数据稀疏性。该方法提高了预测精度和收敛速度。方法:考虑从一组与新(目标)参与者具有相同神经系统疾病的历史参与者中收集的偏好训练数据。在该人群中,可能存在不同的反应表型。目标是确定刺激反应表型与目标参与者最相似的历史参与者,并利用他们的数据来加速和改进目标参与者的参数优化。为了实现这一目标,该算法迭代地执行两步过程:(I)一种新颖的迭代加权过程,识别与目标参与者最接近的刺激偏好的历史参与者;(II)元学习,将已识别参与者的训练数据与目标参与者的有限训练数据相结合,以训练新颖的增强偏好学习模型。然后使用这些模型来预测预期的刺激参数,以最大限度地提高目标参与者的偏好。结果:所提出的算法已通过综合生成的数据集来验证,这些数据集模拟了参与者在神经调节过程中的偏好行为。结论:该方法有望改善个性化的神经调节疗法,提高神经疾病的治疗效果,而无需繁琐的数据收集过程以及疾病特异性病理生物标志物。
{"title":"An augmented preference-based Bayesian approach for optimizing neuromodulation stimulation parameters using meta learning.","authors":"Hafsa Farooqi, Zixi Zhao, David Darrow, Andrew Lamperski, Théoden I Netoff","doi":"10.1088/1741-2552/ae2ba7","DOIUrl":"10.1088/1741-2552/ae2ba7","url":null,"abstract":"<p><p><i>Background.</i>Electrical neuromodulation is increasingly used in the treatment of neurological disorders; however, the selection of stimulation parameters that provide optimal therapeutic benefits remains a major challenge. Moreover, identifying pathological biomarkers linking the effect of stimulation parameters to alleviating symptoms, and hence required for optimizing stimulation parameters, might not always be possible.<i>Objective.</i>We present an augmented, preference-based Bayesian optimization algorithm to optimize stimulation parameters for participants undergoing neuromodulation. This algorithm incorporates two key features: I) It prioritizes the participant's preferences for stimulation parameters, making it independent of the need for pathological biomarkers. II) It leverages meta learning, using historical participant data to guide the initial optimization for new participants and overcome initial data sparsity. This approach improves both prediction accuracy and convergence speed.<i>Approach.</i>Consider preference training data collected from a set of historical participants who share the same neurological disorder as a new (target) participant. Within that population, there may be different response phenotypes. The goal is to identify historical participants whose stimulation-response phenotype is most similar to the target participant, and leverage their data to accelerate and improve parameter optimization for the target participant. To achieve this, the algorithm iteratively performs a two-step process:(I) a novel, iterative weighting procedure that identifies historical participants with stimulation preferences closest to the target participant, and (II) meta learning that combines the training data of the identified participants with the limited training data of the target participant to train novel, augmented preference learning models. These models are then used to predict the stimulation parameters expected to maximize the target participant's preference.<i>Main</i><i>results.</i>The proposed algorithm has been validated using synthetically generated data sets that simulate participant preference behavior during neuromodulation.<i>Significance.</i>This approach holds promise for improving personalized neuromodulation therapies and advancing treatment outcomes for neurological disorders without the need for a tedious data collection process and disease-specific pathological biomarkers.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145746398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
STeCANet: spatio-temporal cross attention network for brain computer interface systems using EEG-fNIRS signals. 基于脑电图-近红外光谱信号的脑机接口系统时空交叉注意网络。
IF 3.8 Pub Date : 2025-12-23 DOI: 10.1088/1741-2552/ae2954
Mohd Faisal, Sudarsan Sahoo, Jupitara Hazarika

Objective.Multimodal neuroimaging fusion has shown promise in enhancing brain-computer interface (BCI) performance by capturing complementary neural dynamics. However, most existing fusion frameworks inadequately model the temporal asynchrony and adaptive fusion between electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), thereby limiting their ability to generalize across sessions and subjects. This work aims to develop an adaptive fusion framework that effectively aligns and integrates EEG and fNIRS representations to improve cross-session and cross-subject generalization in BCI applications.Approach. To address this, we propose STeCANet, a novel Spatiotemporal Cross-Attention Network that integrates EEG and fNIRS signals through hierarchical attention-based alignment. The model leverages fNIRS-guided spatial attention, EEG-fNIRS temporal alignment, adaptive fusion, and adversarial training to ensure robust cross-modal interaction and spatiotemporal consistency.Main results. Evaluations across three cognitive paradigms, namely motor imagery, mental arithmetic, and word generation, demonstrate that STeCANet significantly outperforms unimodal and recent multimodal baselines under both session-independent and subject-independent settings. Ablation studies confirm the contribution of each sub-module and loss function, including the domain adaptation component, in boosting classification accuracy and robustness.Significance. These results suggest that STeCANet offers a robust and interpretable solution for next-generation BCI applications.

多模态神经成像融合通过捕获互补的神经动力学,在增强脑机接口(BCI)性能方面显示出了希望。然而,大多数现有的融合框架没有充分模拟EEG和fNIRS之间的时间异步和自适应融合,从而限制了它们跨会话和对象的泛化能力。目的:本工作旨在开发一种自适应融合框架,有效地对齐和集成EEG和fNIRS表示,以改善脑机接口应用中的跨会话和跨主题泛化。方法-为了解决这个问题,我们提出了STeCANet,这是一种新型的时空交叉注意网络,通过分层的基于注意的校准集成了EEG和fNIRS信号。该模型利用fnirs引导的空间注意力、EEG-fNIRS时间对齐、自适应融合和对抗训练来确保稳健的跨模态交互和时空一致性。主要结果-对三种认知范式(即运动意象(MI),心算(MA)和词生成(WG))的评估表明,在会话独立和主题独立的设置下,STeCANet显著优于单模态和最近的多模态基线。消融研究证实了每个子模块和损失函数(包括域自适应成分)在提高分类精度和鲁棒性方面的贡献。这些结果表明,STeCANet为下一代脑机接口应用提供了一个健壮且可解释的解决方案。
{"title":"STeCANet: spatio-temporal cross attention network for brain computer interface systems using EEG-fNIRS signals.","authors":"Mohd Faisal, Sudarsan Sahoo, Jupitara Hazarika","doi":"10.1088/1741-2552/ae2954","DOIUrl":"10.1088/1741-2552/ae2954","url":null,"abstract":"<p><p><i>Objective.</i>Multimodal neuroimaging fusion has shown promise in enhancing brain-computer interface (BCI) performance by capturing complementary neural dynamics. However, most existing fusion frameworks inadequately model the temporal asynchrony and adaptive fusion between electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), thereby limiting their ability to generalize across sessions and subjects. This work aims to develop an adaptive fusion framework that effectively aligns and integrates EEG and fNIRS representations to improve cross-session and cross-subject generalization in BCI applications.<i>Approach</i>. To address this, we propose STeCANet, a novel Spatiotemporal Cross-Attention Network that integrates EEG and fNIRS signals through hierarchical attention-based alignment. The model leverages fNIRS-guided spatial attention, EEG-fNIRS temporal alignment, adaptive fusion, and adversarial training to ensure robust cross-modal interaction and spatiotemporal consistency.<i>Main results</i>. Evaluations across three cognitive paradigms, namely motor imagery, mental arithmetic, and word generation, demonstrate that STeCANet significantly outperforms unimodal and recent multimodal baselines under both session-independent and subject-independent settings. Ablation studies confirm the contribution of each sub-module and loss function, including the domain adaptation component, in boosting classification accuracy and robustness.<i>Significance</i>. These results suggest that STeCANet offers a robust and interpretable solution for next-generation BCI applications.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145710415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
EEG-based meditation decoding: tackling subject variability with spatial and temporal alignment. 基于脑电图的冥想解码:用空间和时间对齐处理受试者变异性。
IF 3.8 Pub Date : 2025-12-22 DOI: 10.1088/1741-2552/ae2b0f
Angeliki-Ilektra Karaiskou, Carolina Varon, Cem Ates Musluoglu, Kaat Alaerts, Maarten De Vos

Objective. Meditation and mindfulness are increasingly recognized as important in improving mental well-being. However, electroencephalography (EEG)-based neurofeedback systems supporting these practices typically fail to generalize to unseen subjects. This study investigates the application of both spatial and spectral alignment to EEG to improve the classification of meditation and rest states for new subjects without any model retraining.Approach. Two unsupervised domain adaptation techniques are employed to reduce differences between subjects in their EEG recordings. The first, Riemannian Space Data Alignment (RSDA), adjusts and brings together patterns of brain activity across electrodes (spatial domain). The second, Convolutional Monge Mapping Normalization (CMMN), aligns the distribution of brain rhythms across frequencies (spectral domain). Each method is evaluated separately, in combination, and in interaction withz-score normalization. Classification between meditation and rest is performed on the aligned time series using EEGNet, a compact convolutional neural network architecture, with leave-one-subject-out (LOSO) cross-validation to assess generalization across subjects. All experiments are based on a publicly available dataset of meditation EEG recordings from 53 subjects, including both novice and expert meditators.Main results. The combined RSDA+CMMN approach significantly improved LOSO classification accuracy (66.6%) compared to non-aligned (55.7%) andz-score normalized (59.6%) baselines, even though it did not improve overall harmonization. Spectral analysis identified consistent classification contributions from the Theta (4-8 Hz), Alpha (8-14 Hz), and Beta (14-30 Hz) bands, while spatial analysis highlighted Frontopolar and Temporal regions as critical for distinguishing the mental states of meditation and rest.Significance. This work is the first to explore both spatial and spectral alignment in subject-independent meditation decoding for improved cross-subject generalization. Aligning EEG time series without retraining provides a practical solution for real-time neurofeedback, thereby reducing subject variability and paving the way toward calibration-free neurotechnology that supports mental well-being.

目标。人们越来越认识到冥想和正念对改善心理健康的重要性。然而,基于脑电图(EEG)的神经反馈系统支持这些做法通常不能推广到看不见的对象。本研究探讨了空间和频谱对齐在脑电图中的应用,以改善新受试者在没有任何模型再训练的情况下的冥想和休息状态分类。采用两种无监督域自适应技术来减小被试脑电信号的差异。第一种是黎曼空间数据对齐(RSDA),它调整并汇集了跨电极(空间域)的大脑活动模式。第二种方法是卷积蒙格映射归一化(CMMN),它将大脑节奏在不同频率(谱域)上的分布对齐。每种方法分别评估,组合评估,并与z-score归一化相互作用。使用EEGNet(一种紧凑的卷积神经网络架构)对对齐的时间序列进行冥想和休息之间的分类,并使用留一个受试者(LOSO)交叉验证来评估受试者之间的泛化。所有的实验都是基于一个公开的数据集,包括53名冥想者的脑电图记录,其中包括新手和专家冥想者。主要的结果。与未对齐基线(55.7%)和z-score归一化基线(59.6%)相比,RSDA+CMMN联合方法显著提高了LOSO分类准确率(66.6%),尽管它没有提高总体协调性。光谱分析发现,Theta(4-8赫兹)、Alpha(8-14赫兹)和Beta(14-30赫兹)波段对分类的贡献是一致的,而空间分析则强调了额极区和颞叶区对区分冥想和休息的精神状态至关重要。这项工作首次探索了独立于主题的冥想解码中的空间和光谱对齐,以改善跨主题的泛化。无需再训练即可对齐脑电图时间序列为实时神经反馈提供了实用的解决方案,从而减少了受试者的可变性,并为支持心理健康的无需校准的神经技术铺平了道路。
{"title":"EEG-based meditation decoding: tackling subject variability with spatial and temporal alignment.","authors":"Angeliki-Ilektra Karaiskou, Carolina Varon, Cem Ates Musluoglu, Kaat Alaerts, Maarten De Vos","doi":"10.1088/1741-2552/ae2b0f","DOIUrl":"10.1088/1741-2552/ae2b0f","url":null,"abstract":"<p><p><i>Objective</i>. Meditation and mindfulness are increasingly recognized as important in improving mental well-being. However, electroencephalography (EEG)-based neurofeedback systems supporting these practices typically fail to generalize to unseen subjects. This study investigates the application of both spatial and spectral alignment to EEG to improve the classification of meditation and rest states for new subjects without any model retraining.<i>Approach</i>. Two unsupervised domain adaptation techniques are employed to reduce differences between subjects in their EEG recordings. The first, Riemannian Space Data Alignment (RSDA), adjusts and brings together patterns of brain activity across electrodes (spatial domain). The second, Convolutional Monge Mapping Normalization (CMMN), aligns the distribution of brain rhythms across frequencies (spectral domain). Each method is evaluated separately, in combination, and in interaction with<i>z</i>-score normalization. Classification between meditation and rest is performed on the aligned time series using EEGNet, a compact convolutional neural network architecture, with leave-one-subject-out (LOSO) cross-validation to assess generalization across subjects. All experiments are based on a publicly available dataset of meditation EEG recordings from 53 subjects, including both novice and expert meditators.<i>Main results</i>. The combined RSDA+CMMN approach significantly improved LOSO classification accuracy (66.6%) compared to non-aligned (55.7%) and<i>z</i>-score normalized (59.6%) baselines, even though it did not improve overall harmonization. Spectral analysis identified consistent classification contributions from the Theta (4-8 Hz), Alpha (8-14 Hz), and Beta (14-30 Hz) bands, while spatial analysis highlighted Frontopolar and Temporal regions as critical for distinguishing the mental states of meditation and rest.<i>Significance</i>. This work is the first to explore both spatial and spectral alignment in subject-independent meditation decoding for improved cross-subject generalization. Aligning EEG time series without retraining provides a practical solution for real-time neurofeedback, thereby reducing subject variability and paving the way toward calibration-free neurotechnology that supports mental well-being.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145728043","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting spiking activity from scalp EEG. 预测头皮脑电图的尖峰活动。
IF 3.8 Pub Date : 2025-12-19 DOI: 10.1088/1741-2552/ae2541
Dixit Sharma, Bart Krekelberg

Objective.Despite decades of electroencephalography (EEG) research, the relationship between EEG and underlying spiking dynamics remains unclear. This limits our ability to infer neural dynamics reflected in intracranial signals from EEG, a critical step to bridge electrophysiological findings across species and to develop non-invasive brain-machine interfaces (BMIs). In this study, we aimed to estimate spiking activity in the visual cortex using non-invasive scalp EEG.Approach. We recorded spiking activity from a 32-channel floating microarray permanently implanted in parafoveal V1 and scalp-EEG in a male macaque monkey. While the animal fixated, the screen flickered at different temporal frequencies to induce steady-state visual evoked potentials. We analyzed the relationship between the V1 multi-unit spiking activity envelope (MUAe) and EEG frequency bands to predict MUAe at each time point from EEG. We extracted instantaneous spectrotemporal features of the EEG signal, including phase, amplitude, and phase-amplitude coupling of its frequency bands.Main results. Although the relationship between these spectrotemporal features and the V1 MUAe was complex and frequency-dependent, they were reliably predictive of the MUAe. Specifically, in a linear regression predicting MUAe from EEG, each EEG feature (phase, amplitude, coupling) contributed to model predictions. In addition, we found that MUAe predictions were better in shallow than deep cortical layers, and that the phase of stimulus frequency further improved MUAe predictions.Significance.Our study shows that a comprehensive account of spectrotemporal features of non-invasive EEG provides information on underlying spiking activity beyond what is available when only the amplitude or phase of the EEG signal is considered. This demonstrates the richness of the EEG signal and its complex relationship with neural spiking activity and suggests that using more comprehensive spectrotemporal signatures could improve BMI applications.

目的:尽管几十年的脑电图研究,脑电图和潜在的尖峰动力学之间的关系尚不清楚。这限制了我们推断脑电图颅内信号反映的神经动力学的能力,这是跨越物种的电生理发现和开发非侵入性脑机接口(bmi)的关键一步。在这项研究中,我们的目的是利用非侵入性头皮脑电图来估计视觉皮层的尖峰活动。方法:我们记录了一个32通道的浮动微阵列永久植入一个雄性猕猴中央凹旁V1和头皮脑电图的峰值活动。当动物注视时,屏幕以不同的时间频率闪烁以诱导稳态视觉诱发电位(SSVEP)。通过分析V1多单元尖峰活动包络(MUAe)与脑电频带的关系,预测脑电各时间点的MUAe。我们提取了脑电信号的瞬时谱时间特征,包括其频带的相位、幅度和相幅耦合。主要结果:虽然这些光谱时间特征与V1 MUAe之间的关系是复杂的和频率相关的,但它们可以可靠地预测MUAe。具体来说,在从EEG预测MUAe的线性回归中,每个EEG特征(相位、幅度、耦合)都有助于模型预测。此外,我们发现MUAe预测在皮层浅层比深层更好,并且刺激频率的相位进一步改善了MUAe预测。意义:我们的研究表明,对非侵入性脑电图的光谱时间特征的全面描述提供了关于潜在尖峰活动的信息,而不仅仅是考虑脑电图信号的幅度或相位。这证明了脑电图信号的丰富性及其与神经尖峰活动的复杂关系,并表明使用更全面的光谱时间特征可以改善BMI的应用。
{"title":"Predicting spiking activity from scalp EEG.","authors":"Dixit Sharma, Bart Krekelberg","doi":"10.1088/1741-2552/ae2541","DOIUrl":"10.1088/1741-2552/ae2541","url":null,"abstract":"<p><p><i>Objective.</i>Despite decades of electroencephalography (EEG) research, the relationship between EEG and underlying spiking dynamics remains unclear. This limits our ability to infer neural dynamics reflected in intracranial signals from EEG, a critical step to bridge electrophysiological findings across species and to develop non-invasive brain-machine interfaces (BMIs). In this study, we aimed to estimate spiking activity in the visual cortex using non-invasive scalp EEG.<i>Approach</i>. We recorded spiking activity from a 32-channel floating microarray permanently implanted in parafoveal V1 and scalp-EEG in a male macaque monkey. While the animal fixated, the screen flickered at different temporal frequencies to induce steady-state visual evoked potentials. We analyzed the relationship between the V1 multi-unit spiking activity envelope (MUAe) and EEG frequency bands to predict MUAe at each time point from EEG. We extracted instantaneous spectrotemporal features of the EEG signal, including phase, amplitude, and phase-amplitude coupling of its frequency bands.<i>Main results</i>. Although the relationship between these spectrotemporal features and the V1 MUAe was complex and frequency-dependent, they were reliably predictive of the MUAe. Specifically, in a linear regression predicting MUAe from EEG, each EEG feature (phase, amplitude, coupling) contributed to model predictions. In addition, we found that MUAe predictions were better in shallow than deep cortical layers, and that the phase of stimulus frequency further improved MUAe predictions.<i>Significance.</i>Our study shows that a comprehensive account of spectrotemporal features of non-invasive EEG provides information on underlying spiking activity beyond what is available when only the amplitude or phase of the EEG signal is considered. This demonstrates the richness of the EEG signal and its complex relationship with neural spiking activity and suggests that using more comprehensive spectrotemporal signatures could improve BMI applications.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12715843/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145644066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adaptive neuromodulation dialogues: navigating current challenges and emerging innovations in neuromodulation system development. 自适应神经调节对话:导航当前的挑战和神经调节系统发展的新兴创新。
IF 3.8 Pub Date : 2025-12-19 DOI: 10.1088/1741-2552/ae2359
Frederik Lampert, Matthew R Baker, Michael A Jensen, Amir H Ayyoubi, Christian Bentler, Jessica L Bowersock, Rosana Esteller, Jeffrey A Herron, Graham W Johnson, Daryl R Kipke, Christopher K Kovach, Vaclav Kremen, Filip Mivalt, Joseph S Neimat, Theoden I Netoff, Enrico Opri, Alexander Rockhill, Joshua M Rosenow, Kristin K Sellers, Nathan P Staff, Chandra Prakash Swamy, Ashwin Viswanathan, Gerwin Schalk, Timothy Denison, Dora Hermes, Nuri F Ince, Peter Brunner, Gregory A Worrell, Kai J Miller

Adaptive neuromodulation systems and implantable brain-computer interfaces have made notable strides in recent years, translating experimental prototypes into clinical applications and garnering substantial attention from the public. This surge in interest is accompanied by increased scrutiny related to the safety, efficacy, and ethical implications of these systems, all of which must be directly addressed as we introduce new neurotechnologies. In response, we have synthesized the insights resulting from discussions between groups of experts in the field and summarized them into five key domains essential to therapeutic device development: (1) analyzing current landscape of neuromodulation devices and translational platforms (2) identifying clinical need, (3) understanding neural mechanisms, (4) designing viable technologies, and (5) addressing ethical concerns. The role of translational research platforms that allow rapid, iterative testing of hypotheses in both preclinical and clinical settings is emphasized. These platforms must balance experimental flexibility with patient safety and clear clinical benefit. Furthermore, requirements for interoperability, modularity, and wireless communication protocols are explored to support long-term usability and scalability. The current regulatory processes and funding models are examined alongside the ethical responsibilities of researchers and device manufacturers. Special attention is given to the role of patients as active contributors to research and to the long-term obligations we have to them as the primary burden-bearers of the implanted neurotechnologies. This article represents a synthesis of scientific, engineering, and clinical viewpoints to inform key stakeholders in the neuromodulation and brain-computer interface spaces.

自适应神经调节系统和植入式脑机接口近年来取得了显著进展,将实验原型转化为临床应用,并获得了公众的广泛关注。这种兴趣的激增伴随着对这些系统的安全性、有效性和伦理影响的越来越多的审查,所有这些都必须在我们引入新的神经技术时直接解决。作为回应,我们综合了该领域专家小组之间讨论的见解,并将其总结为治疗设备开发必不可少的五个关键领域:(1)分析神经调节设备和翻译平台的现状;(2)确定临床需求;(3)理解神经机制;(4)设计可行的技术;(5)解决伦理问题。强调了在临床前和临床设置中允许快速,迭代测试假设的转化研究平台的作用。这些平台必须在实验灵活性、患者安全性和明确的临床效益之间取得平衡。此外,还探讨了互操作性、模块化和无线通信协议的需求,以支持长期可用性和可伸缩性。目前的监管程序和资助模式与研究人员和设备制造商的道德责任一起被审查。特别关注患者作为研究的积极贡献者的作用,以及我们对他们作为植入神经技术的主要负担承担者的长期义务。本文综合了科学、工程和临床观点,为神经调节和脑机接口领域的关键利益相关者提供信息。
{"title":"Adaptive neuromodulation dialogues: navigating current challenges and emerging innovations in neuromodulation system development.","authors":"Frederik Lampert, Matthew R Baker, Michael A Jensen, Amir H Ayyoubi, Christian Bentler, Jessica L Bowersock, Rosana Esteller, Jeffrey A Herron, Graham W Johnson, Daryl R Kipke, Christopher K Kovach, Vaclav Kremen, Filip Mivalt, Joseph S Neimat, Theoden I Netoff, Enrico Opri, Alexander Rockhill, Joshua M Rosenow, Kristin K Sellers, Nathan P Staff, Chandra Prakash Swamy, Ashwin Viswanathan, Gerwin Schalk, Timothy Denison, Dora Hermes, Nuri F Ince, Peter Brunner, Gregory A Worrell, Kai J Miller","doi":"10.1088/1741-2552/ae2359","DOIUrl":"10.1088/1741-2552/ae2359","url":null,"abstract":"<p><p>Adaptive neuromodulation systems and implantable brain-computer interfaces have made notable strides in recent years, translating experimental prototypes into clinical applications and garnering substantial attention from the public. This surge in interest is accompanied by increased scrutiny related to the safety, efficacy, and ethical implications of these systems, all of which must be directly addressed as we introduce new neurotechnologies. In response, we have synthesized the insights resulting from discussions between groups of experts in the field and summarized them into five key domains essential to therapeutic device development: (1) analyzing current landscape of neuromodulation devices and translational platforms (2) identifying clinical need, (3) understanding neural mechanisms, (4) designing viable technologies, and (5) addressing ethical concerns. The role of translational research platforms that allow rapid, iterative testing of hypotheses in both preclinical and clinical settings is emphasized. These platforms must balance experimental flexibility with patient safety and clear clinical benefit. Furthermore, requirements for interoperability, modularity, and wireless communication protocols are explored to support long-term usability and scalability. The current regulatory processes and funding models are examined alongside the ethical responsibilities of researchers and device manufacturers. Special attention is given to the role of patients as active contributors to research and to the long-term obligations we have to them as the primary burden-bearers of the implanted neurotechnologies. This article represents a synthesis of scientific, engineering, and clinical viewpoints to inform key stakeholders in the neuromodulation and brain-computer interface spaces.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12715846/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145598488","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Regenerative potential of biogenic zinc oxide nanoparticles prepared with Vitis vinifera-derived extract on sciatic nerve injury in rats. 葡萄提取物制备的生物氧化锌纳米颗粒对大鼠坐骨神经损伤的再生潜力。
IF 3.8 Pub Date : 2025-12-18 DOI: 10.1088/1741-2552/ae23ff
Paria Piran, Abolfazl Bayrami, Shima Rahim Pouran, Fatemeh Asghari, Saeideh Aran, Pouya Bayrami

Objective.Damage to the peripheral nerves frequently leads to significant impairments in their functional capacity, highlighting the need for effective treatments that can facilitate nerve repair. This study explores the potential of grape skin extract (Ex), alone and in combination with zinc oxide nanoparticles (ZnO NPs), to enhance regeneration following sciatic nerve injury (SNI) in rats.Approach.ZnO NPs were synthesized using both a conventional chemical route and a green synthesis method in which Ex served as a natural reducing and capping agent. The synthesized nanoparticles were characterized by Fourier-transform infrared spectroscopy, scanning electron microscopy, x-ray diffraction, Thermogravimetric analysis, Energy-dispersive x-ray spectroscopy, zeta potential, and Gas chromatography-mass spectrometry analyses to confirm the role of Ex in shaping nanoparticle morphology and surface properties. Functional recovery and histological outcomes were then assessed in a murine SNI model.Main results.Treatment with Ex and ZnO/Ex significantly reduced collagen accumulation, fibrosis, and tissue vacuolization compared to untreated controls. Both interventions also improved myelination and enhanced the sciatic function index, indicating improved neural repair.Significance.These findings demonstrate that Ex and ZnO/Ex promote nerve regeneration and highlight their potential as promising candidates for the development of biogenic nanotherapeutics targeting peripheral nerve injuries.

目的:周围神经的损伤经常导致其功能的显著损伤,强调需要有效的治疗方法来促进神经修复。本研究探讨葡萄皮提取物(Ex)单独或与氧化锌纳米颗粒(ZnO NPs)联合使用对大鼠坐骨神经损伤后再生的促进作用。方法:采用常规化学方法和绿色合成方法合成氧化锌NPs,其中Ex作为天然还原和封盖剂。通过傅里叶变换红外光谱(FTIR)、扫描电镜(SEM)、x射线衍射(XRD)、热重分析(TGA)、能量色散x射线光谱(EDX)、zeta电位和气相色谱-质谱(GC-MS)分析对合成的纳米颗粒进行了表征,以证实Ex对纳米颗粒形貌和表面性能的影响。然后在小鼠坐骨神经损伤模型中评估功能恢复和组织学结果。主要结果:与未治疗的对照组相比,用Ex和ZnO/Ex治疗可显著减少胶原积累、纤维化和组织空泡化。两种干预措施还改善了髓鞘形成,增强了坐骨神经功能指数(SFI),表明神经修复得到改善。意义:这些发现表明,Ex和ZnO/Ex促进神经再生,并突出了它们作为开发针对周围神经损伤的生物源纳米治疗药物的潜力。
{"title":"Regenerative potential of biogenic zinc oxide nanoparticles prepared with Vitis vinifera-derived extract on sciatic nerve injury in rats.","authors":"Paria Piran, Abolfazl Bayrami, Shima Rahim Pouran, Fatemeh Asghari, Saeideh Aran, Pouya Bayrami","doi":"10.1088/1741-2552/ae23ff","DOIUrl":"10.1088/1741-2552/ae23ff","url":null,"abstract":"<p><p><i>Objective.</i>Damage to the peripheral nerves frequently leads to significant impairments in their functional capacity, highlighting the need for effective treatments that can facilitate nerve repair. This study explores the potential of grape skin extract (Ex), alone and in combination with zinc oxide nanoparticles (ZnO NPs), to enhance regeneration following sciatic nerve injury (SNI) in rats.<i>Approach.</i>ZnO NPs were synthesized using both a conventional chemical route and a green synthesis method in which Ex served as a natural reducing and capping agent. The synthesized nanoparticles were characterized by Fourier-transform infrared spectroscopy, scanning electron microscopy, x-ray diffraction, Thermogravimetric analysis, Energy-dispersive x-ray spectroscopy, zeta potential, and Gas chromatography-mass spectrometry analyses to confirm the role of Ex in shaping nanoparticle morphology and surface properties. Functional recovery and histological outcomes were then assessed in a murine SNI model.<i>Main results.</i>Treatment with Ex and ZnO/Ex significantly reduced collagen accumulation, fibrosis, and tissue vacuolization compared to untreated controls. Both interventions also improved myelination and enhanced the sciatic function index, indicating improved neural repair.<i>Significance.</i>These findings demonstrate that Ex and ZnO/Ex promote nerve regeneration and highlight their potential as promising candidates for the development of biogenic nanotherapeutics targeting peripheral nerve injuries.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145608179","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Thermal lensing during infrared neural stimulation enables spatially resolved photothermal dosimetry. 热透镜在红外神经刺激使空间分辨光热剂量测定。
IF 3.8 Pub Date : 2025-12-18 DOI: 10.1088/1741-2552/ae2953
Jacob Hardenburger, Bryan Millis, Joel Bixler, Christopher Valdez, E Duco Jansen, Anita Mahadevan-Jansen

Photothermal laser tissue interactions are challenging to study at the subcellular level due to the complexity of accurately characterizing spatial energy distributions. Infrared (IR) neural stimulation, a label-free photothermal neuromodulation technique using pulsed IR light, has demonstrated promise but lacks standardized, high-resolution dosimetry methods.Objective. In this study, we present an automated, imaging-based workflow to perform spatially resolved photothermal dosimetry. This method uses thermal lensing to mark the location of IR exposure within the imaging field of view, enabling precise assessment of the radiant exposure dosage and correlated neuronal responses.Approach. Neuronal Ca2+responses to single IR pulses of varying duration (350µs, 2 ms, and 8 ms) were measured using widefield fluorescence microscopy. The thermal lensing artifact (TLA) observed during stimulation was used to model the spatial energy distribution of the laser beam profile. Neuronal Ca2+responses were analyzed relative to the local radiant exposure,H0(x,y), and the average radiant exposure, dosage, Havg, calculated using the laser pulse energy divided by the laser spot area.Main results. The TLA provided a reliable fiducial for tracking the IR stimulus within the imaging field. Neuronal responses to INS were spatially dependent and exhibited three phenotypes: unreactive, low-amplitude, and high-amplitude. The Gaussian laser beam profile led to cells near the beam center receiving higher radiant exposure dosages, exceeding activation thresholds. We find that shorter pulse durations required lower radiant exposure dosages to elicit neuronal responses. TheHavgconsistently underestimates the radiant exposure required for stimulation. TheH0(x,y) required for stimulation did not produce measurable cellular damage.Significance. Local radiant exposure dosage dictates neuronal activation during INS. Our method provides a standardized, high-throughput approach for performing spatially resolved photothermal dosimetry at microscopic level.

由于精确表征空间能量分布的复杂性,在亚细胞水平上研究光热激光组织相互作用(LTI)具有挑战性。红外神经刺激(INS)是一种使用脉冲红外光的无标签光热神经调节技术,已经证明了它的前景,但缺乏标准化、高分辨率的剂量测定方法。在这项研究中,我们提出了一个自动化的,基于成像的工作流程来执行空间分辨光热剂量测定。该方法使用热透镜来标记红外照射在成像视场内的位置,从而能够精确评估辐射照射剂量和相关神经元反应。使用宽视场荧光显微镜测量神经元钙对不同持续时间(350µs, 2 ms和8 ms)的单红外脉冲的响应。利用激发过程中观察到的热透镜伪影(TLA)来模拟激光光束轮廓的空间能量分布。神经元Ca 2 +的响应分析相对于局部辐射暴露,H 0 (x,y)和平均辐射暴露,剂量,Havg,使用激光脉冲能量除以激光光斑面积计算。TLA为在成像场中跟踪红外刺激提供了可靠的基础。神经元对INS的反应具有空间依赖性,并表现出三种表型:无反应性、低振幅和高振幅。高斯激光束轮廓导致光束中心附近的细胞接受更高的辐射暴露剂量,超过激活阈值。我们发现较短的脉冲持续时间需要较低的辐射暴露剂量来引起神经元反应。哈弗一直低估了刺激所需的辐射暴露。刺激所需的H 0 (x,y)没有产生可测量的细胞损伤。局部辐射照射剂量决定了INS期间神经元的激活。我们的方法提供了一种标准化的、高通量的方法,用于在微观水平上进行空间分辨光热剂量测定。
{"title":"Thermal lensing during infrared neural stimulation enables spatially resolved photothermal dosimetry.","authors":"Jacob Hardenburger, Bryan Millis, Joel Bixler, Christopher Valdez, E Duco Jansen, Anita Mahadevan-Jansen","doi":"10.1088/1741-2552/ae2953","DOIUrl":"10.1088/1741-2552/ae2953","url":null,"abstract":"<p><p>Photothermal laser tissue interactions are challenging to study at the subcellular level due to the complexity of accurately characterizing spatial energy distributions. Infrared (IR) neural stimulation, a label-free photothermal neuromodulation technique using pulsed IR light, has demonstrated promise but lacks standardized, high-resolution dosimetry methods.<i>Objective</i>. In this study, we present an automated, imaging-based workflow to perform spatially resolved photothermal dosimetry. This method uses thermal lensing to mark the location of IR exposure within the imaging field of view, enabling precise assessment of the radiant exposure dosage and correlated neuronal responses.<i>Approach</i>. Neuronal Ca<sup>2+</sup>responses to single IR pulses of varying duration (350<i>µ</i>s, 2 ms, and 8 ms) were measured using widefield fluorescence microscopy. The thermal lensing artifact (TLA) observed during stimulation was used to model the spatial energy distribution of the laser beam profile. Neuronal Ca<sup>2+</sup>responses were analyzed relative to the local radiant exposure,<i>H</i><sub>0</sub>(<i>x,y</i>), and the average radiant exposure, dosage, H<sub>avg</sub>, calculated using the laser pulse energy divided by the laser spot area.<i>Main results</i>. The TLA provided a reliable fiducial for tracking the IR stimulus within the imaging field. Neuronal responses to INS were spatially dependent and exhibited three phenotypes: unreactive, low-amplitude, and high-amplitude. The Gaussian laser beam profile led to cells near the beam center receiving higher radiant exposure dosages, exceeding activation thresholds. We find that shorter pulse durations required lower radiant exposure dosages to elicit neuronal responses. The<i>H</i><sub>avg</sub>consistently underestimates the radiant exposure required for stimulation. The<i>H</i><sub>0</sub>(<i>x,y</i>) required for stimulation did not produce measurable cellular damage.<i>Significance</i>. Local radiant exposure dosage dictates neuronal activation during INS. Our method provides a standardized, high-throughput approach for performing spatially resolved photothermal dosimetry at microscopic level.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145710487","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Incorporating multi-modal prompt learning into foundation models enhances predictability of visual fMRI responses to dynamic natural stimuli. 将多模态提示学习纳入基础模型可以提高视觉功能磁共振成像对动态自然刺激反应的可预测性。
IF 3.8 Pub Date : 2025-12-18 DOI: 10.1088/1741-2552/ae1bd9
Panpan Chen, Chi Zhang, Bao Li, Li Tong, Shuxiao Ma, Linyuan Wang, Long Cao, Ziya Yu, Bin Yan

Objective. Modeling neural encoding of visual stimuli often uses deep neural networks (DNNs) to predict human brain response to external stimuli. However, each DNN depends on networks tailored for computer vision tasks, resulting in suboptimal brain correspondence. On the other hand, when end-to-end optimizing the encoding process for specific brain regions, challenges like training difficulties arise. Additionally, these models mostly focus on visual information processing, while the human brain integrates multi-modal information such as language to achieve a comprehensive understanding.Approach. To address these limitations, this paper proposes a multi-modal prompt learning (PL) model for neural encoding of dynamic natural stimuli. Specifically, we leverage the powerful representation ability of pre-trained foundation models and fine-tune them using our multi-modal prompts. These prompts, which include textual and visual prompts tailored to each specific regions of interest, can adapt foundation models to neural encoding tasks with fewer trainable parameters. We use the CLIP For video Clip retrieval (CLIP4clip) and Video Masked Autoencoder V2 (videoMAEv2) for feature extraction with backbone freezing, refine the representations via PL, and map the fused multi-modal features to predict voxel-wise brain responses.Main results. Extensive experiments on two functional magnetic resonance imaging video datasets demonstrate that our method outperforms existing fine-tuning methods and public models.Significance. This work highlights the potential of prompt-based fine-tuning strategies in bridging the gap between foundation models and neural encoding tasks.

视觉刺激的神经编码建模通常使用深度神经网络(dnn)来预测人脑对外部刺激的反应。然而,每个深度神经网络都依赖于为计算机视觉任务量身定制的网络,这导致了次优的大脑通信。另一方面,当端到端优化特定大脑区域的编码过程时,就会出现训练困难等挑战。此外,这些模型主要集中在视觉信息的处理上,而人脑则将语言等多模态信息整合在一起,以达到全面的理解。为了解决这些限制,本文提出了一种多模态提示学习模型,用于动态自然刺激的神经编码。具体来说,我们利用预先训练的基础模型的强大表示能力,并使用我们的多模态提示对它们进行微调。这些提示包括针对每个特定兴趣区域(roi)量身定制的文本和视觉提示,可以使基础模型适应具有较少可训练参数的神经编码任务。我们使用CLIP进行视频剪辑检索(CLIP4clip)和video mask Autoencoder V2 (videoMAEv2)进行特征提取,并使用骨干冻结,通过快速学习改进表征,并映射融合的多模态特征来预测体素脑反应。在两个fMRI视频数据集上的大量实验表明,我们的方法优于现有的微调方法和公共模型。这项工作强调了基于提示的微调策略在弥合基础模型和神经编码任务之间的差距方面的潜力。
{"title":"Incorporating multi-modal prompt learning into foundation models enhances predictability of visual fMRI responses to dynamic natural stimuli.","authors":"Panpan Chen, Chi Zhang, Bao Li, Li Tong, Shuxiao Ma, Linyuan Wang, Long Cao, Ziya Yu, Bin Yan","doi":"10.1088/1741-2552/ae1bd9","DOIUrl":"10.1088/1741-2552/ae1bd9","url":null,"abstract":"<p><p><i>Objective</i>. Modeling neural encoding of visual stimuli often uses deep neural networks (DNNs) to predict human brain response to external stimuli. However, each DNN depends on networks tailored for computer vision tasks, resulting in suboptimal brain correspondence. On the other hand, when end-to-end optimizing the encoding process for specific brain regions, challenges like training difficulties arise. Additionally, these models mostly focus on visual information processing, while the human brain integrates multi-modal information such as language to achieve a comprehensive understanding.<i>Approach</i>. To address these limitations, this paper proposes a multi-modal prompt learning (PL) model for neural encoding of dynamic natural stimuli. Specifically, we leverage the powerful representation ability of pre-trained foundation models and fine-tune them using our multi-modal prompts. These prompts, which include textual and visual prompts tailored to each specific regions of interest, can adapt foundation models to neural encoding tasks with fewer trainable parameters. We use the CLIP For video Clip retrieval (CLIP4clip) and Video Masked Autoencoder V2 (videoMAEv2) for feature extraction with backbone freezing, refine the representations via PL, and map the fused multi-modal features to predict voxel-wise brain responses.<i>Main results</i>. Extensive experiments on two functional magnetic resonance imaging video datasets demonstrate that our method outperforms existing fine-tuning methods and public models.<i>Significance</i>. This work highlights the potential of prompt-based fine-tuning strategies in bridging the gap between foundation models and neural encoding tasks.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145454384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automated estimation of frequency and spatial extent of periodic and rhythmic epileptiform activity from continuous electroencephalography data. 从连续脑电图数据自动估计周期性和节律性癫痫样活动的频率和空间范围。
IF 3.8 Pub Date : 2025-12-16 DOI: 10.1088/1741-2552/ae2716
Alexandra-Maria Tăuțan, Jin Jing, Lara Basovic, Peter N Hadar, Shadi Sartipi, Marta P Fernandes, Jennifer Kim, Aaron F Struck, M Brandon Westover, Sahar F Zafar

Objective.Rhythmic and periodic patterns (RPPs) are harmful brain activity observed on electroencephalography (EEG) recordings of critically ill patients. This work describes automatic methods for detection of the frequency and spatial extent of specific RPPs: lateralized and generalized rhythmic delta activity (LRDA, GRDA) and lateralized and generalized periodic discharges (LPD, GPD).Approach.The frequency and spatial extent of RPPs is estimated using signal processing and rule-based logic. Three algorithm variants based on fast Fourier transform (FFT) and Hilbert-Huang transforms (HHT) were developed for rhythmic delta activity, and three using derivative and time-based peak detection for periodic discharges. Annotations from three expert neurophysiologists served as the gold standard, and inter-rater reliability (IRR) and mean absolute error (MAE) were used to assess performance.Main results.We evaluated the algorithms on segments with 100% agreement on event classification (n= 389) and on the full cohort of 1087 segments (including disagreements). For the first subset, top algorithms matched or exceeded expert agreement for RPP frequency/spatial extent. RDA1b-FFT, the best algorithm for rhythmic delta activity, showed an expert-algorithm IRR of good to excellent with an intra-class correlation coefficient (ICC) of 91% and 96% (MAE 0.13 Hz and 0.26 Hz) frequency, and ICCs of 85% and 66% (MAE 0.19 and 0.09) for spatial extent for LRDA and GRDA. For periodic discharges, PD2a, showed and expert-algorithm IRR ICC of 80% and 61% (MAE 0.41 Hz and 0.15 Hz) for frequency, and ICC 77% and 13% (MAE 0.17 and 0.40) for spatial extent of LPD and GPD. For the full cohort, IRR declined, but expert-algorithm IRR remained comparable or superior to experts.Significance.The presence of RPPs at high frequencies and spatial extent are associated with a higher probability of poor outcomes. The proposed algorithms for estimating frequency and spatial extent of RPPs match expert performance and are a viable tool for large-scale EEG analysis.

目的:节律性和周期性模式(RPP)是在危重患者脑电图(EEG)记录中观察到的有害脑活动。这项工作描述了检测特定rpp频率和空间范围的自动方法:侧化和广义节律性三角洲活动(LRDA, GRDA)和侧化和广义周期性放电(LPD, GPD)。方法:使用信号处理和基于规则的逻辑来估计rpp的频率和空间范围。基于傅里叶(FFT)和Hilbert-Huang (HHT)变换的三种算法变体用于节律性δ活动,三种使用导数和基于时间的峰值检测用于周期性放电。来自三位神经生理学专家的注释作为金标准,并使用评分间信度(IRR)和平均绝对误差(MAE)来评估表现。主要结果:我们对事件分类100%一致的片段(n=389)和1087个片段的全队列(包括不一致的片段)进行了算法评估。对于第一个子集,顶级算法匹配或超过专家协议的RPP频率/空间范围。RDA1b-FFT算法的IRR为优至优,类内相关系数(ICC)分别为91%和96% (MAE 0.13Hz和0.26Hz),类内相关系数(ICC)分别为85%和66% (MAE 0.19和0.09)。对于周期性放电,PD2a显示和专家算法的IRR ICC在频率上分别为80%和61% (MAE 0.41Hz和0.15Hz),在LPD和GPD的空间范围上分别为77%和13% (MAE 0.17和0.40)。对于整个队列,IRR下降,但专家算法的IRR仍然与专家相当或优于专家。意义:rpp在高频率和空间范围内的存在与不良预后的高概率相关。所提出的估计rpp频率和空间范围的算法符合专家的性能,是一种可行的大规模脑电分析工具。
{"title":"Automated estimation of frequency and spatial extent of periodic and rhythmic epileptiform activity from continuous electroencephalography data.","authors":"Alexandra-Maria Tăuțan, Jin Jing, Lara Basovic, Peter N Hadar, Shadi Sartipi, Marta P Fernandes, Jennifer Kim, Aaron F Struck, M Brandon Westover, Sahar F Zafar","doi":"10.1088/1741-2552/ae2716","DOIUrl":"10.1088/1741-2552/ae2716","url":null,"abstract":"<p><p><i>Objective.</i>Rhythmic and periodic patterns (RPPs) are harmful brain activity observed on electroencephalography (EEG) recordings of critically ill patients. This work describes automatic methods for detection of the frequency and spatial extent of specific RPPs: lateralized and generalized rhythmic delta activity (LRDA, GRDA) and lateralized and generalized periodic discharges (LPD, GPD).<i>Approach.</i>The frequency and spatial extent of RPPs is estimated using signal processing and rule-based logic. Three algorithm variants based on fast Fourier transform (FFT) and Hilbert-Huang transforms (HHT) were developed for rhythmic delta activity, and three using derivative and time-based peak detection for periodic discharges. Annotations from three expert neurophysiologists served as the gold standard, and inter-rater reliability (IRR) and mean absolute error (MAE) were used to assess performance.<i>Main results.</i>We evaluated the algorithms on segments with 100% agreement on event classification (<i>n</i>= 389) and on the full cohort of 1087 segments (including disagreements). For the first subset, top algorithms matched or exceeded expert agreement for RPP frequency/spatial extent. RDA1b-FFT, the best algorithm for rhythmic delta activity, showed an expert-algorithm IRR of good to excellent with an intra-class correlation coefficient (ICC) of 91% and 96% (MAE 0.13 Hz and 0.26 Hz) frequency, and ICCs of 85% and 66% (MAE 0.19 and 0.09) for spatial extent for LRDA and GRDA. For periodic discharges, PD2a, showed and expert-algorithm IRR ICC of 80% and 61% (MAE 0.41 Hz and 0.15 Hz) for frequency, and ICC 77% and 13% (MAE 0.17 and 0.40) for spatial extent of LPD and GPD. For the full cohort, IRR declined, but expert-algorithm IRR remained comparable or superior to experts.<i>Significance.</i>The presence of RPPs at high frequencies and spatial extent are associated with a higher probability of poor outcomes. The proposed algorithms for estimating frequency and spatial extent of RPPs match expert performance and are a viable tool for large-scale EEG analysis.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8,"publicationDate":"2025-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145663052","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of neural engineering
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1