首页 > 最新文献

Journal of neural engineering最新文献

英文 中文
EMG-based wake gestures eliminate false activations during out-of-set activities of daily living: an online myoelectric control study. 基于肌电图的清醒手势消除了日常生活中超出设定的活动中的错误激活:一项在线肌电控制研究。
Pub Date : 2025-01-17 DOI: 10.1088/1741-2552/ada4df
Ethan Eddy, Evan Campbell, Scott Bateman, Erik Scheme

Objective.While myoelectric control has been commercialized in prosthetics for decades, its adoption for more general human-machine interaction has been slow. Although high accuracies can be achieved across many gestures, current control approaches are prone to false activations in real-world conditions. This is because the same electromyogram (EMG) signals generated during the elicitation of gestures are also naturally activated when performing activities of daily living (ADLs), such as when driving to work or while typing on a keyboard. This can lead the myoelectric control system, which is trained on a closed set of gestures and thus unaware of the muscle activity associated with these ADLs, to be falsely activated, leading to erroneous inputs and user frustration.Approach.To overcome this problem, the concept of wake gestures, whereby users could switch between a dedicated control mode and a sleep mode by snapping their fingers, was explored. Using a simple dynamic time warping model, the real-world user-in-the-loop efficacy of wake gestures as a toggle for myoelectric interfaces was demonstrated through two online ubiquitous control tasks with varying levels of difficulty: (1) dismissing an alarm and (2) controlling a robot.Main results.During these online evaluations, the designed system ignored almost all (>99.9%) non-target EMG activity generated during a set of ADLs (i.e. walking, typing, writing, phone use, and driving), ignored all control gestures (i.e. wrist flexion, wrist extension, hand open, and hand close), and enabled reliable mode switching during intentional wake gesture elicitation. Additionally, questionnaires revealed that participants responded well to the use of wake gestures and generally preferred false negatives over false positives, providing valuable insights into the future design of these systems.Significance.These results highlight the real-world viability of wake gestures for enabling the intermittent use of myoelectric control, opening up new interaction possibilities for EMG-based inputs.

目的:虽然肌电控制已经在假肢中商业化了几十年,但它在更普遍的人机交互中的应用却很慢。尽管在许多手势中都可以实现高精度,但当前的控制方法在现实环境中容易出现错误激活。这是因为在激发手势时产生的肌电图(EMG)信号在进行日常生活活动(adl)时也会自然激活,例如开车上班或在键盘上打字时。这可能会导致肌电控制系统被错误地激活,导致错误的输入和用户受挫。肌电控制系统是在一组封闭的手势上训练的,因此不知道与这些adl相关的肌肉活动。方法:为了克服这个问题,我们探索了唤醒手势的概念,即用户可以通过打响指在专用控制模式和睡眠模式之间切换。使用一个简单的动态时间扭曲模型,唤醒手势作为肌电界面切换的真实用户在回路中的有效性通过两个不同难度的在线无处不在的控制任务来证明:(1)解除警报和(2)控制机器人。主要结果:在这些在线评估中,设计的系统忽略了在一组adl(即行走、打字、写作、使用手机和驾驶)中产生的几乎所有(>99.9%)非目标肌电活动,忽略了所有控制手势(即腕屈、腕伸、手张开和手闭合),并在有意唤醒手势时实现了可靠的模式切换。此外,问卷调查显示,参与者对唤醒手势的使用反应良好,并且通常更喜欢假阴性而不是假阳性,这为这些系统的未来设计提供了有价值的见解。意义:这些结果强调了唤醒手势在现实世界中间歇性使用肌电控制的可行性,为基于肌电图的输入开辟了新的交互可能性。
{"title":"EMG-based wake gestures eliminate false activations during out-of-set activities of daily living: an online myoelectric control study.","authors":"Ethan Eddy, Evan Campbell, Scott Bateman, Erik Scheme","doi":"10.1088/1741-2552/ada4df","DOIUrl":"10.1088/1741-2552/ada4df","url":null,"abstract":"<p><p><i>Objective.</i>While myoelectric control has been commercialized in prosthetics for decades, its adoption for more general human-machine interaction has been slow. Although high accuracies can be achieved across many gestures, current control approaches are prone to false activations in real-world conditions. This is because the same electromyogram (EMG) signals generated during the elicitation of gestures are also naturally activated when performing activities of daily living (ADLs), such as when driving to work or while typing on a keyboard. This can lead the myoelectric control system, which is trained on a closed set of gestures and thus unaware of the muscle activity associated with these ADLs, to be falsely activated, leading to erroneous inputs and user frustration.<i>Approach.</i>To overcome this problem, the concept of wake gestures, whereby users could switch between a dedicated control mode and a sleep mode by snapping their fingers, was explored. Using a simple dynamic time warping model, the real-world user-in-the-loop efficacy of wake gestures as a toggle for myoelectric interfaces was demonstrated through two online ubiquitous control tasks with varying levels of difficulty: (1) dismissing an alarm and (2) controlling a robot.<i>Main results.</i>During these online evaluations, the designed system ignored almost all (>99.9%) non-target EMG activity generated during a set of ADLs (i.e. walking, typing, writing, phone use, and driving), ignored all control gestures (i.e. wrist flexion, wrist extension, hand open, and hand close), and enabled reliable mode switching during intentional wake gesture elicitation. Additionally, questionnaires revealed that participants responded well to the use of wake gestures and generally preferred false negatives over false positives, providing valuable insights into the future design of these systems.<i>Significance.</i>These results highlight the real-world viability of wake gestures for enabling the intermittent use of myoelectric control, opening up new interaction possibilities for EMG-based inputs.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142924225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robust interpolation of EEG/MEG sensor time-series via electromagnetic source imaging. 基于电磁源成像的脑磁图传感器时间序列鲁棒插值。
Pub Date : 2025-01-15 DOI: 10.1088/1741-2552/ada309
Chang Cai, Xinbao Qi, Yuanshun Long, Zheyuan Zhang, Jing Yan, Huicong Kang, Wei Wu, Srikantan S Nagarajan

Objective.electroencephalography (EEG) and magnetoencephalography (MEG) are widely used non-invasive techniques in clinical and cognitive neuroscience. However, low spatial resolution measurements, partial brain coverage by some sensor arrays, as well as noisy sensors could result in distorted sensor topographies resulting in inaccurate reconstructions of underlying brain dynamics. Solving these problems has been a challenging task. This paper proposes a robust framework based on electromagnetic source imaging for interpolation of unknown or poor quality EEG/MEG measurements.Approach.This framework consists of two steps: (1) estimating brain source activity using a robust inverse algorithm along with the leadfield matrix of available good sensors, and (2) interpolating unknown or poor quality EEG/MEG measurements using the reconstructed brain sources using the leadfield matrices of unknown or poor quality sensors. We evaluate the proposed framework through simulations and several real datasets, comparing its performance to two popular benchmarks-neighborhood interpolation and spherical spline interpolation algorithms.Results.In both simulations and real EEG/MEG measurements, we demonstrate several advantages compared to benchmarks, which are robust to highly correlated brain activity, low signal-to-noise ratio data and accurately estimates cortical dynamics.Significance.These results demonstrate a rigorous platform to enhance the spatial resolution of EEG and MEG, to overcome limitations of partial coverage of EEG/MEG sensor arrays that is particularly relevant to low-channel count optically pumped magnetometer arrays, and to estimate activity in poor/noisy sensors to a certain extent based on the available measurements from other good sensors. Implementation of this framework will enhance the quality of EEG and MEG, thereby expanding the potential applications of these modalities.

目的:脑电图(EEG)和脑磁图(MEG)是临床和认知神经科学中广泛使用的无创技术。然而,低空间分辨率测量、某些传感器阵列的部分大脑覆盖以及噪声传感器可能导致传感器地形扭曲,从而导致对潜在大脑动力学的不准确重建。解决这些问题一直是一项具有挑战性的任务,本文提出了一种基于电磁源成像的鲁棒框架,用于插值未知或质量较差的EEG/MEG测量。方法:该框架包括两个步骤:1)使用鲁棒逆算法和可用的良好传感器的导场矩阵估计脑源活动,以及2)使用未知或质量差的传感器的导场矩阵使用重建的脑源插值未知或质量差的EEG/MEG测量。我们通过模拟和几个真实数据集评估了所提出的框架,并将其性能与两种流行的基准-邻域插值(NI)和球面样条插值(SSI)算法进行了比较。结果:在模拟和真实的EEG/MEG测量中,我们展示了与基准测试相比的几个优势,它们对高度相关的大脑活动、低信噪比数据和准确估计皮层动态具有鲁棒性。意义:这些结果展示了一个严格的平台,可以提高脑电和脑磁图的空间分辨率,克服脑电/脑磁图传感器阵列部分覆盖的局限性,特别是与低通道计数光泵磁强计(OPM)阵列相关的局限性,并在一定程度上基于其他良好传感器的可用测量来估计差/噪声传感器的活动。该框架的实施将提高脑电图和脑磁图的质量,从而扩大这些模式的潜在应用。
{"title":"Robust interpolation of EEG/MEG sensor time-series via electromagnetic source imaging.","authors":"Chang Cai, Xinbao Qi, Yuanshun Long, Zheyuan Zhang, Jing Yan, Huicong Kang, Wei Wu, Srikantan S Nagarajan","doi":"10.1088/1741-2552/ada309","DOIUrl":"10.1088/1741-2552/ada309","url":null,"abstract":"<p><p><i>Objective.</i>electroencephalography (EEG) and magnetoencephalography (MEG) are widely used non-invasive techniques in clinical and cognitive neuroscience. However, low spatial resolution measurements, partial brain coverage by some sensor arrays, as well as noisy sensors could result in distorted sensor topographies resulting in inaccurate reconstructions of underlying brain dynamics. Solving these problems has been a challenging task. This paper proposes a robust framework based on electromagnetic source imaging for interpolation of unknown or poor quality EEG/MEG measurements.<i>Approach.</i>This framework consists of two steps: (1) estimating brain source activity using a robust inverse algorithm along with the leadfield matrix of available good sensors, and (2) interpolating unknown or poor quality EEG/MEG measurements using the reconstructed brain sources using the leadfield matrices of unknown or poor quality sensors. We evaluate the proposed framework through simulations and several real datasets, comparing its performance to two popular benchmarks-neighborhood interpolation and spherical spline interpolation algorithms.<i>Results.</i>In both simulations and real EEG/MEG measurements, we demonstrate several advantages compared to benchmarks, which are robust to highly correlated brain activity, low signal-to-noise ratio data and accurately estimates cortical dynamics.<i>Significance.</i>These results demonstrate a rigorous platform to enhance the spatial resolution of EEG and MEG, to overcome limitations of partial coverage of EEG/MEG sensor arrays that is particularly relevant to low-channel count optically pumped magnetometer arrays, and to estimate activity in poor/noisy sensors to a certain extent based on the available measurements from other good sensors. Implementation of this framework will enhance the quality of EEG and MEG, thereby expanding the potential applications of these modalities.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142886558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AECuration: Automated event curation for spike sorting. AECuration:自动事件管理的尖峰排序。
Pub Date : 2025-01-14 DOI: 10.1088/1741-2552/adaa1c
Xiang Li, Jay W Reddy, Vishal Jain, Mats Forssell, Zabir Ahmed, Maysamreza Chamanzar

Spike sorting is a commonly used analysis method for identifying single-units and multi-units from extracellular recordings. The extracellular recordings contain a mixture of signal components, such as neural and non-neural events, possibly due to motion and breathing artifacts or electrical interference. Identifying single and multi-unit spikes using a simple threshold-crossing method may lead to uncertainty in differentiating the actual neural spikes from non-neural spikes. The traditional method for classifying neural and non-neural units from spike sorting results is manual curation by a trained person. This subjective method suffers from human error and variability and is further complicated by the absence of ground truth in experimental extracellular recordings. Moreover, the manual curation process is time consuming and is becoming intractable due to the growing size and complexity of extracellular datasets. To address these challenges, we, for the first time, present a novel automatic curation method based on an autoencoder model, which is trained on features of simulated extracellular spike waveforms. The model is then applied to experimental electrophysiology datasets, where the reconstruction error is used as the metric for classifying neural and non-neural spikes. As an alternative to the traditional frequency domain and statistical techniques, our proposed method offers a time-domain evaluation model to automate the analysis of extracellular recordings based on learned time-domain features. The model exhibits excellent performance and throughput when applied to real-world extracellular datasets without any retraining, highlighting its generalizability. This method can be integrated into spike sorting pipelines as a pre-processing filtering step or a post-processing curation method.

刺突分选是一种常用的分析方法,用于从细胞外记录中识别单单位和多单位。细胞外记录包含混合的信号成分,如神经和非神经事件,可能是由于运动和呼吸的伪影或电干扰。使用简单的阈值交叉方法识别单个和多单元尖峰可能导致区分实际神经尖峰与非神经尖峰的不确定性。从峰值分类结果中对神经和非神经单元进行分类的传统方法是由受过训练的人手动管理。这种主观的方法受到人为错误和可变性的影响,并且由于实验细胞外记录中缺乏基础事实而进一步复杂化。此外,由于细胞外数据集的规模和复杂性不断增长,人工管理过程非常耗时,并且变得难以处理。为了解决这些挑战,我们首次提出了一种基于自动编码器模型的新型自动管理方法,该模型基于模拟的细胞外尖峰波形的特征进行训练。然后将该模型应用于实验电生理数据集,其中重构误差用作分类神经和非神经尖峰的度量。作为传统频域和统计技术的替代方案,我们提出的方法提供了一个时域评估模型,可以基于学习到的时域特征自动分析细胞外记录。该模型在不需要任何再训练的情况下应用于现实世界的细胞外数据集,表现出优异的性能和吞吐量,突出了其泛化性。该方法可以作为预处理过滤步骤或后处理策展方法集成到尖峰排序管道中。
{"title":"AECuration: Automated event curation for spike sorting.","authors":"Xiang Li, Jay W Reddy, Vishal Jain, Mats Forssell, Zabir Ahmed, Maysamreza Chamanzar","doi":"10.1088/1741-2552/adaa1c","DOIUrl":"https://doi.org/10.1088/1741-2552/adaa1c","url":null,"abstract":"<p><p>Spike sorting is a commonly used analysis method for identifying single-units and multi-units from extracellular recordings. The extracellular recordings contain a mixture of signal components, such as neural and non-neural events, possibly due to motion and breathing artifacts or electrical interference. Identifying single and multi-unit spikes using a simple threshold-crossing method may lead to uncertainty in differentiating the actual neural spikes from non-neural spikes. The traditional method for classifying neural and non-neural units from spike sorting results is manual curation by a trained person. This subjective method suffers from human error and variability and is further complicated by the absence of ground truth in experimental extracellular recordings. Moreover, the manual curation process is time consuming and is becoming intractable due to the growing size and complexity of extracellular datasets. To address these challenges, we, for the first time, present a novel automatic curation method based on an autoencoder model, which is trained on features of simulated extracellular spike waveforms. The model is then applied to experimental electrophysiology datasets, where the reconstruction error is used as the metric for classifying neural and non-neural spikes. As an alternative to the traditional frequency domain and statistical techniques, our proposed method offers a time-domain evaluation model to automate the analysis of extracellular recordings based on learned time-domain features. The model exhibits excellent performance and throughput when applied to real-world extracellular datasets without any retraining, highlighting its generalizability. This method can be integrated into spike sorting pipelines as a pre-processing filtering step or a post-processing curation method.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142985849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Personalized μ-transcranial alternating current stimulation improves online brain-computer interface control. 个性化μ-经颅交流电刺激改善了在线脑机接口控制。
Pub Date : 2025-01-13 DOI: 10.1088/1741-2552/ada9c0
Deland Hu Liu, Satyam Kumar, Hussein Alawieh, Frigyes Samuel Racz, Jose Del R Millan

Objective: A motor imagery (MI)-based brain-computer interface (BCI) enables users to engage with external environments by capturing and decoding electroencephalography (EEG) signals associated with the imagined movement of specific limbs. Despite significant advancements in BCI technologies over the past 40 years, a notable challenge remains: many users lack BCI proficiency, unable to produce sufficiently distinct and reliable MI brain patterns, hence leading to low classification rates in their BCIs. The objective of this study is to enhance the online performance of MI-BCIs in a personalized, biomarker-driven approach using transcranial alternating current stimulation (tACS).

Approach: Previous studies have identified that the peak power spectral density (PSD) value in sensorimotor idling rhythms is a neural correlate of participants' upper limb MI-BCI performances. In this active-controlled, single-blind study, we applied 20 minutes of tACS at the participant-specific, peak µ frequency in resting-state sensorimotor rhythms (SMRs), with the goal of enhancing resting-state µ SMRs.

Main results: After tACS, we observed significant improvements in event-related desynchronizations (ERDs) of µ sensorimotor rhythms (SMRs), and in the performance of an online MI-BCI that decodes left versus right hand commands in healthy participants (N=10) -but not in an active control-stimulation control group (N=10). Lastly, we showed a significant correlation between the resting-state µ SMRs and µ ERD, offering a mechanistic interpretation behind the observed changes in online BCI performances.

Significance: Our research lays the groundwork for future non-invasive interventions designed to enhance BCI performances, thereby improving the independence and interactions of individuals who rely on these systems.

目的:基于运动图像(MI)的脑机接口(BCI)通过捕获和解码与特定肢体想象运动相关的脑电图(EEG)信号,使用户能够参与外部环境。尽管脑机接口技术在过去40年中取得了重大进展,但仍存在一个显著的挑战:许多用户缺乏脑机接口的熟练程度,无法产生足够清晰可靠的脑机接口脑模式,因此导致脑机接口的分类率较低。本研究的目的是利用经颅交流电刺激(tACS),以个性化的、生物标志物驱动的方法提高mi - bci的在线性能。方法:已有研究发现,感觉运动怠速节奏的峰值功率谱密度(PSD)值与上肢MI-BCI表现存在神经关联。在这项主动对照的单盲研究中,我们在参与者特定的静息状态感觉运动节律(smr)峰值频率上应用了20分钟的tACS,目的是增强静息状态的µsmr。主要结果:在tACS后,我们观察到健康参与者(N=10)的感觉运动节律(smr)的事件相关去同步(ERDs)和在线MI-BCI解码左手和右手命令的表现显著改善,但在主动对照刺激对照组(N=10)没有显著改善。最后,我们展示了静息状态的微smr和微ERD之间的显著相关性,为观察到的在线脑机接口性能变化提供了机制解释。意义:我们的研究为未来旨在提高脑机接口性能的非侵入性干预奠定了基础,从而提高依赖这些系统的个体的独立性和相互作用。
{"title":"Personalized μ-transcranial alternating current stimulation improves online brain-computer interface control.","authors":"Deland Hu Liu, Satyam Kumar, Hussein Alawieh, Frigyes Samuel Racz, Jose Del R Millan","doi":"10.1088/1741-2552/ada9c0","DOIUrl":"https://doi.org/10.1088/1741-2552/ada9c0","url":null,"abstract":"<p><strong>Objective: </strong>A motor imagery (MI)-based brain-computer interface (BCI) enables users to engage with external environments by capturing and decoding electroencephalography (EEG) signals associated with the imagined movement of specific limbs. Despite significant advancements in BCI technologies over the past 40 years, a notable challenge remains: many users lack BCI proficiency, unable to produce sufficiently distinct and reliable MI brain patterns, hence leading to low classification rates in their BCIs. The objective of this study is to enhance the online performance of MI-BCIs in a personalized, biomarker-driven approach using transcranial alternating current stimulation (tACS).</p><p><strong>Approach: </strong>Previous studies have identified that the peak power spectral density (PSD) value in sensorimotor idling rhythms is a neural correlate of participants' upper limb MI-BCI performances. In this active-controlled, single-blind study, we applied 20 minutes of tACS at the participant-specific, peak µ frequency in resting-state sensorimotor rhythms (SMRs), with the goal of enhancing resting-state µ SMRs.</p><p><strong>Main results: </strong>After tACS, we observed significant improvements in event-related desynchronizations (ERDs) of µ sensorimotor rhythms (SMRs), and in the performance of an online MI-BCI that decodes left versus right hand commands in healthy participants (N=10) -but not in an active control-stimulation control group (N=10). Lastly, we showed a significant correlation between the resting-state µ SMRs and µ ERD, offering a mechanistic interpretation behind the observed changes in online BCI performances.</p><p><strong>Significance: </strong>Our research lays the groundwork for future non-invasive interventions designed to enhance BCI performances, thereby improving the independence and interactions of individuals who rely on these systems.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142980388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robust assessment of the cortical encoding of word-level expectations using the temporal response function. 利用时间反应函数对词汇水平期望的皮质编码进行稳健评估。
Pub Date : 2025-01-13 DOI: 10.1088/1741-2552/ada30a
Amirhossein Chalehchaleh, Martin M Winchester, Giovanni M Di Liberto

Objective. Speech comprehension involves detecting words and interpreting their meaning according to the preceding semantic context. This process is thought to be underpinned by a predictive neural system that uses that context to anticipate upcoming words. However, previous studies relied on evaluation metrics designed for continuous univariate sound features, overlooking the discrete and sparse nature of word-level features. This mismatch has limited effect sizes and hampered progress in understanding lexical prediction mechanisms in ecologically-valid experiments.Approach. We investigate these limitations by analyzing both simulated and actual electroencephalography (EEG) signals recorded during a speech comprehension task. We then introduce two novel assessment metrics tailored to capture the neural encoding of lexical surprise, improving upon traditional evaluation approaches.Main results. The proposed metrics demonstrated effect-sizes over 140% larger than those achieved with the conventional temporal response function (TRF) evaluation. These improvements were consistent across both simulated and real EEG datasets.Significance. Our findings substantially advance methods for evaluating lexical prediction in neural data, enabling more precise measurements and deeper insights into how the brain builds predictive representations during speech comprehension. These contributions open new avenues for research into predictive coding mechanisms in naturalistic language processing.

语音理解包括根据前面的语义上下文来检测单词并解释它们的意思。这一过程被认为是由一个预测神经系统支持的,该系统使用该上下文来预测即将出现的单词。最近的研究表明,这种预测过程可以通过使用线性滞后模型(如时间响应函数)从生态有效的语音听力任务中记录的神经信号中进行探测。这通常是通过提取刺激特征来完成的,比如估计单词水平的惊讶度,并将这些特征与神经信号联系起来。虽然现代大型语言模型(LLM)在如何建立词级特征和预测模型方面取得了实质性的飞跃,但用于评估模型如何很好地将刺激特征和神经信号联系起来的指标方面却进展甚微。事实上,以前的研究依赖于为研究连续的单变量声音特征(如声包络)而设计的评价指标,而没有考虑词级特征的不同要求,这些特征本质上是离散的和稀疏的。因此,在生态有效的实验中探索词汇预测机制的研究通常表现出较小的效应大小,严重限制了可以得出的观察类型,并且在我们的大脑如何准确地建立词汇预测方面留下了相当大的不确定性。首先,本研究讨论并量化了模拟和实际脑电图信号捕捉语音理解任务反应的局限性。其次,我们通过引入两个词汇惊讶神经编码的评估指标来解决这个问题,这大大提高了最新的水平。新指标在模拟和实际脑电图数据集上进行了测试,显示出比普通时间反应函数评估的效果大140%以上。
{"title":"Robust assessment of the cortical encoding of word-level expectations using the temporal response function.","authors":"Amirhossein Chalehchaleh, Martin M Winchester, Giovanni M Di Liberto","doi":"10.1088/1741-2552/ada30a","DOIUrl":"10.1088/1741-2552/ada30a","url":null,"abstract":"<p><p><i>Objective</i>. Speech comprehension involves detecting words and interpreting their meaning according to the preceding semantic context. This process is thought to be underpinned by a predictive neural system that uses that context to anticipate upcoming words. However, previous studies relied on evaluation metrics designed for continuous univariate sound features, overlooking the discrete and sparse nature of word-level features. This mismatch has limited effect sizes and hampered progress in understanding lexical prediction mechanisms in ecologically-valid experiments.<i>Approach</i>. We investigate these limitations by analyzing both simulated and actual electroencephalography (EEG) signals recorded during a speech comprehension task. We then introduce two novel assessment metrics tailored to capture the neural encoding of lexical surprise, improving upon traditional evaluation approaches.<i>Main results</i>. The proposed metrics demonstrated effect-sizes over 140% larger than those achieved with the conventional temporal response function (TRF) evaluation. These improvements were consistent across both simulated and real EEG datasets.<i>Significance</i>. Our findings substantially advance methods for evaluating lexical prediction in neural data, enabling more precise measurements and deeper insights into how the brain builds predictive representations during speech comprehension. These contributions open new avenues for research into predictive coding mechanisms in naturalistic language processing.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142886554","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation of objective methods for analyzing ipsilateral motor evoked potentials in stroke survivors with chronic upper extremity motor impairment. 慢性上肢运动障碍脑卒中幸存者同侧运动诱发电位客观分析方法的评价。
Pub Date : 2025-01-09 DOI: 10.1088/1741-2552/ada827
Akhil Mohan, Xin Li, Bei Zhang, Jayme S Knutson, Morgan Widina, Xiaofeng Wang, Ken Uchino, Ela B Plow, David A Cunningham

Objective:Ipsilateral motor evoked potentials (iMEPs) are believed to represent cortically evoked excitability of uncrossed brainstem-mediated pathways. In the event of extensive injury to (crossed) corticospinal pathways, which can occur following a stroke, uncrossed ipsilateral pathways may serve as an alternate resource to support the recovery of the paretic limb. However, iMEPs, even in neurally intact people, can be small, infrequent, and noisy, so discerning them in stroke survivors is very challenging. This study aimed to investigate the inter-rater reliability of iMEP features (presence/absence, amplitude, area, onset, and offset) to evaluate the reliability of existing methods for objectively analyzing iMEPs in stroke survivors with chronic upper extremity motor impairment. Approach:Two investigators subjectively measured iMEP features from thirty-two stroke participants with chronic upper extremity motor impairment. Six objective methods based on standard deviation (SD) and mean consecutive differences (MCD) were used to measure the iMEP features from the same 32 participants. IMEP analysis used both trial-by-trial (individual signal) and average-signal analysis approaches. Inter-rater reliability of iMEP features and agreement between the subjective and objective methods were analyzed (percent agreement-PA and intraclass correlation coefficient-ICC). Main results:Inter-rater reliability was excellent for iMEP detection (PA> 85%), amplitude, and area (ICC> 0.9). Of the six objective methods we tested, the 1SD method was most appropriate for identifying and analyzing iMEP amplitude and area (ICC> 0.9) in both trial-by-trial and average signal analysis approaches. None of the objective methods were reliable for analyzing iMEP onset and offset. Results also support using the average-signal analysis approach over the trial-by-trial analysis approach, as it offers excellent reliability for iMEP analysis in stroke survivors with chronic upper extremity motor impairment. Significance:Findings from our study have relevance for understanding the role of ipsilateral pathways that typically survive unilateral severe white matter injury in people with stroke. .

目的:同侧运动诱发电位(iMEPs)被认为代表非交叉脑干介导通路的皮质诱发兴奋性。在中风后皮质脊髓通路(交叉)广泛损伤的情况下,未交叉的同侧通路可作为支持瘫肢体恢复的替代资源。然而,即使在神经完整的人身上,imep也可能很小,不常见,而且很吵,所以在中风幸存者身上识别它们是非常具有挑战性的。本研究旨在探讨iMEP特征(存在/不存在、幅度、面积、发作和偏移)的评分间可靠性,以评估现有方法客观分析慢性上肢运动障碍卒中幸存者iMEP的可靠性。方法:两位研究者主观测量了32名慢性上肢运动障碍卒中参与者的iMEP特征。采用基于标准差(SD)和平均连续差(MCD)的6种客观方法测量同一32名受试者的iMEP特征。IMEP分析使用逐个试验(单个信号)和平均信号分析方法。分析了iMEP特征的等级间信度和主客观方法之间的一致性(百分比一致性-PA和类内相关系数-ICC)。主要结果:iMEP检测的等级间信度非常好(PA> 85%),幅度和面积(ICC> 0.9)。在我们测试的六种客观方法中,在逐次试验和平均信号分析方法中,1SD方法最适合识别和分析iMEP振幅和面积(ICC> 0.9)。没有一种客观的方法可以可靠地分析iMEP的发病和偏移。结果也支持使用平均信号分析方法而不是试验分析方法,因为它为慢性上肢运动损伤的脑卒中幸存者的iMEP分析提供了极好的可靠性。意义:我们的研究结果与理解同侧通路的作用有关,这些通路通常在脑卒中患者单侧严重白质损伤中存活下来。
{"title":"Evaluation of objective methods for analyzing ipsilateral motor evoked potentials in stroke survivors with chronic upper extremity motor impairment.","authors":"Akhil Mohan, Xin Li, Bei Zhang, Jayme S Knutson, Morgan Widina, Xiaofeng Wang, Ken Uchino, Ela B Plow, David A Cunningham","doi":"10.1088/1741-2552/ada827","DOIUrl":"https://doi.org/10.1088/1741-2552/ada827","url":null,"abstract":"<p><p><b>Objective:</b>Ipsilateral motor evoked potentials (iMEPs) are believed to represent cortically evoked excitability of uncrossed brainstem-mediated pathways. In the event of extensive injury to (crossed) corticospinal pathways, which can occur following a stroke, uncrossed ipsilateral pathways may serve as an alternate resource to support the recovery of the paretic limb. However, iMEPs, even in neurally intact people, can be small, infrequent, and noisy, so discerning them in stroke survivors is very challenging. This study aimed to investigate the inter-rater reliability of iMEP features (presence/absence, amplitude, area, onset, and offset) to evaluate the reliability of existing methods for objectively analyzing iMEPs in stroke survivors with chronic upper extremity motor impairment.&#xD;<b>Approach:</b>Two investigators subjectively measured iMEP features from thirty-two stroke participants with chronic upper extremity motor impairment. Six objective methods based on standard deviation (SD) and mean consecutive differences (MCD) were used to measure the iMEP features from the same 32 participants. IMEP analysis used both trial-by-trial (individual signal) and average-signal analysis approaches. Inter-rater reliability of iMEP features and agreement between the subjective and objective methods were analyzed (percent agreement-PA and intraclass correlation coefficient-ICC).&#xD;<b>Main results:</b>Inter-rater reliability was excellent for iMEP detection (PA> 85%), amplitude, and area (ICC> 0.9). Of the six objective methods we tested, the 1SD method was most appropriate for identifying and analyzing iMEP amplitude and area (ICC> 0.9) in both trial-by-trial and average signal analysis approaches. None of the objective methods were reliable for analyzing iMEP onset and offset. Results also support using the average-signal analysis approach over the trial-by-trial analysis approach, as it offers excellent reliability for iMEP analysis in stroke survivors with chronic upper extremity motor impairment.&#xD;<b>Significance:</b>Findings from our study have relevance for understanding the role of ipsilateral pathways that typically survive unilateral severe white matter injury in people with stroke.&#xD.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142960779","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A multimodal neuroimaging study of cerebrovascular regulation: protocols and insights of combining electroencephalography, functional near-infrared spectroscopy, transcranial Doppler ultrasound, and physiological parameters. 脑血管调节的多模态神经影像学研究:结合脑电图、功能近红外光谱、经颅多普勒超声和生理参数的方案和见解。
Pub Date : 2025-01-09 DOI: 10.1088/1741-2552/ada4de
Joel S Burma, Nathan E Johnson, Ibukunoluwa K Oni, Andrew P Lapointe, Chantel T Debert, Kathryn J Schneider, Jeff F Dunn, Jonathan D Smirl

Objective. The current paper describes the creation of a simultaneous trimodal neuroimaging protocol. The authors detail their methodological design for a subsequent large-scale study, demonstrate the ability to obtain the expected physiologically induced responses across cerebrovascular domains, and describe the pitfalls experienced when developing this approach.Approach. Electroencephalography (EEG), functional near-infrared spectroscopy (fNIRS), and transcranial Doppler ultrasound (TCD) were combined to provide an assessment of neuronal activity, microvascular oxygenation, and upstream artery velocity, respectively. Real-time blood pressure, capnography, and heart rate were quantified to control for the known confounding influence of cardiorespiratory variables. The EEG-fNIRS-TCD protocol was attached to a 21 year-old male who completed neurovascular coupling/functional hyperemia (finger tapping and 'Where's Waldo/Wally?'), dynamic cerebral autoregulation (squat-stand maneuvers), and cerebrovascular reactivity tasks (end-tidal clamping during hypocapnia/hypercapnia).Main results. In a pilot participant, the Waldo task produced robust hemodynamic responses within the occipital microvasculature and the posterior cerebral artery. A ∼90% decrease in alpha band power was seen in the occipital cortical region compared between the eyes closed and eyes opened protocol, compared to the frontal, central, and parietal regions (∼80% reduction). A modest increase in motor oxygenated hemoglobin was seen during the finger tapping task, with a harmonious alpha decrease of ∼15% across all cortical regions. No change in the middle or posterior cerebral arteries were noted during finger tapping. During cerebral autoregulatory challenges, sinusoidal oscillations were produced in hemodynamics at 0.05 and 0.10 Hz, while a decrease and increase in TCD and fNIRS metrics were elicited during hypocapnia and hypercapnia protocols, respectively.Significance. All neuroimaging modalities have their inherent limitations; however, these can be minimized by employing multimodal neuroimaging approaches. This EEG-fNIRS-TCD protocol enables a comprehensive assessment of cerebrovascular regulation across the association between electrical activity and cerebral hemodynamics during tasks with a mild degree of body and/or head movement.

目的:本文描述了同时三模态神经成像协议的创建。作者为后续的大规模研究详细介绍了他们的方法设计,展示了在脑血管领域获得预期的生理诱导反应的能力,并描述了在开发这种方法时所经历的陷阱。结合脑电图(EEG)、功能性近红外光谱(fNIRS)和经颅多普勒超声(TCD)分别评估神经元活动、微血管氧合和上游动脉流速。实时血压、血管造影和心率被量化,以控制已知的心肺变量的混杂影响。EEG-fNIRS-TCD方案附在一名21岁的男性身上,他完成了神经血管耦合/功能性充血(手指轻敲和“Waldo/Wally在哪里?”)、大脑动态自动调节(深坐-站立动作)和脑血管反应性任务(低碳酸血症/高碳酸血症期间潮汐末夹持)。主要结果:在一名试点参与者中,Waldo任务在枕微血管和大脑后动脉内产生了强大的血流动力学反应。与睁眼和闭眼相比,枕皮质区α带功率降低约90%,与额叶、中央和顶叶区相比(降低约80%)。在手指敲击任务中,运动氧合血红蛋白适度增加,所有皮质区域的α和谐减少约15%。手指敲击时,大脑中动脉和后动脉未见变化。在大脑自身调节挑战中,血流动力学在0.05和0.10 Hz下产生正弦振荡,而在低碳酸血症和高碳酸血症方案中分别引起TCD和fNIRS指标的降低和增加。 ;意义:所有神经成像方式都有其固有的局限性;然而,这些可以通过采用多模态神经成像方法最小化。这项EEG-fNIRS-TCD方案能够全面评估在轻度身体和/或头部运动的任务中,脑电活动和脑血流动力学之间的关系。
{"title":"A multimodal neuroimaging study of cerebrovascular regulation: protocols and insights of combining electroencephalography, functional near-infrared spectroscopy, transcranial Doppler ultrasound, and physiological parameters.","authors":"Joel S Burma, Nathan E Johnson, Ibukunoluwa K Oni, Andrew P Lapointe, Chantel T Debert, Kathryn J Schneider, Jeff F Dunn, Jonathan D Smirl","doi":"10.1088/1741-2552/ada4de","DOIUrl":"10.1088/1741-2552/ada4de","url":null,"abstract":"<p><p><i>Objective</i>. The current paper describes the creation of a simultaneous trimodal neuroimaging protocol. The authors detail their methodological design for a subsequent large-scale study, demonstrate the ability to obtain the expected physiologically induced responses across cerebrovascular domains, and describe the pitfalls experienced when developing this approach.<i>Approach</i>. Electroencephalography (EEG), functional near-infrared spectroscopy (fNIRS), and transcranial Doppler ultrasound (TCD) were combined to provide an assessment of neuronal activity, microvascular oxygenation, and upstream artery velocity, respectively. Real-time blood pressure, capnography, and heart rate were quantified to control for the known confounding influence of cardiorespiratory variables. The EEG-fNIRS-TCD protocol was attached to a 21 year-old male who completed neurovascular coupling/functional hyperemia (finger tapping and '<i>Where's Waldo/Wally?</i>'), dynamic cerebral autoregulation (squat-stand maneuvers), and cerebrovascular reactivity tasks (end-tidal clamping during hypocapnia/hypercapnia).<i>Main results</i>. In a pilot participant, the Waldo task produced robust hemodynamic responses within the occipital microvasculature and the posterior cerebral artery. A ∼90% decrease in alpha band power was seen in the occipital cortical region compared between the eyes closed and eyes opened protocol, compared to the frontal, central, and parietal regions (∼80% reduction). A modest increase in motor oxygenated hemoglobin was seen during the finger tapping task, with a harmonious alpha decrease of ∼15% across all cortical regions. No change in the middle or posterior cerebral arteries were noted during finger tapping. During cerebral autoregulatory challenges, sinusoidal oscillations were produced in hemodynamics at 0.05 and 0.10 Hz, while a decrease and increase in TCD and fNIRS metrics were elicited during hypocapnia and hypercapnia protocols, respectively.<i>Significance</i>. All neuroimaging modalities have their inherent limitations; however, these can be minimized by employing multimodal neuroimaging approaches. This EEG-fNIRS-TCD protocol enables a comprehensive assessment of cerebrovascular regulation across the association between electrical activity and cerebral hemodynamics during tasks with a mild degree of body and/or head movement.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142924184","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Novel AIRTrode-based wearable electrode supports long-term, online brain-computer interface operations. 基于 AIRTrode 的新型可穿戴电极支持长期在线脑机接口操作。
Pub Date : 2025-01-07 DOI: 10.1088/1741-2552/ad9edf
Deland H Liu, Ju-Chun Hsieh, Hussein Alawieh, Satyam Kumar, Fumiaki Iwane, Ilya Pyatnitskiy, Zoya J Ahmad, Huiliang Wang, José Del R Millán

Objective.Non-invasive electroencephalograms (EEG)-based brain-computer interfaces (BCIs) play a crucial role in a diverse range of applications, including motor rehabilitation, assistive and communication technologies, holding potential promise to benefit users across various clinical spectrums. Effective integration of these applications into daily life requires systems that provide stable and reliable BCI control for extended periods. Our prior research introduced the AIRTrode, a self-adhesive (A), injectable (I), and room-temperature (RT) spontaneously-crosslinked hydrogel electrode (AIRTrode). The AIRTrode has shown lower skin-contact impedance and greater stability than dry electrodes and, unlike wet gel electrodes, does not dry out after just a few hours, enhancing its suitability for long-term application. This study aims to demonstrate the efficacy of AIRTrodes in facilitating reliable, stable and long-term online EEG-based BCI operations.Approach.In this study, four healthy participants utilized AIRTrodes in two BCI control tasks-continuous and discrete-across two sessions separated by six hours. Throughout this duration, the AIRTrodes remained attached to the participants' heads. In the continuous task, participants controlled the BCI through decoding of upper-limb motor imagery (MI). In the discrete task, the control was based on decoding of error-related potentials (ErrPs).Main Results.Using AIRTrodes, participants demonstrated consistently reliable online BCI performance across both sessions and tasks. The physiological signals captured during MI and ErrPs tasks were valid and remained stable over sessions. Lastly, both the BCI performances and physiological signals captured were comparable with those from freshly applied, research-grade wet gel electrodes, the latter requiring inconvenient re-application at the start of the second session.Significance.AIRTrodes show great potential promise for integrating non-invasive BCIs into everyday settings due to their ability to support consistent BCI performances over extended periods. This technology could significantly enhance the usability of BCIs in real-world applications, facilitating continuous, all-day functionality that was previously challenging with existing electrode technologies.

目的:基于无创脑电图(EEG)的脑机接口(bci)在包括运动康复、辅助和通信技术在内的各种应用中发挥着至关重要的作用,使各种临床领域的用户受益。将这些应用程序有效地集成到日常生活中,需要系统提供长时间稳定可靠的BCI控制。我们之前的研究介绍了AIRTrode,一种自粘(a)、可注射(I)和室温(RT)自发交联水凝胶电极(AIRTrode)。与干电极相比,AIRTrode具有更低的皮肤接触阻抗和更高的稳定性,并且与湿凝胶电极不同,它在几个小时后不会变干,从而增强了其长期应用的适用性。本研究旨在证明AIRTrodes在促进可靠、稳定和长期的基于脑电图的脑机接口手术方面的功效。方法:在这项研究中,四名健康的参与者在两个BCI控制任务中使用AIRTrodes -连续和离散-跨越两个间隔6小时的会话。在这段时间内,AIRTrodes一直附着在参与者的头上。在连续任务中,被试通过解码上肢运动意象(MI)来控制脑机接口。在离散任务中,控制基于错误相关电位(ErrPs)的解码。主要结果:使用AIRTrodes,参与者在会话和任务中都表现出始终可靠的在线BCI性能。在MI和errp任务中捕获的生理信号是有效的,并且在会话中保持稳定。最后,BCI性能和捕获的生理信号与新应用的研究级湿凝胶电极相当,后者需要在第二阶段开始时重新应用,这很不方便。意义:AIRTrodes显示出将无创脑机接口集成到日常设置中的巨大潜力,因为它们能够长时间支持一致的脑机接口性能。这项技术可以显著提高bci在实际应用中的可用性,促进连续的、全天的功能,这是以前现有电极技术所面临的挑战。
{"title":"Novel AIRTrode-based wearable electrode supports long-term, online brain-computer interface operations.","authors":"Deland H Liu, Ju-Chun Hsieh, Hussein Alawieh, Satyam Kumar, Fumiaki Iwane, Ilya Pyatnitskiy, Zoya J Ahmad, Huiliang Wang, José Del R Millán","doi":"10.1088/1741-2552/ad9edf","DOIUrl":"10.1088/1741-2552/ad9edf","url":null,"abstract":"<p><p><i>Objective.</i>Non-invasive electroencephalograms (EEG)-based brain-computer interfaces (BCIs) play a crucial role in a diverse range of applications, including motor rehabilitation, assistive and communication technologies, holding potential promise to benefit users across various clinical spectrums. Effective integration of these applications into daily life requires systems that provide stable and reliable BCI control for extended periods. Our prior research introduced the AIRTrode, a self-adhesive (A), injectable (I), and room-temperature (RT) spontaneously-crosslinked hydrogel electrode (AIRTrode). The AIRTrode has shown lower skin-contact impedance and greater stability than dry electrodes and, unlike wet gel electrodes, does not dry out after just a few hours, enhancing its suitability for long-term application. This study aims to demonstrate the efficacy of AIRTrodes in facilitating reliable, stable and long-term online EEG-based BCI operations.<i>Approach.</i>In this study, four healthy participants utilized AIRTrodes in two BCI control tasks-continuous and discrete-across two sessions separated by six hours. Throughout this duration, the AIRTrodes remained attached to the participants' heads. In the continuous task, participants controlled the BCI through decoding of upper-limb motor imagery (MI). In the discrete task, the control was based on decoding of error-related potentials (ErrPs).<i>Main Results.</i>Using AIRTrodes, participants demonstrated consistently reliable online BCI performance across both sessions and tasks. The physiological signals captured during MI and ErrPs tasks were valid and remained stable over sessions. Lastly, both the BCI performances and physiological signals captured were comparable with those from freshly applied, research-grade wet gel electrodes, the latter requiring inconvenient re-application at the start of the second session.<i>Significance.</i>AIRTrodes show great potential promise for integrating non-invasive BCIs into everyday settings due to their ability to support consistent BCI performances over extended periods. This technology could significantly enhance the usability of BCIs in real-world applications, facilitating continuous, all-day functionality that was previously challenging with existing electrode technologies.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142823032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A hybrid network using transformer with modified locally linear embedding and sliding window convolution for EEG decoding. 一种基于改进局部线性嵌入和滑动窗口卷积的变压器混合网络用于脑电图解码。
Pub Date : 2025-01-06 DOI: 10.1088/1741-2552/ada30b
Ketong Li, Peng Chen, Qian Chen, Xiangyun Li

Objective. Brain-computer interface(BCI) is leveraged by artificial intelligence in EEG signal decoding, which makes it possible to become a new means of human-machine interaction. However, the performance of current EEG decoding methods is still insufficient for clinical applications because of inadequate EEG information extraction and limited computational resources in hospitals. This paper introduces a hybrid network that employs a transformer with modified locally linear embedding and sliding window convolution for EEG decoding.Approach. This network separately extracts channel and temporal features from EEG signals, subsequently fusing these features using a cross-attention mechanism. Simultaneously, manifold learning is employed to lower the computational burden of the model by mapping the high-dimensional EEG data to a low-dimensional space by its dimension reduction function.Main results. The proposed model achieves accuracy rates of 84.44%, 94.96%, and 82.79% on the BCI Competition IV dataset 2a, high gamma dataset, and a self-constructed motor imagery (MI) dataset from the left and right hand fist-clenching tests respectively. The results indicate our model outperforms the baseline models by EEG-channel transformer with dimension-reduced EEG data and window attention with sliding window convolution. Additionally, to enhance the interpretability of the model, features preceding the temporal feature extraction network were visualized. This visualization promotes the understanding of how the model prefers task-related channels.Significance. The transformer-based method makes the MI-EEG decoding more practical for further clinical applications.

目的:脑机接口(BCI)是人工智能在脑电信号解码中的应用,有望成为一种新的人机交互手段。然而,由于脑电图信息提取不足和医院计算资源有限,目前脑电图解码方法的性能仍不适合临床应用。本文介绍了一种采用改进局部线性嵌入和滑动窗口卷积的变压器混合网络进行脑电图解码的方法。方法:该网络分别从脑电信号中提取通道和时间特征,然后利用交叉注意机制融合这些特征。同时,利用流形学习的降维函数将高维脑电数据映射到低维空间,降低了模型的计算量。主要结果:该模型在BCI Competition IV数据集2a、High Gamma数据集和自构建的左手握拳和右手握拳图像数据集上分别达到了84.44%、94.96%和82.79%的准确率。结果表明,该模型优于基于脑电信号降维的脑电信号通道变压器和基于滑动窗口卷积的窗口注意的基线模型。此外,为了增强模型的可解释性,将时序特征提取网络之前的特征可视化。这种可视化促进了对模型如何偏爱任务相关通道的理解。意义:基于变压器的方法使MI-EEG解码更具有临床应用价值。
{"title":"A hybrid network using transformer with modified locally linear embedding and sliding window convolution for EEG decoding.","authors":"Ketong Li, Peng Chen, Qian Chen, Xiangyun Li","doi":"10.1088/1741-2552/ada30b","DOIUrl":"10.1088/1741-2552/ada30b","url":null,"abstract":"<p><p><i>Objective</i>. Brain-computer interface(BCI) is leveraged by artificial intelligence in EEG signal decoding, which makes it possible to become a new means of human-machine interaction. However, the performance of current EEG decoding methods is still insufficient for clinical applications because of inadequate EEG information extraction and limited computational resources in hospitals. This paper introduces a hybrid network that employs a transformer with modified locally linear embedding and sliding window convolution for EEG decoding.<i>Approach</i>. This network separately extracts channel and temporal features from EEG signals, subsequently fusing these features using a cross-attention mechanism. Simultaneously, manifold learning is employed to lower the computational burden of the model by mapping the high-dimensional EEG data to a low-dimensional space by its dimension reduction function.<i>Main results</i>. The proposed model achieves accuracy rates of 84.44%, 94.96%, and 82.79% on the BCI Competition IV dataset 2a, high gamma dataset, and a self-constructed motor imagery (MI) dataset from the left and right hand fist-clenching tests respectively. The results indicate our model outperforms the baseline models by EEG-channel transformer with dimension-reduced EEG data and window attention with sliding window convolution. Additionally, to enhance the interpretability of the model, features preceding the temporal feature extraction network were visualized. This visualization promotes the understanding of how the model prefers task-related channels.<i>Significance</i>. The transformer-based method makes the MI-EEG decoding more practical for further clinical applications.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142886584","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tactile sensitivity to softness in virtual reality can increase when visual expectation and tactile feedback contradict each other. 在虚拟现实中,当视觉期望和触觉反馈相互矛盾时,触觉对柔软的敏感度会增加。
Pub Date : 2024-12-27 DOI: 10.1088/1741-2552/ada0e8
Gabriele Frediani, Federico Carpi

Objective. The perception of softness plays a key role in interactions with various objects, both in the real world and in virtual/augmented reality (VR/AR) systems. The latter can be enriched with haptic feedback on virtual objects' softness to improve immersivity and realism. In such systems, visual expectation can influence tactile sensitivity to softness, as multisensory integration attempts to create a coherent perceptual experience. Nevertheless, expectation is sometimes reported to attenuate, and other times to enhance, perception. Elucidating how the perception of softness is affected by visual expectation in VR/AR is relevant not only to the neuropsychology and neuroscience of perception, but also to practical applications, such as VR/AR-based training or rehabilitation.Approach.Here, by using novel wearable tactile displays of softness previously described by us, we investigated how the sensitivity to softness in a visuo-tactile VR platform can be influenced by expectation. Twelve subjects were engaged in comparing the softness of pairs of virtual objects, familiar or not, with tactile feedback of softness and visual expectation either conflicting or not. The objects' Young's moduli were initially randomly selected from a large set, spanning two orders of magnitude (0.5, 2, 20, 50 and 100 MPa), and then their difference was iteratively reduced, to reach the just noticeable difference in softness.Main results.For the intermediate modulus, a conflict between tactile feedback and visual expectation caused a statistically significant increase in sensitivity.Significance.This finding supports the theory that there can be conditions in which contradictory stimuli strengthen attention (to resolve conflicting sensory information), which in turn can reverse the sensory silencing effect that expectation may otherwise have on perception.

目的:无论是在现实世界还是在虚拟/增强现实(VR/AR)系统中,柔软度的感知在与各种物体的交互中都起着关键作用。后者可以通过对虚拟物体柔软度的触觉反馈来丰富,以提高沉浸感和真实感。在这样的系统中,视觉期望可以影响触觉对柔软的敏感性,因为多感官整合试图创造一个连贯的感知体验。然而,预期有时会减弱,有时会增强感知。阐明VR/AR中视觉期望如何影响柔软感知,不仅与感知的神经心理学和神经科学相关,而且与实际应用相关,例如基于VR/AR的训练或康复。方法:在这里,我们使用我们之前描述的新颖的可穿戴触觉柔软显示,我们研究了视觉触觉VR平台对柔软的敏感性如何受到期望的影响。12名受试者参与了对虚拟物体的柔软度的比较,熟悉或不熟悉,柔软度的触觉反馈和视觉期望是否冲突。物体的杨氏模量最初是从一个大集合中随机选择的,跨越两个数量级(0.5、2、20、50和100 MPa),然后迭代减小它们的差异,以达到柔软度的刚好可注意的差异。主要结果:对于中间模量,触觉反馈和视觉期望之间的冲突导致敏感度显著增加。意义:这一发现支持了这样一个理论,即在某些条件下,相互矛盾的刺激会加强注意(以解决相互冲突的感觉信息),这反过来又可以逆转预期可能对感知产生的感觉沉默效应。 。
{"title":"Tactile sensitivity to softness in virtual reality can increase when visual expectation and tactile feedback contradict each other.","authors":"Gabriele Frediani, Federico Carpi","doi":"10.1088/1741-2552/ada0e8","DOIUrl":"10.1088/1741-2552/ada0e8","url":null,"abstract":"<p><p><i>Objective</i>. The perception of softness plays a key role in interactions with various objects, both in the real world and in virtual/augmented reality (VR/AR) systems. The latter can be enriched with haptic feedback on virtual objects' softness to improve immersivity and realism. In such systems, visual expectation can influence tactile sensitivity to softness, as multisensory integration attempts to create a coherent perceptual experience. Nevertheless, expectation is sometimes reported to attenuate, and other times to enhance, perception. Elucidating how the perception of softness is affected by visual expectation in VR/AR is relevant not only to the neuropsychology and neuroscience of perception, but also to practical applications, such as VR/AR-based training or rehabilitation.<i>Approach.</i>Here, by using novel wearable tactile displays of softness previously described by us, we investigated how the sensitivity to softness in a visuo-tactile VR platform can be influenced by expectation. Twelve subjects were engaged in comparing the softness of pairs of virtual objects, familiar or not, with tactile feedback of softness and visual expectation either conflicting or not. The objects' Young's moduli were initially randomly selected from a large set, spanning two orders of magnitude (0.5, 2, 20, 50 and 100 MPa), and then their difference was iteratively reduced, to reach the just noticeable difference in softness.<i>Main results.</i>For the intermediate modulus, a conflict between tactile feedback and visual expectation caused a statistically significant increase in sensitivity.<i>Significance.</i>This finding supports the theory that there can be conditions in which contradictory stimuli strengthen attention (to resolve conflicting sensory information), which in turn can reverse the sensory silencing effect that expectation may otherwise have on perception.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142857373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of neural engineering
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1