首页 > 最新文献

IEEE Transactions on Neural Systems and Rehabilitation Engineering最新文献

英文 中文
Attention-Adaptive BCI-AOT System Enhances Motor Recovery and Neural Engagement After Stroke 注意-自适应BCI-AOT系统增强脑卒中后运动恢复和神经参与。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-19 DOI: 10.1109/TNSRE.2026.3654935
Hyunmi Lim;Hyoseon Choi;Bilal Ahmed;Yoonghil Park;Jeonghun Ku
Stroke frequently results in long-term motor deficits that impair quality of life. Action observation therapy (AOT) has shown promise for motor recovery through engagement of the mirror neuron system (MNS), yet its passive nature and lack of attentional tracking limit its neuroplasticity efficacy. To address these limitations, we developed a closed-loop Brain-Computer Interface-integrated AOT (BCI-AOT) system employing real-time Steady-State Visual Evoked Potential (SSVEP)-based attention monitoring to dynamically control therapy delivery. In a within-subject crossover study, 22 individuals with hemiplegic stroke completed both BCI-AOT and conventional AOT conditions, each consisting of five daily sessions and separated by a one-week washout. In BCI-AOT, video playback depended on sustained attentional engagement detected via SSVEPs. Behavioral outcomes (Box and Block Test [BBT], Action Research Arm Test [ARAT]) and physiological measures (Motor Evoked Potential [MEP] amplitude and latency, EEG power) were assessed pre- and post-intervention. Significant Condition $times $ Day interactions were found for both BBT and ARAT, indicating greater functional gains over time in the BCI-AOT condition. Both conditions showed increased corticospinal excitability over time, while BCI-AOT additionally exhibited distinct mu and theta modulation over time. Participants also reported greater motivation and attention after BCI-AOT compared to conventional AOT. These results suggest that BCI-AOT elicits stronger neuroplasticity responses and user engagement than standard AOT. This study supports the feasibility and clinical potential of closed-loop, attention-adaptive neurorehabilitation for stroke recovery.
中风经常导致长期运动障碍,从而影响生活质量。动作观察疗法(AOT)通过参与镜像神经元系统(MNS)显示出运动恢复的希望,但其被动性质和缺乏注意跟踪限制了其神经可塑性的效果。为了解决这些限制,我们开发了一种闭环脑机接口集成AOT (BCI-AOT)系统,采用基于实时稳态视觉诱发电位(SSVEP)的注意力监测来动态控制治疗递送。在一项受试者内交叉研究中,22名偏瘫中风患者完成了BCI-AOT和常规AOT条件,每个条件由每天五个疗程组成,间隔一周的洗脱期。在BCI-AOT中,视频播放依赖于通过ssvep检测到的持续注意力投入。评估干预前后的行为结果(Box and Block Test [BBT]、动作研究臂测试[ARAT])和生理指标(运动诱发电位[MEP]振幅、潜伏期、脑电图功率)。在BBT和ARAT中发现了显著的条件×日相互作用,表明BCI-AOT条件下随着时间的推移功能增加更大。随着时间的推移,这两种情况都显示出皮质脊髓兴奋性的增加,而BCI-AOT也表现出明显的mu和theta调制。与常规AOT相比,BCI-AOT后参与者也报告了更大的动机和注意力。这些结果表明BCI-AOT比标准AOT引起更强的神经可塑性反应和用户参与。本研究支持闭环、注意适应性神经康复治疗脑卒中康复的可行性和临床潜力。
{"title":"Attention-Adaptive BCI-AOT System Enhances Motor Recovery and Neural Engagement After Stroke","authors":"Hyunmi Lim;Hyoseon Choi;Bilal Ahmed;Yoonghil Park;Jeonghun Ku","doi":"10.1109/TNSRE.2026.3654935","DOIUrl":"10.1109/TNSRE.2026.3654935","url":null,"abstract":"Stroke frequently results in long-term motor deficits that impair quality of life. Action observation therapy (AOT) has shown promise for motor recovery through engagement of the mirror neuron system (MNS), yet its passive nature and lack of attentional tracking limit its neuroplasticity efficacy. To address these limitations, we developed a closed-loop Brain-Computer Interface-integrated AOT (BCI-AOT) system employing real-time Steady-State Visual Evoked Potential (SSVEP)-based attention monitoring to dynamically control therapy delivery. In a within-subject crossover study, 22 individuals with hemiplegic stroke completed both BCI-AOT and conventional AOT conditions, each consisting of five daily sessions and separated by a one-week washout. In BCI-AOT, video playback depended on sustained attentional engagement detected via SSVEPs. Behavioral outcomes (Box and Block Test [BBT], Action Research Arm Test [ARAT]) and physiological measures (Motor Evoked Potential [MEP] amplitude and latency, EEG power) were assessed pre- and post-intervention. Significant Condition <inline-formula> <tex-math>$times $ </tex-math></inline-formula> Day interactions were found for both BBT and ARAT, indicating greater functional gains over time in the BCI-AOT condition. Both conditions showed increased corticospinal excitability over time, while BCI-AOT additionally exhibited distinct mu and theta modulation over time. Participants also reported greater motivation and attention after BCI-AOT compared to conventional AOT. These results suggest that BCI-AOT elicits stronger neuroplasticity responses and user engagement than standard AOT. This study supports the feasibility and clinical potential of closed-loop, attention-adaptive neurorehabilitation for stroke recovery.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"686-698"},"PeriodicalIF":5.2,"publicationDate":"2026-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11358787","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146003352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Feet-Based IMU Algorithm Yields High Specificity for Detection of Walking in Daily Life 基于足部的IMU算法对日常生活中行走的检测具有较高的特异性。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-19 DOI: 10.1109/TNSRE.2026.3655791
Michelle van Mierlo;Katrijn Smulders;Noël Keijsers
Daily life gait performance measures can provide ecologically valid gait characteristics, which are interesting for monitoring individuals with gait impairments. The first step in obtaining these gait characteristics is selecting walking periods from multiple day recordings. We developed and validated an algorithm for walking detection using inertial measurement units (IMU) on Both feet and compared the performance with two others in healthy individuals and those with neurologically impaired gait: 1) using Sacrum accelerometer data (Iluz et al. 2014); 2) using Single foot gyroscopic data (Ullrich et al. 2020). We also assessed which activities reduce the algorithms’ specificity for walking detection. The Both feet algorithm consisted of three stages, 1) selecting time periods potentially containing walking; 2) excluding periods not containing walking; 3) checking the selected periods for minimal walking bout requirements. For validation, 32 participants (12 healthy and 20 with neurologically impaired gait) performed 20-30 minutes of daily life activities, while wearing IMUs on both feet and the sacrum. Using labelled video recordings as reference, we calculated each algorithm’s specificity, sensitivity and accuracy for walking detection. Both feet outperformed the other algorithms on specificity (96.6% versus 92.1% and 72.1% for the Single foot en Sacrum respectively). Stair climbing was misclassified as walking most often by all algorithms. Sacrum outperformed the others on sensitivity (99.5%), but had low specificity and accuracy. The high specificity of the Both feet algorithm makes it suitable when spatiotemporal gait characteristics are of interest, and is applicable in populations with mild neurological conditions affecting gait.
日常生活步态性能测量可以提供生态有效的步态特征,这对监测步态障碍的个体很有意义。获得这些步态特征的第一步是从多天记录中选择步行周期。我们开发并验证了一种使用双脚惯性测量单元(IMU)进行行走检测的算法,并将其与健康个体和神经系统步态受损者的其他两种算法进行了比较:1)使用骶骨加速度计数据(Iluz et al. 2014);2)使用单脚陀螺仪数据(Ullrich et al. 2020)。我们还评估了哪些活动降低了算法对步行检测的特异性。双脚算法包括三个阶段:1)选择可能包含步行的时间段;2)不包括散步时段;3)检查所选时段的最小步行回合要求。为了验证,32名参与者(12名健康参与者和20名神经性步态受损参与者)在双脚和骶骨上佩戴imu,进行20- 30分钟的日常生活活动。以标记视频为参考,我们计算了每种算法在行走检测中的特异性、灵敏度和准确性。两只脚的特异性优于其他算法(分别为96.6%和92.1%,单脚和骶骨分别为72.1%)。爬楼梯最常被所有算法错误地归类为步行。骶骨的敏感性为99.5%,但特异性和准确性较低。双脚算法的高特异性使其适用于对时空步态特征感兴趣的情况,并且适用于轻度神经系统疾病影响步态的人群。
{"title":"Feet-Based IMU Algorithm Yields High Specificity for Detection of Walking in Daily Life","authors":"Michelle van Mierlo;Katrijn Smulders;Noël Keijsers","doi":"10.1109/TNSRE.2026.3655791","DOIUrl":"10.1109/TNSRE.2026.3655791","url":null,"abstract":"Daily life gait performance measures can provide ecologically valid gait characteristics, which are interesting for monitoring individuals with gait impairments. The first step in obtaining these gait characteristics is selecting walking periods from multiple day recordings. We developed and validated an algorithm for walking detection using inertial measurement units (IMU) on Both feet and compared the performance with two others in healthy individuals and those with neurologically impaired gait: 1) using Sacrum accelerometer data (Iluz et al. 2014); 2) using Single foot gyroscopic data (Ullrich et al. 2020). We also assessed which activities reduce the algorithms’ specificity for walking detection. The Both feet algorithm consisted of three stages, 1) selecting time periods potentially containing walking; 2) excluding periods not containing walking; 3) checking the selected periods for minimal walking bout requirements. For validation, 32 participants (12 healthy and 20 with neurologically impaired gait) performed 20-30 minutes of daily life activities, while wearing IMUs on both feet and the sacrum. Using labelled video recordings as reference, we calculated each algorithm’s specificity, sensitivity and accuracy for walking detection. Both feet outperformed the other algorithms on specificity (96.6% versus 92.1% and 72.1% for the Single foot en Sacrum respectively). Stair climbing was misclassified as walking most often by all algorithms. Sacrum outperformed the others on sensitivity (99.5%), but had low specificity and accuracy. The high specificity of the Both feet algorithm makes it suitable when spatiotemporal gait characteristics are of interest, and is applicable in populations with mild neurological conditions affecting gait.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"931-940"},"PeriodicalIF":5.2,"publicationDate":"2026-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11358952","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146003336","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Defining Experimental Design for Human Motor Control Identification: A Novel Framework 定义人体运动控制识别的实验设计:一个新的框架。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-15 DOI: 10.1109/TNSRE.2026.3654843
Adriana Cancrini;Bruno Borghi;Naveed Reza Aghamohammadi;Arturo Ramirez;James L. Patton
Characterizing each person’s sensorimotor profile is crucial for designing precise and personalized motor rehabilitation therapies. Building on our previous work in system identification of human motor control dynamics, we now extend our parameter recovery technique developed in synthetic models to a real-world human experiment. This twin-based digital method actively guides the experimental design by selecting the most informative perturbations and movement conditions to most accurately identify (recover) sensory feedback gains. We applied this framework to 10 neurotypical participants, analyzing their performance during arm planar reaching movements. By combining the optimized experimental design with this forward–inverse modeling pipeline, we estimated individual sensory feedback gains. These gains were then used to simulate movement trajectories, achieving a movement prediction accuracy of 85% compared to withheld trajectories performed by the same subjects. These results validate the ability of our mathematical model to capture and explain individual sensorimotor dynamics through the identification of subject-specific feedback gains. This approach offers a promising tool for gaining insights into the roles of different sensory channels and identifying the most informative data required for efficient assessment.
描述每个人的感觉运动特征对于设计精确和个性化的运动康复疗法至关重要。基于我们之前在人体运动控制动力学系统识别方面的工作,我们现在将我们在合成模型中开发的参数恢复技术扩展到现实世界的人体实验中。这种基于孪生的数字方法通过选择信息量最大的扰动和运动条件来主动指导实验设计,以最准确地识别(恢复)感官反馈增益。我们将这一框架应用于10名神经正常的参与者,分析他们在手臂平面伸展运动中的表现。通过将优化的实验设计与这种正逆建模管道相结合,我们估计了个体感官反馈增益。然后,这些增益被用来模拟运动轨迹,与相同受试者执行的保留轨迹相比,实现了85%的运动预测精度。这些结果验证了我们的数学模型通过识别特定主体的反馈增益来捕获和解释个体感觉运动动力学的能力。这种方法提供了一种很有前途的工具,可以深入了解不同感觉通道的作用,并确定有效评估所需的最具信息量的数据。
{"title":"Defining Experimental Design for Human Motor Control Identification: A Novel Framework","authors":"Adriana Cancrini;Bruno Borghi;Naveed Reza Aghamohammadi;Arturo Ramirez;James L. Patton","doi":"10.1109/TNSRE.2026.3654843","DOIUrl":"10.1109/TNSRE.2026.3654843","url":null,"abstract":"Characterizing each person’s sensorimotor profile is crucial for designing precise and personalized motor rehabilitation therapies. Building on our previous work in system identification of human motor control dynamics, we now extend our parameter recovery technique developed in synthetic models to a real-world human experiment. This twin-based digital method actively guides the experimental design by selecting the most informative perturbations and movement conditions to most accurately identify (recover) sensory feedback gains. We applied this framework to 10 neurotypical participants, analyzing their performance during arm planar reaching movements. By combining the optimized experimental design with this forward–inverse modeling pipeline, we estimated individual sensory feedback gains. These gains were then used to simulate movement trajectories, achieving a movement prediction accuracy of 85% compared to withheld trajectories performed by the same subjects. These results validate the ability of our mathematical model to capture and explain individual sensorimotor dynamics through the identification of subject-specific feedback gains. This approach offers a promising tool for gaining insights into the roles of different sensory channels and identifying the most informative data required for efficient assessment.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"721-731"},"PeriodicalIF":5.2,"publicationDate":"2026-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11355670","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145984652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Toward Biomarker Discovery for Early Cerebral Palsy Detection: Evaluating Explanations Through Kinematic Perturbations 早期脑瘫检测的生物标志物发现:通过运动扰动评估解释。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-14 DOI: 10.1109/TNSRE.2026.3654400
Kimji N. Pellano;Inga Strümke;Daniel Groos;Lars Adde;Pål Haugen;Espen Alexander F. Ihlen
Cerebral Palsy (CP) is a prevalent motor disability in children, for which early detection can significantly improve treatment outcomes. While skeleton-based Graph Convolutional Network (GCN) models have shown promise in automatically predicting CP risk from infant videos, their “black-box” nature raises concerns about clinical explainability. To address this, we introduce a perturbation framework tailored for infant movement features and use it to compare two explainable AI (XAI) methods: Class Activation Mapping (CAM) and Gradient-weighted Class Activation Mapping (Grad-CAM). First, we identify significant and non-significant body keypoints in very low and very high risk infant video snippets based on the XAI attribution scores. We then conduct targeted velocity and angular perturbations, both individually and in combination, on these keypoints to assess how the GCN model’s risk predictions change. Our results indicate that velocity-driven features of the arms, hips, and legs appear to have a dominant influence on CP risk predictions, while angular perturbations have a more modest impact. Furthermore, CAM and Grad-CAM show partial convergence in their explanations for both low and high CP risk groups. Our findings demonstrate the use of XAI-driven movement analysis for early CP prediction, and offer insights into potential movement-based biomarker discovery that warrant further clinical validation.
脑瘫(CP)是儿童中常见的运动障碍,早期发现可以显著提高治疗效果。尽管基于骨架的图卷积网络(GCN)模型在从婴儿视频中自动预测CP风险方面显示出了希望,但它们的“黑箱”性质引起了人们对临床可解释性的担忧。为了解决这个问题,我们引入了一个针对婴儿运动特征量身定制的扰动框架,并用它来比较两种可解释的AI (XAI)方法:类激活映射(CAM)和梯度加权类激活映射(Grad-CAM)。首先,我们基于XAI归因分数在非常低和非常高风险的婴儿视频片段中识别显著和非显著的身体关键点。然后,我们对这些关键点单独或联合进行有针对性的速度和角度扰动,以评估GCN模型的风险预测如何变化。我们的研究结果表明,手臂、臀部和腿部的速度驱动特征似乎对CP风险预测有主要影响,而角度扰动的影响则较为温和。此外,CAM和Grad-CAM对低和高CP风险组的解释显示出部分收敛性。我们的研究结果证明了xai驱动的运动分析用于早期CP预测,并为潜在的基于运动的生物标志物发现提供了见解,需要进一步的临床验证。
{"title":"Toward Biomarker Discovery for Early Cerebral Palsy Detection: Evaluating Explanations Through Kinematic Perturbations","authors":"Kimji N. Pellano;Inga Strümke;Daniel Groos;Lars Adde;Pål Haugen;Espen Alexander F. Ihlen","doi":"10.1109/TNSRE.2026.3654400","DOIUrl":"10.1109/TNSRE.2026.3654400","url":null,"abstract":"Cerebral Palsy (CP) is a prevalent motor disability in children, for which early detection can significantly improve treatment outcomes. While skeleton-based Graph Convolutional Network (GCN) models have shown promise in automatically predicting CP risk from infant videos, their “black-box” nature raises concerns about clinical explainability. To address this, we introduce a perturbation framework tailored for infant movement features and use it to compare two explainable AI (XAI) methods: Class Activation Mapping (CAM) and Gradient-weighted Class Activation Mapping (Grad-CAM). First, we identify significant and non-significant body keypoints in very low and very high risk infant video snippets based on the XAI attribution scores. We then conduct targeted velocity and angular perturbations, both individually and in combination, on these keypoints to assess how the GCN model’s risk predictions change. Our results indicate that velocity-driven features of the arms, hips, and legs appear to have a dominant influence on CP risk predictions, while angular perturbations have a more modest impact. Furthermore, CAM and Grad-CAM show partial convergence in their explanations for both low and high CP risk groups. Our findings demonstrate the use of XAI-driven movement analysis for early CP prediction, and offer insights into potential movement-based biomarker discovery that warrant further clinical validation.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"750-766"},"PeriodicalIF":5.2,"publicationDate":"2026-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11352985","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145984698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Discrete Tactile Feedback Based on Weber’s Law Enhances Prosthetic Hand Approaching Performance Under Divided Visual Attention 基于韦伯定律的离散触觉反馈增强分散视觉注意下假手接近性能。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-13 DOI: 10.1109/TNSRE.2026.3653788
Xianwei Meng;Jianjun Meng;Guohong Chai;Xinjun Sheng;Xiangyang Zhu
In multiple vision-demanding tasks, accurately controlling a prosthetic hand to approach a target object is particularly challenging for amputees, as visual attention diverted by other tasks forces them to rely heavily on peripheral vision. This study aims to initially validate that functionally effective sensory feedback can enhance the control of prosthetic hands during object approach under divided visual attention. To quantify prosthesis users’ ability to approach and manipulate objects using central and peripheral vision in real-life scenarios, we conducted two experimental tasks—APPROACHING and PINCH—under two visual feedback modes: full-vision and partial-vision. During the approaching process, we compared four feedback conditions: no supplementary sensory feedback (PURE), traditional continuous feedback (CONT), evenly distributed discrete feedback (ADIS), and a novel discrete strategy based on Weber’s law (WDIS) proposed in this study. Task performance was evaluated using metrics such as position error, dispersion, task completion time, and pinch failures, while psychological factors were assessed through a questionnaire. Results show that WDIS enabled more accurate and stable object approach, with shorter task completion times, which leads to better subsequent manipulation performance. This also provides participants with enhanced psychological experiences, including reduced workload and increased intuitiveness. WDIS improved prosthetic control and user experience in the simplified laboratory settings, providing a foundation for real-world applications.
在多种视觉要求的任务中,准确控制假手接近目标物体对截肢者来说尤其具有挑战性,因为视觉注意力被其他任务转移,迫使他们严重依赖周边视觉。本研究旨在初步验证在视觉注意力分散的情况下,功能有效的感觉反馈可以增强假手在物体接近过程中的控制能力。为了量化假肢使用者在现实场景中使用中央视觉和周边视觉接近和操纵物体的能力,我们在全视觉和部分视觉两种视觉反馈模式下进行了接近和捏捏两个实验任务。在逼近过程中,我们比较了四种反馈条件:无补充感官反馈(PURE)、传统连续反馈(CONT)、均匀分布离散反馈(ADIS)和本研究提出的基于韦伯定律的新型离散策略(WDIS)。任务绩效通过位置误差、分散、任务完成时间和夹紧失败等指标进行评估,而心理因素则通过问卷进行评估。结果表明,WDIS能够实现更精确和稳定的目标逼近,任务完成时间更短,从而提高后续操作性能。这也为参与者提供了增强的心理体验,包括减少工作量和提高直觉。WDIS在简化的实验室环境中改善了假肢控制和用户体验,为实际应用奠定了基础。
{"title":"Discrete Tactile Feedback Based on Weber’s Law Enhances Prosthetic Hand Approaching Performance Under Divided Visual Attention","authors":"Xianwei Meng;Jianjun Meng;Guohong Chai;Xinjun Sheng;Xiangyang Zhu","doi":"10.1109/TNSRE.2026.3653788","DOIUrl":"10.1109/TNSRE.2026.3653788","url":null,"abstract":"In multiple vision-demanding tasks, accurately controlling a prosthetic hand to approach a target object is particularly challenging for amputees, as visual attention diverted by other tasks forces them to rely heavily on peripheral vision. This study aims to initially validate that functionally effective sensory feedback can enhance the control of prosthetic hands during object approach under divided visual attention. To quantify prosthesis users’ ability to approach and manipulate objects using central and peripheral vision in real-life scenarios, we conducted two experimental tasks—APPROACHING and PINCH—under two visual feedback modes: full-vision and partial-vision. During the approaching process, we compared four feedback conditions: no supplementary sensory feedback (PURE), traditional continuous feedback (CONT), evenly distributed discrete feedback (ADIS), and a novel discrete strategy based on Weber’s law (WDIS) proposed in this study. Task performance was evaluated using metrics such as position error, dispersion, task completion time, and pinch failures, while psychological factors were assessed through a questionnaire. Results show that WDIS enabled more accurate and stable object approach, with shorter task completion times, which leads to better subsequent manipulation performance. This also provides participants with enhanced psychological experiences, including reduced workload and increased intuitiveness. WDIS improved prosthetic control and user experience in the simplified laboratory settings, providing a foundation for real-world applications.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"674-685"},"PeriodicalIF":5.2,"publicationDate":"2026-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11348986","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145966025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Quantitative Assessment of Upper Limb Multi-Modal Feature Fusion Under Task-Oriented Movement 任务导向运动下上肢多模态特征融合的定量评价。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-13 DOI: 10.1109/TNSRE.2026.3653761
Keping Liu;Guang Liu;Zhifei Zhai;Baozhen Nie;Xiaoqin Duan;Changxian Xu;Zhongbo Sun
Assessment of motor function is an important component of a post-stroke rehabilitation program. The traditional assessment process mainly relies on clinical experience and lacks quantitative analysis. To objectively assess the upper limb motor status of post-stroke hemiplegic patients, this study proposes a novel assessment method based on multi-modal feature fusion of the upper limb for task-oriented movement. Features are extracted from each modal data and input into the corresponding base classifiers. The kinematic and muscle synergy are quantified by singular value decomposition (SVD) and similarity metric index, and the results are integrated to construct an aggregated classifier for in-depth quantitative assessment of different movement modalities. To exploit the complementary nature of kinematic and muscular level assessment results, a multi-modal feature fusion scheme is proposed and a probability-based functional scoring mechanism is generated to comprehensively analyze upper extremity motor function. Experimental results show that integrating synergy analyses into the assessment system improves the classification accuracy by 2.39% and 2.31%, respectively, which can be further improved to 90.75% by fusing the features extracted from different modalities. Furthermore, the assessment results of multi-modal fusion framework are significantly correlated with standard clinical trial scores ( $r$ =-0.81, $p$ =0.0147). These promising results suggest that it is feasible to apply the proposed method to the clinical assessment of hemiplegic patients after stroke.
运动功能评估是卒中后康复计划的重要组成部分。传统的评估过程主要依靠临床经验,缺乏定量分析。为了客观评估脑卒中后偏瘫患者的上肢运动状态,本研究提出了一种基于任务导向运动的上肢多模态特征融合的评估方法。从每个模态数据中提取特征并输入到相应的基分类器中。通过奇异值分解(SVD)和相似度度量指标对运动和肌肉协同作用进行量化,并将结果整合到一个聚合分类器中,对不同的运动方式进行深度定量评估。为了利用运动和肌肉水平评估结果的互补性,提出了一种多模态特征融合方案,并生成了一种基于概率的功能评分机制,对上肢运动功能进行综合分析。实验结果表明,将协同分析集成到评估系统中,分类准确率分别提高了2.39%和2.31%,通过融合不同模式提取的特征,分类准确率可进一步提高到90.75%。此外,多模态融合框架的评估结果与标准临床试验评分显著相关(r=-0.81, p=0.0147)。这些令人鼓舞的结果表明,将该方法应用于脑卒中后偏瘫患者的临床评估是可行的。
{"title":"Quantitative Assessment of Upper Limb Multi-Modal Feature Fusion Under Task-Oriented Movement","authors":"Keping Liu;Guang Liu;Zhifei Zhai;Baozhen Nie;Xiaoqin Duan;Changxian Xu;Zhongbo Sun","doi":"10.1109/TNSRE.2026.3653761","DOIUrl":"10.1109/TNSRE.2026.3653761","url":null,"abstract":"Assessment of motor function is an important component of a post-stroke rehabilitation program. The traditional assessment process mainly relies on clinical experience and lacks quantitative analysis. To objectively assess the upper limb motor status of post-stroke hemiplegic patients, this study proposes a novel assessment method based on multi-modal feature fusion of the upper limb for task-oriented movement. Features are extracted from each modal data and input into the corresponding base classifiers. The kinematic and muscle synergy are quantified by singular value decomposition (SVD) and similarity metric index, and the results are integrated to construct an aggregated classifier for in-depth quantitative assessment of different movement modalities. To exploit the complementary nature of kinematic and muscular level assessment results, a multi-modal feature fusion scheme is proposed and a probability-based functional scoring mechanism is generated to comprehensively analyze upper extremity motor function. Experimental results show that integrating synergy analyses into the assessment system improves the classification accuracy by 2.39% and 2.31%, respectively, which can be further improved to 90.75% by fusing the features extracted from different modalities. Furthermore, the assessment results of multi-modal fusion framework are significantly correlated with standard clinical trial scores (<inline-formula> <tex-math>$r$ </tex-math></inline-formula>=-0.81, <inline-formula> <tex-math>$p$ </tex-math></inline-formula>=0.0147). These promising results suggest that it is feasible to apply the proposed method to the clinical assessment of hemiplegic patients after stroke.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"711-720"},"PeriodicalIF":5.2,"publicationDate":"2026-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11348979","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145966030","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhanced Mapping of Finger Movement Representations Using Diffuse Optical Tomography: A Systematic Comparison With fNIRS 利用漫射光学断层扫描增强手指运动表征的映射:与近红外光谱的系统比较。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-12 DOI: 10.1109/TNSRE.2026.3652812
Shuo Guan;Yuhang Li;Yuanyuan Gao;Ran Yin;Yuxi Luo;Jiuxing Liang;Juan Zhang;Yingchun Zhang;Rihui Li
Advancing neuroimaging modalities for motor cortex analysis is critical for understanding the neural mechanisms underlying fine motor tasks and for expanding clinical applications. Functional Near-Infrared Spectroscopy (fNIRS) is widely used for measuring cortical hemodynamic activity due to its portability and accessibility, but its inherent limitations in spatial resolution and noise sensitivity reduce its utility for precise neural mapping. Diffuse Optical Tomography (DOT) has emerged as a promising alternative with superior spatial resolution and sensitivity. In this study, we performed a systematic comparison of DOT and fNIRS in detecting task-evoked neural activation during a finger-tapping paradigm including four conditions varying by finger type (thumb vs. little finger) and frequency (high vs. low). Our results demonstrated that DOT consistently captured robust activation in motor-related brain regions, even during less demanding conditions, while fNIRS exhibited limited sensitivity. Temporal trace analyses revealed that DOT achieved higher contrast-to-noise ratio (CNR) and contrast-to-background ratio (CBR), validating its enhanced signal quality and ability to distinguish subtle hemodynamic responses. Furthermore, statistical comparisons highlighted significant differences in task-related activations detected by the two modalities, particularly in low-effort conditions. These findings underscore the advantages of DOT over fNIRS, particularly in applications requiring high spatial resolution and sensitivity to subtle neural processes. The results contribute to ongoing efforts to refine optical imaging techniques for motor neuroscience and reinforce DOT’s potential for clinical translation in motor deficit diagnosis, rehabilitation monitoring, and brain-computer interface development.
推进运动皮层分析的神经成像模式对于理解精细运动任务的神经机制和扩大临床应用至关重要。功能近红外光谱(fNIRS)由于其便携性和可获取性而被广泛用于测量皮质血流动力学活动,但其固有的空间分辨率和噪声灵敏度限制了其在精确神经映射中的应用。漫射光学层析成像(DOT)已成为一种有前途的替代方案,具有优越的空间分辨率和灵敏度。在这项研究中,我们对DOT和fNIRS在检测手指敲击范式中任务诱发的神经激活进行了系统的比较,包括四种不同手指类型(拇指与小指)和频率(高与低)的情况。我们的研究结果表明,即使在较低的条件下,DOT也能持续捕捉到与运动相关的大脑区域的强劲激活,而fNIRS的灵敏度有限。时间轨迹分析显示,DOT获得了更高的对比噪声比(CNR)和对比背景比(CBR),验证了其增强的信号质量和区分细微血流动力学反应的能力。此外,统计比较突出了两种模式检测到的任务相关激活的显着差异,特别是在低努力条件下。这些发现强调了DOT相对于fNIRS的优势,特别是在需要高空间分辨率和对微妙神经过程敏感的应用中。这些结果有助于改进运动神经科学的光学成像技术,并加强DOT在运动缺陷诊断、康复监测和脑机接口开发方面的临床应用潜力。
{"title":"Enhanced Mapping of Finger Movement Representations Using Diffuse Optical Tomography: A Systematic Comparison With fNIRS","authors":"Shuo Guan;Yuhang Li;Yuanyuan Gao;Ran Yin;Yuxi Luo;Jiuxing Liang;Juan Zhang;Yingchun Zhang;Rihui Li","doi":"10.1109/TNSRE.2026.3652812","DOIUrl":"10.1109/TNSRE.2026.3652812","url":null,"abstract":"Advancing neuroimaging modalities for motor cortex analysis is critical for understanding the neural mechanisms underlying fine motor tasks and for expanding clinical applications. Functional Near-Infrared Spectroscopy (fNIRS) is widely used for measuring cortical hemodynamic activity due to its portability and accessibility, but its inherent limitations in spatial resolution and noise sensitivity reduce its utility for precise neural mapping. Diffuse Optical Tomography (DOT) has emerged as a promising alternative with superior spatial resolution and sensitivity. In this study, we performed a systematic comparison of DOT and fNIRS in detecting task-evoked neural activation during a finger-tapping paradigm including four conditions varying by finger type (thumb vs. little finger) and frequency (high vs. low). Our results demonstrated that DOT consistently captured robust activation in motor-related brain regions, even during less demanding conditions, while fNIRS exhibited limited sensitivity. Temporal trace analyses revealed that DOT achieved higher contrast-to-noise ratio (CNR) and contrast-to-background ratio (CBR), validating its enhanced signal quality and ability to distinguish subtle hemodynamic responses. Furthermore, statistical comparisons highlighted significant differences in task-related activations detected by the two modalities, particularly in low-effort conditions. These findings underscore the advantages of DOT over fNIRS, particularly in applications requiring high spatial resolution and sensitivity to subtle neural processes. The results contribute to ongoing efforts to refine optical imaging techniques for motor neuroscience and reinforce DOT’s potential for clinical translation in motor deficit diagnosis, rehabilitation monitoring, and brain-computer interface development.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"617-625"},"PeriodicalIF":5.2,"publicationDate":"2026-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11345245","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145959425","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Smart Ward Control Based on a Wearable Multimodal Brain–Computer Interface Mouse 基于可穿戴多模态脑机接口鼠标的智能病房控制。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-12 DOI: 10.1109/TNSRE.2026.3653138
Junbiao Zhu;Kendi Li;Sicong Chen;Haiyun Huang;Yupeng Zhang;Li Hu;Yuanqing Li
For patients with severe extremity motor function impairment, traditional smart ward control methods, such as those using joysticks and touchscreens, are frequently unsuitable due to their limited physical abilities. Consequently, developing an effective brain–computer interface (BCI) suitable for their operation has become an immediate concern. This paper presents a wearable multimodal BCI system for smart ward control, which employs a self-designed wearable headband to capture head rotation and blinking movement. By wearing the headband, users can control a computer cursor on the screen only with head rotation and blinking, and further control devices in a smart ward with self-designed graphical user interfaces (GUIs). The system decodes signals from an inertial measurement unit (IMU) to map the head posture to the position of the cursor on the screen and decodes electrooculography (EOG) and electroencephalography (EEG) signals to detect valid blinks for selecting and activating function buttons. Ten participants were recruited to perform two experimental tasks that simulate the daily needs of patients with extremity motor function issues. To our satisfaction, all the participants fully accomplished the simulated tasks, and an average accuracy of $97.0pm 3.9$ % and an average response time of $2.39pm 0.53$ s were achieved. Different from traditional step-controlled BCI nursing beds, we designed a continuous-controlled nursing bed and achieved satisfactory results. Furthermore, workload evaluation using NASA Task Load Index (NASA-TLX) revealed that the participants experienced a low workload when using the system. The experimental results demonstrate the effectiveness of our proposed system, indicating significant potential for practical applications.
对于严重肢体运动功能障碍的患者,传统的智能病房控制方法,如使用操纵杆和触摸屏,由于他们的身体能力有限,往往不适合。因此,开发一种有效的脑机接口(BCI),适合他们的操作已成为当务之急。本文提出了一种用于智能病房控制的可穿戴式多模态脑机接口系统,该系统采用自行设计的可穿戴式头带来捕捉头部旋转和眨眼运动。佩戴头带后,用户只需头部旋转和闪烁即可控制屏幕上的计算机光标,并通过自行设计的图形用户界面(gui)进一步控制智能病房内的设备。该系统对来自惯性测量单元(IMU)的信号进行解码,将头部姿势映射到屏幕上光标的位置,并对眼电(EOG)和脑电图(EEG)信号进行解码,以检测选择和激活功能按钮的有效眨眼。10名参与者被招募来执行两项模拟四肢运动功能问题患者日常需求的实验任务。令我们满意的是,所有参与者都完全完成了模拟任务,平均准确率为97.0±3.9%,平均反应时间为2.39±0.53 s。与传统的步控BCI护理床不同,我们设计了一种连续控制的BCI护理床,取得了满意的效果。此外,使用NASA任务负载指数(NASA- tlx)进行的工作量评估显示,参与者在使用该系统时经历了较低的工作量。实验结果证明了该系统的有效性,显示了实际应用的巨大潜力。
{"title":"Smart Ward Control Based on a Wearable Multimodal Brain–Computer Interface Mouse","authors":"Junbiao Zhu;Kendi Li;Sicong Chen;Haiyun Huang;Yupeng Zhang;Li Hu;Yuanqing Li","doi":"10.1109/TNSRE.2026.3653138","DOIUrl":"10.1109/TNSRE.2026.3653138","url":null,"abstract":"For patients with severe extremity motor function impairment, traditional smart ward control methods, such as those using joysticks and touchscreens, are frequently unsuitable due to their limited physical abilities. Consequently, developing an effective brain–computer interface (BCI) suitable for their operation has become an immediate concern. This paper presents a wearable multimodal BCI system for smart ward control, which employs a self-designed wearable headband to capture head rotation and blinking movement. By wearing the headband, users can control a computer cursor on the screen only with head rotation and blinking, and further control devices in a smart ward with self-designed graphical user interfaces (GUIs). The system decodes signals from an inertial measurement unit (IMU) to map the head posture to the position of the cursor on the screen and decodes electrooculography (EOG) and electroencephalography (EEG) signals to detect valid blinks for selecting and activating function buttons. Ten participants were recruited to perform two experimental tasks that simulate the daily needs of patients with extremity motor function issues. To our satisfaction, all the participants fully accomplished the simulated tasks, and an average accuracy of <inline-formula> <tex-math>$97.0pm 3.9$ </tex-math></inline-formula> % and an average response time of <inline-formula> <tex-math>$2.39pm 0.53$ </tex-math></inline-formula> s were achieved. Different from traditional step-controlled BCI nursing beds, we designed a continuous-controlled nursing bed and achieved satisfactory results. Furthermore, workload evaluation using NASA Task Load Index (NASA-TLX) revealed that the participants experienced a low workload when using the system. The experimental results demonstrate the effectiveness of our proposed system, indicating significant potential for practical applications.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"638-649"},"PeriodicalIF":5.2,"publicationDate":"2026-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11346927","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145959445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Early Detection of Mild Cognitive Impairment Through Balance Assessment Using Multi-Location Wearable Inertial Sensors 基于多位置可穿戴惯性传感器平衡评估的轻度认知障碍早期检测。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-12 DOI: 10.1109/TNSRE.2026.3651786
Mobeena Jamshed;Ahsan Shahzad;Kiseon Kim
Early detection of Mild Cognitive Impairment (MCI), a prodromal stage of dementia, plays a pivotal role in enabling timely clinical intervention and slowing cognitive decline. This paper presents a multi-sensor balance assessment framework designed to identify MCI-related postural instabilities using a wearable inertial measurement unit (IMU) network. The proposed system employs five synchronized IMUs placed at the waist, thighs, and shanks to capture balance dynamics across four static balance tasks: Eyes-Open, Eyes-Closed, Right-Leg Lift, and Left-Leg Lift. A three-stage feature selection strategy, comprising variance and correlation pruning, univariate filtering, and embedded model selection, is implemented within a Leave-One-Subject-Out (LOSO) cross-validation scheme to extract discriminative sway features. Classification using Support Vector Machines and tree-based ensemble models consistently yields superior results, achieving accuracies between 71.7% and 79.2%, with the highest performance observed in the Eyes-Open condition. A compact 10-feature subset demonstrates stable and robust discriminative power across all tasks. Compared to a single-sensor baseline, the multi-sensor configuration provides improved classification performance, underscoring the feasibility of compact, balance-driven, non-invasive MCI screening through wearable sensor systems.
早期发现轻度认知障碍(MCI)是痴呆症的前驱阶段,在及时进行临床干预和减缓认知能力下降方面起着关键作用。本文提出了一个多传感器平衡评估框架,旨在利用可穿戴惯性测量单元(IMU)网络识别mci相关的姿势不稳定性。该系统采用了5个同步的imu,分别放置在腰部、大腿和小腿上,以捕捉四种静态平衡任务的平衡动态:睁眼、闭眼、右腿举和左腿举。一种三阶段特征选择策略,包括方差和相关修剪、单变量滤波和嵌入式模型选择,在留一主体(LOSO)交叉验证方案中实现,以提取判别性摇摆特征。使用支持向量机(Support Vector Machines)和基于树的集成模型(tree-based ensemble models)进行分类的结果一直很好,准确率在71.7%到79.2%之间,其中在Eyes-Open条件下的性能最高。一个紧凑的10个特征子集在所有任务中表现出稳定和健壮的判别能力。与单传感器基线相比,多传感器配置提供了更好的分类性能,强调了通过可穿戴传感器系统进行紧凑、平衡驱动、非侵入性MCI筛查的可行性。
{"title":"Early Detection of Mild Cognitive Impairment Through Balance Assessment Using Multi-Location Wearable Inertial Sensors","authors":"Mobeena Jamshed;Ahsan Shahzad;Kiseon Kim","doi":"10.1109/TNSRE.2026.3651786","DOIUrl":"10.1109/TNSRE.2026.3651786","url":null,"abstract":"Early detection of Mild Cognitive Impairment (MCI), a prodromal stage of dementia, plays a pivotal role in enabling timely clinical intervention and slowing cognitive decline. This paper presents a multi-sensor balance assessment framework designed to identify MCI-related postural instabilities using a wearable inertial measurement unit (IMU) network. The proposed system employs five synchronized IMUs placed at the waist, thighs, and shanks to capture balance dynamics across four static balance tasks: Eyes-Open, Eyes-Closed, Right-Leg Lift, and Left-Leg Lift. A three-stage feature selection strategy, comprising variance and correlation pruning, univariate filtering, and embedded model selection, is implemented within a Leave-One-Subject-Out (LOSO) cross-validation scheme to extract discriminative sway features. Classification using Support Vector Machines and tree-based ensemble models consistently yields superior results, achieving accuracies between 71.7% and 79.2%, with the highest performance observed in the Eyes-Open condition. A compact 10-feature subset demonstrates stable and robust discriminative power across all tasks. Compared to a single-sensor baseline, the multi-sensor configuration provides improved classification performance, underscoring the feasibility of compact, balance-driven, non-invasive MCI screening through wearable sensor systems.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"552-562"},"PeriodicalIF":5.2,"publicationDate":"2026-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11342299","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145959431","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Severity-Controllable Pathological Text-to-Speech Synthesis for Clinical Applications 用于临床应用的严重可控病理文本-语音合成。
IF 5.2 2区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2026-01-12 DOI: 10.1109/TNSRE.2026.3651761
Bence Mark Halpern;Wen-Chin Huang;Lester Phillip Violeta;Tomoki Toda
The article presents a new pathological text-to-speech (TTS) synthesis system that has the ability to control speech severity using latent interpolations. Recognizing the difficulty of this task, our work uses a data augmentation technique to generate a single-speaker multi-severity training dataset required for training such a model. Furthermore, we show how x-vectors already contain information about the severity and leverage it as a conditioning variable for the synthesis. Finally, we propose modifications to the GradTTS architecture to enhance the duration modeling of pathological speech. We carry out objective and subjective evaluations to demonstrate that the proposed GradTTS system works well, and produces more natural, controllable, and stable pathological speech samples than the baseline TransformerTTS system.
本文提出了一种新的病理文本到语音(TTS)合成系统,该系统具有利用潜在插值控制语音严重程度的能力。认识到这项任务的难度,我们的工作使用数据增强技术来生成训练这种模型所需的单说话人多严重性训练数据集。此外,我们还展示了x向量如何包含有关严重性的信息,并将其作为合成的条件变量。最后,我们提出了对GradTTS架构的修改,以增强病理语音的持续时间建模。我们进行了客观和主观评估,以证明所提出的GradTTS系统工作良好,并且比基线TransformerTTS系统产生更自然,可控和稳定的病理语音样本。
{"title":"Severity-Controllable Pathological Text-to-Speech Synthesis for Clinical Applications","authors":"Bence Mark Halpern;Wen-Chin Huang;Lester Phillip Violeta;Tomoki Toda","doi":"10.1109/TNSRE.2026.3651761","DOIUrl":"10.1109/TNSRE.2026.3651761","url":null,"abstract":"The article presents a new pathological text-to-speech (TTS) synthesis system that has the ability to control speech severity using latent interpolations. Recognizing the difficulty of this task, our work uses a data augmentation technique to generate a single-speaker multi-severity training dataset required for training such a model. Furthermore, we show how x-vectors already contain information about the severity and leverage it as a conditioning variable for the synthesis. Finally, we propose modifications to the GradTTS architecture to enhance the duration modeling of pathological speech. We carry out objective and subjective evaluations to demonstrate that the proposed GradTTS system works well, and produces more natural, controllable, and stable pathological speech samples than the baseline TransformerTTS system.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"34 ","pages":"573-582"},"PeriodicalIF":5.2,"publicationDate":"2026-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11342311","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145959443","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Transactions on Neural Systems and Rehabilitation Engineering
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1