首页 > 最新文献

Frontiers in Neurorobotics最新文献

英文 中文
Approaches for retraining sEMG classifiers for upper-limb prostheses. 上肢假体表面肌电信号分类器再训练方法。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-10-01 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1627872
Tom Donnelly, Elena Seminati, Benjamin Metcalfe

Introduction: Abandonment rates for myoelectric upper limb prostheses can reach 44%, negatively affecting quality of life and increasing the risk of injury due to compensatory movements. Traditional myoelectric prostheses rely on conventional signal processing for the detection and classification of movement intentions, whereas machine learning offers more robust and complex control through pattern recognition. However, the non-stationary nature of surface electromyogram signals and their day-to-day variations significantly degrade the classification performance of machine learning algorithms. Although single-session classification accuracies exceeding 99% have been reported for 8-class datasets, multisession accuracies typically decrease by 23% between morning and afternoon sessions. Retraining or adaptation can mitigate this accuracy loss.

Methods: This study evaluates three paradigms for retraining a machine learning-based classifier: confidence scores, nearest neighbour window assessment, and a novel signal-to-noise ratio-based approach.

Results: The results show that all paradigms improve accuracy against no retraining, with the nearest neighbour and signal-to-noise ratio methods showing an average improvement 5% in accuracy over the confidence-based approach.

Discussion: The effectiveness of each paradigm is assessed based on intersession accuracy across 10 sessions recorded over 5 days using the NinaPro 6 dataset.

导言:肌电上肢假体的放弃率可达44%,对生活质量产生负面影响,并增加代偿运动引起的损伤风险。传统的肌电假肢依靠传统的信号处理来检测和分类运动意图,而机器学习通过模式识别提供更强大和复杂的控制。然而,表面肌电信号的非平稳性及其日常变化显著降低了机器学习算法的分类性能。虽然8类数据集的单会话分类准确率超过99%,但上午和下午的多会话分类准确率通常会下降23%。再培训或适应可以减轻这种准确性损失。方法:本研究评估了三种重新训练基于机器学习的分类器的范式:置信度评分、最近邻窗口评估和一种新的基于信噪比的方法。结果:结果表明,在不进行再训练的情况下,所有范式都提高了准确性,最近邻和信噪比方法比基于置信度的方法平均提高了5%的准确性。讨论:每个范例的有效性是基于使用NinaPro 6数据集记录的5天内10个会话的间歇准确性来评估的。
{"title":"Approaches for retraining sEMG classifiers for upper-limb prostheses.","authors":"Tom Donnelly, Elena Seminati, Benjamin Metcalfe","doi":"10.3389/fnbot.2025.1627872","DOIUrl":"10.3389/fnbot.2025.1627872","url":null,"abstract":"<p><strong>Introduction: </strong>Abandonment rates for myoelectric upper limb prostheses can reach 44%, negatively affecting quality of life and increasing the risk of injury due to compensatory movements. Traditional myoelectric prostheses rely on conventional signal processing for the detection and classification of movement intentions, whereas machine learning offers more robust and complex control through pattern recognition. However, the non-stationary nature of surface electromyogram signals and their day-to-day variations significantly degrade the classification performance of machine learning algorithms. Although single-session classification accuracies exceeding 99% have been reported for 8-class datasets, multisession accuracies typically decrease by 23% between morning and afternoon sessions. Retraining or adaptation can mitigate this accuracy loss.</p><p><strong>Methods: </strong>This study evaluates three paradigms for retraining a machine learning-based classifier: confidence scores, nearest neighbour window assessment, and a novel signal-to-noise ratio-based approach.</p><p><strong>Results: </strong>The results show that all paradigms improve accuracy against no retraining, with the nearest neighbour and signal-to-noise ratio methods showing an average improvement 5% in accuracy over the confidence-based approach.</p><p><strong>Discussion: </strong>The effectiveness of each paradigm is assessed based on intersession accuracy across 10 sessions recorded over 5 days using the NinaPro 6 dataset.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1627872"},"PeriodicalIF":2.8,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12521216/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145307751","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction: Pre-training, personalization, and self-calibration: all a neural network-based myoelectric decoder needs. 校正:预训练,个性化和自校准:所有基于神经网络的肌电解码器需要。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-09-19 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1675642
Chenfei Ma, Xinyu Jiang, Kianoush Nazarpour

[This corrects the article DOI: 10.3389/fnbot.2025.1604453.].

[这更正了文章DOI: 10.3389/fnbot.2025.1604453.]。
{"title":"Correction: Pre-training, personalization, and self-calibration: all a neural network-based myoelectric decoder needs.","authors":"Chenfei Ma, Xinyu Jiang, Kianoush Nazarpour","doi":"10.3389/fnbot.2025.1675642","DOIUrl":"https://doi.org/10.3389/fnbot.2025.1675642","url":null,"abstract":"<p><p>[This corrects the article DOI: 10.3389/fnbot.2025.1604453.].</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1675642"},"PeriodicalIF":2.8,"publicationDate":"2025-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12498340/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145244414","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
4D trajectory prediction for inbound flights. 入境航班4D轨迹预测。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-09-17 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1625074
Weizhen Tang, Jie Dai

Introduction: To address the challenges of cumulative errors, insufficient modeling of complex spatiotemporal features, and limitations in computational efficiency and generalization ability in 4D trajectory prediction, this paper proposes a high-precision, robust prediction method.

Methods: A hybrid model SVMD-DBO-RCBAM is constructed, integrating sequential variational modal decomposition (SVMD), the dung beetle optimization algorithm (DBO), and the ResNet-CBAM network. Innovations include frequency-domain feature decoupling, dynamic parameter optimization, and enhanced spatio-temporal feature focusing.

Results: Experiments show that the model achieves a low longitude MAE of 0.0377 in single-step prediction, a 38.5% reduction compared to the baseline model; in multi-step prediction, the longitude R2 reaches 0.9844, with a 72.9% reduction in cumulative error rate and an IQR of prediction errors less than 10% of traditional models, demonstrating high accuracy and stability.

Discussion: Experiments show that the model achieves a low longitude MAE of 0.0377 in single-step prediction, a 38.5% reduction compared to the baseline model; in multi-step prediction, the longitude R2 reaches 0.9844, with a 72.9% reduction in cumulative error rate and an IQR of prediction errors less than 10% of traditional models, demonstrating high accuracy and stability.

针对四维轨迹预测存在累积误差、复杂时空特征建模不足、计算效率和泛化能力有限等问题,提出了一种高精度、鲁棒的四维轨迹预测方法。方法:将顺序变分模态分解(SVMD)、屎壳郎优化算法(DBO)和ResNet-CBAM网络相结合,构建SVMD-DBO- rcbam混合模型。创新包括频域特征解耦、动态参数优化和增强的时空特征聚焦。结果:实验表明,该模型单步预测的低经度MAE为0.0377,比基线模型降低38.5%;在多步预测中,经R2达到0.9844,累计错误率降低72.9%,预测误差的IQR小于传统模型的10%,具有较高的准确性和稳定性。讨论:实验表明,该模型单步预测的低经度MAE为0.0377,比基线模型降低38.5%;在多步预测中,经R2达到0.9844,累计错误率降低72.9%,预测误差的IQR小于传统模型的10%,具有较高的准确性和稳定性。
{"title":"4D trajectory prediction for inbound flights.","authors":"Weizhen Tang, Jie Dai","doi":"10.3389/fnbot.2025.1625074","DOIUrl":"https://doi.org/10.3389/fnbot.2025.1625074","url":null,"abstract":"<p><strong>Introduction: </strong>To address the challenges of cumulative errors, insufficient modeling of complex spatiotemporal features, and limitations in computational efficiency and generalization ability in 4D trajectory prediction, this paper proposes a high-precision, robust prediction method.</p><p><strong>Methods: </strong>A hybrid model SVMD-DBO-RCBAM is constructed, integrating sequential variational modal decomposition (SVMD), the dung beetle optimization algorithm (DBO), and the ResNet-CBAM network. Innovations include frequency-domain feature decoupling, dynamic parameter optimization, and enhanced spatio-temporal feature focusing.</p><p><strong>Results: </strong>Experiments show that the model achieves a low longitude MAE of 0.0377 in single-step prediction, a 38.5% reduction compared to the baseline model; in multi-step prediction, the longitude R2 reaches 0.9844, with a 72.9% reduction in cumulative error rate and an IQR of prediction errors less than 10% of traditional models, demonstrating high accuracy and stability.</p><p><strong>Discussion: </strong>Experiments show that the model achieves a low longitude MAE of 0.0377 in single-step prediction, a 38.5% reduction compared to the baseline model; in multi-step prediction, the longitude R2 reaches 0.9844, with a 72.9% reduction in cumulative error rate and an IQR of prediction errors less than 10% of traditional models, demonstrating high accuracy and stability.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1625074"},"PeriodicalIF":2.8,"publicationDate":"2025-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12497917/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145244444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
RSA-TransUNet: a robust structure-adaptive TransUNet for enhanced road crack segmentation. RSA-TransUNet:用于增强道路裂缝分割的鲁棒结构自适应TransUNet。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-09-16 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1633697
Liling Hou, Fei Yu, Yaowen Hu, Yang Hu, Ruoli Yang

With the advancement of deep learning, road crack segmentation has become increasingly crucial for intelligent transportation safety. Despite notable progress, existing methods still face challenges in capturing fine-grained textures in small crack regions, handling blurred edges and significant width variations, and performing multi-class segmentation. Moreover, the high computational cost of training such models hinders their practical deployment. To tackle these limitations, we propose RSA-TransUNet, a novel model for road crack segmentation. At its core is the Axial-shift MLP Attention (ASMA) mechanism, which integrates axial perception with sparse contextual modeling. Through multi-path axial perturbations and an attention-guided structure, ASMA effectively captures long-range dependencies within row-column patterns, enabling detailed modeling of multi-scale crack features. To improve the model's adaptability to structural irregularities, we introduce the Adaptive Spline Linear Unit (ASLU), which enhances the model's capacity to represent nonlinear transformations. ASLU improves responsiveness to microstructural variations, morphological distortions, and local discontinuities, thereby boosting robustness across different domains. We further develop a Structure-aware Multi-stage Evolutionary Optimization (SMEO) strategy, which guides the training process through three phases: structural perception exploration, feature stability enhancement, and global perturbation. This strategy combines breadth sampling, convergence compression, and local escape mechanisms to improve convergence speed, global search efficiency, and generalization performance. Extensive evaluations on the Crack500, CFD, and DeepCrack datasets-including ablation studies and comparative experiments-demonstrate that RSA-TransUNet achieves superior segmentation accuracy and robustness in complex road environments, highlighting its potential for real-world applications.

随着深度学习技术的发展,道路裂缝分割对智能交通安全的重要性日益凸显。尽管取得了显著进展,但现有方法在小裂纹区域的细粒度纹理捕获、边缘模糊和显著宽度变化的处理以及多类分割等方面仍面临挑战。此外,训练这些模型的高计算成本阻碍了它们的实际部署。为了解决这些限制,我们提出了一种新的道路裂缝分割模型RSA-TransUNet。其核心是轴向转移MLP注意(ASMA)机制,该机制将轴向感知与稀疏上下文建模相结合。通过多路径轴向扰动和注意力引导结构,ASMA有效地捕获了行-列模式中的远程依赖关系,从而实现了多尺度裂缝特征的详细建模。为了提高模型对结构不规则性的适应性,我们引入了自适应样条线性单元(ASLU),增强了模型表示非线性变换的能力。ASLU提高了对微观结构变化、形态扭曲和局部不连续性的响应能力,从而增强了跨不同领域的鲁棒性。我们进一步开发了一种结构感知的多阶段进化优化(SMEO)策略,该策略指导训练过程通过三个阶段:结构感知探索、特征稳定性增强和全局扰动。该策略结合了广度采样、收敛压缩和局部逃避机制,提高了收敛速度、全局搜索效率和泛化性能。对Crack500、CFD和DeepCrack数据集(包括消融研究和比较实验)的广泛评估表明,RSA-TransUNet在复杂的道路环境中实现了卓越的分割精度和鲁棒性,突出了其在实际应用中的潜力。
{"title":"RSA-TransUNet: a robust structure-adaptive TransUNet for enhanced road crack segmentation.","authors":"Liling Hou, Fei Yu, Yaowen Hu, Yang Hu, Ruoli Yang","doi":"10.3389/fnbot.2025.1633697","DOIUrl":"10.3389/fnbot.2025.1633697","url":null,"abstract":"<p><p>With the advancement of deep learning, road crack segmentation has become increasingly crucial for intelligent transportation safety. Despite notable progress, existing methods still face challenges in capturing fine-grained textures in small crack regions, handling blurred edges and significant width variations, and performing multi-class segmentation. Moreover, the high computational cost of training such models hinders their practical deployment. To tackle these limitations, we propose RSA-TransUNet, a novel model for road crack segmentation. At its core is the Axial-shift MLP Attention (ASMA) mechanism, which integrates axial perception with sparse contextual modeling. Through multi-path axial perturbations and an attention-guided structure, ASMA effectively captures long-range dependencies within row-column patterns, enabling detailed modeling of multi-scale crack features. To improve the model's adaptability to structural irregularities, we introduce the Adaptive Spline Linear Unit (ASLU), which enhances the model's capacity to represent nonlinear transformations. ASLU improves responsiveness to microstructural variations, morphological distortions, and local discontinuities, thereby boosting robustness across different domains. We further develop a Structure-aware Multi-stage Evolutionary Optimization (SMEO) strategy, which guides the training process through three phases: structural perception exploration, feature stability enhancement, and global perturbation. This strategy combines breadth sampling, convergence compression, and local escape mechanisms to improve convergence speed, global search efficiency, and generalization performance. Extensive evaluations on the Crack500, CFD, and DeepCrack datasets-including ablation studies and comparative experiments-demonstrate that RSA-TransUNet achieves superior segmentation accuracy and robustness in complex road environments, highlighting its potential for real-world applications.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1633697"},"PeriodicalIF":2.8,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12479514/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145206146","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Toward accurate single image sand dust removal by utilizing uncertainty-aware neural network. 利用不确定性感知神经网络实现单幅图像的精确除尘。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-09-10 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1575995
Bingcai Wei, Hui Liu, Chuang Qian, Haoliang Shen, Yibiao Chen, Yixin Wang

Although deep learning methods have made significant strides in single image sand dust removal, the heterogeneous uncertainty induced by dusty environments poses a considerable challenge. In response, our research presents a novel framework known as the Hierarchical Interactive Uncertainty-aware Network (HIUNet). HIUNet leverages Bayesian neural networks for the extraction of robust shallow features, bolstered by pre-trained encoders for feature extraction and the agility of lightweight decoders for preliminary image reconstitution. Subsequently, a feature frequency selection mechanism is activated to enhance overall performance by strategically identifying and retaining valuable features while effectively suppressing redundant and irrelevant ones. Following this, a feature enhancement module is applied to the preliminary restoration. This intricate fusion culminates in the production of a restored image of superior quality. Our extensive experiments, using our proposed Sand11K dataset that exhibits various levels of degradation from dust and sand, confirm the effectiveness and soundness of our proposed method. By modeling uncertainty via Bayesian neural networks to extract robust shallow features and selecting valuable features through frequency selection, HIUNet can reconstruct high-quality clean images. For future work, we plan to extend our uncertainty-aware framework to handle extreme sand scenarios.

尽管深度学习方法在单幅图像沙尘去除方面取得了重大进展,但由沙尘环境引起的异质性不确定性带来了相当大的挑战。作为回应,我们的研究提出了一种新的框架,称为层次交互不确定性感知网络(HIUNet)。HIUNet利用贝叶斯神经网络提取鲁棒的浅层特征,通过预训练的编码器进行特征提取和轻量级解码器的敏捷性进行初步图像重构。随后,激活特征频率选择机制,通过战略性地识别和保留有价值的特征,同时有效地抑制冗余和不相关的特征,从而提高整体性能。在此之后,特征增强模块应用于初步恢复。这种复杂的融合最终产生了高质量的修复图像。我们使用我们提出的Sand11K数据集进行了广泛的实验,该数据集显示了灰尘和沙子的不同程度的退化,证实了我们提出的方法的有效性和合理性。HIUNet通过贝叶斯神经网络对不确定性进行建模,提取鲁棒的浅层特征,并通过频率选择选择有价值的特征,重建出高质量的干净图像。在未来的工作中,我们计划扩展我们的不确定性感知框架来处理极端的沙子场景。
{"title":"Toward accurate single image sand dust removal by utilizing uncertainty-aware neural network.","authors":"Bingcai Wei, Hui Liu, Chuang Qian, Haoliang Shen, Yibiao Chen, Yixin Wang","doi":"10.3389/fnbot.2025.1575995","DOIUrl":"10.3389/fnbot.2025.1575995","url":null,"abstract":"<p><p>Although deep learning methods have made significant strides in single image sand dust removal, the heterogeneous uncertainty induced by dusty environments poses a considerable challenge. In response, our research presents a novel framework known as the Hierarchical Interactive Uncertainty-aware Network (HIUNet). HIUNet leverages Bayesian neural networks for the extraction of robust shallow features, bolstered by pre-trained encoders for feature extraction and the agility of lightweight decoders for preliminary image reconstitution. Subsequently, a feature frequency selection mechanism is activated to enhance overall performance by strategically identifying and retaining valuable features while effectively suppressing redundant and irrelevant ones. Following this, a feature enhancement module is applied to the preliminary restoration. This intricate fusion culminates in the production of a restored image of superior quality. Our extensive experiments, using our proposed Sand11K dataset that exhibits various levels of degradation from dust and sand, confirm the effectiveness and soundness of our proposed method. By modeling uncertainty via Bayesian neural networks to extract robust shallow features and selecting valuable features through frequency selection, HIUNet can reconstruct high-quality clean images. For future work, we plan to extend our uncertainty-aware framework to handle extreme sand scenarios.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1575995"},"PeriodicalIF":2.8,"publicationDate":"2025-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12457322/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145148867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynamic graph neural networks for UAV-based group activity recognition in structured team sports. 结构化团队运动中基于无人机的群体活动识别的动态图神经网络。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-09-08 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1631998
Ishrat Zahra, Yanfeng Wu, Haifa F Alhasson, Shuaa S Alharbi, Hanan Aljuaid, Ahmad Jalal, Hui Liu

Introduction: Understanding group actions in real-world settings is essential for the advancement of applications in surveillance, robotics, and autonomous systems. Group activity recognition, particularly in sports scenarios, presents unique challenges due to dynamic interactions, occlusions, and varying viewpoints. To address these challenges, we develop a deep learning system that recognizes multi-person behaviors by integrating appearance-based features (HOG, LBP, SIFT), skeletal data (MediaPipe, MOCON), and motion features. Our approach employs a Dynamic Graph Neural Network (DGNN) and Bi-LSTM architecture, enabling robust recognition of group activities in diverse and dynamic environments. To further validate our framework's adaptability, we include evaluations on Volleyball and SoccerTrack UAV-recorded datasets, which offer unique perspectives and challenges.

Method: Our framework integrates YOLOv11 for object detection and SORT for tracking to extract multi-modal features-including HOG, LBP, SIFT, skeletal data (MediaPipe), and motion context (MOCON). These features are optimized using genetic algorithms and fused within a Dynamic Graph Neural Network (DGNN), which models players as nodes in a spatio-temporal graph, effectively capturing both spatial formations and temporal dynamics.

Results: We evaluated our framework on three datasets: a volleyball dataset, SoccerTrack UAV-based soccer dataset, and NBA basketball dataset. Our system achieved 94.5% accuracy on the volleyball dataset (mAP: 94.2%, MPCA: 93.8%) with an inference time of 0.18 s per frame. On the SoccerTrack UAV dataset, accuracy was 91.8% (mAP: 91.5%, MPCA: 90.5%) with 0.20 s inference, and on the NBA basketball dataset, it was 91.1% (mAP: 90.8%, MPCA: 89.8%) with the same 0.20 s per frame. These results highlight our framework's high performance and efficient computational efficiency across various sports and perspectives.

Discussion: Our approach demonstrates robust performance in recognizing multi-person actions across diverse conditions, highlighting its adaptability to both conventional and UAV-based video sources.

引言:了解现实环境中的群体行为对于监控、机器人和自主系统的应用进步至关重要。群体活动识别,特别是在运动场景中,由于动态互动,闭塞和不同的观点,呈现出独特的挑战。为了应对这些挑战,我们开发了一个深度学习系统,通过集成基于外观的特征(HOG, LBP, SIFT),骨骼数据(MediaPipe, MOCON)和运动特征来识别多人行为。我们的方法采用动态图神经网络(DGNN)和Bi-LSTM架构,能够在多样化和动态环境中对群体活动进行鲁棒识别。为了进一步验证我们的框架的适应性,我们对排球和SoccerTrack无人机记录的数据集进行了评估,这些数据集提供了独特的视角和挑战。方法:我们的框架集成了用于目标检测的YOLOv11和用于跟踪的SORT,以提取多模态特征-包括HOG, LBP, SIFT,骨骼数据(MediaPipe)和运动上下文(MOCON)。这些功能使用遗传算法进行优化,并融合到动态图神经网络(DGNN)中,该网络将玩家建模为时空图中的节点,有效地捕获空间形成和时间动态。结果:我们在三个数据集上评估了我们的框架:排球数据集、基于SoccerTrack无人机的足球数据集和NBA篮球数据集。我们的系统在排球数据集上实现了94.5%的准确率(mAP: 94.2%, MPCA: 93.8%),每帧推理时间为0.18 s。在SoccerTrack无人机数据集上,准确率为91.8% (mAP: 91.5%, MPCA: 90.5%),每帧推理0.20 s;在NBA篮球数据集上,准确率为91.1% (mAP: 90.8%, MPCA: 89.8%),每帧推理0.20 s。这些结果突出了我们的框架在各种运动和视角中的高性能和高效计算效率。讨论:我们的方法在识别不同条件下的多人动作方面表现出强大的性能,突出了它对传统和基于无人机的视频源的适应性。
{"title":"Dynamic graph neural networks for UAV-based group activity recognition in structured team sports.","authors":"Ishrat Zahra, Yanfeng Wu, Haifa F Alhasson, Shuaa S Alharbi, Hanan Aljuaid, Ahmad Jalal, Hui Liu","doi":"10.3389/fnbot.2025.1631998","DOIUrl":"10.3389/fnbot.2025.1631998","url":null,"abstract":"<p><strong>Introduction: </strong>Understanding group actions in real-world settings is essential for the advancement of applications in surveillance, robotics, and autonomous systems. Group activity recognition, particularly in sports scenarios, presents unique challenges due to dynamic interactions, occlusions, and varying viewpoints. To address these challenges, we develop a deep learning system that recognizes multi-person behaviors by integrating appearance-based features (HOG, LBP, SIFT), skeletal data (MediaPipe, MOCON), and motion features. Our approach employs a Dynamic Graph Neural Network (DGNN) and Bi-LSTM architecture, enabling robust recognition of group activities in diverse and dynamic environments. To further validate our framework's adaptability, we include evaluations on Volleyball and SoccerTrack UAV-recorded datasets, which offer unique perspectives and challenges.</p><p><strong>Method: </strong>Our framework integrates YOLOv11 for object detection and SORT for tracking to extract multi-modal features-including HOG, LBP, SIFT, skeletal data (MediaPipe), and motion context (MOCON). These features are optimized using genetic algorithms and fused within a Dynamic Graph Neural Network (DGNN), which models players as nodes in a spatio-temporal graph, effectively capturing both spatial formations and temporal dynamics.</p><p><strong>Results: </strong>We evaluated our framework on three datasets: a volleyball dataset, SoccerTrack UAV-based soccer dataset, and NBA basketball dataset. Our system achieved 94.5% accuracy on the volleyball dataset (mAP: 94.2%, MPCA: 93.8%) with an inference time of 0.18 s per frame. On the SoccerTrack UAV dataset, accuracy was 91.8% (mAP: 91.5%, MPCA: 90.5%) with 0.20 s inference, and on the NBA basketball dataset, it was 91.1% (mAP: 90.8%, MPCA: 89.8%) with the same 0.20 s per frame. These results highlight our framework's high performance and efficient computational efficiency across various sports and perspectives.</p><p><strong>Discussion: </strong>Our approach demonstrates robust performance in recognizing multi-person actions across diverse conditions, highlighting its adaptability to both conventional and UAV-based video sources.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1631998"},"PeriodicalIF":2.8,"publicationDate":"2025-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12452097/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145130117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Imitation-relaxation reinforcement learning for sparse badminton strikes via dynamic trajectory generation. 基于动态轨迹生成的稀疏羽毛球击球的模仿松弛强化学习。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-09-02 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1649870
Yanyan Yuan, Yucheng Tao, Shaowen Cheng, Yanhong Liang, Yongbin Jin, Hongtao Wang

Robotic racket sports provide exceptional benchmarks for evaluating dynamic motion control capabilities in robots. Due to the highly non-linear dynamics of the shuttlecock, the stringent demands on robots' dynamic responses, and the convergence difficulties caused by sparse rewards in reinforcement learning, badminton strikes remain a formidable challenge for robot systems. To address these issues, this study proposes DTG-IRRL, a novel learning framework for badminton strikes that integrates imitation-relaxation reinforcement learning with dynamic trajectory generation. The framework demonstrates significantly improved training efficiency and performance, achieving faster convergence and twice the landing accuracy. Analysis of the reward function within a specific parameter space hyperplane intuitively reveals the convergence difficulties arising from the inherent sparsity of rewards in racket sports and demonstrates the framework's effectiveness in mitigating local and slow convergence. Implemented on hardware with zero-shot transfer, the framework achieves a 90% hitting rate and a 70% landing accuracy, enabling sustained humanrobot rallies. Cross-platform validation using the UR5 robot demonstrates the framework's generalizability while highlighting the requirement for high dynamic performance of robotic arms in racket sports.

机器人球拍运动为评估机器人的动态运动控制能力提供了卓越的基准。由于羽毛球运动的高度非线性动力学特性、对机器人动态响应的严格要求以及强化学习中稀疏奖励带来的收敛困难,羽毛球击球仍然是机器人系统面临的一个巨大挑战。为了解决这些问题,本研究提出了一种新的羽毛球击球学习框架DTG-IRRL,该框架将模仿-放松强化学习与动态轨迹生成相结合。该框架显著提高了训练效率和性能,实现了更快的收敛速度和两倍的着陆精度。对特定参数空间超平面内奖励函数的分析直观地揭示了球拍运动中奖励固有的稀疏性所带来的收敛困难,并证明了该框架在缓解局部和缓慢收敛方面的有效性。该框架在硬件上实现了零射击转移,实现了90%的命中率和70%的着陆精度,实现了持续的人机拉力赛。使用UR5机器人进行的跨平台验证证明了框架的通用性,同时突出了球拍运动中机械臂的高动态性能要求。
{"title":"Imitation-relaxation reinforcement learning for sparse badminton strikes via dynamic trajectory generation.","authors":"Yanyan Yuan, Yucheng Tao, Shaowen Cheng, Yanhong Liang, Yongbin Jin, Hongtao Wang","doi":"10.3389/fnbot.2025.1649870","DOIUrl":"10.3389/fnbot.2025.1649870","url":null,"abstract":"<p><p>Robotic racket sports provide exceptional benchmarks for evaluating dynamic motion control capabilities in robots. Due to the highly non-linear dynamics of the shuttlecock, the stringent demands on robots' dynamic responses, and the convergence difficulties caused by sparse rewards in reinforcement learning, badminton strikes remain a formidable challenge for robot systems. To address these issues, this study proposes DTG-IRRL, a novel learning framework for badminton strikes that integrates imitation-relaxation reinforcement learning with dynamic trajectory generation. The framework demonstrates significantly improved training efficiency and performance, achieving faster convergence and twice the landing accuracy. Analysis of the reward function within a specific parameter space hyperplane intuitively reveals the convergence difficulties arising from the inherent sparsity of rewards in racket sports and demonstrates the framework's effectiveness in mitigating local and slow convergence. Implemented on hardware with zero-shot transfer, the framework achieves a 90% hitting rate and a 70% landing accuracy, enabling sustained humanrobot rallies. Cross-platform validation using the UR5 robot demonstrates the framework's generalizability while highlighting the requirement for high dynamic performance of robotic arms in racket sports.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1649870"},"PeriodicalIF":2.8,"publicationDate":"2025-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12436432/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145079389","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Variable admittance control with sEMG-based support for wearable wrist exoskeleton. 可变导纳控制与肌电图为基础的支持可穿戴手腕外骨骼。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-09-01 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1562675
Charles Lambelet, Melvin Mathis, Marc Siegenthaler, Jeremia P O Held, Daniel Woolley, Olivier Lambercy, Roger Gassert, Nicole Wenderoth

Introduction: Wrist function impairment is common after stroke and heavily impacts the execution of daily tasks. Robotic therapy, and more specifically wearable exoskeletons, have the potential to boost training dose in context-relevant scenarios, promote voluntary effort through motor intent detection, and mitigate the effect of gravity. Portable exoskeletons are often non-backdrivable and it is challenging to make their control safe, reactive and stable. Admittance control is often used in this case, however, this type of control can become unstable when the supported biological joint stiffens. Variable admittance control adapts its parameters dynamically to allow free motion and stabilize the human-robot interaction.

Methods: In this study, we implemented a variable admittance control scheme on a one degree of freedom wearable wrist exoskeleton. The damping parameter of the admittance scheme is adjusted in real-time to cope with instabilities and varying wrist stiffness. In addition to the admittance control scheme, sEMG- and gravity-based controllers were implemented, characterized and optimized on ten healthy participants and tested on six stroke survivors.

Results: The results show that (1) the variable admittance control scheme could stabilize the interaction but at the cost of a decrease in transparency, and (2) when coupled with the variable admittance controller the sEMG-based control enhanced wrist functionality of stroke survivors in the most extreme angular positions.

Discussion: Our variable admittance control scheme with sEMG- and gravity-based support was most beneficial for patients with higher levels of impairment by improving range of motion and promoting voluntary effort. Future work could combine both controllers to customize and fine tune the stability of the support to a wider range of impairment levels and types.

手腕功能损伤是中风后常见的,严重影响日常工作的执行。机器人疗法,更具体地说,可穿戴外骨骼,有可能在与环境相关的场景中提高训练剂量,通过运动意图检测促进自愿努力,并减轻重力的影响。便携式外骨骼通常是不可反向驱动的,使其控制安全、反应性和稳定性具有挑战性。导纳控制通常用于这种情况,然而,当支撑的生物关节变硬时,这种类型的控制会变得不稳定。变导纳控制可以动态地调整其参数以实现自由运动和稳定人机交互。方法:在本研究中,我们在一自由度可穿戴腕部外骨骼上实现了可变导纳控制方案。实时调整导纳方案的阻尼参数,以应对不稳定性和手腕刚度的变化。除了导纳控制方案外,还在10名健康参与者和6名中风幸存者身上实施、表征和优化了基于表面肌电信号和重力的控制器。结果表明:(1)可变导纳控制方案可以稳定相互作用,但以降低透明度为代价;(2)与可变导纳控制器结合使用时,基于表面肌电信号的控制可以增强中风幸存者在最极端角度位置的手腕功能。讨论:我们的可变导纳控制方案结合肌电图和重力支持,通过改善活动范围和促进自主活动,对重度损伤患者最有益。未来的工作可以结合这两个控制器来定制和微调支持的稳定性,以适应更大范围的损伤水平和类型。
{"title":"Variable admittance control with sEMG-based support for wearable wrist exoskeleton.","authors":"Charles Lambelet, Melvin Mathis, Marc Siegenthaler, Jeremia P O Held, Daniel Woolley, Olivier Lambercy, Roger Gassert, Nicole Wenderoth","doi":"10.3389/fnbot.2025.1562675","DOIUrl":"10.3389/fnbot.2025.1562675","url":null,"abstract":"<p><strong>Introduction: </strong>Wrist function impairment is common after stroke and heavily impacts the execution of daily tasks. Robotic therapy, and more specifically wearable exoskeletons, have the potential to boost training dose in context-relevant scenarios, promote voluntary effort through motor intent detection, and mitigate the effect of gravity. Portable exoskeletons are often non-backdrivable and it is challenging to make their control safe, reactive and stable. Admittance control is often used in this case, however, this type of control can become unstable when the supported biological joint stiffens. Variable admittance control adapts its parameters dynamically to allow free motion and stabilize the human-robot interaction.</p><p><strong>Methods: </strong>In this study, we implemented a variable admittance control scheme on a one degree of freedom wearable wrist exoskeleton. The damping parameter of the admittance scheme is adjusted in real-time to cope with instabilities and varying wrist stiffness. In addition to the admittance control scheme, sEMG- and gravity-based controllers were implemented, characterized and optimized on ten healthy participants and tested on six stroke survivors.</p><p><strong>Results: </strong>The results show that (1) the variable admittance control scheme could stabilize the interaction but at the cost of a decrease in transparency, and (2) when coupled with the variable admittance controller the sEMG-based control enhanced wrist functionality of stroke survivors in the most extreme angular positions.</p><p><strong>Discussion: </strong>Our variable admittance control scheme with sEMG- and gravity-based support was most beneficial for patients with higher levels of impairment by improving range of motion and promoting voluntary effort. Future work could combine both controllers to customize and fine tune the stability of the support to a wider range of impairment levels and types.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1562675"},"PeriodicalIF":2.8,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12434121/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145075000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
4D trajectory lightweight prediction algorithm based on knowledge distillation technique. 基于知识蒸馏技术的四维轨迹轻量化预测算法。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-08-22 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1643919
Weizhen Tang, Jie Dai, Zhousheng Huang, Boyang Hao, Weizheng Xie

Introduction: To address the challenges of current 4D trajectory prediction-specifically, limited multi-factor feature extraction and excessive computational cost-this study develops a lightweight prediction framework tailored for real-time air-traffic management.

Methods: We propose a hybrid RCBAM-TCN-LSTM architecture enhanced with a teacher-student knowledge distillation mechanism. The Residual Convolutional Block Attention Module (RCBAM) serves as the teacher network to extract high-dimensional spatial features via residual structures and channel-spatial attention. The student network adopts a Temporal Convolutional Network-LSTM (TCN-LSTM) design, integrating dilated causal convolutions and two LSTM layers for efficient temporal modeling. Historical ADS-B trajectory data from Zhuhai Jinwan Airport are preprocessed using cubic spline interpolation and a uniform-step sliding window to ensure data alignment and temporal consistency. In the distillation process, soft labels from the teacher and hard labels from actual observations jointly guide student training.

Results: In multi-step prediction experiments, the distilled RCBAM-TCN-LSTM model achieved average reductions of 40%-60% in MAE, RMSE, and MAPE compared with the original RCBAM and TCN-LSTM models, while improving R ² by 4%-6%. The approach maintained high accuracy across different prediction horizons while reducing computational complexity.

Discussion: The proposed method effectively balances high-precision modeling of spatiotemporal dependencies with lightweight deployment requirements, enabling real-time air-traffic monitoring and early warning on standard CPUs and embedded devices. This framework offers a scalable solution for enhancing the operational safety and efficiency of modern air-traffic control systems.

导言:为了解决当前四维轨迹预测的挑战,特别是有限的多因素特征提取和过高的计算成本,本研究开发了一个专为实时空中交通管理量身定制的轻量级预测框架。方法:我们提出了一种混合rbam - tcn - lstm架构,增强了师生知识蒸馏机制。残差卷积块注意模块(RCBAM)作为教师网络,通过残差结构和通道空间注意提取高维空间特征。学生网络采用时序卷积网络-LSTM (TCN-LSTM)设计,将扩展因果卷积和两层LSTM相结合,实现了高效的时序建模。采用三次样条插值和均匀步长滑动窗口对珠海金湾机场ADS-B历史轨迹数据进行预处理,确保数据对齐和时间一致性。在蒸馏过程中,来自老师的软标签和来自实际观察的硬标签共同指导学生的训练。结果:在多步预测实验中,与原始RCBAM和TCN-LSTM模型相比,蒸馏后的RCBAM-TCN-LSTM模型的MAE、RMSE和MAPE平均降低了40%-60%,R²提高了4%-6%。该方法在降低计算复杂度的同时,在不同预测范围内保持了较高的预测精度。讨论:提出的方法有效地平衡了高精度的时空依赖性建模和轻量级部署需求,在标准cpu和嵌入式设备上实现实时空中交通监控和预警。该框架为提高现代空中交通管制系统的操作安全性和效率提供了可扩展的解决方案。
{"title":"4D trajectory lightweight prediction algorithm based on knowledge distillation technique.","authors":"Weizhen Tang, Jie Dai, Zhousheng Huang, Boyang Hao, Weizheng Xie","doi":"10.3389/fnbot.2025.1643919","DOIUrl":"10.3389/fnbot.2025.1643919","url":null,"abstract":"<p><strong>Introduction: </strong>To address the challenges of current 4D trajectory prediction-specifically, limited multi-factor feature extraction and excessive computational cost-this study develops a lightweight prediction framework tailored for real-time air-traffic management.</p><p><strong>Methods: </strong>We propose a hybrid RCBAM-TCN-LSTM architecture enhanced with a teacher-student knowledge distillation mechanism. The Residual Convolutional Block Attention Module (RCBAM) serves as the teacher network to extract high-dimensional spatial features via residual structures and channel-spatial attention. The student network adopts a Temporal Convolutional Network-LSTM (TCN-LSTM) design, integrating dilated causal convolutions and two LSTM layers for efficient temporal modeling. Historical ADS-B trajectory data from Zhuhai Jinwan Airport are preprocessed using cubic spline interpolation and a uniform-step sliding window to ensure data alignment and temporal consistency. In the distillation process, soft labels from the teacher and hard labels from actual observations jointly guide student training.</p><p><strong>Results: </strong>In multi-step prediction experiments, the distilled RCBAM-TCN-LSTM model achieved average reductions of 40%-60% in MAE, RMSE, and MAPE compared with the original RCBAM and TCN-LSTM models, while improving <i>R</i> <sup>²</sup> by 4%-6%. The approach maintained high accuracy across different prediction horizons while reducing computational complexity.</p><p><strong>Discussion: </strong>The proposed method effectively balances high-precision modeling of spatiotemporal dependencies with lightweight deployment requirements, enabling real-time air-traffic monitoring and early warning on standard CPUs and embedded devices. This framework offers a scalable solution for enhancing the operational safety and efficiency of modern air-traffic control systems.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1643919"},"PeriodicalIF":2.8,"publicationDate":"2025-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12411499/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145014961","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tri-manual interaction in hybrid BCI-VR systems: integrating gaze, EEG control for enhanced 3D object manipulation. 混合BCI-VR系统中的三手交互:整合凝视、脑电图控制以增强3D对象操作。
IF 2.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-08-14 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1628968
Jian Teng, Sukyoung Cho, Shaw-Mung Lee

Brain-computer interface (BCI) integration with virtual reality (VR) has progressed from single-limb control to multi-limb coordination, yet achieving intuitive tri-manual operation remains challenging. This study presents a consumer-grade hybrid BCI-VR framework enabling simultaneous control of two biological hands and a virtual third limb through integration of Tobii eye-tracking, NeuroSky single-channel EEG, and non-haptic controllers. The system employs e-Sense attention thresholds (>80% for 300 ms) to trigger virtual hand activation combined with gaze-driven targeting within 45° visual cones. A soft maximum weighted arbitration algorithm resolves spatiotemporal conflicts between manual and virtual inputs with 92.4% success rate. Experimental validation with eight participants across 160 trials demonstrated 87.5% virtual hand success rate and 41% spatial error reduction (σ = 0.23 mm vs. 0.39 mm) compared to traditional dual-hand control. The framework achieved 320 ms activation latency and 22% NASA-TLX workload reduction through adaptive cognitive load management. Time-frequency analysis revealed characteristic beta-band (15-20 Hz) energy modulations during successful virtual limb control, providing neurophysiological evidence for attention-mediated supernumerary limb embodiment. These findings demonstrate that sophisticated algorithmic approaches can compensate for consumer-grade hardware limitations, enabling laboratory-grade precision in accessible tri-manual VR applications for rehabilitation, training, and assistive technologies.

脑机接口(BCI)与虚拟现实(VR)的集成已经从单肢控制发展到多肢协调,但实现直观的三手操作仍然是一个挑战。本研究提出了一种消费级混合BCI-VR框架,通过集成Tobii眼动追踪、NeuroSky单通道EEG和非触觉控制器,可以同时控制两只生物手和虚拟第三肢。该系统采用e-Sense注意力阈值(bbb80 %, 300 ms)来触发虚拟手激活,并结合45°视锥内的凝视驱动目标。一种软最大加权仲裁算法解决了人工和虚拟输入的时空冲突,成功率为92.4%。8名参与者参与的160项实验验证表明,与传统双手控制相比,虚拟手成功率为87.5%,空间误差降低41% (σ = 0.23 mm vs. 0.39 mm)。该框架通过自适应认知负载管理实现了320 ms的激活延迟和22%的NASA-TLX工作负载减少。时频分析显示,在成功的虚拟肢体控制过程中,特征的β波段(15-20 Hz)能量调制,为注意介导的多肢体体现提供了神经生理学证据。这些研究结果表明,复杂的算法方法可以弥补消费者级硬件的限制,使实验室级的精度在可访问的三手动VR应用中用于康复、训练和辅助技术。
{"title":"Tri-manual interaction in hybrid BCI-VR systems: integrating gaze, EEG control for enhanced 3D object manipulation.","authors":"Jian Teng, Sukyoung Cho, Shaw-Mung Lee","doi":"10.3389/fnbot.2025.1628968","DOIUrl":"10.3389/fnbot.2025.1628968","url":null,"abstract":"<p><p>Brain-computer interface (BCI) integration with virtual reality (VR) has progressed from single-limb control to multi-limb coordination, yet achieving intuitive tri-manual operation remains challenging. This study presents a consumer-grade hybrid BCI-VR framework enabling simultaneous control of two biological hands and a virtual third limb through integration of Tobii eye-tracking, NeuroSky single-channel EEG, and non-haptic controllers. The system employs e-Sense attention thresholds (>80% for 300 ms) to trigger virtual hand activation combined with gaze-driven targeting within 45° visual cones. A soft maximum weighted arbitration algorithm resolves spatiotemporal conflicts between manual and virtual inputs with 92.4% success rate. Experimental validation with eight participants across 160 trials demonstrated 87.5% virtual hand success rate and 41% spatial error reduction (<i>σ</i> = 0.23 mm vs. 0.39 mm) compared to traditional dual-hand control. The framework achieved 320 ms activation latency and 22% NASA-TLX workload reduction through adaptive cognitive load management. Time-frequency analysis revealed characteristic beta-band (15-20 Hz) energy modulations during successful virtual limb control, providing neurophysiological evidence for attention-mediated supernumerary limb embodiment. These findings demonstrate that sophisticated algorithmic approaches can compensate for consumer-grade hardware limitations, enabling laboratory-grade precision in accessible tri-manual VR applications for rehabilitation, training, and assistive technologies.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1628968"},"PeriodicalIF":2.8,"publicationDate":"2025-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12390853/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144950948","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Frontiers in Neurorobotics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1