首页 > 最新文献

Biomimetic Intelligence and Robotics最新文献

英文 中文
Snake-inspired trajectory planning and control for confined pipeline inspection with hyper-redundant manipulators 基于超冗余机械手的受限管道检测蛇形轨迹规划与控制
IF 5.4 Pub Date : 2025-06-03 DOI: 10.1016/j.birob.2025.100245
Junjie Zhu , Mingming Su , Longchuan Li , Yuxuan Xiang , Jianming Wang , Xuan Xiao
The hyper-redundant manipulator (HRM) can explore narrow and curved pipelines by leveraging its high flexibility and redundancy. However, planning collision-free motion trajectories for HRMs in confined environments remains a significant challenge. To address this issue, a pipeline inspection approach that combines nonlinear model predictive control (NMPC) with the snake-inspired crawling algorithm(SCA) is proposed. The approach consists of three processes: insertion, inspection, and exit. The insertion and exit processes utilize the SCA, inspired by snake motion, to significantly reduce path planning time. The inspection process employs NMPC to generate collision-free motion. The prototype HRM is developed, and inspection experiments are conducted in various complex pipeline scenarios to validate the effectiveness and feasibility of the proposed method. Experimental results demonstrate that the approach effectively minimizes the computational cost of path planning, offering a practical solution for HRM applications in pipeline inspection.
超冗余机械手利用其高灵活性和冗余性,可以探索狭窄弯曲的管道。然而,在受限环境中规划hrm的无碰撞运动轨迹仍然是一个重大挑战。为了解决这一问题,提出了一种将非线性模型预测控制(NMPC)与蛇启发爬行算法(SCA)相结合的管道检测方法。该方法包括三个过程:插入、检查和退出。插入和退出过程利用SCA,灵感来自蛇的运动,以显著减少路径规划时间。检测过程采用NMPC产生无碰撞运动。开发了原型HRM,并在各种复杂的管道场景下进行了检测实验,验证了所提方法的有效性和可行性。实验结果表明,该方法有效地降低了路径规划的计算成本,为人力资源管理在管道检测中的应用提供了一种实用的解决方案。
{"title":"Snake-inspired trajectory planning and control for confined pipeline inspection with hyper-redundant manipulators","authors":"Junjie Zhu ,&nbsp;Mingming Su ,&nbsp;Longchuan Li ,&nbsp;Yuxuan Xiang ,&nbsp;Jianming Wang ,&nbsp;Xuan Xiao","doi":"10.1016/j.birob.2025.100245","DOIUrl":"10.1016/j.birob.2025.100245","url":null,"abstract":"<div><div>The hyper-redundant manipulator (HRM) can explore narrow and curved pipelines by leveraging its high flexibility and redundancy. However, planning collision-free motion trajectories for HRMs in confined environments remains a significant challenge. To address this issue, a pipeline inspection approach that combines nonlinear model predictive control (NMPC) with the snake-inspired crawling algorithm(SCA) is proposed. The approach consists of three processes: insertion, inspection, and exit. The insertion and exit processes utilize the SCA, inspired by snake motion, to significantly reduce path planning time. The inspection process employs NMPC to generate collision-free motion. The prototype HRM is developed, and inspection experiments are conducted in various complex pipeline scenarios to validate the effectiveness and feasibility of the proposed method. Experimental results demonstrate that the approach effectively minimizes the computational cost of path planning, offering a practical solution for HRM applications in pipeline inspection.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 3","pages":"Article 100245"},"PeriodicalIF":5.4,"publicationDate":"2025-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144886416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Genetic Informed Trees (GIT*): Path planning via reinforced genetic programming heuristics 遗传信息树(GIT*):基于强化遗传规划启发式的路径规划
IF 5.4 Pub Date : 2025-05-20 DOI: 10.1016/j.birob.2025.100237
Liding Zhang , Kuanqi Cai , Zhenshan Bing , Chaoqun Wang , Alois Knoll
Optimal path planning involves finding a feasible state sequence between a start and a goal that optimizes an objective. This process relies on heuristic functions to guide the search direction. While a robust function can improve search efficiency and solution quality, current methods often overlook available environmental data and simplify the function structure due to the complexity of information relationships. This study introduces Genetic Informed Trees (GIT*), which improves upon Effort Informed Trees (EIT*) by integrating a wider array of environmental data, such as repulsive forces from obstacles and the dynamic importance of vertices, to refine heuristic functions for better guidance. Furthermore, we integrated reinforced genetic programming (RGP), which combines genetic programming with reward system feedback to mutate genotype-generative heuristic functions for GIT*. RGP leverages a multitude of data types, thereby improving computational efficiency and solution quality within a set timeframe. Comparative analyses demonstrate that GIT* surpasses existing single-query, sampling-based planners in problems ranging from R4 to R16 and was tested on a real-world mobile manipulation task. A video showcasing our experimental results is available at https://youtu.be/URjXbc_BiYg.
最优路径规划包括在起点和目标之间找到一个可行的状态序列,以优化目标。该过程依靠启发式函数来指导搜索方向。虽然鲁棒函数可以提高搜索效率和求解质量,但由于信息关系的复杂性,目前的方法往往忽略了可用的环境数据,并简化了函数结构。本研究引入了遗传信息树(GIT*),它在努力信息树(EIT*)的基础上改进了遗传信息树(GIT*),通过整合更广泛的环境数据,如障碍物的排斥力和顶点的动态重要性,来改进启发式函数,以获得更好的指导。此外,我们将强化遗传规划(RGP)与奖励系统反馈相结合,对GIT*的基因型生成启发式函数进行了突变。RGP利用多种数据类型,从而在设定的时间范围内提高计算效率和解决方案质量。对比分析表明,GIT*在R4到R16的问题中超越了现有的单查询、基于抽样的计划器,并在现实世界的移动操作任务中进行了测试。展示我们实验结果的视频可以在https://youtu.be/URjXbc_BiYg上找到。
{"title":"Genetic Informed Trees (GIT*): Path planning via reinforced genetic programming heuristics","authors":"Liding Zhang ,&nbsp;Kuanqi Cai ,&nbsp;Zhenshan Bing ,&nbsp;Chaoqun Wang ,&nbsp;Alois Knoll","doi":"10.1016/j.birob.2025.100237","DOIUrl":"10.1016/j.birob.2025.100237","url":null,"abstract":"<div><div>Optimal path planning involves finding a feasible state sequence between a start and a goal that optimizes an objective. This process relies on heuristic functions to guide the search direction. While a robust function can improve search efficiency and solution quality, current methods often overlook available environmental data and simplify the function structure due to the complexity of information relationships. This study introduces Genetic Informed Trees (GIT*), which improves upon Effort Informed Trees (EIT*) by integrating a wider array of environmental data, such as repulsive forces from obstacles and the dynamic importance of vertices, to refine heuristic functions for better guidance. Furthermore, we integrated reinforced genetic programming (RGP), which combines genetic programming with reward system feedback to mutate genotype-generative heuristic functions for GIT*. RGP leverages a multitude of data types, thereby improving computational efficiency and solution quality within a set timeframe. Comparative analyses demonstrate that GIT* surpasses existing single-query, sampling-based planners in problems ranging from <span><math><msup><mrow><mi>R</mi></mrow><mrow><mn>4</mn></mrow></msup></math></span> to <span><math><msup><mrow><mi>R</mi></mrow><mrow><mn>16</mn></mrow></msup></math></span> and was tested on a real-world mobile manipulation task. A video showcasing our experimental results is available at <span><span>https://youtu.be/URjXbc_BiYg</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 3","pages":"Article 100237"},"PeriodicalIF":5.4,"publicationDate":"2025-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144892904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Image segmentation network for laparoscopic surgery 用于腹腔镜手术的图像分割网络
Pub Date : 2025-05-06 DOI: 10.1016/j.birob.2025.100236
Kang Peng , Yaoyuan Chang , Guodong Lang , Jian Xu , Yongsheng Gao , Jiajun Yin , Jie Zhao
Surgical image segmentation serves as the foundation for laparoscopic surgical navigation technology. The indistinct local features of biological tissues in laparoscopic image pose challenges for image segmentation. To address this issue, we develop an image segmentation network tailored for laparoscopic surgery. Firstly, we introduce the Mixed Attention Enhancement (MAE) module that sequentially conducts the Channel Attention Enhancement (CAE) module and the Global Feature Enhancement (GFE) module linked in series. The CAE module enhances the network’s perception of prominent channels, allowing feature maps to exhibit clear local features. The GFE module is capable of extracting global features from both the height and width dimensions of images and integrating them into three-dimensional features. This enhancement improves the network’s ability to capture global features, thereby facilitating the inference of regions with indistinct local features. Secondly, we propose the Multi-scale Feature Fusion (MFF) module. This module expands the feature map into various scales, further enlarging the network’s receptive field and enhancing perception of features at multiple scales. In addition, we tested the proposed network on the EndoVis 2018 and a human minimally invasive liver resection image segmentation dataset, comparing it against six other advanced image segmentation networks. The comparative test results demonstrate that the proposed network achieves the most advanced performance on both datasets, proving its potential in improving surgical image segmentation outcome. The codes of MAMNet are available at: https://github.com/Pang1234567/MAMNet.
手术图像分割是腹腔镜手术导航技术的基础。腹腔镜图像中生物组织的局部特征不明确,给图像分割带来了挑战。为了解决这个问题,我们开发了一个适合腹腔镜手术的图像分割网络。首先,我们介绍了混合注意增强(MAE)模块,该模块依次将信道注意增强(CAE)模块和全局特征增强(GFE)模块串联起来。CAE模块增强了网络对突出通道的感知,允许特征图显示清晰的局部特征。GFE模块能够从图像的高度和宽度两个维度提取全局特征,并将其整合为三维特征。这种增强提高了网络捕获全局特征的能力,从而促进了局部特征不明确的区域的推断。其次,提出了多尺度特征融合(MFF)模块。该模块将特征映射扩展到不同的尺度,进一步扩大了网络的接受野,增强了对多尺度特征的感知。此外,我们在EndoVis 2018和人类微创肝切除图像分割数据集上测试了所提出的网络,并将其与其他六种先进的图像分割网络进行了比较。对比测试结果表明,本文提出的网络在两个数据集上都取得了最先进的性能,证明了其在提高手术图像分割效果方面的潜力。MAMNet的代码可在https://github.com/Pang1234567/MAMNet获得。
{"title":"Image segmentation network for laparoscopic surgery","authors":"Kang Peng ,&nbsp;Yaoyuan Chang ,&nbsp;Guodong Lang ,&nbsp;Jian Xu ,&nbsp;Yongsheng Gao ,&nbsp;Jiajun Yin ,&nbsp;Jie Zhao","doi":"10.1016/j.birob.2025.100236","DOIUrl":"10.1016/j.birob.2025.100236","url":null,"abstract":"<div><div>Surgical image segmentation serves as the foundation for laparoscopic surgical navigation technology. The indistinct local features of biological tissues in laparoscopic image pose challenges for image segmentation. To address this issue, we develop an image segmentation network tailored for laparoscopic surgery. Firstly, we introduce the Mixed Attention Enhancement (MAE) module that sequentially conducts the Channel Attention Enhancement (CAE) module and the Global Feature Enhancement (GFE) module linked in series. The CAE module enhances the network’s perception of prominent channels, allowing feature maps to exhibit clear local features. The GFE module is capable of extracting global features from both the height and width dimensions of images and integrating them into three-dimensional features. This enhancement improves the network’s ability to capture global features, thereby facilitating the inference of regions with indistinct local features. Secondly, we propose the Multi-scale Feature Fusion (MFF) module. This module expands the feature map into various scales, further enlarging the network’s receptive field and enhancing perception of features at multiple scales. In addition, we tested the proposed network on the EndoVis 2018 and a human minimally invasive liver resection image segmentation dataset, comparing it against six other advanced image segmentation networks. The comparative test results demonstrate that the proposed network achieves the most advanced performance on both datasets, proving its potential in improving surgical image segmentation outcome. The codes of MAMNet are available at: <span><span>https://github.com/Pang1234567/MAMNet</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 3","pages":"Article 100236"},"PeriodicalIF":0.0,"publicationDate":"2025-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144490238","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An adaptive compensation strategy for sensors based on the degree of degradation 基于退化程度的传感器自适应补偿策略
IF 5.4 Pub Date : 2025-04-30 DOI: 10.1016/j.birob.2025.100235
Yanbin Li , Wei Zhang , Zhiguo Zhang , Xiaogang Shi , Ziruo Li , Mingming Zhang , Wenzheng Chi
Simultaneous Localization and Mapping (SLAM) is widely used to solve the localization problem of unmanned devices such as robots. However, in degraded environments, the accuracy of SLAM is greatly reduced due to the lack of constrained features. In this article, we propose a deep learning-based adaptive compensation strategy for sensors. First, we create a dataset dedicated to training a degradation detection model, which contains coordinate data of particle swarms with different distributional features, and endow the model with degradation detection capability through supervised learning. Second, we design a lightweight network model with short computation time and good accuracy for real-time degradation detection tasks. Finally, an adaptive compensation strategy for sensors based on the degree of degradation is designed, where the SLAM is able to assign different weights to the sensor information according to the degree of degradation given by the model, to adjust the contribution of different sensors in the pose optimization process. We demonstrate through simulation experiments and real experiments that the robustness of the improved SLAM in degraded environments is significantly enhanced, and the accuracy of localization and mapping are improved.
同时定位与制图(SLAM)被广泛应用于解决机器人等无人设备的定位问题。然而,在退化环境中,由于缺乏约束特征,SLAM的精度大大降低。在本文中,我们提出了一种基于深度学习的传感器自适应补偿策略。首先,我们创建一个专门用于训练退化检测模型的数据集,该数据集包含具有不同分布特征的粒子群坐标数据,并通过监督学习赋予模型退化检测能力。其次,针对实时退化检测任务,设计了计算时间短、精度好的轻量级网络模型。最后,设计了基于退化程度的传感器自适应补偿策略,SLAM能够根据模型给出的退化程度对传感器信息赋予不同的权重,以调整不同传感器在位姿优化过程中的贡献。通过仿真实验和实际实验证明,改进后的SLAM在退化环境下的鲁棒性显著增强,定位和映射精度得到提高。
{"title":"An adaptive compensation strategy for sensors based on the degree of degradation","authors":"Yanbin Li ,&nbsp;Wei Zhang ,&nbsp;Zhiguo Zhang ,&nbsp;Xiaogang Shi ,&nbsp;Ziruo Li ,&nbsp;Mingming Zhang ,&nbsp;Wenzheng Chi","doi":"10.1016/j.birob.2025.100235","DOIUrl":"10.1016/j.birob.2025.100235","url":null,"abstract":"<div><div>Simultaneous Localization and Mapping (SLAM) is widely used to solve the localization problem of unmanned devices such as robots. However, in degraded environments, the accuracy of SLAM is greatly reduced due to the lack of constrained features. In this article, we propose a deep learning-based adaptive compensation strategy for sensors. First, we create a dataset dedicated to training a degradation detection model, which contains coordinate data of particle swarms with different distributional features, and endow the model with degradation detection capability through supervised learning. Second, we design a lightweight network model with short computation time and good accuracy for real-time degradation detection tasks. Finally, an adaptive compensation strategy for sensors based on the degree of degradation is designed, where the SLAM is able to assign different weights to the sensor information according to the degree of degradation given by the model, to adjust the contribution of different sensors in the pose optimization process. We demonstrate through simulation experiments and real experiments that the robustness of the improved SLAM in degraded environments is significantly enhanced, and the accuracy of localization and mapping are improved.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 4","pages":"Article 100235"},"PeriodicalIF":5.4,"publicationDate":"2025-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145266328","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tendon friction compensation and slack avoidance for trajectory tracking control of the tendon-driven medical continuum manipulator 肌腱驱动医疗连续体机械臂轨迹跟踪控制的肌腱摩擦补偿与松弛避免
IF 5.4 Pub Date : 2025-04-23 DOI: 10.1016/j.birob.2025.100234
Pengyu Du , Jianxiong Hao , Kun Qian , Yue Zhang , Zhiqiang Zhang , Chaoyang Shi
Tendon-driven continuum manipulators can perform tasks in confined environments due to their flexibility and curvilinearity, especially in minimally invasive surgeries. However, the friction along tendons and tendon slack present challenges to their motion control. This work proposes a trajectory tracking controller based on adaptive fuzzy sliding mode control (AFSMC) for the tendon-driven continuum manipulators. It consists of a sliding mode control (SMC) law with two groups of adaptive fuzzy subcontrollers. The first one is utilized to estimate and compensate for friction forces along tendons. The second one adapts the switching terms of SMC to alleviate the chattering phenomenon and enhance control robustness. To prevent tendon slack, an antagonistic strategy along with the AFSMC controller is adopted to allocate driving forces. Simulation and experiment studies have been conducted to investigate the efficacy of the proposed controller. In free space experiments, the AFSMC controller generates an average root-mean-square error (RMSE) of 0.42% compared with 0.90% of the SMC controller. In the case of a 50 g load, the proposed controller reduces the average RMSE to 1.47% compared with 4.29% of the SMC controller. These experimental results demonstrate that the proposed AFSMC controller has high control accuracy, robustness, and reduced chattering.
肌腱驱动的连续机械臂由于其灵活性和曲线性可以在受限环境中执行任务,特别是在微创手术中。然而,沿肌腱和肌腱松弛的摩擦对其运动控制提出了挑战。提出了一种基于自适应模糊滑模控制(AFSMC)的肌腱驱动连续体机械臂轨迹跟踪控制器。它由滑模控制律和两组自适应模糊子控制器组成。第一个用来估计和补偿沿肌腱的摩擦力。第二种方法采用小波控制的开关项来减轻系统的抖振现象,增强系统的鲁棒性。为了防止肌腱松弛,采用对抗策略和AFSMC控制器来分配驱动力。通过仿真和实验研究验证了所提控制器的有效性。在自由空间实验中,AFSMC控制器产生的均方根误差(RMSE)为0.42%,而SMC控制器产生的均方根误差为0.90%。在50g负载的情况下,所提出的控制器将平均RMSE降低到1.47%,而SMC控制器的RMSE为4.29%。实验结果表明,所提出的AFSMC控制器具有较高的控制精度、鲁棒性和较低的抖振。
{"title":"Tendon friction compensation and slack avoidance for trajectory tracking control of the tendon-driven medical continuum manipulator","authors":"Pengyu Du ,&nbsp;Jianxiong Hao ,&nbsp;Kun Qian ,&nbsp;Yue Zhang ,&nbsp;Zhiqiang Zhang ,&nbsp;Chaoyang Shi","doi":"10.1016/j.birob.2025.100234","DOIUrl":"10.1016/j.birob.2025.100234","url":null,"abstract":"<div><div>Tendon-driven continuum manipulators can perform tasks in confined environments due to their flexibility and curvilinearity, especially in minimally invasive surgeries. However, the friction along tendons and tendon slack present challenges to their motion control. This work proposes a trajectory tracking controller based on adaptive fuzzy sliding mode control (AFSMC) for the tendon-driven continuum manipulators. It consists of a sliding mode control (SMC) law with two groups of adaptive fuzzy subcontrollers. The first one is utilized to estimate and compensate for friction forces along tendons. The second one adapts the switching terms of SMC to alleviate the chattering phenomenon and enhance control robustness. To prevent tendon slack, an antagonistic strategy along with the AFSMC controller is adopted to allocate driving forces. Simulation and experiment studies have been conducted to investigate the efficacy of the proposed controller. In free space experiments, the AFSMC controller generates an average root-mean-square error (RMSE) of 0.42% compared with 0.90% of the SMC controller. In the case of a 50 g load, the proposed controller reduces the average RMSE to 1.47% compared with 4.29% of the SMC controller. These experimental results demonstrate that the proposed AFSMC controller has high control accuracy, robustness, and reduced chattering.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 4","pages":"Article 100234"},"PeriodicalIF":5.4,"publicationDate":"2025-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144926625","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Novel 3D instrument navigation in intracranial vascular surgery with multi-source image fusion and self-calibration 基于多源图像融合和自校准的颅内血管手术三维仪器导航
IF 5.4 Pub Date : 2025-04-22 DOI: 10.1016/j.birob.2025.100233
Linsen Zhang , Shiqi Liu , Xiaoliang Xie , Xiaohu Zhou , Zengguang Hou , Xinkai Qu , Wenzheng Han , Meng Song , Xiyao Ma , Haining Zhao
In cerebrovascular interventional surgery, spatial position prediction navigation (SPPN) provides 3D spatial information of the vascular lumen, reducing the spatial dimension loss from digital subtraction angiography (DSA) and improving surgical precision. However, it is limited in its adaptability to complex vascular environments and prone to error accumulation. To address these issues, we propose spatial position prediction-based multimodal navigation (SPPMN), integrating minimal intraoperative X-ray images to enhance SPPN accuracy. In the first phase, a feature-weighted dynamic time warping (FDTW)-based branch matching algorithm is introduced for 3D topological positioning under non-registered conditions, with a dynamic location repositioning module for real-time corrections. In the second phase, an occlusion correction module, based on the elastic potential energy of the instrument tip, dynamically adjusts the tip’s angle to achieve low-projection occlusion control. Experimental validation using a high-precision electromagnetic tracking system (EMTS) on a 3D vascular model shows that the proposed method achieves an average 3D positioning accuracy of 9.36 mm in intracranial vascular regions, with a 78% reduction in radiation exposure, significantly enhancing both precision and safety in interventional surgeries.
在脑血管介入手术中,空间位置预测导航(SPPN)提供血管腔的三维空间信息,减少数字减影血管造影(DSA)带来的空间维度损失,提高手术精度。但其对复杂血管环境的适应能力有限,容易产生误差积累。为了解决这些问题,我们提出了基于空间位置预测的多模式导航(SPPMN),结合最小的术中x线图像来提高SPPN的准确性。在第一阶段,引入了一种基于特征加权动态时间翘曲(FDTW)的分支匹配算法,用于非配准条件下的三维拓扑定位,并采用动态位置重定位模块进行实时校正。第二阶段,遮挡校正模块基于仪器尖端的弹性势能,动态调整仪器尖端的角度,实现低投影遮挡控制。高精度电磁跟踪系统(EMTS)在三维血管模型上的实验验证表明,该方法在颅内血管区域的平均三维定位精度为9.36 mm,辐射暴露减少78%,显著提高了介入手术的精度和安全性。
{"title":"Novel 3D instrument navigation in intracranial vascular surgery with multi-source image fusion and self-calibration","authors":"Linsen Zhang ,&nbsp;Shiqi Liu ,&nbsp;Xiaoliang Xie ,&nbsp;Xiaohu Zhou ,&nbsp;Zengguang Hou ,&nbsp;Xinkai Qu ,&nbsp;Wenzheng Han ,&nbsp;Meng Song ,&nbsp;Xiyao Ma ,&nbsp;Haining Zhao","doi":"10.1016/j.birob.2025.100233","DOIUrl":"10.1016/j.birob.2025.100233","url":null,"abstract":"<div><div>In cerebrovascular interventional surgery, spatial position prediction navigation (SPPN) provides 3D spatial information of the vascular lumen, reducing the spatial dimension loss from digital subtraction angiography (DSA) and improving surgical precision. However, it is limited in its adaptability to complex vascular environments and prone to error accumulation. To address these issues, we propose spatial position prediction-based multimodal navigation (SPPMN), integrating minimal intraoperative X-ray images to enhance SPPN accuracy. In the first phase, a feature-weighted dynamic time warping (FDTW)-based branch matching algorithm is introduced for 3D topological positioning under non-registered conditions, with a dynamic location repositioning module for real-time corrections. In the second phase, an occlusion correction module, based on the elastic potential energy of the instrument tip, dynamically adjusts the tip’s angle to achieve low-projection occlusion control. Experimental validation using a high-precision electromagnetic tracking system (EMTS) on a 3D vascular model shows that the proposed method achieves an average 3D positioning accuracy of 9.36 mm in intracranial vascular regions, with a 78% reduction in radiation exposure, significantly enhancing both precision and safety in interventional surgeries.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 3","pages":"Article 100233"},"PeriodicalIF":5.4,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144895044","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Soft objects grasping evaluation using a novel VCFN-YOLOv8 framework 基于VCFN-YOLOv8框架的软目标抓取评估
Pub Date : 2025-04-11 DOI: 10.1016/j.birob.2025.100232
Guoshun Cui , Shiwei Su , Hanyu Gao , Kai Zhuo , Kun Yang , Hang Wu
Humans can quickly perform adaptive grasping of soft objects by using visual perception and judgment of the grasping angle, which helps prevent the objects from sliding or deforming excessively. However, this easy task remains a challenge for robots. The grasping states of soft objects can be categorized into four types: sliding, appropriate, excessive and extreme. Effective recognition of different states is crucial for achieving adaptive grasping of soft objects. To address this problem, a novel visual-curvature fusion network based on YOLOv8 (VCFN-YOLOv8) is proposed to evaluate the grasping state of various soft objects. In this framework, the robotic arm equipped with the wrist camera and the curvature sensor is established to perform generalization grasping and lifting experiments on 11 different objects. Meanwhile, the dataset is built for training and testing the proposed method. The results show a classification accuracy of 99.51% on four different grasping states. A series of grasping evaluation experiments is conducted based on the proposed framework, along with tests for the model’s generality. The experiment results demonstrate that VCFN-YOLOv8 is accurate and efficient in evaluating the grasping state of soft objects and shows a certain degree of generalization for non-soft objects. It can be widely applied in fields such as automatic control, adaptive grasping and surgical robot.
人类通过视觉感知和对抓取角度的判断,可以快速地对柔软物体进行自适应抓取,从而防止物体过度滑动或变形。然而,这项简单的任务对机器人来说仍然是一个挑战。软性物体的抓取状态可分为滑动、适度、过度和极端四种。对不同状态的有效识别是实现软物体自适应抓取的关键。针对这一问题,提出了一种基于YOLOv8的视觉曲率融合网络(VCFN-YOLOv8)来评估各种软物体的抓取状态。在该框架下,建立了配备腕部相机和曲率传感器的机械臂,对11个不同的物体进行泛化抓取和提升实验。同时,建立数据集用于训练和测试所提出的方法。结果表明,在四种不同抓取状态下,分类准确率达到99.51%。基于所提出的框架进行了一系列抓取评价实验,并对模型的通用性进行了测试。实验结果表明,VCFN-YOLOv8对软性物体的抓取状态评价准确、高效,对非软性物体具有一定的泛化能力。可广泛应用于自动控制、自适应抓取、手术机器人等领域。
{"title":"Soft objects grasping evaluation using a novel VCFN-YOLOv8 framework","authors":"Guoshun Cui ,&nbsp;Shiwei Su ,&nbsp;Hanyu Gao ,&nbsp;Kai Zhuo ,&nbsp;Kun Yang ,&nbsp;Hang Wu","doi":"10.1016/j.birob.2025.100232","DOIUrl":"10.1016/j.birob.2025.100232","url":null,"abstract":"<div><div>Humans can quickly perform adaptive grasping of soft objects by using visual perception and judgment of the grasping angle, which helps prevent the objects from sliding or deforming excessively. However, this easy task remains a challenge for robots. The grasping states of soft objects can be categorized into four types: sliding, appropriate, excessive and extreme. Effective recognition of different states is crucial for achieving adaptive grasping of soft objects. To address this problem, a novel visual-curvature fusion network based on YOLOv8 (VCFN-YOLOv8) is proposed to evaluate the grasping state of various soft objects. In this framework, the robotic arm equipped with the wrist camera and the curvature sensor is established to perform generalization grasping and lifting experiments on 11 different objects. Meanwhile, the dataset is built for training and testing the proposed method. The results show a classification accuracy of 99.51% on four different grasping states. A series of grasping evaluation experiments is conducted based on the proposed framework, along with tests for the model’s generality. The experiment results demonstrate that VCFN-YOLOv8 is accurate and efficient in evaluating the grasping state of soft objects and shows a certain degree of generalization for non-soft objects. It can be widely applied in fields such as automatic control, adaptive grasping and surgical robot.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 3","pages":"Article 100232"},"PeriodicalIF":0.0,"publicationDate":"2025-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144714580","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hierarchical reinforcement learning for enhancing stability and adaptability of hexapod robots in complex terrains 层次强化学习提高六足机器人在复杂地形中的稳定性和适应性
IF 5.4 Pub Date : 2025-03-27 DOI: 10.1016/j.birob.2025.100231
Shichang Huang , Zhihan Xiao , Minhua Zheng , Wen Shi
In the field of hexapod robot control, the application of central pattern generators (CPG) and deep reinforcement learning (DRL) is becoming increasingly common. Compared to traditional control methods that rely on dynamic models, both the CPG and the end-to-end DRL approaches significantly simplify the complexity of designing control models. However, relying solely on DRL for control also has its drawbacks, such as slow convergence speed and low exploration efficiency. Moreover, although the CPG can produce rhythmic gaits, its control strategy is relatively singular, limiting the robot’s ability to adapt to complex terrains. To overcome these limitations, this study proposes a three-layer DRL control architecture. The high-level reinforcement learning controller is responsible for learning the parameters of the middle-level CPG and the low-level mapping functions, while the middle and low level controllers coordinate the joint movements within and between legs. By integrating the learning capabilities of DRL with the gait generation characteristics of CPG, this method significantly enhances the stability and adaptability of hexapod robots in complex terrains. Experimental results show that, compared to pure DRL approaches, this method significantly improves learning efficiency and control performance, when dealing with complex terrains, it considerably enhances the robot’s stability and adaptability compared to pure CPG control.
在六足机器人控制领域,中心模式发生器(CPG)和深度强化学习(DRL)的应用越来越普遍。与依赖于动态模型的传统控制方法相比,CPG和端到端DRL方法都大大简化了控制模型设计的复杂性。但是,单纯依靠DRL进行控制也存在收敛速度慢、勘探效率低等缺点。此外,尽管CPG可以产生有节奏的步态,但其控制策略相对单一,限制了机器人适应复杂地形的能力。为了克服这些限制,本研究提出了一个三层DRL控制体系结构。高级强化学习控制器负责学习中级CPG的参数和低级映射函数,中低级控制器协调腿内和腿间的关节运动。该方法将DRL的学习能力与CPG的步态生成特性相结合,显著提高了六足机器人在复杂地形中的稳定性和适应性。实验结果表明,与纯DRL方法相比,该方法显著提高了学习效率和控制性能,在处理复杂地形时,与纯CPG控制相比,该方法显著增强了机器人的稳定性和自适应能力。
{"title":"Hierarchical reinforcement learning for enhancing stability and adaptability of hexapod robots in complex terrains","authors":"Shichang Huang ,&nbsp;Zhihan Xiao ,&nbsp;Minhua Zheng ,&nbsp;Wen Shi","doi":"10.1016/j.birob.2025.100231","DOIUrl":"10.1016/j.birob.2025.100231","url":null,"abstract":"<div><div>In the field of hexapod robot control, the application of central pattern generators (CPG) and deep reinforcement learning (DRL) is becoming increasingly common. Compared to traditional control methods that rely on dynamic models, both the CPG and the end-to-end DRL approaches significantly simplify the complexity of designing control models. However, relying solely on DRL for control also has its drawbacks, such as slow convergence speed and low exploration efficiency. Moreover, although the CPG can produce rhythmic gaits, its control strategy is relatively singular, limiting the robot’s ability to adapt to complex terrains. To overcome these limitations, this study proposes a three-layer DRL control architecture. The high-level reinforcement learning controller is responsible for learning the parameters of the middle-level CPG and the low-level mapping functions, while the middle and low level controllers coordinate the joint movements within and between legs. By integrating the learning capabilities of DRL with the gait generation characteristics of CPG, this method significantly enhances the stability and adaptability of hexapod robots in complex terrains. Experimental results show that, compared to pure DRL approaches, this method significantly improves learning efficiency and control performance, when dealing with complex terrains, it considerably enhances the robot’s stability and adaptability compared to pure CPG control.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 3","pages":"Article 100231"},"PeriodicalIF":5.4,"publicationDate":"2025-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144879101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Editorial for the special issue on Advanced Technology in Autonomous Robots and Swarm Intelligence “自主机器人和群体智能中的先进技术”特刊社论
Pub Date : 2025-03-18 DOI: 10.1016/j.birob.2025.100230
Weinan Chen, Tao Zhang, Jiyu Cheng, Yangming Lee, Yisheng Guan
{"title":"Editorial for the special issue on Advanced Technology in Autonomous Robots and Swarm Intelligence","authors":"Weinan Chen,&nbsp;Tao Zhang,&nbsp;Jiyu Cheng,&nbsp;Yangming Lee,&nbsp;Yisheng Guan","doi":"10.1016/j.birob.2025.100230","DOIUrl":"10.1016/j.birob.2025.100230","url":null,"abstract":"","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 3","pages":"Article 100230"},"PeriodicalIF":0.0,"publicationDate":"2025-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143828691","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A novel magnetoelastic torque sensor with planar spiral coil probes for humanoid robot joints 一种基于平面螺旋线圈探头的新型人形机器人关节磁弹性扭矩传感器
Pub Date : 2025-03-17 DOI: 10.1016/j.birob.2025.100229
Zijian Zhang , Zitao Wang , Ming Shao , Yangyang Dong , Fenglei Ni
Humanoid robot joints require real-time torque detection to provide accurate force feedback information for the control system. To meet the measurement requirements and realize the miniaturization of the sensor, a torque sensor based on the magnetoelastic effect is developed, utilizing planar spiral coils as detection probes. In this work, a planar spiral coil mutual inductance calculation model is established to solve the mutual inductance coefficient, and the mechanical structure and circuit design of the sensor are completed. Finally, a torque loading platform is built to perform calibration experiments, and the hysteresis model is improved to compensate for the hysteresis phenomenon. The calibration results indicate that the sensor shows excellent loaded nonlinearity of 3.08%F.S., unloaded nonlinearity of 2.71%F.S., loaded repeatability of 2.48%F.S., unloaded repeatability of 1.89%F.S. and hysteresis of 1.9%F.S., at a compact probe size of 13.8×9.9×1.8 mm.
人形机器人关节需要实时扭矩检测,为控制系统提供准确的力反馈信息。为满足测量要求,实现传感器的小型化,研制了一种基于磁弹性效应的扭矩传感器,采用平面螺旋线圈作为检测探头。本文建立了平面螺旋线圈互感计算模型,求解了互感系数,完成了传感器的机械结构和电路设计。最后,搭建了扭矩加载平台进行标定实验,并对滞回模型进行了改进以补偿滞回现象。标定结果表明,该传感器具有良好的负载非线性(3.08%F.S)。,卸载非线性为2.71%F.S。加载重复性为2.48%F.S。,卸载重复性为1.89%F.S。迟滞率为1.9%F.S。,探头尺寸紧凑,为13.8×9.9×1.8 mm。
{"title":"A novel magnetoelastic torque sensor with planar spiral coil probes for humanoid robot joints","authors":"Zijian Zhang ,&nbsp;Zitao Wang ,&nbsp;Ming Shao ,&nbsp;Yangyang Dong ,&nbsp;Fenglei Ni","doi":"10.1016/j.birob.2025.100229","DOIUrl":"10.1016/j.birob.2025.100229","url":null,"abstract":"<div><div>Humanoid robot joints require real-time torque detection to provide accurate force feedback information for the control system. To meet the measurement requirements and realize the miniaturization of the sensor, a torque sensor based on the magnetoelastic effect is developed, utilizing planar spiral coils as detection probes. In this work, a planar spiral coil mutual inductance calculation model is established to solve the mutual inductance coefficient, and the mechanical structure and circuit design of the sensor are completed. Finally, a torque loading platform is built to perform calibration experiments, and the hysteresis model is improved to compensate for the hysteresis phenomenon. The calibration results indicate that the sensor shows excellent loaded nonlinearity of 3.08%F.S., unloaded nonlinearity of 2.71%F.S., loaded repeatability of 2.48%F.S., unloaded repeatability of 1.89%F.S. and hysteresis of 1.9%F.S., at a compact probe size of 13.8<span><math><mrow><mo>×</mo><mn>9</mn><mo>.</mo><mn>9</mn><mo>×</mo></mrow></math></span>1.8 mm.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 3","pages":"Article 100229"},"PeriodicalIF":0.0,"publicationDate":"2025-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144634131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Biomimetic Intelligence and Robotics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1