首页 > 最新文献

Robotics and Autonomous Systems最新文献

英文 中文
Vision-guided gripping process with minimizing folding for flexible fabric materials by integrating a sequential optimization algorithm and FEM analysis 结合序列优化算法和有限元分析的视觉引导柔性织物材料最小折叠夹持过程
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2026-01-07 DOI: 10.1016/j.robot.2026.105349
Minh Khang Ngo , Chanhee Won , HyunKyo Lim , Dae Young Lim , Than Trong Khanh Dat , Jonghun Yoon
Automatic fabric handling in garment manufacturing presents significant challenges due to the soft, deformable, and highly variable nature of textile materials. This paper proposes an integrated robotic fabric gripping system capable of reliably identifying and manipulating fabric parts with minimal folding. The system comprises an industrial robotic arm, four needle grippers mounted on an adjustable jig mechanism, and a high-precision 3D vision camera for real-time fabric detection. A key contribution of this work is a sequential optimization model that determines four optimal gripping points for each fabric pattern, based on material characterization, deformation criteria, and folding definitions derived from experiments and finite element simulations. These points are mapped relative to CAD data and stored for retrieval. A vision-based matching algorithm then aligns real-time image inputs with CAD templates to localize the fabric piece and recover the precomputed optimal gripping points, which are transmitted to the robot for autonomous execution. Quantitative evaluations demonstrate that the proposed approach significantly reduces fabric folding and enhances the reliability of robotic garment handling, representing a substantial step toward fully automated garment production.
由于纺织材料的柔软,可变形和高度可变的性质,服装制造中的自动织物处理提出了重大挑战。提出了一种集成的机器人织物抓取系统,该系统能够以最小的折叠量可靠地识别和操纵织物零件。该系统包括一个工业机械臂、安装在可调夹具机构上的四个抓针器和一个用于实时织物检测的高精度3D视觉相机。这项工作的一个关键贡献是一个顺序优化模型,该模型基于材料特性、变形标准和从实验和有限元模拟中得出的折叠定义,确定每种织物图案的四个最佳夹紧点。这些点相对于CAD数据进行映射并存储以供检索。然后,基于视觉的匹配算法将实时图像输入与CAD模板对齐,以定位织物片并恢复预先计算的最佳抓取点,这些点将传输给机器人进行自主执行。定量评估表明,所提出的方法显著减少了织物折叠,提高了机器人服装处理的可靠性,代表着向全自动服装生产迈出了实质性的一步。
{"title":"Vision-guided gripping process with minimizing folding for flexible fabric materials by integrating a sequential optimization algorithm and FEM analysis","authors":"Minh Khang Ngo ,&nbsp;Chanhee Won ,&nbsp;HyunKyo Lim ,&nbsp;Dae Young Lim ,&nbsp;Than Trong Khanh Dat ,&nbsp;Jonghun Yoon","doi":"10.1016/j.robot.2026.105349","DOIUrl":"10.1016/j.robot.2026.105349","url":null,"abstract":"<div><div>Automatic fabric handling in garment manufacturing presents significant challenges due to the soft, deformable, and highly variable nature of textile materials. This paper proposes an integrated robotic fabric gripping system capable of reliably identifying and manipulating fabric parts with minimal folding. The system comprises an industrial robotic arm, four needle grippers mounted on an adjustable jig mechanism, and a high-precision 3D vision camera for real-time fabric detection. A key contribution of this work is a sequential optimization model that determines four optimal gripping points for each fabric pattern, based on material characterization, deformation criteria, and folding definitions derived from experiments and finite element simulations. These points are mapped relative to CAD data and stored for retrieval. A vision-based matching algorithm then aligns real-time image inputs with CAD templates to localize the fabric piece and recover the precomputed optimal gripping points, which are transmitted to the robot for autonomous execution. Quantitative evaluations demonstrate that the proposed approach significantly reduces fabric folding and enhances the reliability of robotic garment handling, representing a substantial step toward fully automated garment production.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105349"},"PeriodicalIF":5.2,"publicationDate":"2026-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145978333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Path planning of bionic robotic fish based on enhanced SAC algorithm combined with HER and CQL 基于改进SAC算法结合HER和CQL的仿生机器鱼路径规划
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2026-01-06 DOI: 10.1016/j.robot.2026.105336
Ming Wang, Tinglong Zhao, Lingchen Zuo, Yanling Gong, Guangxin Lv, Ruilong Wang
Underwater robots play a crucial role in ocean exploration and resource development. As a type of underwater robot, bionic robotic fish can mimic the swimming patterns of real fish, offering unique advantages in complex underwater environments. However, traditional path planning methods perform poorly in unknown or dynamic environments. This paper proposes a path planning algorithm based on deep reinforcement learning, which improves the path planning capabilities of bionic robotic fish in unknown environments by combining the Soft Actor-Critic (SAC) algorithm with the Hindsight Experience Replay (HER) mechanism. Furthermore, the use of the Conservative Q-Learning (CQL) algorithm enhances the algorithm’s exploration capability and robustness. The effectiveness and practicality of the proposed algorithm are validated through simulation results.
水下机器人在海洋勘探和资源开发中发挥着至关重要的作用。仿生机器鱼作为一种水下机器人,能够模仿真鱼的游动模式,在复杂的水下环境中具有独特的优势。然而,传统的路径规划方法在未知或动态环境中表现不佳。本文提出了一种基于深度强化学习的路径规划算法,通过将软Actor-Critic (SAC)算法与后见之明经验回放(HER)机制相结合,提高了仿生机器鱼在未知环境下的路径规划能力。此外,使用保守Q-Learning (CQL)算法增强了算法的探索能力和鲁棒性。仿真结果验证了该算法的有效性和实用性。
{"title":"Path planning of bionic robotic fish based on enhanced SAC algorithm combined with HER and CQL","authors":"Ming Wang,&nbsp;Tinglong Zhao,&nbsp;Lingchen Zuo,&nbsp;Yanling Gong,&nbsp;Guangxin Lv,&nbsp;Ruilong Wang","doi":"10.1016/j.robot.2026.105336","DOIUrl":"10.1016/j.robot.2026.105336","url":null,"abstract":"<div><div>Underwater robots play a crucial role in ocean exploration and resource development. As a type of underwater robot, bionic robotic fish can mimic the swimming patterns of real fish, offering unique advantages in complex underwater environments. However, traditional path planning methods perform poorly in unknown or dynamic environments. This paper proposes a path planning algorithm based on deep reinforcement learning, which improves the path planning capabilities of bionic robotic fish in unknown environments by combining the Soft Actor-Critic (SAC) algorithm with the Hindsight Experience Replay (HER) mechanism. Furthermore, the use of the Conservative Q-Learning (CQL) algorithm enhances the algorithm’s exploration capability and robustness. The effectiveness and practicality of the proposed algorithm are validated through simulation results.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105336"},"PeriodicalIF":5.2,"publicationDate":"2026-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145940039","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A self-supervised exploratory guided push and grasp approach to enhance robotic manipulation in clutter 一种自监督探索性引导推抓方法提高机器人在杂波环境下的操作能力
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2026-01-06 DOI: 10.1016/j.robot.2026.105339
Chiat Pin Tay , Shijun Yan , Chong Chen , Wei Qi Toh , Miaolong Yuan , Dongkyu Choi
Robot manipulation of cluttered and stacked objects remains a crucial yet challenging task with immense real-world applications. Integrating push actions into grasp strategies has been proposed to address this challenge. However, existing deep learning approaches, particularly those based on reinforcement learning, often suffer from lengthy training times and inefficient action selection. This paper introduces a novel exploratory guided push approach that leverages self-supervised learning and a memory buffer enhancement strategy to accelerate efficient data sampling for model training. We investigated and analysed various network architectures, data collection methods, and learning strategies to understand their impacts on push-and-grasp tasks. Extensive experiments conducted in both simulated and real environments demonstrate the effectiveness of our proposed solution.
机器人操纵杂乱和堆叠的物体仍然是一个具有巨大现实应用的关键但具有挑战性的任务。为了应对这一挑战,建议将推动行动整合到把握策略中。然而,现有的深度学习方法,尤其是那些基于强化学习的方法,往往存在训练时间长、动作选择效率低的问题。本文介绍了一种新的探索性引导推送方法,该方法利用自监督学习和记忆缓冲增强策略来加速模型训练的有效数据采样。我们调查并分析了各种网络架构、数据收集方法和学习策略,以了解它们对推抓任务的影响。在模拟和真实环境中进行的大量实验证明了我们提出的解决方案的有效性。
{"title":"A self-supervised exploratory guided push and grasp approach to enhance robotic manipulation in clutter","authors":"Chiat Pin Tay ,&nbsp;Shijun Yan ,&nbsp;Chong Chen ,&nbsp;Wei Qi Toh ,&nbsp;Miaolong Yuan ,&nbsp;Dongkyu Choi","doi":"10.1016/j.robot.2026.105339","DOIUrl":"10.1016/j.robot.2026.105339","url":null,"abstract":"<div><div>Robot manipulation of cluttered and stacked objects remains a crucial yet challenging task with immense real-world applications. Integrating push actions into grasp strategies has been proposed to address this challenge. However, existing deep learning approaches, particularly those based on reinforcement learning, often suffer from lengthy training times and inefficient action selection. This paper introduces a novel exploratory guided push approach that leverages self-supervised learning and a memory buffer enhancement strategy to accelerate efficient data sampling for model training. We investigated and analysed various network architectures, data collection methods, and learning strategies to understand their impacts on push-and-grasp tasks. Extensive experiments conducted in both simulated and real environments demonstrate the effectiveness of our proposed solution.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105339"},"PeriodicalIF":5.2,"publicationDate":"2026-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145940043","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing sampling-based planning with a library of paths 使用路径库增强基于抽样的规划
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2026-01-05 DOI: 10.1016/j.robot.2026.105334
Michal Minařík, Vojtěch Vonásek, Robert Pěnička
Path planning for 3D solid objects is a challenging problem, requiring a search in a six-dimensional configuration space, which is, nevertheless, essential in many robotic applications such as bin-picking and assembly. The commonly used sampling-based planners, such as Rapidly-exploring Random Trees, struggle with narrow passages where the sampling probability is low, increasing the time needed to find a solution. In scenarios like robotic bin-picking, various objects must be transported through the same environment. However, traditional planners start from scratch each time, losing valuable information gained during the planning process. We address this by using a library of past solutions, allowing the reuse of previous experiences even when planning for a new, previously unseen object. Paths for a set of objects are stored, and when planning for a new object, we find the most similar one in the library and use its paths as approximate solutions, adjusting for possible mutual transformations. The configuration space is then sampled along the approximate paths. Our method is tested in various narrow passage scenarios and compared with state-of-the-art methods from the OMPL library. Results show significant speed improvements (up to 85% decrease in the required time) of our method, often finding a solution in cases where the other planners fail. Our implementation of the proposed method is released as an open-source package.
三维实体物体的路径规划是一个具有挑战性的问题,需要在六维构型空间中进行搜索,然而,这在许多机器人应用中是必不可少的,例如拾取和组装。常用的基于抽样的计划,如快速探索随机树,在抽样概率低的狭窄通道中挣扎,增加了找到解决方案所需的时间。在像机器人拾取垃圾箱这样的场景中,不同的物体必须通过相同的环境进行运输。然而,传统的规划者每次都从零开始,失去了在规划过程中获得的宝贵信息。我们通过使用过去解决方案的库来解决这个问题,即使在规划新的,以前未见过的对象时,也可以重用以前的经验。存储一组对象的路径,当规划一个新对象时,我们在库中找到最相似的对象,并使用其路径作为近似解,调整可能的相互转换。然后沿着近似路径对构型空间进行采样。我们的方法在各种狭窄通道场景中进行了测试,并与OMPL库中最先进的方法进行了比较。结果表明,我们的方法显著提高了速度(所需时间减少了85%),通常在其他计划器失败的情况下找到解决方案。我们提出的方法的实现作为一个开源包发布。
{"title":"Enhancing sampling-based planning with a library of paths","authors":"Michal Minařík,&nbsp;Vojtěch Vonásek,&nbsp;Robert Pěnička","doi":"10.1016/j.robot.2026.105334","DOIUrl":"10.1016/j.robot.2026.105334","url":null,"abstract":"<div><div>Path planning for 3D solid objects is a challenging problem, requiring a search in a six-dimensional configuration space, which is, nevertheless, essential in many robotic applications such as bin-picking and assembly. The commonly used sampling-based planners, such as Rapidly-exploring Random Trees, struggle with narrow passages where the sampling probability is low, increasing the time needed to find a solution. In scenarios like robotic bin-picking, various objects must be transported through the same environment. However, traditional planners start from scratch each time, losing valuable information gained during the planning process. We address this by using a library of past solutions, allowing the reuse of previous experiences even when planning for a new, previously unseen object. Paths for a set of objects are stored, and when planning for a new object, we find the most similar one in the library and use its paths as approximate solutions, adjusting for possible mutual transformations. The configuration space is then sampled along the approximate paths. Our method is tested in various narrow passage scenarios and compared with state-of-the-art methods from the OMPL library. Results show significant speed improvements (up to <span><math><mrow><mn>85</mn><mtext>%</mtext></mrow></math></span> decrease in the required time) of our method, often finding a solution in cases where the other planners fail. Our implementation of the proposed method is released as an open-source package.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105334"},"PeriodicalIF":5.2,"publicationDate":"2026-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145940041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reinforcement learning in robotic systems : A review on sim-to-real transfer 机器人系统中的强化学习:模拟到真实迁移研究综述
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2026-01-05 DOI: 10.1016/j.robot.2025.105327
Rajesh Tiwari, Shailesh Khapre, Avantika Singh
Sim-to-real transfer reinforcement learning has become a pivotal approach for narrowing the gap between simulation environments and real-world robotic applications. While reinforcement learning methods achieve remarkable success in simulation, their direct deployment in real environments remains challenging due to the inherent reality gap caused by mismatches in physical dynamics, sensory inputs, and environmental variability. This paper presents a comprehensive review of recent advances in sim-to-real transfer, emphasizing improved simulation fidelity, actuator-level modeling, and domain randomization encompassing both environmental and robotic parameters. A unified framework is proposed that outlines key processes, including simulation model optimization, strategy transfer, and iterative policy refinement across virtual and real domains. The study also discusses emerging developments such as Progressive Neural Networks for policy migration and modern benchmarking platforms. The review concludes with open challenges and future directions, including automated simulator tuning, adaptive domain adaptation, and establishing theoretical guarantees for robust and generalizable transfer learning.
模拟到真实的迁移强化学习已经成为缩小模拟环境和现实世界机器人应用之间差距的关键方法。虽然强化学习方法在模拟中取得了显著的成功,但由于物理动力学、感官输入和环境可变性不匹配导致的固有现实差距,它们在真实环境中的直接部署仍然具有挑战性。本文全面回顾了模拟到真实转移的最新进展,强调了改进的仿真保真度,执行器级建模以及包含环境和机器人参数的域随机化。提出了一个统一的框架,概述了关键过程,包括仿真模型优化、策略转移和跨虚拟和现实领域的迭代策略优化。该研究还讨论了新兴的发展,如用于政策迁移的渐进式神经网络和现代基准平台。最后提出了未来的挑战和发展方向,包括自动模拟器调优、自适应领域适应以及建立鲁棒和可推广迁移学习的理论保证。
{"title":"Reinforcement learning in robotic systems : A review on sim-to-real transfer","authors":"Rajesh Tiwari,&nbsp;Shailesh Khapre,&nbsp;Avantika Singh","doi":"10.1016/j.robot.2025.105327","DOIUrl":"10.1016/j.robot.2025.105327","url":null,"abstract":"<div><div>Sim-to-real transfer reinforcement learning has become a pivotal approach for narrowing the gap between simulation environments and real-world robotic applications. While reinforcement learning methods achieve remarkable success in simulation, their direct deployment in real environments remains challenging due to the inherent reality gap caused by mismatches in physical dynamics, sensory inputs, and environmental variability. This paper presents a comprehensive review of recent advances in sim-to-real transfer, emphasizing improved simulation fidelity, actuator-level modeling, and domain randomization encompassing both environmental and robotic parameters. A unified framework is proposed that outlines key processes, including simulation model optimization, strategy transfer, and iterative policy refinement across virtual and real domains. The study also discusses emerging developments such as Progressive Neural Networks for policy migration and modern benchmarking platforms. The review concludes with open challenges and future directions, including automated simulator tuning, adaptive domain adaptation, and establishing theoretical guarantees for robust and generalizable transfer learning.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105327"},"PeriodicalIF":5.2,"publicationDate":"2026-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145978324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automatic measurement process for hand–eye calibration based on Archimedean solids pose distribution 基于阿基米德固体位姿分布的手眼标定自动测量过程
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2026-01-05 DOI: 10.1016/j.robot.2026.105333
Kaifan Zhong, Nianfeng Wang, Xianmin Zhang
Hand–eye calibration is a vital process for determining an unknown transformation between sensors and a robot end frame before applying robot vision. In addition to optimizing the mathematical solution, refining the pose distribution involved in the calibration can improve the calibration accuracy and efficiency. To optimize the pose distribution, the 3-D position distribution of the tool centre point is designed first, and then the final poses are determined considering the current application scenario. In this paper, an automatic pose generation method is proposed to stably output suitable poses in on-site calibration scenes when an arbitrary 3-D position distribution of the tool centre point is input. Based on this, different pose distributions are discussed regarding their effect on the calibration error, and an indicator is presented to evaluate the performance of these distributions before executing a calibration process. Moreover, a special pose distribution formed by an Archimedean solid is presented, and it shows better performance in improving the hand–eye calibration accuracy and efficiency. Both simulation and on-site experiments are carried out to verify the proposed methods and analyse the effect of different distributions on the calibration results.
在应用机器人视觉之前,手眼标定是确定传感器与机器人端架之间未知变换的关键过程。除了优化数学解外,对标定过程中涉及的位姿分布进行细化,可以提高标定精度和效率。为了优化位姿分布,首先设计了刀具中心点的三维位置分布,然后结合当前应用场景确定了最终位姿。本文提出了一种姿态自动生成方法,当输入任意刀具中心点的三维位置分布时,可在现场标定场景中稳定输出合适的姿态。在此基础上,讨论了不同位姿分布对校准误差的影响,并在执行校准过程之前提出了一个指标来评估这些分布的性能。提出了一种由阿基米德实体构成的特殊位姿分布,在提高手眼标定精度和效率方面表现出较好的效果。通过仿真和现场实验验证了所提出的方法,并分析了不同分布对标定结果的影响。
{"title":"Automatic measurement process for hand–eye calibration based on Archimedean solids pose distribution","authors":"Kaifan Zhong,&nbsp;Nianfeng Wang,&nbsp;Xianmin Zhang","doi":"10.1016/j.robot.2026.105333","DOIUrl":"10.1016/j.robot.2026.105333","url":null,"abstract":"<div><div>Hand–eye calibration is a vital process for determining an unknown transformation between sensors and a robot end frame before applying robot vision. In addition to optimizing the mathematical solution, refining the pose distribution involved in the calibration can improve the calibration accuracy and efficiency. To optimize the pose distribution, the 3-D position distribution of the tool centre point is designed first, and then the final poses are determined considering the current application scenario. In this paper, an automatic pose generation method is proposed to stably output suitable poses in on-site calibration scenes when an arbitrary 3-D position distribution of the tool centre point is input. Based on this, different pose distributions are discussed regarding their effect on the calibration error, and an indicator is presented to evaluate the performance of these distributions before executing a calibration process. Moreover, a special pose distribution formed by an Archimedean solid is presented, and it shows better performance in improving the hand–eye calibration accuracy and efficiency. Both simulation and on-site experiments are carried out to verify the proposed methods and analyse the effect of different distributions on the calibration results.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105333"},"PeriodicalIF":5.2,"publicationDate":"2026-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145940042","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
System identification and model reference adaptive control of bipedal locomotion with neural networks 基于神经网络的双足运动系统辨识与模型参考自适应控制
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2026-01-05 DOI: 10.1016/j.robot.2026.105331
Burak Çatalbaş , Bahadır Çatalbaş , Ömer Morgül
Biped robots have enormous potential to transform our lives with the usability of the infrastructure already prepared for humans, thanks to our morphological similarities. Unfortunately, the realization of this potential requires solutions to inherited difficulties of bipedal locomotion dynamics. Controlling these systems poses challenges due to their high degree of freedom, small support polygon, hybrid dynamics, etc. Nervous system ensures the locomotion of biological counterparts of biped robots. Similarly, artificial neural networks show competence to control bipedal locomotion. Unfortunately, complexity of neural network-based controllers (NNBCs) makes it difficult to adapt them to changes in robot model dynamics. In this paper, we propose a model reference adaptive control algorithm for bipedal locomotion, together with neural networks consisting of recurrent and feedforward layers in the controller and system identification tasks to overcome this drawback. Controller weights are updated via error gradient calculated through system identification neural network to force the controlled system output to desired behavior in an iterative manner. Moreover, we examine the effectiveness of our algorithm in decreasing the speed of steady-state error of neural controllers under different simulated scenarios. It is shown that recurrent and feedforward layers are beneficial for walking control and system identification with neural networks and implementable for real-time applications on various Jetson single-board computers. Results suggest that our method is capable of adapting neural controllers without requiring training from scratch. Under different scenarios, up to 33.6%, 34%, 31.8% in the target speed tracking error decrease is acquired with our algorithm on training, validation, and test sets.
由于我们在形态上的相似性,两足机器人有巨大的潜力来改变我们的生活,利用已经为人类准备好的基础设施。不幸的是,实现这种潜力需要解决两足运动动力学的遗传困难。由于这些系统具有高自由度、小支撑多边形、混合动力学等特点,对其控制提出了挑战。神经系统保证了双足机器人的生物对应物的运动。同样,人工神经网络显示出控制两足运动的能力。然而,基于神经网络的控制器(nnbc)的复杂性使其难以适应机器人模型动力学的变化。在本文中,我们提出了一种模型参考自适应控制算法,并在控制器和系统识别任务中使用由循环层和前馈层组成的神经网络来克服这一缺点。通过系统辨识神经网络计算误差梯度来更新控制器权值,以迭代的方式迫使被控系统输出达到期望行为。此外,我们还检验了该算法在不同仿真场景下降低神经控制器稳态误差速度的有效性。结果表明,循环层和前馈层有利于神经网络的行走控制和系统辨识,并可在各种Jetson单板计算机上实现实时应用。结果表明,我们的方法能够适应神经控制器,而不需要从头开始训练。在不同的场景下,我们的算法在训练集、验证集和测试集上的目标速度跟踪误差分别降低了33.6%、34%和31.8%。
{"title":"System identification and model reference adaptive control of bipedal locomotion with neural networks","authors":"Burak Çatalbaş ,&nbsp;Bahadır Çatalbaş ,&nbsp;Ömer Morgül","doi":"10.1016/j.robot.2026.105331","DOIUrl":"10.1016/j.robot.2026.105331","url":null,"abstract":"<div><div>Biped robots have enormous potential to transform our lives with the usability of the infrastructure already prepared for humans, thanks to our morphological similarities. Unfortunately, the realization of this potential requires solutions to inherited difficulties of bipedal locomotion dynamics. Controlling these systems poses challenges due to their high degree of freedom, small support polygon, hybrid dynamics, etc. Nervous system ensures the locomotion of biological counterparts of biped robots. Similarly, artificial neural networks show competence to control bipedal locomotion. Unfortunately, complexity of neural network-based controllers (NNBCs) makes it difficult to adapt them to changes in robot model dynamics. In this paper, we propose a model reference adaptive control algorithm for bipedal locomotion, together with neural networks consisting of recurrent and feedforward layers in the controller and system identification tasks to overcome this drawback. Controller weights are updated via error gradient calculated through system identification neural network to force the controlled system output to desired behavior in an iterative manner. Moreover, we examine the effectiveness of our algorithm in decreasing the speed of steady-state error of neural controllers under different simulated scenarios. It is shown that recurrent and feedforward layers are beneficial for walking control and system identification with neural networks and implementable for real-time applications on various Jetson single-board computers. Results suggest that our method is capable of adapting neural controllers without requiring training from scratch. Under different scenarios, up to 33.6%, 34%, 31.8% in the target speed tracking error decrease is acquired with our algorithm on training, validation, and test sets.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105331"},"PeriodicalIF":5.2,"publicationDate":"2026-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145978327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Human–robot collaborative control method based on command-weighted fusion strategy for manned legged robot 基于命令加权融合策略的人-机器人协同控制方法
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2026-01-04 DOI: 10.1016/j.robot.2025.105323
Yaojin Fan , Bo You , Jiayu Li , Yufei Liu , Chen Chen , Xiaolei Chen , Liang Ding
This paper proposes a human–robot collaborative control method based on command-weighted fusion strategy for manned legged robot, addressing challenges posed by the complex structure of manned legged robots. These challenges affect both the safety of autonomous decision-making algorithms and the complexity of manual control. First, we design an autonomous command optimization method integrating terrain information and cost functions to enhance decision-making in complex terrains. Subsequently, a method for optimizing driving weighting factors is designed, utilizing a prior mechanism and rule knowledge base, while considering the influence of driver reliability and terrain complexity on driving safety and stability. Through analysis of human-machine driving intentions and the autonomous driving weighting factor, a commands weighted fusion strategy for human-machine commands is devised to achieve rational dynamic allocation of driving weighting and command fusion. Finally, validation through a human–robot collaborative control experiment demonstrates that the proposed control strategy effectively leverages the strengths of both human drivers and intelligent systems, yielding satisfactory control performance.
针对人腿机器人结构复杂的问题,提出了一种基于命令加权融合策略的人-机器人协同控制方法。这些挑战既影响了自主决策算法的安全性,也影响了人工控制的复杂性。首先,设计了一种集成地形信息和成本函数的自主指挥优化方法,以增强复杂地形下的决策能力。随后,在考虑驾驶员可靠性和地形复杂性对驾驶安全稳定性影响的基础上,利用先验机制和规则知识库,设计了一种优化驾驶权重因子的方法。通过对人机驾驶意图和自动驾驶权重因子的分析,设计了人机命令加权融合策略,实现了驾驶权重的合理动态分配和命令融合。最后,通过人机协同控制实验验证,该控制策略有效地利用了人类驾驶员和智能系统的优势,取得了令人满意的控制性能。
{"title":"Human–robot collaborative control method based on command-weighted fusion strategy for manned legged robot","authors":"Yaojin Fan ,&nbsp;Bo You ,&nbsp;Jiayu Li ,&nbsp;Yufei Liu ,&nbsp;Chen Chen ,&nbsp;Xiaolei Chen ,&nbsp;Liang Ding","doi":"10.1016/j.robot.2025.105323","DOIUrl":"10.1016/j.robot.2025.105323","url":null,"abstract":"<div><div>This paper proposes a human–robot collaborative control method based on command-weighted fusion strategy for manned legged robot, addressing challenges posed by the complex structure of manned legged robots. These challenges affect both the safety of autonomous decision-making algorithms and the complexity of manual control. First, we design an autonomous command optimization method integrating terrain information and cost functions to enhance decision-making in complex terrains. Subsequently, a method for optimizing driving weighting factors is designed, utilizing a prior mechanism and rule knowledge base, while considering the influence of driver reliability and terrain complexity on driving safety and stability. Through analysis of human-machine driving intentions and the autonomous driving weighting factor, a commands weighted fusion strategy for human-machine commands is devised to achieve rational dynamic allocation of driving weighting and command fusion. Finally, validation through a human–robot collaborative control experiment demonstrates that the proposed control strategy effectively leverages the strengths of both human drivers and intelligent systems, yielding satisfactory control performance.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105323"},"PeriodicalIF":5.2,"publicationDate":"2026-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145978322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the video quality captured by a surveillance mobile robot 监控移动机器人捕捉到的视频质量
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2026-01-03 DOI: 10.1016/j.robot.2026.105330
Adwaith Vijayakumar , Ishank Juneja , Leena Vachhani
In many robot surveillance applications, the major contributor to the quality degradation of the captured video is the unintended relative motion between the camera and the scene. This unintended motion induces an unintended effect called jitter in the captured video sequence. The evaluation of video quality captured by a mobile robot in surveillance scenarios is often application-specific and is often based on the amount of jitter obtained through feature tracking or camera path reconstruction or intensity patterns obtained across video frames. The contributions in this paper are two folds: development and benchmarking of a novel algorithm for video quality assessment, and jitter-specific recommendations for stabilization approaches. Unlike existing Video Quality Assessment (VQA) scores, the proposed Topology Score (TS) is a non-reference technique that does not involve feature tracking or camera path reconstruction, suitable for mobile robots used for surveillance. We adopt sliding window geometry using persistent homology concept for quantifying the jitter associated with the periodic/quasiperiodic oscillations induced by the moving mobile robots, which in turn gives a VQA score. The experimental results suggest that the trend of the proposed score aligns with the existing rhythm scores that correlate highly with human subjective evaluation, but needs reference video for the assessment. Additionally, we perform a comparative study on various video stabilization algorithms on three categories of robots based on the jitter characteristics: (1) Spherical robot videos with second-order damped oscillations causing low-frequency high-amplitude jitters, (2) Autonomous drone videos with intermittent jitters, and (3) Humanoids mimicked by the casual movements of hand-held video recorder (gait motions have a periodic structure) that contain high-frequency low-amplitude jitters from the recorder’s movement, using the proposed and existing VQA scores. We apply seven different stabilization approaches to the selected robot categories and quantify the tested algorithms’ output quality and resource requirements. Finally, we report the decision matrix based on the robot’s available resources to readily use the state-of-the-art stabilization methods in mobile robot surveillance. Our findings show that the proposed topology score is most suitable for evaluating videos captured by mobile robots in unknown environments due to non-reference assessment associated with periodic/quasiperiodic jitter, and the decision matrix to select a video stabilization algorithm based on the jitter characteristics of mobile robot for the quality improvement of captured video.
在许多机器人监控应用中,导致捕获视频质量下降的主要原因是摄像机和场景之间的意外相对运动。这种意想不到的运动在捕获的视频序列中引起了一种意想不到的效果,称为抖动。对移动机器人在监控场景中捕获的视频质量的评估通常是特定于应用程序的,并且通常基于通过特征跟踪或摄像机路径重建或跨视频帧获得的强度模式获得的抖动量。本文的贡献有两个方面:一种用于视频质量评估的新算法的开发和基准测试,以及针对稳定方法的抖动特定建议。与现有的视频质量评估(VQA)评分不同,本文提出的拓扑评分(TS)是一种不涉及特征跟踪或摄像机路径重建的非参考技术,适用于用于监控的移动机器人。我们采用滑动窗口几何,使用持久同调概念来量化与移动机器人引起的周期/准周期振荡相关的抖动,从而给出VQA分数。实验结果表明,提出的分数趋势与现有的节奏分数一致,与人类的主观评价高度相关,但需要参考视频进行评估。此外,我们根据抖动特性对三类机器人的各种视频稳定算法进行了比较研究:(1)具有二阶阻尼振荡导致低频高振幅抖动的球形机器人视频,(2)具有间歇性抖动的自主无人机视频,以及(3)由手持录像机(步态运动具有周期性结构)的随意运动模仿的类人机器人视频,其中包含来自记录器运动的高频低振幅抖动,使用提出的和现有的VQA分数。我们将七种不同的稳定方法应用于选定的机器人类别,并量化测试算法的输出质量和资源需求。最后,我们报告了基于机器人可用资源的决策矩阵,以便在移动机器人监控中易于使用最先进的稳定方法。研究结果表明,由于非参考评估与周期性/准周期性抖动相关,本文提出的拓扑评分最适合用于评估未知环境下移动机器人捕获的视频,并根据移动机器人的抖动特性选择视频稳定算法的决策矩阵,以提高捕获视频的质量。
{"title":"On the video quality captured by a surveillance mobile robot","authors":"Adwaith Vijayakumar ,&nbsp;Ishank Juneja ,&nbsp;Leena Vachhani","doi":"10.1016/j.robot.2026.105330","DOIUrl":"10.1016/j.robot.2026.105330","url":null,"abstract":"<div><div>In many robot surveillance applications, the major contributor to the quality degradation of the captured video is the unintended relative motion between the camera and the scene. This unintended motion induces an unintended effect called <em>jitter</em> in the captured video sequence. The evaluation of video quality captured by a mobile robot in surveillance scenarios is often application-specific and is often based on the amount of jitter obtained through feature tracking or camera path reconstruction or intensity patterns obtained across video frames. The contributions in this paper are two folds: development and benchmarking of a novel algorithm for video quality assessment, and jitter-specific recommendations for stabilization approaches. Unlike existing Video Quality Assessment (VQA) scores, the proposed Topology Score (TS) is a non-reference technique that does not involve feature tracking or camera path reconstruction, suitable for mobile robots used for surveillance. We adopt sliding window geometry using persistent homology concept for quantifying the jitter associated with the periodic/quasiperiodic oscillations induced by the moving mobile robots, which in turn gives a VQA score. The experimental results suggest that the trend of the proposed score aligns with the existing rhythm scores that correlate highly with human subjective evaluation, but needs reference video for the assessment. Additionally, we perform a comparative study on various video stabilization algorithms on three categories of robots based on the jitter characteristics: (1) Spherical robot videos with second-order damped oscillations causing low-frequency high-amplitude jitters, (2) Autonomous drone videos with intermittent jitters, and (3) Humanoids mimicked by the casual movements of hand-held video recorder (gait motions have a periodic structure) that contain high-frequency low-amplitude jitters from the recorder’s movement, using the proposed and existing VQA scores. We apply seven different stabilization approaches to the selected robot categories and quantify the tested algorithms’ output quality and resource requirements. Finally, we report the decision matrix based on the robot’s available resources to readily use the state-of-the-art stabilization methods in mobile robot surveillance. Our findings show that the proposed topology score is most suitable for evaluating videos captured by mobile robots in unknown environments due to non-reference assessment associated with periodic/quasiperiodic jitter, and the decision matrix to select a video stabilization algorithm based on the jitter characteristics of mobile robot for the quality improvement of captured video.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105330"},"PeriodicalIF":5.2,"publicationDate":"2026-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145885486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reliable Nonsingularity Adaptive fixed-time sliding mode control under input saturation for an uncertain robotic manipulator 不确定机械臂输入饱和下可靠的非奇异自适应定时滑模控制
IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-12-31 DOI: 10.1016/j.robot.2025.105326
Van Tinh Nguyen , Thanh Tung Bui , Hai Yen Pham , Ngoc Thanh Pham , Dang-Khoa Nguyen , Saleh Mobayen
This paper proposes a novel reliable terminal sliding mode control (TSMC) scheme for an uncertain robotic manipulator that is susceptible to parameter uncertainties, external disturbances, and input saturation. The suggested approach guarantees constant time tracking errors and non-singular convergence regardless of initial conditions by combining the classic pole placement technique with a well-designed sliding manifold. Both the unknown nonlinear dynamics and uncertainties are approximated using a radial basis function neural network (RBFNN), and the effects of input saturation are lessened by an appropriate solution. The system states converge to a small neighborhood of the origin in a limited amount of time, according to theoretical analysis based on Lyapunov stability lemmas and constant time stability. Simulation results confirm the superior performance of the proposed approach compared to existing methods, showing better accuracy, reduced chatter, and saved energy. This control strategy offers a practical and effective solution for high-precision path tracking in robotic systems operating in challenging environments.
针对易受参数不确定性、外部干扰和输入饱和影响的不确定机器人,提出了一种可靠的终端滑模控制(TSMC)方案。该方法通过将经典的极点配置技术与设计良好的滑动流形相结合,保证了恒定的时间跟踪误差和非奇异收敛性,而不管初始条件如何。利用径向基函数神经网络(RBFNN)逼近未知的非线性动力学和不确定性,并通过适当的解减小输入饱和的影响。根据李雅普诺夫稳定性引理和常时间稳定性的理论分析,系统状态在有限的时间内收敛到原点的小邻域。仿真结果表明,与现有方法相比,该方法具有更高的精度,减少了颤振,节省了能量。该控制策略为机器人系统在复杂环境下的高精度路径跟踪提供了一种实用有效的解决方案。
{"title":"Reliable Nonsingularity Adaptive fixed-time sliding mode control under input saturation for an uncertain robotic manipulator","authors":"Van Tinh Nguyen ,&nbsp;Thanh Tung Bui ,&nbsp;Hai Yen Pham ,&nbsp;Ngoc Thanh Pham ,&nbsp;Dang-Khoa Nguyen ,&nbsp;Saleh Mobayen","doi":"10.1016/j.robot.2025.105326","DOIUrl":"10.1016/j.robot.2025.105326","url":null,"abstract":"<div><div>This paper proposes a novel reliable terminal sliding mode control (TSMC) scheme for an uncertain robotic manipulator that is susceptible to parameter uncertainties, external disturbances, and input saturation. The suggested approach guarantees constant time tracking errors and non-singular convergence regardless of initial conditions by combining the classic pole placement technique with a well-designed sliding manifold. Both the unknown nonlinear dynamics and uncertainties are approximated using a radial basis function neural network (RBFNN), and the effects of input saturation are lessened by an appropriate solution. The system states converge to a small neighborhood of the origin in a limited amount of time, according to theoretical analysis based on Lyapunov stability lemmas and constant time stability. Simulation results confirm the superior performance of the proposed approach compared to existing methods, showing better accuracy, reduced chatter, and saved energy. This control strategy offers a practical and effective solution for high-precision path tracking in robotic systems operating in challenging environments.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"198 ","pages":"Article 105326"},"PeriodicalIF":5.2,"publicationDate":"2025-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145940045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Robotics and Autonomous Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1