首页 > 最新文献

Robotics and Autonomous Systems最新文献

英文 中文
When and where to step: Terrain-aware real-time footstep location and timing optimization for bipedal robots 何时何地迈步:双足机器人的地形感知实时脚步位置和时间优化
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-06-13 DOI: 10.1016/j.robot.2024.104742
Ke Wang , Zhaoyang Jacopo Hu , Peter Tisnikar , Oskar Helander , Digby Chappell , Petar Kormushev

Online footstep planning is essential for bipedal walking robots, allowing them to walk in the presence of disturbances and sensory noise. Most of the literature on the topic has focused on optimizing the footstep placement while keeping the step timing constant. In this work, we introduce a footstep planner capable of optimizing footstep placement and step time online. The proposed planner, consisting of an Interior Point Optimizer (IPOPT) and an optimizer based on Augmented Lagrangian (AL) method with analytical gradient descent, solves the full dynamics of the Linear Inverted Pendulum (LIP) model in real time to optimize for footstep location as well as step timing at the rate of 200 Hz. We show that such asynchronous real-time optimization with the AL method (ARTO-AL) provides the required robustness and speed for successful online footstep planning. Furthermore, ARTO-AL can be extended to plan footsteps in 3D, allowing terrain-aware footstep planning on uneven terrains. Compared to an algorithm with no footstep time adaptation, our proposed ARTO-AL demonstrates increased stability in simulated walking experiments as it can resist pushes on flat ground and on a 10° ramp up to 120 N and 100 N respectively. Videos2 and open-source code3 are released.

在线脚步规划对于双足行走机器人来说至关重要,它使机器人能够在干扰和感知噪声的情况下行走。有关该主题的大部分文献都侧重于优化脚步位置,同时保持步进时间不变。在这项工作中,我们介绍了一种能够在线优化脚步位置和步进时间的脚步规划器。所提出的规划器由一个内部点优化器(IPOPT)和一个基于分析梯度下降的增强拉格朗日(AL)方法的优化器组成,实时求解线性倒立摆(LIP)模型的全部动力学,以 200 Hz 的速率优化脚步位置和步进时间。我们的研究表明,AL 方法(ARTO-AL)的这种异步实时优化为成功的在线脚步规划提供了所需的鲁棒性和速度。此外,ARTO-AL 还可以扩展到三维脚步规划,从而在不平坦的地形上实现地形感知脚步规划。与没有脚步时间自适应的算法相比,我们提出的 ARTO-AL 在模拟行走实验中表现出更高的稳定性,因为它可以在平地上和 10° 斜坡上分别抵抗高达 120 N 和 100 N 的推力。视频2和开源代码3已发布。
{"title":"When and where to step: Terrain-aware real-time footstep location and timing optimization for bipedal robots","authors":"Ke Wang ,&nbsp;Zhaoyang Jacopo Hu ,&nbsp;Peter Tisnikar ,&nbsp;Oskar Helander ,&nbsp;Digby Chappell ,&nbsp;Petar Kormushev","doi":"10.1016/j.robot.2024.104742","DOIUrl":"https://doi.org/10.1016/j.robot.2024.104742","url":null,"abstract":"<div><p>Online footstep planning is essential for bipedal walking robots, allowing them to walk in the presence of disturbances and sensory noise. Most of the literature on the topic has focused on optimizing the footstep placement while keeping the step timing constant. In this work, we introduce a footstep planner capable of optimizing footstep placement and step time online. The proposed planner, consisting of an Interior Point Optimizer (IPOPT) and an optimizer based on Augmented Lagrangian (AL) method with analytical gradient descent, solves the full dynamics of the Linear Inverted Pendulum (LIP) model in real time to optimize for footstep location as well as step timing at the rate of 200 Hz. We show that such asynchronous real-time optimization with the AL method (ARTO-AL) provides the required robustness and speed for successful online footstep planning. Furthermore, ARTO-AL can be extended to plan footsteps in 3D, allowing terrain-aware footstep planning on uneven terrains. Compared to an algorithm with no footstep time adaptation, our proposed ARTO-AL demonstrates increased stability in simulated walking experiments as it can resist pushes on flat ground and on a <span><math><mrow><mn>10</mn><mo>°</mo></mrow></math></span> ramp up to 120 N and 100 N respectively. Videos<span><sup>2</sup></span> and open-source code<span><sup>3</sup></span> are released.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S092188902400126X/pdfft?md5=599882b40704d445bb509be303dd3163&pid=1-s2.0-S092188902400126X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141434213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
UAV path planning algorithm based on Deep Q-Learning to search for a floating lost target in the ocean 基于深度 Q-Learning 的无人机路径规划算法,用于搜索海洋中的漂浮迷失目标
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-06-07 DOI: 10.1016/j.robot.2024.104730
Mehrez Boulares, Afef Fehri, Mohamed Jemni

In the context of real world application, Search and Rescue Missions on the ocean surface remain a complex task due to the large-scale area and the forces of the ocean currents, spreading lost targets and debris in an unpredictable way. In this work, we present a Path Planning Approach to search for a lost target on ocean surface using a swarm of UAVs. The combination of GlobCurrent dataset and a Lagrangian simulator is used to determine where the particles are moved by the ocean currents forces while Deep Q-learning algorithm is applied to learn from their dynamics. The evaluation results of the trained models show that our search strategy is effective and efficient. Over a total search area (red Sea zone), surface of 453422 Km2, we have shown that our strategy Search Success Rate is 98.61%, the maximum Search Time to detection is 15 days and the average Search Time to detection is almost 15 h.

在现实应用中,海面搜救任务仍然是一项复杂的任务,因为海面面积大,洋流的作用力大,丢失的目标和碎片会以不可预测的方式扩散。在这项工作中,我们提出了一种利用无人机群在海面上搜索迷失目标的路径规划方法。我们结合 GlobCurrent 数据集和拉格朗日模拟器来确定粒子在洋流作用下的移动位置,同时采用深度 Q-learning 算法来学习粒子的动态。训练模型的评估结果表明,我们的搜索策略是有效和高效的。在总搜索面积(红海区)453422 平方公里的海面上,我们的策略搜索成功率为 98.61%,最大搜索检测时间为 15 天,平均搜索检测时间接近 15 小时。
{"title":"UAV path planning algorithm based on Deep Q-Learning to search for a floating lost target in the ocean","authors":"Mehrez Boulares,&nbsp;Afef Fehri,&nbsp;Mohamed Jemni","doi":"10.1016/j.robot.2024.104730","DOIUrl":"10.1016/j.robot.2024.104730","url":null,"abstract":"<div><p>In the context of real world application, Search and Rescue Missions on the ocean surface remain a complex task due to the large-scale area and the forces of the ocean currents, spreading lost targets and debris in an unpredictable way. In this work, we present a Path Planning Approach to search for a lost target on ocean surface using a swarm of UAVs. The combination of GlobCurrent dataset and a Lagrangian simulator is used to determine where the particles are moved by the ocean currents forces while Deep Q-learning algorithm is applied to learn from their dynamics. The evaluation results of the trained models show that our search strategy is effective and efficient. Over a total search area (red Sea zone), surface of 453422 Km<span><math><msup><mrow></mrow><mrow><mn>2</mn></mrow></msup></math></span>, we have shown that our strategy Search Success Rate is 98.61%, the maximum Search Time to detection is 15 days and the average Search Time to detection is almost 15 h.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141399395","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
H-SLAM: Hybrid direct–indirect visual SLAM H-SLAM:混合直接-间接视觉 SLAM
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-06-06 DOI: 10.1016/j.robot.2024.104729
Georges Younes , Douaa Khalil , John Zelek , Daniel Asmar

The recent success of hybrid methods in monocular odometry has led to many attempts to generalize the performance gains to hybrid monocular SLAM. However, most attempts fall short in several respects, with the most prominent issue being the need for two different map representations (local and global maps), with each requiring different, computationally expensive, and often redundant processes to maintain. Moreover, these maps tend to drift with respect to each other, resulting in contradicting pose and scene estimates, and leading to catastrophic failure. In this paper, we propose a novel approach that makes use of descriptor sharing to generate a single inverse depth scene representation. This representation can be used locally, queried globally to perform loop closure, and has the ability to re-activate previously observed map points after redundant points are marginalized from the local map, eliminating the need for separate map maintenance processes. The maps generated by our method exhibit no drift between each other, and can be computed at a fraction of the computational cost and memory footprint required by other monocular SLAM systems. Despite the reduced resource requirements, the proposed approach maintains its robustness and accuracy, delivering performance comparable to state-of-the-art SLAM methods (e.g., LDSO, ORB-SLAM3) on the majority of sequences from well-known datasets like EuRoC, KITTI, and TUM VI. The source code is available at: https://github.com/AUBVRL/fslam_ros_docker.

最近,混合方法在单目测距中取得了成功,因此很多人试图将其性能提升推广到混合单目SLAM中。然而,大多数尝试在几个方面都存在不足,其中最突出的问题是需要两种不同的地图表示(局部地图和全局地图),而每种地图都需要不同的、计算成本高昂且往往是多余的过程来维护。此外,这些地图往往会相互漂移,导致姿态和场景估计相互矛盾,从而导致灾难性故障。在本文中,我们提出了一种利用描述符共享生成单一反深度场景表示的新方法。这种表示法可在本地使用,也可在全局范围内查询以执行循环闭合,并能在本地地图中的冗余点被边缘化后重新激活先前观察到的地图点,从而无需单独的地图维护流程。我们的方法生成的地图不会相互漂移,而且计算成本和内存占用仅为其他单目 SLAM 系统的一小部分。尽管对资源的要求降低了,但所提出的方法仍保持了其鲁棒性和准确性,在 EuRoC、KITTI 和 TUM VI 等著名数据集的大多数序列上,其性能可与最先进的 SLAM 方法(如 LDSO、ORB-SLAM3)相媲美。源代码可在以下网址获取:https://github.com/AUBVRL/fslam_ros_docker。
{"title":"H-SLAM: Hybrid direct–indirect visual SLAM","authors":"Georges Younes ,&nbsp;Douaa Khalil ,&nbsp;John Zelek ,&nbsp;Daniel Asmar","doi":"10.1016/j.robot.2024.104729","DOIUrl":"https://doi.org/10.1016/j.robot.2024.104729","url":null,"abstract":"<div><p>The recent success of hybrid methods in monocular odometry has led to many attempts to generalize the performance gains to hybrid monocular SLAM. However, most attempts fall short in several respects, with the most prominent issue being the need for two different map representations (local and global maps), with each requiring different, computationally expensive, and often redundant processes to maintain. Moreover, these maps tend to drift with respect to each other, resulting in contradicting pose and scene estimates, and leading to catastrophic failure. In this paper, we propose a novel approach that makes use of descriptor sharing to generate a single inverse depth scene representation. This representation can be used locally, queried globally to perform loop closure, and has the ability to re-activate previously observed map points after redundant points are marginalized from the local map, eliminating the need for separate map maintenance processes. The maps generated by our method exhibit no drift between each other, and can be computed at a fraction of the computational cost and memory footprint required by other monocular SLAM systems. Despite the reduced resource requirements, the proposed approach maintains its robustness and accuracy, delivering performance comparable to state-of-the-art SLAM methods (<em>e.g</em>., LDSO, ORB-SLAM3) on the majority of sequences from well-known datasets like EuRoC, KITTI, and TUM VI. The source code is available at: <span>https://github.com/AUBVRL/fslam_ros_docker</span><svg><path></path></svg>.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141313653","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Corrigendum to “ICACIA: An Intelligent Context-Aware framework for COBOT in defense industry using ontological and deep learning models” [Robotics and Autonomous Systems Volume 157, November 2022, 104234] ICACIA:使用本体论和深度学习模型的国防工业 COBOT 智能情境感知框架"[《机器人与自主系统》第 157 卷,2022 年 11 月,104234] 的更正
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-06-04 DOI: 10.1016/j.robot.2024.104726
Arodh Lal Karn , Sudhakar Sengan , Ketan Kotecha , Irina V Pustokhina , Denis A Pustokhin , V Subramaniyaswamy , Dharam Buddhi
{"title":"Corrigendum to “ICACIA: An Intelligent Context-Aware framework for COBOT in defense industry using ontological and deep learning models” [Robotics and Autonomous Systems Volume 157, November 2022, 104234]","authors":"Arodh Lal Karn ,&nbsp;Sudhakar Sengan ,&nbsp;Ketan Kotecha ,&nbsp;Irina V Pustokhina ,&nbsp;Denis A Pustokhin ,&nbsp;V Subramaniyaswamy ,&nbsp;Dharam Buddhi","doi":"10.1016/j.robot.2024.104726","DOIUrl":"https://doi.org/10.1016/j.robot.2024.104726","url":null,"abstract":"","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0921889024001106/pdfft?md5=2ac8751b4f87547e5795f759d0dd0b6b&pid=1-s2.0-S0921889024001106-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141244851","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Learning-based methods for adaptive informative path planning 基于学习的自适应信息路径规划方法
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-06-04 DOI: 10.1016/j.robot.2024.104727
Marija Popović , Joshua Ott , Julius Rückin , Mykel J. Kochenderfer

Adaptive informative path planning (AIPP) is important to many robotics applications, enabling mobile robots to efficiently collect useful data about initially unknown environments. In addition, learning-based methods are increasingly used in robotics to enhance adaptability, versatility, and robustness across diverse and complex tasks. Our survey explores research on applying robotic learning to AIPP, bridging the gap between these two research fields. We begin by providing a unified mathematical problem definition for general AIPP problems. Next, we establish two complementary taxonomies of current work from the perspectives of (i) learning algorithms and (ii) robotic applications. We explore synergies, recent trends, and highlight the benefits of learning-based methods in AIPP frameworks. Finally, we discuss key challenges and promising future directions to enable more generally applicable and robust robotic data-gathering systems through learning. We provide a comprehensive catalog of papers reviewed in our survey, including publicly available repositories, to facilitate future studies in the field.

自适应信息路径规划(AIPP)对许多机器人应用都很重要,它能让移动机器人有效地收集最初未知环境的有用数据。此外,基于学习的方法也越来越多地应用于机器人领域,以增强机器人在各种复杂任务中的适应性、多功能性和鲁棒性。我们的调查探讨了将机器人学习应用于 AIPP 的研究,弥合了这两个研究领域之间的差距。首先,我们为一般 AIPP 问题提供了统一的数学问题定义。接下来,我们从 (i) 学习算法和 (ii) 机器人应用的角度,为当前工作建立了两个互补的分类法。我们探讨了 AIPP 框架中基于学习的方法的协同作用、最新趋势和优势。最后,我们讨论了通过学习实现更普遍适用、更强大的机器人数据采集系统所面临的主要挑战和未来的发展方向。我们提供了一份综合目录,收录了在我们的调查中审查过的论文,包括可公开获取的资料库,以促进该领域的未来研究。
{"title":"Learning-based methods for adaptive informative path planning","authors":"Marija Popović ,&nbsp;Joshua Ott ,&nbsp;Julius Rückin ,&nbsp;Mykel J. Kochenderfer","doi":"10.1016/j.robot.2024.104727","DOIUrl":"10.1016/j.robot.2024.104727","url":null,"abstract":"<div><p>Adaptive informative path planning (AIPP) is important to many robotics applications, enabling mobile robots to efficiently collect useful data about initially unknown environments. In addition, learning-based methods are increasingly used in robotics to enhance adaptability, versatility, and robustness across diverse and complex tasks. Our survey explores research on applying robotic learning to AIPP, bridging the gap between these two research fields. We begin by providing a unified mathematical problem definition for general AIPP problems. Next, we establish two complementary taxonomies of current work from the perspectives of (i) learning algorithms and (ii) robotic applications. We explore synergies, recent trends, and highlight the benefits of learning-based methods in AIPP frameworks. Finally, we discuss key challenges and promising future directions to enable more generally applicable and robust robotic data-gathering systems through learning. We provide a comprehensive catalog of papers reviewed in our survey, including publicly available repositories, to facilitate future studies in the field.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0921889024001118/pdfft?md5=28de4de4b6cc186bd0057d379cd895ba&pid=1-s2.0-S0921889024001118-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141279580","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Suppressing violent sloshing flow in food serving robots 抑制上菜机器人的剧烈晃动流
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-05-29 DOI: 10.1016/j.robot.2024.104728
Jinsuk Choi , Wookyong Kwon , Kwanwoong Yoon , Seongwon Yoon , Young Sam Lee , Soo Jeon , Soohee Han

This article presents the self-balancing slosh-free control (SBSFC) scheme, a notable advancement for stable navigation in food-serving robots. The uniqueness of SBSFC is that it does not require direct modeling of slosh dynamics. Utilizing just two inertial measurement units (IMUs), the proposed scheme offers an online solution, obviating the need for complex dynamics or high-cost supplementary systems. Central to this work is the design of a control strategy favorable for sloshing suppression, achieved through feedforward reference shaping and disturbance compensation. This means the SBSFC indirectly alleviates and compensates for sloshing effects, rather than directly controlling them as a state variable by relying on pixel-based measurements of sloshing. Key contributions include rapid slosh damping via reference shaping, robust posture stabilization through optimal control, and enhanced disturbance handling with a disturbance observer. These strategies synergistically ensure immediate vibration reduction and long-term stability under real-world conditions. This study is expected to lead to a significant leap forward in commercial food-serving robotics.

本文介绍了自平衡无湍流控制(SBSFC)方案,这是食品服务机器人稳定导航的一项显著进步。SBSFC 的独特之处在于它不需要对荡流动力学进行直接建模。只需利用两个惯性测量单元(IMU),该方案就能提供在线解决方案,无需复杂的动力学或高成本的辅助系统。这项工作的核心是设计一种有利于抑制荡流的控制策略,通过前馈参考整形和干扰补偿来实现。这意味着 SBSFC 可以间接缓解和补偿荡流效应,而不是依靠基于像素的荡流测量来直接将其作为状态变量进行控制。SBSFC 的主要贡献包括:通过参考塑形快速抑制荡流、通过优化控制实现稳健的姿态稳定,以及通过扰动观测器增强扰动处理能力。这些策略协同作用,可确保在实际条件下立即减少振动并保持长期稳定。这项研究有望为商用食品供应机器人技术带来重大飞跃。
{"title":"Suppressing violent sloshing flow in food serving robots","authors":"Jinsuk Choi ,&nbsp;Wookyong Kwon ,&nbsp;Kwanwoong Yoon ,&nbsp;Seongwon Yoon ,&nbsp;Young Sam Lee ,&nbsp;Soo Jeon ,&nbsp;Soohee Han","doi":"10.1016/j.robot.2024.104728","DOIUrl":"https://doi.org/10.1016/j.robot.2024.104728","url":null,"abstract":"<div><p>This article presents the self-balancing slosh-free control (SBSFC) scheme, a notable advancement for stable navigation in food-serving robots. The uniqueness of SBSFC is that it does not require direct modeling of slosh dynamics. Utilizing just two inertial measurement units (IMUs), the proposed scheme offers an online solution, obviating the need for complex dynamics or high-cost supplementary systems. Central to this work is the design of a control strategy favorable for sloshing suppression, achieved through feedforward reference shaping and disturbance compensation. This means the SBSFC indirectly alleviates and compensates for sloshing effects, rather than directly controlling them as a state variable by relying on pixel-based measurements of sloshing. Key contributions include rapid slosh damping via reference shaping, robust posture stabilization through optimal control, and enhanced disturbance handling with a disturbance observer. These strategies synergistically ensure immediate vibration reduction and long-term stability under real-world conditions. This study is expected to lead to a significant leap forward in commercial food-serving robotics.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141286342","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing human–robot collaborative transportation through obstacle-aware vibrotactile warning and virtual fixtures 通过障碍物感知振动触觉预警和虚拟装置加强人与机器人的协作运输
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-05-23 DOI: 10.1016/j.robot.2024.104725
Doganay Sirintuna , Theodora Kastritsi , Idil Ozdamar , Juan M. Gandarias , Arash Ajoudani

Transporting large and heavy objects can benefit from Human–Robot Collaboration (HRC), increasing the contribution of robots to our daily tasks and addressing challenges arising from labor shortages. This strategy typically positions the human collaborator as the leader, with the robot assuming the follower role. However, when transporting large objects, the operator’s situational awareness can be compromised as the objects may occlude different parts of the environment, weakening the human leader’s decision-making capacity and leading to failure due to collision. This paper proposes a situational awareness framework for collaborative transportation to face this challenge. The framework integrates a multi-modal haptic-based Obstacle Feedback Module with two units. The first unit consists of a warning module that alerts the operator through a haptic belt with four vibrotactile devices that provide feedback about the location and proximity of the obstacles. The second unit implements virtual fixtures as hard constraints for mobility. The warning feedback and the virtual fixtures act online based on the information given by two Lidars mounted on a mobile manipulator to detect the obstacles in the surroundings. By enhancing the operator’s awareness of the environment, the proposed module improves the safety of the human–robot team in collaborative transportation scenarios by preventing collisions. Experiments with 16 non-expert subjects in four feedback modalities during four scenarios report an objective evaluation thanks to quantitative metrics and subjective evaluations based on user-level experiences. The results reveal the strengths and weaknesses of the implemented feedback modalities while providing solid evidence of the increased situational awareness of the operator when the two haptic units are employed.

人机协作 (HRC) 可以帮助运输大型和重型物体,增加机器人对日常工作的贡献,并应对劳动力短缺带来的挑战。这种策略通常将人类合作者定位为领导者,而机器人则扮演跟随者的角色。然而,在运输大型物体时,操作员的态势感知能力可能会受到影响,因为物体可能会遮挡环境的不同部分,从而削弱人类领导者的决策能力,导致因碰撞而失败。面对这一挑战,本文提出了协同运输的态势感知框架。该框架将基于多模式触觉的障碍物反馈模块与两个单元集成在一起。第一个单元包括一个警告模块,通过触觉带和四个振动触觉装置向操作员发出警告,这些装置可提供有关障碍物位置和距离的反馈。第二个单元采用虚拟固定装置作为移动的硬约束。警告反馈和虚拟固定装置根据安装在移动机械手上的两个激光雷达提供的信息进行在线操作,以探测周围的障碍物。通过提高操作员对环境的感知能力,所提出的模块可以防止碰撞,从而提高协作运输场景中人与机器人团队的安全性。在四个场景中使用四种反馈模式对 16 名非专业受试者进行的实验报告了量化指标的客观评价和基于用户体验的主观评价。实验结果揭示了所采用的反馈模式的优缺点,同时也为操作员在使用两种触觉装置时提高态势感知能力提供了确凿证据。
{"title":"Enhancing human–robot collaborative transportation through obstacle-aware vibrotactile warning and virtual fixtures","authors":"Doganay Sirintuna ,&nbsp;Theodora Kastritsi ,&nbsp;Idil Ozdamar ,&nbsp;Juan M. Gandarias ,&nbsp;Arash Ajoudani","doi":"10.1016/j.robot.2024.104725","DOIUrl":"10.1016/j.robot.2024.104725","url":null,"abstract":"<div><p>Transporting large and heavy objects can benefit from Human–Robot Collaboration (HRC), increasing the contribution of robots to our daily tasks and addressing challenges arising from labor shortages. This strategy typically positions the human collaborator as the leader, with the robot assuming the follower role. However, when transporting large objects, the operator’s situational awareness can be compromised as the objects may occlude different parts of the environment, weakening the human leader’s decision-making capacity and leading to failure due to collision. This paper proposes a situational awareness framework for collaborative transportation to face this challenge. The framework integrates a multi-modal haptic-based Obstacle Feedback Module with two units. The first unit consists of a warning module that alerts the operator through a haptic belt with four vibrotactile devices that provide feedback about the location and proximity of the obstacles. The second unit implements virtual fixtures as hard constraints for mobility. The warning feedback and the virtual fixtures act online based on the information given by two Lidars mounted on a mobile manipulator to detect the obstacles in the surroundings. By enhancing the operator’s awareness of the environment, the proposed module improves the safety of the human–robot team in collaborative transportation scenarios by preventing collisions. Experiments with 16 non-expert subjects in four feedback modalities during four scenarios report an objective evaluation thanks to quantitative metrics and subjective evaluations based on user-level experiences. The results reveal the strengths and weaknesses of the implemented feedback modalities while providing solid evidence of the increased situational awareness of the operator when the two haptic units are employed.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0921889024001088/pdfft?md5=e83bacf7a309029949012e8f8a6e240a&pid=1-s2.0-S0921889024001088-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141140168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Long-term navigation for autonomous robots based on spatio-temporal map prediction 基于时空地图预测的自主机器人长期导航
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-05-22 DOI: 10.1016/j.robot.2024.104724
Yanbo Wang, Yaxian Fan, Jingchuan Wang, Weidong Chen

The robotics community has witnessed a growing demand for long-term navigation of autonomous robots in diverse environments, including factories, homes, offices, and public places. The core challenge in long-term navigation for autonomous robots lies in effectively adapting to varying degrees of dynamism in the environment. In this paper, we propose a long-term navigation method for autonomous robots based on spatio-temporal map prediction. The time series model is introduced to learn the changing patterns of different environmental structures or objects on multiple time scales based on the historical maps and forecast the future maps for long-term navigation. Then, an improved global path planning algorithm is performed based on the time-variant predicted cost maps. During navigation, the current observations are fused with the predicted map through a modified Bayesian filter to reduce the impact of prediction errors, and the updated map is stored for future predictions. We run simulation and conduct several weeks of experiments in multiple scenarios. The results show that our algorithm is effective and robust for long-term navigation in dynamic environments.

机器人界对自主机器人在工厂、家庭、办公室和公共场所等各种环境中长期导航的需求日益增长。自主机器人长期导航的核心挑战在于如何有效地适应环境中不同程度的动态变化。本文提出了一种基于时空地图预测的自主机器人长期导航方法。本文引入了时间序列模型,以历史地图为基础,学习不同环境结构或物体在多个时间尺度上的变化规律,并预测未来地图,从而实现长期导航。然后,根据时变预测成本地图执行改进的全局路径规划算法。在导航过程中,通过改进的贝叶斯滤波器将当前观测数据与预测地图融合,以减少预测误差的影响,并将更新后的地图存储起来,用于未来预测。我们进行了仿真,并在多个场景中进行了数周的实验。结果表明,我们的算法对于动态环境中的长期导航是有效和稳健的。
{"title":"Long-term navigation for autonomous robots based on spatio-temporal map prediction","authors":"Yanbo Wang,&nbsp;Yaxian Fan,&nbsp;Jingchuan Wang,&nbsp;Weidong Chen","doi":"10.1016/j.robot.2024.104724","DOIUrl":"10.1016/j.robot.2024.104724","url":null,"abstract":"<div><p>The robotics community has witnessed a growing demand for long-term navigation of autonomous robots in diverse environments, including factories, homes, offices, and public places. The core challenge in long-term navigation for autonomous robots lies in effectively adapting to varying degrees of dynamism in the environment. In this paper, we propose a long-term navigation method for autonomous robots based on spatio-temporal map prediction. The time series model is introduced to learn the changing patterns of different environmental structures or objects on multiple time scales based on the historical maps and forecast the future maps for long-term navigation. Then, an improved global path planning algorithm is performed based on the time-variant predicted cost maps. During navigation, the current observations are fused with the predicted map through a modified Bayesian filter to reduce the impact of prediction errors, and the updated map is stored for future predictions. We run simulation and conduct several weeks of experiments in multiple scenarios. The results show that our algorithm is effective and robust for long-term navigation in dynamic environments.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141142091","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
“Reinforcement learning particle swarm optimization based trajectory planning of autonomous ground vehicle using 2D LiDAR point cloud” "基于强化学习的粒子群优化,利用二维激光雷达点云进行自主地面飞行器轨迹规划"
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-05-21 DOI: 10.1016/j.robot.2024.104723
Ambuj, Harsh Nagar, Ayan Paul, Rajendra Machavaram, Peeyush Soni

The advent of autonomous mobile robots has spurred research into efficient trajectory planning methods, particularly in dynamic environments with varied obstacles. This study focuses on optimizing trajectory planning for an Autonomous Ground Vehicle (AGV) using a novel Reinforcement Learning Particle Swarm Optimization (RLPSO) algorithm. Real-time mobile robot localization and map generation are introduced through the utilization of the Hector-SLAM algorithm within the Robot Operating System (ROS) platform, resulting in the creation of a binary occupancy grid. The present research thoroughly investigates the performance of the RLPSO algorithm, juxtaposed against five established Particle Swarm Optimization (PSO) variants, within the context of four distinct physical environments. The experimental design is tailored to emulate real-world scenarios, encompassing a spectrum of challenges posed by static and dynamic obstacles. The AGV, equipped with LiDAR sensors, navigates through diverse environments characterized by obstacles of different geometries. The RLPSO algorithm dynamically adapts its strategies based on feedback, enabling adaptable trajectory planning while effectively avoiding obstacles. Numerical results obtained from extensive experimentation highlight the algorithm's efficacy. The navigational model's validation is achieved within a MATLAB 2D virtual environment, employing 2D Lidar mapping point data. Transitioning to physical experiments with an AGV, RLPSO continues to demonstrate superior performance, showcasing its potential for real-world applications in autonomous navigation. On average, RLPSO achieves a 10–15 % reduction in path distances and traversal time compared to the following best-performing PSO variant across diverse scenarios. The adaptive nature of RLPSO, informed by feedback from the environment, distinguishes it as a promising solution for autonomous navigation in dynamic settings, with implications for practical implementation in real-world scenarios.

自主移动机器人的出现促进了对高效轨迹规划方法的研究,尤其是在存在各种障碍物的动态环境中。本研究的重点是利用新颖的强化学习粒子群优化(RLPSO)算法优化自主地面车辆(AGV)的轨迹规划。通过在机器人操作系统(ROS)平台中使用 Hector-SLAM 算法,引入了实时移动机器人定位和地图生成功能,从而创建了一个二元占位网格。本研究深入探讨了 RLPSO 算法的性能,并在四种不同的物理环境中将其与五种成熟的粒子群优化(PSO)变体进行对比。实验设计旨在模拟真实世界的场景,包括静态和动态障碍物带来的一系列挑战。配备了激光雷达传感器的 AGV 在不同几何形状的障碍物构成的各种环境中航行。RLPSO 算法可根据反馈动态调整策略,从而在有效避开障碍物的同时,实现适应性轨迹规划。大量实验得出的数值结果凸显了该算法的功效。利用二维激光雷达测绘点数据,在 MATLAB 二维虚拟环境中对导航模型进行了验证。在使用 AGV 进行物理实验时,RLPSO 继续表现出卓越的性能,展示了其在实际自主导航应用中的潜力。在不同的场景中,与性能最佳的 PSO 变体相比,RLPSO 的路径距离和穿越时间平均缩短了 10-15%。RLPSO 的自适应特性,以及来自环境的反馈信息,使其成为在动态环境中进行自主导航的一种有前途的解决方案,并对在现实世界中的实际应用产生了影响。
{"title":"“Reinforcement learning particle swarm optimization based trajectory planning of autonomous ground vehicle using 2D LiDAR point cloud”","authors":"Ambuj,&nbsp;Harsh Nagar,&nbsp;Ayan Paul,&nbsp;Rajendra Machavaram,&nbsp;Peeyush Soni","doi":"10.1016/j.robot.2024.104723","DOIUrl":"10.1016/j.robot.2024.104723","url":null,"abstract":"<div><p>The advent of autonomous mobile robots has spurred research into efficient trajectory planning methods, particularly in dynamic environments with varied obstacles. This study focuses on optimizing trajectory planning for an Autonomous Ground Vehicle (AGV) using a novel Reinforcement Learning Particle Swarm Optimization (RLPSO) algorithm. Real-time mobile robot localization and map generation are introduced through the utilization of the Hector-SLAM algorithm within the Robot Operating System (ROS) platform, resulting in the creation of a binary occupancy grid. The present research thoroughly investigates the performance of the RLPSO algorithm, juxtaposed against five established Particle Swarm Optimization (PSO) variants, within the context of four distinct physical environments. The experimental design is tailored to emulate real-world scenarios, encompassing a spectrum of challenges posed by static and dynamic obstacles. The AGV, equipped with LiDAR sensors, navigates through diverse environments characterized by obstacles of different geometries. The RLPSO algorithm dynamically adapts its strategies based on feedback, enabling adaptable trajectory planning while effectively avoiding obstacles. Numerical results obtained from extensive experimentation highlight the algorithm's efficacy. The navigational model's validation is achieved within a MATLAB 2D virtual environment, employing 2D Lidar mapping point data. Transitioning to physical experiments with an AGV, RLPSO continues to demonstrate superior performance, showcasing its potential for real-world applications in autonomous navigation. On average, RLPSO achieves a 10–15 % reduction in path distances and traversal time compared to the following best-performing PSO variant across diverse scenarios. The adaptive nature of RLPSO, informed by feedback from the environment, distinguishes it as a promising solution for autonomous navigation in dynamic settings, with implications for practical implementation in real-world scenarios.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141143407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A distributed multi-robot task allocation method for time-constrained dynamic collective transport 用于时间受限动态集体运输的分布式多机器人任务分配方法
IF 4.3 2区 计算机科学 Q1 Mathematics Pub Date : 2024-05-21 DOI: 10.1016/j.robot.2024.104722
Xiaotao Shan, Yichao Jin, Marius Jurt, Peizheng Li

Recent studies in warehouse logistics have highlighted the importance of multi-robot collaboration in collective transport scenarios, where multiple robots work together to lift and transport bulky and heavy items. However, limited attention has been given to task allocation in such scenarios, particularly when dealing with continuously arriving tasks and time constraints. In this paper, we propose a decentralized auction-based method to address this challenge. Our approach involves robots predicting the task choices of their peers, estimating the values and partnerships associated with multi-robot tasks, and ultimately determining their task choices and collaboration partners through an auction process. A unique “suggestion” mechanism is introduced to the auction process to mitigate the decision bias caused by the leader–follower mode inherent in typical auction-based methods. Additionally, an available time update mechanism is designed to prevent the accumulation of schedule deviations during the robots’ operation process. Through extensive simulations, we demonstrate the superior performance and computational efficiency of the proposed algorithm compared to both the Agent-Based Sequential Greedy Algorithm and the Consensus-Based Time Table Algorithm, in both dynamic and static scenarios.

最近对仓储物流的研究强调了多机器人协作在集体运输场景中的重要性,在这种场景中,多个机器人共同抬起和运输大件和重物。然而,人们对此类场景中的任务分配关注有限,尤其是在处理连续到达的任务和时间限制时。在本文中,我们提出了一种基于分散拍卖的方法来应对这一挑战。我们的方法涉及机器人预测同伴的任务选择、估算与多机器人任务相关的价值和合作关系,并最终通过拍卖过程确定自己的任务选择和合作伙伴。拍卖过程中引入了一种独特的 "建议 "机制,以减轻典型拍卖方法中固有的领导者-追随者模式造成的决策偏差。此外,我们还设计了一种可用时间更新机制,以防止机器人运行过程中计划偏差的累积。通过大量仿真,我们证明了在动态和静态场景下,与基于代理的顺序贪婪算法和基于共识的时间表算法相比,所提出的算法具有更优越的性能和计算效率。
{"title":"A distributed multi-robot task allocation method for time-constrained dynamic collective transport","authors":"Xiaotao Shan,&nbsp;Yichao Jin,&nbsp;Marius Jurt,&nbsp;Peizheng Li","doi":"10.1016/j.robot.2024.104722","DOIUrl":"10.1016/j.robot.2024.104722","url":null,"abstract":"<div><p>Recent studies in warehouse logistics have highlighted the importance of multi-robot collaboration in collective transport scenarios, where multiple robots work together to lift and transport bulky and heavy items. However, limited attention has been given to task allocation in such scenarios, particularly when dealing with continuously arriving tasks and time constraints. In this paper, we propose a decentralized auction-based method to address this challenge. Our approach involves robots predicting the task choices of their peers, estimating the values and partnerships associated with multi-robot tasks, and ultimately determining their task choices and collaboration partners through an auction process. A unique “suggestion” mechanism is introduced to the auction process to mitigate the decision bias caused by the leader–follower mode inherent in typical auction-based methods. Additionally, an available time update mechanism is designed to prevent the accumulation of schedule deviations during the robots’ operation process. Through extensive simulations, we demonstrate the superior performance and computational efficiency of the proposed algorithm compared to both the Agent-Based Sequential Greedy Algorithm and the Consensus-Based Time Table Algorithm, in both dynamic and static scenarios.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141142104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Robotics and Autonomous Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1