首页 > 最新文献

IEEE Robotics and Automation Letters最新文献

英文 中文
Exploring Unstructured Environments Using Minimal Sensing on Cooperative Nano-Drones 利用合作式纳米无人机上的最小传感探索非结构化环境
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-24 DOI: 10.1109/LRA.2024.3486212
Pedro Arias-Perez;Alvika Gautam;Miguel Fernandez-Cortizas;David Perez-Saura;Srikanth Saripalli;Pascual Campoy
Recent advances have improved autonomous navigation and mapping under payload constraints, but current multi-robot inspection algorithms are unsuitable for nano-drones, due to their need for heavy sensors and high computational resources. To address these challenges, we introduce ExploreBug, a novel hybrid frontier range-bug algorithm designed to handle limited sensing capabilities for a swarm of nano-drones. This system includes three primary components: a mapping subsystem, an exploration subsystem, and a navigation subsystem. Additionally, an intra-swarm collision avoidance system is integrated to prevent collisions between drones. We validate the efficacy of our approach through extensive simulations and real-world exploration experiments, involving up to seven drones in simulations and three in real-world settings, across various obstacle configurations and with a maximum navigation speed of 0.75 m/s. Our tests prove that the algorithm efficiently completes exploration tasks, even with minimal sensing, across different swarm sizes and obstacle densities. Furthermore, our frontier allocation heuristic ensures an equal distribution of explored areas and paths traveled by each drone in the swarm. We publicly release the source code of the proposed system to foster further developments in mapping and exploration using autonomous nano drones.
最近的进步改善了有效载荷限制下的自主导航和测绘,但目前的多机器人检测算法不适合纳米无人机,因为它们需要重型传感器和高计算资源。为了应对这些挑战,我们引入了 ExploreBug,这是一种新颖的混合前沿测距-虫算法,旨在处理纳米无人机群有限的传感能力。该系统包括三个主要组件:绘图子系统、探索子系统和导航子系统。此外,还集成了一个蜂群内部防撞系统,以防止无人机之间发生碰撞。我们通过大量的模拟和实际探索实验验证了我们方法的有效性,在模拟中最多涉及七架无人机,在实际环境中最多涉及三架无人机,涉及各种障碍物配置,最大导航速度为 0.75 米/秒。我们的测试证明,在不同的蜂群规模和障碍物密度下,该算法都能高效地完成探索任务,即使感知能力极低。此外,我们的前沿分配启发式确保了蜂群中每架无人机所探索区域和路径的平均分配。我们公开发布了拟议系统的源代码,以促进使用自主纳米无人机进行测绘和探索的进一步发展。
{"title":"Exploring Unstructured Environments Using Minimal Sensing on Cooperative Nano-Drones","authors":"Pedro Arias-Perez;Alvika Gautam;Miguel Fernandez-Cortizas;David Perez-Saura;Srikanth Saripalli;Pascual Campoy","doi":"10.1109/LRA.2024.3486212","DOIUrl":"https://doi.org/10.1109/LRA.2024.3486212","url":null,"abstract":"Recent advances have improved autonomous navigation and mapping under payload constraints, but current multi-robot inspection algorithms are unsuitable for nano-drones, due to their need for heavy sensors and high computational resources. To address these challenges, we introduce \u0000<italic>ExploreBug</i>\u0000, a novel hybrid frontier range-bug algorithm designed to handle limited sensing capabilities for a swarm of nano-drones. This system includes three primary components: a mapping subsystem, an exploration subsystem, and a navigation subsystem. Additionally, an intra-swarm collision avoidance system is integrated to prevent collisions between drones. We validate the efficacy of our approach through extensive simulations and real-world exploration experiments, involving up to seven drones in simulations and three in real-world settings, across various obstacle configurations and with a maximum navigation speed of 0.75 m/s. Our tests prove that the algorithm efficiently completes exploration tasks, even with minimal sensing, across different swarm sizes and obstacle densities. Furthermore, our frontier allocation heuristic ensures an equal distribution of explored areas and paths traveled by each drone in the swarm. We publicly release the source code of the proposed system to foster further developments in mapping and exploration using autonomous nano drones.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11202-11209"},"PeriodicalIF":4.6,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10734219","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142598642","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ATI-CTLO: Adaptive Temporal Interval-Based Continuous-Time LiDAR-Only Odometry ATI-CTLO:基于时间间隔的自适应连续时间激光雷达测距仪
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-24 DOI: 10.1109/LRA.2024.3486233
Bo Zhou;Jiajie Wu;Yan Pan;Chuanzhao Lu
The motion distortion in LiDAR scans caused by the robot's aggressive motion and environmental terrain features significantly impacts the positioning and mapping performance of 3D LiDAR odometry. Existing distortion correction solutions struggle to balance computational complexity and accuracy. In this letter, we propose an Adaptive Temporal Interval-based Continuous-Time LiDAR-only Odometry (ATI-CTLO), which is based on straightforward and efficient linear interpolation. Our method can flexibly adjust the temporal intervals between control nodes according to the motion dynamics and environmental degeneracy. This adaptability enhances performance across various motion states and improves the algorithms robustness in degenerate, particularly feature-sparse, environments. We validated our method's effectiveness on multiple datasets across different platforms, achieving comparable accuracy to state-of-the-art LiDAR-only odometry methods. Notably, in situations involving aggressive motion and sparse features, our method outperforms existing LiDAR-only methods.
机器人的剧烈运动和环境地形特征造成的激光雷达扫描运动失真严重影响了三维激光雷达里程测量的定位和绘图性能。现有的失真校正解决方案很难在计算复杂性和准确性之间取得平衡。在这封信中,我们提出了一种基于时间间隔的自适应连续时间激光雷达测距法(ATI-CTLO),它基于简单高效的线性插值。我们的方法可以根据运动动态和环境退行性灵活调整控制节点之间的时间间隔。这种适应性提高了在各种运动状态下的性能,并改善了算法在退化环境,特别是特征稀少环境中的鲁棒性。我们在不同平台的多个数据集上验证了我们方法的有效性,其精确度与最先进的纯激光雷达里程测量方法相当。值得注意的是,在涉及剧烈运动和稀疏特征的情况下,我们的方法优于现有的纯激光雷达方法。
{"title":"ATI-CTLO: Adaptive Temporal Interval-Based Continuous-Time LiDAR-Only Odometry","authors":"Bo Zhou;Jiajie Wu;Yan Pan;Chuanzhao Lu","doi":"10.1109/LRA.2024.3486233","DOIUrl":"https://doi.org/10.1109/LRA.2024.3486233","url":null,"abstract":"The motion distortion in LiDAR scans caused by the robot's aggressive motion and environmental terrain features significantly impacts the positioning and mapping performance of 3D LiDAR odometry. Existing distortion correction solutions struggle to balance computational complexity and accuracy. In this letter, we propose an \u0000<bold>A</b>\u0000daptive \u0000<bold>T</b>\u0000emporal \u0000<bold>I</b>\u0000nterval-based \u0000<bold>C</b>\u0000ontinuous-\u0000<bold>T</b>\u0000ime \u0000<bold>L</b>\u0000iDAR-only \u0000<bold>O</b>\u0000dometry (ATI-CTLO), which is based on straightforward and efficient linear interpolation. Our method can flexibly adjust the temporal intervals between control nodes according to the motion dynamics and environmental degeneracy. This adaptability enhances performance across various motion states and improves the algorithms robustness in degenerate, particularly feature-sparse, environments. We validated our method's effectiveness on multiple datasets across different platforms, achieving comparable accuracy to state-of-the-art LiDAR-only odometry methods. Notably, in situations involving aggressive motion and sparse features, our method outperforms existing LiDAR-only methods.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11162-11169"},"PeriodicalIF":4.6,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142598621","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Kernel-Based Metrics Learning for Uncertain Opponent Vehicle Trajectory Prediction in Autonomous Racing 基于核的度量学习用于自主赛车中不确定对手车辆的轨迹预测
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-24 DOI: 10.1109/LRA.2024.3486178
Hojin Lee;Youngim Nam;Sanghun Lee;Cheolhyeon Kwon
Autonomous racing confronts significant challenges in safely overtaking Opponent Vehicles (OVs) that exhibit uncertain trajectories, stemming from unknown driving policies. To address these challenges, this study proposes heterogeneous kernel metrics for Deep Kernel Learning (DKL), designed to robustly capture the diverse driving policies of OVs, and carry out precise trajectory predictions along with the associated uncertainties. A key virtue of the proposed kernel metrics lies in their ability to align similar driving policies and disjoin dissimilar ones in an unsupervised manner, given the observed interactions between the Ego Vehicle (EV) and OVs. The efficacy of the proposed method is substantiated through experimental studies on a 1/10th scale racecar platform, demonstrating improved prediction accuracy and thereby safely overtaking against OVs. Furthermore, our method is computationally efficient for onboard computing units, affirming its viability in fast-paced racing environments.
自动赛车在安全超越对手车辆(OV)时面临着巨大挑战,因为未知的驾驶策略会导致对手车辆的轨迹不确定。为了应对这些挑战,本研究提出了用于深度核学习(DKL)的异构核指标,旨在稳健地捕捉 OV 的各种驾驶策略,并对相关的不确定性进行精确的轨迹预测。所提出的内核指标的一个主要优点在于,考虑到所观察到的自我车辆(EV)与 OV 之间的相互作用,它们能够以无监督的方式调整相似的驾驶策略并分离不相似的策略。通过在 1/10 比例的赛车平台上进行实验研究,证明了所提方法的有效性,证明了预测准确性的提高,从而实现了对 OV 的安全超车。此外,我们的方法对于车载计算单元来说计算效率高,这肯定了它在快节奏赛车环境中的可行性。
{"title":"Kernel-Based Metrics Learning for Uncertain Opponent Vehicle Trajectory Prediction in Autonomous Racing","authors":"Hojin Lee;Youngim Nam;Sanghun Lee;Cheolhyeon Kwon","doi":"10.1109/LRA.2024.3486178","DOIUrl":"https://doi.org/10.1109/LRA.2024.3486178","url":null,"abstract":"Autonomous racing confronts significant challenges in safely overtaking Opponent Vehicles (OVs) that exhibit uncertain trajectories, stemming from unknown driving policies. To address these challenges, this study proposes heterogeneous kernel metrics for Deep Kernel Learning (DKL), designed to robustly capture the diverse driving policies of OVs, and carry out precise trajectory predictions along with the associated uncertainties. A key virtue of the proposed kernel metrics lies in their ability to align similar driving policies and disjoin dissimilar ones in an unsupervised manner, given the observed interactions between the Ego Vehicle (EV) and OVs. The efficacy of the proposed method is substantiated through experimental studies on a 1/10th scale racecar platform, demonstrating improved prediction accuracy and thereby safely overtaking against OVs. Furthermore, our method is computationally efficient for onboard computing units, affirming its viability in fast-paced racing environments.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11050-11057"},"PeriodicalIF":4.6,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142565503","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Safer Gap: Safe Navigation of Planar Nonholonomic Robots With a Gap-Based Local Planner 更安全的间隙:利用基于间隙的局部规划器实现平面非全局机器人的安全导航
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-24 DOI: 10.1109/LRA.2024.3486231
Shiyu Feng;Ahmad Abuaish;Patricio A. Vela
This paper extends the gap-based navigation technique Potential Gap with safety guarantees at the local planning level for a kinematic planar nonholonomic robot model, leading to Safer Gap. It relies on a subset of navigable free space from the robot to a gap, denoted the keyhole region. The region is defined by the union of the largest collision-free disc centered on the robot and a collision-free trapezoidal region directed through the gap. Safer Gap first generates Bézier-based collision-free paths within the keyhole regions. The keyhole region of the top scoring path is encoded by a shallow neural network-based zeroing barrier function (ZBF) synthesized in real-time. Nonlinear Model Predictive Control (NMPC) with Keyhole ZBF constraints and output tracking of the Bézier path, synthesizes a safe kinematically feasible trajectory. The Potential Gap projection operator serves as a last action to enforce safety if the NMPC optimization fails to converge to a solution within the prescribed time. Simulation and experimental validation of Safer Gap confirm its collision-free navigation properties.
本文对基于间隙的导航技术 "潜在间隙"(Potential Gap)进行了扩展,为运动学平面非全局机器人模型提供了局部规划层面的安全保证,从而实现了 "更安全的间隙"(Safer Gap)。它依赖于从机器人到间隙的可导航自由空间子集,表示为钥匙孔区域。该区域由以机器人为中心的最大无碰撞圆盘和穿过间隙的无碰撞梯形区域的结合体定义。Safer Gap 首先在锁孔区域内生成基于贝塞尔的无碰撞路径。得分最高路径的锁孔区域由实时合成的基于浅层神经网络的归零障碍函数(ZBF)编码。非线性模型预测控制(NMPC)利用锁孔 ZBF 约束和贝塞尔路径的输出跟踪,合成出安全的运动学可行轨迹。如果 NMPC 优化未能在规定时间内收敛到一个解决方案,潜在间隙投影算子将作为最后的行动,以确保安全。Safer Gap 的仿真和实验验证证实了其无碰撞导航特性。
{"title":"Safer Gap: Safe Navigation of Planar Nonholonomic Robots With a Gap-Based Local Planner","authors":"Shiyu Feng;Ahmad Abuaish;Patricio A. Vela","doi":"10.1109/LRA.2024.3486231","DOIUrl":"https://doi.org/10.1109/LRA.2024.3486231","url":null,"abstract":"This paper extends the gap-based navigation technique \u0000<italic>Potential Gap</i>\u0000 with safety guarantees at the local planning level for a kinematic planar nonholonomic robot model, leading to \u0000<italic>Safer Gap</i>\u0000. It relies on a subset of navigable free space from the robot to a gap, denoted the keyhole region. The region is defined by the union of the largest collision-free disc centered on the robot and a collision-free trapezoidal region directed through the gap. \u0000<italic>Safer Gap</i>\u0000 first generates Bézier-based collision-free paths within the keyhole regions. The keyhole region of the top scoring path is encoded by a shallow neural network-based zeroing barrier function (ZBF) synthesized in real-time. Nonlinear Model Predictive Control (NMPC) with \u0000<italic>Keyhole ZBF</i>\u0000 constraints and output tracking of the Bézier path, synthesizes a safe kinematically feasible trajectory. The \u0000<italic>Potential Gap</i>\u0000 projection operator serves as a last action to enforce safety if the NMPC optimization fails to converge to a solution within the prescribed time. Simulation and experimental validation of \u0000<italic>Safer Gap</i>\u0000 confirm its collision-free navigation properties.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11034-11041"},"PeriodicalIF":4.6,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142565543","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Collision-Free Trajectory Optimization in Cluttered Environments Using Sums-of-Squares Programming 利用平方和编程实现杂乱环境中的无碰撞轨迹优化
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-24 DOI: 10.1109/LRA.2024.3486235
Yulin Li;Chunxin Zheng;Kai Chen;Yusen Xie;Xindong Tang;Michael Yu Wang;Jun Ma
In this work, we propose a trajectory optimization approach for robot navigation in cluttered 3D environments. We represent the robot's geometry as a semialgebraic set defined by polynomial inequalities such that robots with general shapes can be suitably characterized. We exploit the collision-free space directly to construct a graph of free regions, search for the reference path, and allocate each waypoint on the trajectory to a specific region. Then, we incorporate a uniform scaling factor for each free region and formulate a Sums-of-Squares (SOS) optimization problem whose optimal solutions reveal the containment relationship between robots and the free space. The SOS optimization problem is further reformulated to a semidefinite program (SDP), and the collision-free constraints are shown to be equivalent to limiting the scaling factor along the entire trajectory. Next, to solve the trajectory optimization problem with the proposed safety constraints, we derive a guiding direction for updating the robot configuration to decrease the minimum scaling factor by calculating the gradient of the Lagrangian at the primal-dual optimum of the SDP. As a result, this seamlessly facilitates the use of gradient-based methods in efficient solving of the trajectory optimization problem. Through a series of simulations and real-world experiments, the proposed trajectory optimization approach is validated in various challenging scenarios, and the results demonstrate its effectiveness in generating collision-free trajectories in dense and intricate environments.
在这项工作中,我们提出了一种在杂乱的三维环境中进行机器人导航的轨迹优化方法。我们将机器人的几何形状表示为一个由多项式不等式定义的半代数集合,从而可以适当地描述具有一般形状的机器人。我们直接利用无碰撞空间来构建自由区域图,搜索参考路径,并将轨迹上的每个航点分配到特定区域。然后,我们为每个自由区域加入一个统一的缩放因子,并提出一个平方和(SOS)优化问题,其最优解揭示了机器人与自由空间之间的包含关系。SOS 优化问题被进一步重新表述为一个半定式程序 (SDP),并证明无碰撞约束等同于限制整个轨迹上的缩放因子。接下来,为了解决带有安全约束的轨迹优化问题,我们通过计算 SDP 原始双最优处的拉格朗日梯度,得出了更新机器人配置以降低最小缩放因子的指导方向。因此,这无缝地促进了基于梯度的方法在有效解决轨迹优化问题中的应用。通过一系列模拟和实际实验,所提出的轨迹优化方法在各种具有挑战性的场景中得到了验证,结果表明它能有效地在密集复杂的环境中生成无碰撞轨迹。
{"title":"Collision-Free Trajectory Optimization in Cluttered Environments Using Sums-of-Squares Programming","authors":"Yulin Li;Chunxin Zheng;Kai Chen;Yusen Xie;Xindong Tang;Michael Yu Wang;Jun Ma","doi":"10.1109/LRA.2024.3486235","DOIUrl":"https://doi.org/10.1109/LRA.2024.3486235","url":null,"abstract":"In this work, we propose a trajectory optimization approach for robot navigation in cluttered 3D environments. We represent the robot's geometry as a semialgebraic set defined by polynomial inequalities such that robots with general shapes can be suitably characterized. We exploit the collision-free space directly to construct a graph of free regions, search for the reference path, and allocate each waypoint on the trajectory to a specific region. Then, we incorporate a uniform scaling factor for each free region and formulate a Sums-of-Squares (SOS) optimization problem whose optimal solutions reveal the containment relationship between robots and the free space. The SOS optimization problem is further reformulated to a semidefinite program (SDP), and the collision-free constraints are shown to be equivalent to limiting the scaling factor along the entire trajectory. Next, to solve the trajectory optimization problem with the proposed safety constraints, we derive a guiding direction for updating the robot configuration to decrease the minimum scaling factor by calculating the gradient of the Lagrangian at the primal-dual optimum of the SDP. As a result, this seamlessly facilitates the use of gradient-based methods in efficient solving of the trajectory optimization problem. Through a series of simulations and real-world experiments, the proposed trajectory optimization approach is validated in various challenging scenarios, and the results demonstrate its effectiveness in generating collision-free trajectories in dense and intricate environments.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11026-11033"},"PeriodicalIF":4.6,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142565553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Floor Plan Based Active Global Localization and Navigation Aid for Persons With Blindness and Low Vision 基于平面图的盲人和低视力者主动全球定位和导航辅助系统
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-24 DOI: 10.1109/LRA.2024.3486208
R. G. Goswami;H. Sinha;P. V. Amith;J. Hari;P. Krishnamurthy;J. Rizzo;F. Khorrami
Navigation of an agent, such as a person with blindness or low vision, in an unfamiliar environment poses substantial difficulties, even in scenarios where prior maps, like floor plans, are available. It becomes essential first to determine the agent's pose in the environment. The task's complexity increases when the agent also needs directions for exploring the environment to reduce uncertainty in the agent's position. This problem of active global localization typically involves finding a transformation to match the agent's sensor-generated map to the floor plan while providing a series of point-to-point directions for effective exploration. Current methods fall into two categories: learning-based, requiring extensive training for each environment, or non-learning-based, which generally depend on prior knowledge of the agent's initial position, or the use of floor plan maps created with the same sensor modality as the agent. Addressing these limitations, we introduce a novel system for real-time, active global localization and navigation for persons with blindness and low vision. By generating semantically informed real-time goals, our approach enables local exploration and the creation of a 2D semantic point cloud for effective global localization. Moreover, it dynamically corrects for odometry drift using the architectural floor plan, independent of the agent's global position and introduces a new method for real-time loop closure on reversal. Our approach's effectiveness is validated through multiple real-world indoor experiments, also highlighting its adaptability and ease of extension to any mobile robot.
即使是在有诸如平面图之类的先行地图的情况下,要让盲人或低视力者等代理在陌生环境中导航也会遇到很大困难。首先必须确定代理在环境中的姿态。如果代理还需要探索环境的方向,以减少代理位置的不确定性,任务的复杂性就会增加。这种主动全局定位问题通常涉及寻找一种变换,以将代理的传感器生成的地图与平面图相匹配,同时为有效探索提供一系列点到点的方向。目前的方法分为两类:基于学习的方法,需要针对每个环境进行大量训练;非基于学习的方法,通常依赖于事先了解的代理初始位置,或使用与代理相同的传感器模式生成的平面图。针对这些局限性,我们推出了一种新型系统,用于为盲人和低视力者进行实时、主动的全局定位和导航。通过生成具有语义信息的实时目标,我们的方法能够进行局部探索并创建二维语义点云,从而实现有效的全局定位。此外,它还能利用建筑平面图动态校正里程漂移,而不依赖于代理的全局位置,并引入了一种新方法来实时关闭反向循环。我们的方法通过多个真实世界的室内实验验证了其有效性,同时也突出了它的适应性和易于扩展到任何移动机器人的特点。
{"title":"Floor Plan Based Active Global Localization and Navigation Aid for Persons With Blindness and Low Vision","authors":"R. G. Goswami;H. Sinha;P. V. Amith;J. Hari;P. Krishnamurthy;J. Rizzo;F. Khorrami","doi":"10.1109/LRA.2024.3486208","DOIUrl":"https://doi.org/10.1109/LRA.2024.3486208","url":null,"abstract":"Navigation of an agent, such as a person with blindness or low vision, in an unfamiliar environment poses substantial difficulties, even in scenarios where prior maps, like floor plans, are available. It becomes essential first to determine the agent's pose in the environment. The task's complexity increases when the agent also needs directions for exploring the environment to reduce uncertainty in the agent's position. This problem of \u0000<italic>active global localization</i>\u0000 typically involves finding a transformation to match the agent's sensor-generated map to the floor plan while providing a series of point-to-point directions for effective exploration. Current methods fall into two categories: learning-based, requiring extensive training for each environment, or non-learning-based, which generally depend on prior knowledge of the agent's initial position, or the use of floor plan maps created with the same sensor modality as the agent. Addressing these limitations, we introduce a novel system for real-time, active global localization and navigation for persons with blindness and low vision. By generating semantically informed real-time goals, our approach enables local exploration and the creation of a 2D semantic point cloud for effective global localization. Moreover, it dynamically corrects for odometry drift using the architectural floor plan, independent of the agent's global position and introduces a new method for real-time loop closure on reversal. Our approach's effectiveness is validated through multiple real-world indoor experiments, also highlighting its adaptability and ease of extension to any mobile robot.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11058-11065"},"PeriodicalIF":4.6,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142565558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Flying Calligrapher: Contact-Aware Motion and Force Planning and Control for Aerial Manipulation 飞行书法家:用于空中操纵的接触感知运动和力规划与控制
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-24 DOI: 10.1109/LRA.2024.3486236
Xiaofeng Guo;Guanqi He;Jiahe Xu;Mohammadreza Mousaei;Junyi Geng;Sebastian Scherer;Guanya Shi
Aerial manipulation has gained interest in completing high-altitude tasks that are challenging for human workers, such as contact inspection and defect detection, etc. Previous research has focused on maintaining static contact points or forces. This letter addresses a more general and dynamic task: simultaneously tracking time-varying contact force in the surface normal direction and motion trajectories on tangential surfaces. We propose a pipeline that includes a contact-aware trajectory planner to generate dynamically feasible trajectories, and a hybrid motion-force controller to track such trajectories. We demonstrate the approach in an aerial calligraphy task using a novel sponge pen design as the end-effector, whose stroke width is positively related to the contact force. Additionally, we develop a touchscreen interface for flexible user input. Experiments show our method can effectively draw diverse letters, achieving an IoU of 0.59 and an end-effector position (force) tracking RMSE of 2.9 cm (0.7N).
在完成对人类工人具有挑战性的高空任务(如接触检查和缺陷检测等)方面,空中操纵已引起人们的兴趣。以往的研究侧重于保持静态接触点或力。这封信讨论的是一个更普遍的动态任务:同时跟踪表面法线方向上的时变接触力和切线表面上的运动轨迹。我们提出了一个管道,其中包括一个用于生成动态可行轨迹的接触感知轨迹规划器,以及一个用于跟踪此类轨迹的混合运动力控制器。我们使用新型海绵笔设计作为终端执行器,在空中书法任务中演示了该方法,其笔划宽度与接触力呈正相关。此外,我们还开发了一个用于灵活用户输入的触摸屏界面。实验表明,我们的方法可以有效地绘制各种字母,IoU 达到 0.59,末端执行器位置(力)跟踪 RMSE 为 2.9 厘米(0.7N)。
{"title":"Flying Calligrapher: Contact-Aware Motion and Force Planning and Control for Aerial Manipulation","authors":"Xiaofeng Guo;Guanqi He;Jiahe Xu;Mohammadreza Mousaei;Junyi Geng;Sebastian Scherer;Guanya Shi","doi":"10.1109/LRA.2024.3486236","DOIUrl":"https://doi.org/10.1109/LRA.2024.3486236","url":null,"abstract":"Aerial manipulation has gained interest in completing high-altitude tasks that are challenging for human workers, such as contact inspection and defect detection, etc. Previous research has focused on maintaining static contact points or forces. This letter addresses a more general and dynamic task: simultaneously tracking time-varying contact force in the surface normal direction and motion trajectories on tangential surfaces. We propose a pipeline that includes a contact-aware trajectory planner to generate dynamically feasible trajectories, and a hybrid motion-force controller to track such trajectories. We demonstrate the approach in an aerial calligraphy task using a novel sponge pen design as the end-effector, whose stroke width is positively related to the contact force. Additionally, we develop a touchscreen interface for flexible user input. Experiments show our method can effectively draw diverse letters, achieving an IoU of 0.59 and an end-effector position (force) tracking RMSE of 2.9 cm (0.7N).","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11194-11201"},"PeriodicalIF":4.6,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142598676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design and Shape Control of Robotic Morphing Interface With Reprogrammable Stiffness Based on Machine Learning 基于机器学习的具有可重新编程刚度的机器人变形界面的设计与形状控制
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-21 DOI: 10.1109/LRA.2024.3484160
Xiaojie Diao;Juncai Long;Jituo Li;Chengdi Zhou;Huixu Dong;Guodong Lu
Deformable organisms in nature inspire the design of shape-shifting robots, including soft robots, bionic robots and physical human-robot interfaces. However, to achieve multi-objective shape imitation and multi-form transformation, shape-shifting robots often require complex actuation systems, control strategies, and inverse design algorithms. In this letter, we propose a robotic morphing interface with reprogrammable stiffness (RoMI-RS) based on machine learning. RoMI-RS uses a circular elastic bilayer as the base, which can produce isotropic deformation under pneumatic actuation. By repeatedly attaching and detaching high-stiffness limiting layers to the surface of the base, the stiffness distribution can be reprogrammed, guiding anisotropic deformation. Thus, without changing the base material or actuation mechanism, RoMI-RS can precisely mimic various static shapes and dynamic movements. To address the nonlinear coupling of soft materials and pneumatic actuation, we employed a data-driven approach to inversely design limiting layer arrangements (i.e., the stiffness distribution of RoMI-RS) in the form of images. Hence, our proposed pneumatic RoMI-RS not only responds quickly and deforms reversibly but also allows users to intuitively and rapidly reconfigure target shapes. We also demonstrate the applications of RoMI-RS in shape-shifting robotics, particularly in soft grippers and physical human-robot interfaces, verifying its deformation flexibility and adaptability.
自然界中的可变形生物激发了变形机器人的设计灵感,包括软体机器人、仿生机器人和物理人机界面。然而,要实现多目标形状模仿和多形态变换,变形机器人往往需要复杂的执行系统、控制策略和反向设计算法。在这封信中,我们提出了一种基于机器学习的具有可重新编程刚度的机器人变形界面(RoMI-RS)。RoMI-RS 以圆形弹性双层膜为基底,在气动驱动下可产生各向同性的变形。通过在基底表面反复粘贴和剥离高刚度限制层,可对刚度分布进行重新编程,从而引导各向异性变形。因此,在不改变基底材料或驱动机制的情况下,RoMI-RS 可以精确模拟各种静态形状和动态运动。为了解决软材料和气动致动器的非线性耦合问题,我们采用了一种数据驱动方法,以图像的形式反向设计限制层排列(即 RoMI-RS 的刚度分布)。因此,我们提出的气动 RoMI-RS 不仅能快速响应和可逆变形,还能让用户直观、快速地重新配置目标形状。我们还展示了 RoMI-RS 在变形机器人技术中的应用,特别是在软抓手和物理人机界面中的应用,验证了其变形的灵活性和适应性。
{"title":"Design and Shape Control of Robotic Morphing Interface With Reprogrammable Stiffness Based on Machine Learning","authors":"Xiaojie Diao;Juncai Long;Jituo Li;Chengdi Zhou;Huixu Dong;Guodong Lu","doi":"10.1109/LRA.2024.3484160","DOIUrl":"https://doi.org/10.1109/LRA.2024.3484160","url":null,"abstract":"Deformable organisms in nature inspire the design of shape-shifting robots, including soft robots, bionic robots and physical human-robot interfaces. However, to achieve multi-objective shape imitation and multi-form transformation, shape-shifting robots often require complex actuation systems, control strategies, and inverse design algorithms. In this letter, we propose a robotic morphing interface with reprogrammable stiffness (RoMI-RS) based on machine learning. RoMI-RS uses a circular elastic bilayer as the base, which can produce isotropic deformation under pneumatic actuation. By repeatedly attaching and detaching high-stiffness limiting layers to the surface of the base, the stiffness distribution can be reprogrammed, guiding anisotropic deformation. Thus, without changing the base material or actuation mechanism, RoMI-RS can precisely mimic various static shapes and dynamic movements. To address the nonlinear coupling of soft materials and pneumatic actuation, we employed a data-driven approach to inversely design limiting layer arrangements (i.e., the stiffness distribution of RoMI-RS) in the form of images. Hence, our proposed pneumatic RoMI-RS not only responds quickly and deforms reversibly but also allows users to intuitively and rapidly reconfigure target shapes. We also demonstrate the applications of RoMI-RS in shape-shifting robotics, particularly in soft grippers and physical human-robot interfaces, verifying its deformation flexibility and adaptability.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"10930-10937"},"PeriodicalIF":4.6,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142565560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
One-Step Identification of Robot Physical Dynamic Parameters Considering the Velocity-Load Friction Model 考虑速度-负载摩擦模型的机器人物理动态参数的一步式识别
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-21 DOI: 10.1109/LRA.2024.3484133
Yian Qian;Lijin Fang;Jiqian Xu;Tangzhong Song;Guanghui Liu
We propose a robot dynamic model to improve the accuracy of the identification, by introducing a friction model that takes into account the joint loads. Firstly, we analyze torque transfer in robot joints, assigning a physical meaning to motor inertia parameters. Then, we enhance the traditional friction model in identification by accounting for joint loads, presenting a new friction model with loads. Next, we employ a one-step method to directly identify both basic dynamic parameters and physical dynamic parameters of the robot. Experimental validation is conducted using a Rokea XMate3pro 7-DOF robot. Results demonstrate that our proposed dynamic model achieves higher accuracy in dynamic identification. It effectively describes the jitter phenomenon caused by motor torque when joints change the direction of motion. Furthermore, in identifying parameters for physical feasibility, our model outperforms traditional approaches by better fitting the dynamic of end joints.
我们提出了一种机器人动态模型,通过引入考虑关节负载的摩擦模型来提高识别的准确性。首先,我们分析了机器人关节中的扭矩传递,为电机惯性参数赋予了物理意义。然后,我们通过考虑关节载荷来改进识别中的传统摩擦模型,提出了一种带载荷的新摩擦模型。接下来,我们采用一步法直接识别机器人的基本动态参数和物理动态参数。我们使用 Rokea XMate3pro 7-DOF 机器人进行了实验验证。结果表明,我们提出的动态模型在动态识别方面达到了更高的精度。它能有效地描述关节改变运动方向时电机扭矩引起的抖动现象。此外,在识别物理可行性参数时,我们的模型能更好地拟合末端关节的动态,因而优于传统方法。
{"title":"One-Step Identification of Robot Physical Dynamic Parameters Considering the Velocity-Load Friction Model","authors":"Yian Qian;Lijin Fang;Jiqian Xu;Tangzhong Song;Guanghui Liu","doi":"10.1109/LRA.2024.3484133","DOIUrl":"https://doi.org/10.1109/LRA.2024.3484133","url":null,"abstract":"We propose a robot dynamic model to improve the accuracy of the identification, by introducing a friction model that takes into account the joint loads. Firstly, we analyze torque transfer in robot joints, assigning a physical meaning to motor inertia parameters. Then, we enhance the traditional friction model in identification by accounting for joint loads, presenting a new friction model with loads. Next, we employ a one-step method to directly identify both basic dynamic parameters and physical dynamic parameters of the robot. Experimental validation is conducted using a Rokea XMate3pro 7-DOF robot. Results demonstrate that our proposed dynamic model achieves higher accuracy in dynamic identification. It effectively describes the jitter phenomenon caused by motor torque when joints change the direction of motion. Furthermore, in identifying parameters for physical feasibility, our model outperforms traditional approaches by better fitting the dynamic of end joints.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"10890-10897"},"PeriodicalIF":4.6,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142517904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data-Driven Dynamics Modeling of Miniature Robotic Blimps Using Neural ODEs With Parameter Auto-Tuning 利用带有参数自动调整功能的神经 ODE 建立微型机器人飞艇的数据驱动动力学模型
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-21 DOI: 10.1109/LRA.2024.3484182
Yongjian Zhu;Hao Cheng;Feitian Zhang
Miniature robotic blimps, as one type of lighter-than-air aerial vehicles, have attracted increasing attention in the science and engineering community for their enhanced safety, extended endurance, and quieter operation compared to quadrotors. Accurately modeling the dynamics of these robotic blimps poses a significant challenge due to the complex aerodynamics stemming from their large lifting bodies. Traditional first-principle models have difficulty obtaining accurate aerodynamic parameters and often overlook high-order nonlinearities, thus coming to their limit in modeling the motion dynamics of miniature robotic blimps. To tackle this challenge, this letter proposes the Auto-tuning Blimp-oriented Neural Ordinary Differential Equation method (ABNODE), a data-driven approach that integrates first-principle and neural network modeling. Spiraling motion experiments of robotic blimps are conducted, comparing the ABNODE with first-principle and other data-driven benchmark models, the results of which demonstrate the effectiveness of the proposed method.
微型机器人飞艇是轻于空气的航空飞行器的一种,与四旋翼飞行器相比,其安全性更高、续航时间更长、运行更安静,因此越来越受到科学和工程界的关注。由于大型升力体具有复杂的空气动力学特性,因此对这些机器人飞艇的动力学进行精确建模是一项重大挑战。传统的第一原理模型难以获得准确的空气动力学参数,而且往往忽略了高阶非线性因素,因此在微型机器人飞艇的运动动力学建模方面已经达到了极限。为解决这一难题,本文提出了面向飞艇的自动调整神经常微分方程法(ABNODE),这是一种数据驱动的方法,将第一原理和神经网络建模融为一体。我们对机器人飞艇进行了螺旋运动实验,将 ABNODE 与第一原理模型和其他数据驱动基准模型进行了比较,结果证明了所提方法的有效性。
{"title":"Data-Driven Dynamics Modeling of Miniature Robotic Blimps Using Neural ODEs With Parameter Auto-Tuning","authors":"Yongjian Zhu;Hao Cheng;Feitian Zhang","doi":"10.1109/LRA.2024.3484182","DOIUrl":"https://doi.org/10.1109/LRA.2024.3484182","url":null,"abstract":"Miniature robotic blimps, as one type of lighter-than-air aerial vehicles, have attracted increasing attention in the science and engineering community for their enhanced safety, extended endurance, and quieter operation compared to quadrotors. Accurately modeling the dynamics of these robotic blimps poses a significant challenge due to the complex aerodynamics stemming from their large lifting bodies. Traditional first-principle models have difficulty obtaining accurate aerodynamic parameters and often overlook high-order nonlinearities, thus coming to their limit in modeling the motion dynamics of miniature robotic blimps. To tackle this challenge, this letter proposes the Auto-tuning Blimp-oriented Neural Ordinary Differential Equation method (ABNODE), a data-driven approach that integrates first-principle and neural network modeling. Spiraling motion experiments of robotic blimps are conducted, comparing the ABNODE with first-principle and other data-driven benchmark models, the results of which demonstrate the effectiveness of the proposed method.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"10986-10993"},"PeriodicalIF":4.6,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142565511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Robotics and Automation Letters
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1