首页 > 最新文献

The International Journal of Robotics Research最新文献

英文 中文
Continuum concentric push–pull robots: A Cosserat rod model 连续同心推拉机器人:科塞拉特杆模型
Pub Date : 2024-09-14 DOI: 10.1177/02783649241263366
Matthias Tummers, Frédéric Boyer, Vincent Lebastard, Alexis Offermann, Jocelyne Troccaz, Benoît Rosa, M. Taha Chikhaoui
Various approaches and structures emerged recently to design continuum robots. One of the most promising designs regards a new concept of continuum concentric push–pull robots (CPPRs) that have the characteristic of combining several key advantages of tendon actuated, multi-backbone, and concentric tube ones (direct curvature actuation, small outer/inner diameter ratio, free lumen, etc.). Geometrically-exact models of such recently introduced robots are yet to be developed to gain leverage of their full potential. This article extends beyond usual definitions of Cosserat rod theory in order to take into account this new type of continuum robots, constituted by sliding rods, in a shape of tubes whose cross-sections are neither uniform nor symmetrical along their entire length. The introduced model is capable of considering versatile design options, external loads, 3D deformations, an arbitrary number of tubes and profiles of the centroid lines, as well as a new actuation method consisting of an input rotation. Numerical simulations and experiments on CPPR prototypes validate our model.
最近出现了各种设计连续机器人的方法和结构。其中最有前途的设计之一是新概念的连续同心推拉机器人(CPPR),它的特点是结合了腱驱动、多骨干和同心管机器人的几个主要优点(直接曲率驱动、小外径/内径比、自由腔体等)。最近推出的这类机器人的精确几何模型尚待开发,以充分发挥其潜力。本文超越了 Cosserat 杆理论的常规定义,将这种由滑动杆构成的新型连续机器人纳入考虑范围,这些滑动杆呈管状,其横截面既不均匀,也不沿整个长度对称。引入的模型能够考虑多种设计方案、外部载荷、三维变形、任意数量的管子和中心线轮廓,以及由输入旋转组成的新驱动方法。在 CPPR 原型上进行的数值模拟和实验验证了我们的模型。
{"title":"Continuum concentric push–pull robots: A Cosserat rod model","authors":"Matthias Tummers, Frédéric Boyer, Vincent Lebastard, Alexis Offermann, Jocelyne Troccaz, Benoît Rosa, M. Taha Chikhaoui","doi":"10.1177/02783649241263366","DOIUrl":"https://doi.org/10.1177/02783649241263366","url":null,"abstract":"Various approaches and structures emerged recently to design continuum robots. One of the most promising designs regards a new concept of continuum concentric push–pull robots (CPPRs) that have the characteristic of combining several key advantages of tendon actuated, multi-backbone, and concentric tube ones (direct curvature actuation, small outer/inner diameter ratio, free lumen, etc.). Geometrically-exact models of such recently introduced robots are yet to be developed to gain leverage of their full potential. This article extends beyond usual definitions of Cosserat rod theory in order to take into account this new type of continuum robots, constituted by sliding rods, in a shape of tubes whose cross-sections are neither uniform nor symmetrical along their entire length. The introduced model is capable of considering versatile design options, external loads, 3D deformations, an arbitrary number of tubes and profiles of the centroid lines, as well as a new actuation method consisting of an input rotation. Numerical simulations and experiments on CPPR prototypes validate our model.","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"51 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142264767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Transfer learning in robotics: An upcoming breakthrough? A review of promises and challenges 机器人中的迁移学习:即将实现的突破?前景与挑战综述
Pub Date : 2024-09-14 DOI: 10.1177/02783649241273565
Noémie Jaquier, Michael C Welle, Andrej Gams, Kunpeng Yao, Bernardo Fichera, Aude Billard, Aleš Ude, Tamim Asfour, Danica Kragic
Transfer learning is a conceptually-enticing paradigm in pursuit of truly intelligent embodied agents. The core concept—reusing prior knowledge to learn in and from novel situations—is successfully leveraged by humans to handle novel situations. In recent years, transfer learning has received renewed interest from the community from different perspectives, including imitation learning, domain adaptation, and transfer of experience from simulation to the real world, among others. In this paper, we unify the concept of transfer learning in robotics and provide the first taxonomy of its kind considering the key concepts of robot, task, and environment. Through a review of the promises and challenges in the field, we identify the need of transferring at different abstraction levels, the need of quantifying the transfer gap and the quality of transfer, as well as the dangers of negative transfer. Via this position paper, we hope to channel the effort of the community towards the most significant roadblocks to realize the full potential of transfer learning in robotics.
迁移学习是一种概念新颖的范例,旨在实现真正的智能化代理。其核心理念--利用已有知识在新情况下进行学习--被人类成功地用于处理新情况。近年来,迁移学习从不同的角度再次受到社会各界的关注,其中包括模仿学习、领域适应以及从模拟到现实世界的经验迁移等等。在本文中,我们统一了机器人迁移学习的概念,并提供了首个考虑到机器人、任务和环境等关键概念的同类分类法。通过回顾该领域的前景和挑战,我们明确了在不同抽象层次进行迁移的必要性、量化迁移差距和迁移质量的必要性,以及负迁移的危险性。我们希望通过这份立场文件,引导社会各界努力解决最重要的障碍,充分发挥机器人迁移学习的潜力。
{"title":"Transfer learning in robotics: An upcoming breakthrough? A review of promises and challenges","authors":"Noémie Jaquier, Michael C Welle, Andrej Gams, Kunpeng Yao, Bernardo Fichera, Aude Billard, Aleš Ude, Tamim Asfour, Danica Kragic","doi":"10.1177/02783649241273565","DOIUrl":"https://doi.org/10.1177/02783649241273565","url":null,"abstract":"Transfer learning is a conceptually-enticing paradigm in pursuit of truly intelligent embodied agents. The core concept—reusing prior knowledge to learn in and from novel situations—is successfully leveraged by humans to handle novel situations. In recent years, transfer learning has received renewed interest from the community from different perspectives, including imitation learning, domain adaptation, and transfer of experience from simulation to the real world, among others. In this paper, we unify the concept of transfer learning in robotics and provide the first taxonomy of its kind considering the key concepts of robot, task, and environment. Through a review of the promises and challenges in the field, we identify the need of transferring at different abstraction levels, the need of quantifying the transfer gap and the quality of transfer, as well as the dangers of negative transfer. Via this position paper, we hope to channel the effort of the community towards the most significant roadblocks to realize the full potential of transfer learning in robotics.","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142264664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Selected papers from WAFR 2022 WAFR 2022 论文选编
Pub Date : 2024-09-14 DOI: 10.1177/02783649241274937
Jason M O’Kane, Michael Otte, Dorsa Sadigh, Pratap Tokekar
{"title":"Selected papers from WAFR 2022","authors":"Jason M O’Kane, Michael Otte, Dorsa Sadigh, Pratap Tokekar","doi":"10.1177/02783649241274937","DOIUrl":"https://doi.org/10.1177/02783649241274937","url":null,"abstract":"","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"40 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142264665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Sim-to-real transfer of adaptive control parameters for AUV stabilisation under current disturbance 海流干扰下用于自动潜航器稳定的自适应控制参数的仿真到实际转移
Pub Date : 2024-09-10 DOI: 10.1177/02783649241272115
Thomas Chaffre, Jonathan Wheare, Andrew Lammas, Paulo Santos, Gilles Le Chenadec, Karl Sammut, Benoit Clement
Learning-based adaptive control methods hold the potential to empower autonomous agents in mitigating the impact of process variations with minimal human intervention. However, their application to autonomous underwater vehicles (AUVs) has been constrained by two main challenges: (1) the presence of unknown dynamics in the form of sea current disturbances, which cannot be modelled or measured due to limited sensor capability, particularly on smaller low-cost AUVs, and (2) the nonlinearity of AUV tasks, where the controller response at certain operating points must be excessively conservative to meet specifications at other points. Deep Reinforcement Learning (DRL) offers a solution to these challenges by training versatile neural network policies. Nevertheless, the application of DRL algorithms to AUVs has been predominantly limited to simulated environments due to their inherent high sample complexity and the distribution shift problem. This paper introduces a novel approach by combining the Maximum Entropy Deep Reinforcement Learning framework with a classic model-based control architecture to formulate an adaptive controller. In this framework, we propose a Sim-to-Real transfer strategy, incorporating a bio-inspired experience replay mechanism, an enhanced domain randomisation technique, and an evaluation protocol executed on a physical platform. Our experimental assessments demonstrate the effectiveness of this method in learning proficient policies from suboptimal simulated models of the AUV. When transferred to a real-world vehicle, the approach exhibits a control performance three times higher compared to its model-based nonadaptive but optimal counterpart.
基于学习的自适应控制方法有可能使自主代理减轻过程变化的影响,而只需最少的人工干预。然而,这些方法在自主水下航行器(AUV)中的应用受到两大挑战的制约:(1)存在以海流干扰为形式的未知动态,由于传感器能力有限,无法对其进行建模或测量,特别是在较小的低成本 AUV 上;(2)AUV 任务的非线性,控制器在某些工作点的响应必须过于保守,以满足其他点的规格要求。深度强化学习(DRL)通过训练多功能神经网络策略为这些挑战提供了解决方案。然而,由于其固有的高样本复杂性和分布偏移问题,DRL 算法在 AUV 上的应用主要局限于模拟环境。本文引入了一种新方法,将最大熵深度强化学习框架与经典的基于模型的控制架构相结合,以制定自适应控制器。在这一框架中,我们提出了一种从模拟到真实的转移策略,其中融合了生物启发的经验重放机制、增强型域随机化技术以及在物理平台上执行的评估协议。我们的实验评估证明了这种方法在从次优的自动潜航器仿真模型中学习熟练策略方面的有效性。与基于模型的非自适应但最优的对应方法相比,当将该方法移植到真实世界的飞行器上时,其控制性能要高出三倍。
{"title":"Sim-to-real transfer of adaptive control parameters for AUV stabilisation under current disturbance","authors":"Thomas Chaffre, Jonathan Wheare, Andrew Lammas, Paulo Santos, Gilles Le Chenadec, Karl Sammut, Benoit Clement","doi":"10.1177/02783649241272115","DOIUrl":"https://doi.org/10.1177/02783649241272115","url":null,"abstract":"Learning-based adaptive control methods hold the potential to empower autonomous agents in mitigating the impact of process variations with minimal human intervention. However, their application to autonomous underwater vehicles (AUVs) has been constrained by two main challenges: (1) the presence of unknown dynamics in the form of sea current disturbances, which cannot be modelled or measured due to limited sensor capability, particularly on smaller low-cost AUVs, and (2) the nonlinearity of AUV tasks, where the controller response at certain operating points must be excessively conservative to meet specifications at other points. Deep Reinforcement Learning (DRL) offers a solution to these challenges by training versatile neural network policies. Nevertheless, the application of DRL algorithms to AUVs has been predominantly limited to simulated environments due to their inherent high sample complexity and the distribution shift problem. This paper introduces a novel approach by combining the Maximum Entropy Deep Reinforcement Learning framework with a classic model-based control architecture to formulate an adaptive controller. In this framework, we propose a Sim-to-Real transfer strategy, incorporating a bio-inspired experience replay mechanism, an enhanced domain randomisation technique, and an evaluation protocol executed on a physical platform. Our experimental assessments demonstrate the effectiveness of this method in learning proficient policies from suboptimal simulated models of the AUV. When transferred to a real-world vehicle, the approach exhibits a control performance three times higher compared to its model-based nonadaptive but optimal counterpart.","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"5 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142205784","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
No compromise in solution quality: Speeding up belief-dependent continuous partially observable Markov decision processes via adaptive multilevel simplification 解决方案质量不打折扣:通过自适应多级简化加速依赖信念的连续部分可观测马尔可夫决策过程
Pub Date : 2024-09-09 DOI: 10.1177/02783649241261398
Andrey Zhitnikov, Ori Sztyglic, Vadim Indelman
Continuous Partially Observable Markov Decision Processes (POMDPs) with general belief-dependent rewards are notoriously difficult to solve online. In this paper, we present a complete provable theory of adaptive multilevel simplification for the setting of a given externally constructed belief tree and Monte Carlo Tree Search (MCTS) that constructs the belief tree on the fly using an exploration technique. Our theory allows to accelerate POMDP planning with belief-dependent rewards without any sacrifice in the quality of the obtained solution. We rigorously prove each theoretical claim in the proposed unified theory. Using the general theoretical results, we present three algorithms to accelerate continuous POMDP online planning with belief-dependent rewards. Our two algorithms, SITH-BSP and LAZY-SITH-BSP, can be utilized on top of any method that constructs a belief tree externally. The third algorithm, SITH-PFT, is an anytime MCTS method that permits to plug-in any exploration technique. All our methods are guaranteed to return exactly the same optimal action as their unsimplified equivalents. We replace the costly computation of information-theoretic rewards with novel adaptive upper and lower bounds which we derive in this paper, and are of independent interest. We show that they are easy to calculate and can be tightened by the demand of our algorithms. Our approach is general; namely, any bounds that monotonically converge to the reward can be utilized to achieve a significant speedup without any loss in performance. Our theory and algorithms support the challenging setting of continuous states, actions, and observations. The beliefs can be parametric or general and represented by weighted particles. We demonstrate in simulation a significant speedup in planning compared to baseline approaches with guaranteed identical performance.
具有一般信念依赖奖励的连续部分可观测马尔可夫决策过程(POMDPs)在线求解的难度是众所周知的。在本文中,我们针对给定外部构建的信念树和蒙特卡罗树搜索(Monte Carlo Tree Search,MCTS)提出了一套完整的可证明的自适应多级简化理论,该理论可使用探索技术快速构建信念树。我们的理论允许在不牺牲所获解决方案质量的情况下,加速具有依赖于信念的奖励的 POMDP 规划。我们严格证明了所提出的统一理论中的每个理论主张。利用一般理论结果,我们提出了三种算法来加速具有信念依赖奖励的连续 POMDP 在线规划。我们的两种算法 SITH-BSP 和 LAZY-SITH-BSP 可用于任何从外部构建信念树的方法。第三种算法 SITH-PFT 是一种随时 MCTS 方法,允许插入任何探索技术。我们的所有方法都能保证返回与其未简化等效方法完全相同的最优行动。我们用新颖的自适应上界和下界取代了代价高昂的信息论奖励计算,这些上界和下界是我们在本文中推导出来的,具有独立的意义。我们证明,它们很容易计算,而且可以根据我们算法的要求加以收紧。我们的方法是通用的,即可以利用任何单调收敛于奖励的边界,在不损失任何性能的情况下实现显著提速。我们的理论和算法支持具有挑战性的连续状态、行动和观察设置。信念可以是参数信念,也可以是一般信念,并用加权粒子表示。我们在仿真中证明,与保证性能相同的基线方法相比,规划速度明显加快。
{"title":"No compromise in solution quality: Speeding up belief-dependent continuous partially observable Markov decision processes via adaptive multilevel simplification","authors":"Andrey Zhitnikov, Ori Sztyglic, Vadim Indelman","doi":"10.1177/02783649241261398","DOIUrl":"https://doi.org/10.1177/02783649241261398","url":null,"abstract":"Continuous Partially Observable Markov Decision Processes (POMDPs) with general belief-dependent rewards are notoriously difficult to solve online. In this paper, we present a complete provable theory of adaptive multilevel simplification for the setting of a given externally constructed belief tree and Monte Carlo Tree Search (MCTS) that constructs the belief tree on the fly using an exploration technique. Our theory allows to accelerate POMDP planning with belief-dependent rewards without any sacrifice in the quality of the obtained solution. We rigorously prove each theoretical claim in the proposed unified theory. Using the general theoretical results, we present three algorithms to accelerate continuous POMDP online planning with belief-dependent rewards. Our two algorithms, SITH-BSP and LAZY-SITH-BSP, can be utilized on top of any method that constructs a belief tree externally. The third algorithm, SITH-PFT, is an anytime MCTS method that permits to plug-in any exploration technique. All our methods are guaranteed to return exactly the same optimal action as their unsimplified equivalents. We replace the costly computation of information-theoretic rewards with novel adaptive upper and lower bounds which we derive in this paper, and are of independent interest. We show that they are easy to calculate and can be tightened by the demand of our algorithms. Our approach is general; namely, any bounds that monotonically converge to the reward can be utilized to achieve a significant speedup without any loss in performance. Our theory and algorithms support the challenging setting of continuous states, actions, and observations. The beliefs can be parametric or general and represented by weighted particles. We demonstrate in simulation a significant speedup in planning compared to baseline approaches with guaranteed identical performance.","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"6 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142205789","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dataset and Benchmark: Novel Sensors for Autonomous Vehicle Perception 数据集和基准:用于自动驾驶车辆感知的新型传感器
Pub Date : 2024-09-07 DOI: 10.1177/02783649241273554
Spencer Carmichael, Austin Buchan, Mani Ramanagopal, Radhika Ravi, Ram Vasudevan, Katherine A Skinner
Conventional cameras employed in autonomous vehicle (AV) systems support many perception tasks but are challenged by low-light or high dynamic range scenes, adverse weather, and fast motion. Novel sensors, such as event and thermal cameras, offer capabilities with the potential to address these scenarios, but they remain to be fully exploited. This paper introduces the Novel Sensors for Autonomous Vehicle Perception (NSAVP) dataset to facilitate future research on this topic. The dataset was captured with a platform including stereo event, thermal, monochrome, and RGB cameras as well as a high precision navigation system providing ground truth poses. The data was collected by repeatedly driving two ∼8 km routes and includes varied lighting conditions and opposing viewpoint perspectives. We provide benchmarking experiments on the task of place recognition to demonstrate challenges and opportunities for novel sensors to enhance critical AV perception tasks. To our knowledge, the NSAVP dataset is the first to include stereo thermal cameras together with stereo event and monochrome cameras. The dataset and supporting software suite is available at https://umautobots.github.io/nsavp .
自动驾驶汽车(AV)系统中使用的传统摄像头可支持许多感知任务,但在低照度或高动态范围场景、恶劣天气和快速运动时却面临挑战。新型传感器,如事件和热像仪,具有解决这些问题的潜力,但仍有待充分利用。本文介绍了用于自主车辆感知的新型传感器(NSAVP)数据集,以促进未来对这一主题的研究。该数据集由一个平台采集,该平台包括立体事件、热敏、单色和 RGB 摄像机以及提供地面实况姿势的高精度导航系统。数据是通过重复驾驶两条 8 公里长的路线收集的,包括不同的照明条件和不同的视角。我们提供了地点识别任务的基准实验,以展示新型传感器在增强关键视听感知任务方面所面临的挑战和机遇。据我们所知,NSAVP 数据集是首个包含立体热像仪、立体事件相机和单色相机的数据集。该数据集和支持软件套件可在 https://umautobots.github.io/nsavp 上获取。
{"title":"Dataset and Benchmark: Novel Sensors for Autonomous Vehicle Perception","authors":"Spencer Carmichael, Austin Buchan, Mani Ramanagopal, Radhika Ravi, Ram Vasudevan, Katherine A Skinner","doi":"10.1177/02783649241273554","DOIUrl":"https://doi.org/10.1177/02783649241273554","url":null,"abstract":"Conventional cameras employed in autonomous vehicle (AV) systems support many perception tasks but are challenged by low-light or high dynamic range scenes, adverse weather, and fast motion. Novel sensors, such as event and thermal cameras, offer capabilities with the potential to address these scenarios, but they remain to be fully exploited. This paper introduces the Novel Sensors for Autonomous Vehicle Perception (NSAVP) dataset to facilitate future research on this topic. The dataset was captured with a platform including stereo event, thermal, monochrome, and RGB cameras as well as a high precision navigation system providing ground truth poses. The data was collected by repeatedly driving two ∼8 km routes and includes varied lighting conditions and opposing viewpoint perspectives. We provide benchmarking experiments on the task of place recognition to demonstrate challenges and opportunities for novel sensors to enhance critical AV perception tasks. To our knowledge, the NSAVP dataset is the first to include stereo thermal cameras together with stereo event and monochrome cameras. The dataset and supporting software suite is available at https://umautobots.github.io/nsavp .","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"49 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142205790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multi-visual-inertial system: Analysis, calibration, and estimation 多视觉惯性系统:分析、校准和估算
Pub Date : 2024-08-26 DOI: 10.1177/02783649241245726
Yulin Yang, Patrick Geneva, Guoquan Huang
In this paper, we study state estimation of multi-visual-inertial systems (MVIS) and develop sensor fusion algorithms to optimally fuse an arbitrary number of asynchronous inertial measurement units (IMUs) or gyroscopes and global and/or rolling shutter cameras. We are especially interested in the full calibration of the associated visual-inertial sensors, including the IMU/camera intrinsics and the IMU-IMU/camera spatiotemporal extrinsics as well as the image readout time of rolling-shutter cameras (if used). To this end, we develop a new analytic combined IMU integration with inertial intrinsics—termed ACI3—to pre-integrate IMU measurements, which is leveraged to fuse auxiliary IMUs and/or gyroscopes alongside a base IMU. We model the multi-inertial measurements to include all the necessary inertial intrinsic and IMU-IMU spatiotemporal extrinsic parameters, while leveraging IMU-IMU rigid-body constraints to eliminate the necessity of auxiliary inertial poses and thus reducing computational complexity. By performing observability analysis of MVIS, we prove that the standard four unobservable directions remain—no matter how many inertial sensors are used, and also identify, for the first time, degenerate motions for IMU-IMU spatiotemporal extrinsics and auxiliary inertial intrinsics. In addition to extensive simulations that validate our analysis and algorithms, we have built our own MVIS sensor rig and collected over 25 real-world datasets to experimentally verify the proposed calibration against the state-of-the-art calibration method Kalibr. We show that the proposed MVIS calibration is able to achieve competing accuracy with improved convergence and repeatability, which is open sourced to better benefit the community.
在本文中,我们研究了多视觉惯性系统(MVIS)的状态估计,并开发了传感器融合算法,以优化融合任意数量的异步惯性测量单元(IMU)或陀螺仪以及全局和/或滚动快门相机。我们对相关视觉惯性传感器的全面校准特别感兴趣,包括 IMU/相机的本征、IMU-IMU/相机的时空外征以及滚动快门相机(如果使用)的图像读出时间。为此,我们开发了一种新的分析方法,将 IMU 与惯性本征相结合--称为 ACI3--对 IMU 测量进行预集成,并利用它将辅助 IMU 和/或陀螺仪与基本 IMU 融合在一起。我们对多惯性测量进行建模,以包含所有必要的惯性本征参数和 IMU-IMU 时空外征参数,同时利用 IMU-IMU 刚体约束消除辅助惯性姿势的必要性,从而降低计算复杂性。通过对 MVIS 进行可观测性分析,我们证明了无论使用多少个惯性传感器,标准的四个不可观测方向依然存在,并首次确定了 IMU-IMU 时空外参量和辅助惯性内参量的退化运动。除了验证我们的分析和算法的大量模拟之外,我们还建立了自己的 MVIS 传感器平台,并收集了超过 25 个真实世界的数据集,以实验验证所提出的校准方法与最先进的校准方法 Kalibr 的对比。我们的研究表明,所提出的 MVIS 校准方法能够达到与之相媲美的精度,同时还提高了收敛性和可重复性。
{"title":"Multi-visual-inertial system: Analysis, calibration, and estimation","authors":"Yulin Yang, Patrick Geneva, Guoquan Huang","doi":"10.1177/02783649241245726","DOIUrl":"https://doi.org/10.1177/02783649241245726","url":null,"abstract":"In this paper, we study state estimation of multi-visual-inertial systems (MVIS) and develop sensor fusion algorithms to optimally fuse an arbitrary number of asynchronous inertial measurement units (IMUs) or gyroscopes and global and/or rolling shutter cameras. We are especially interested in the full calibration of the associated visual-inertial sensors, including the IMU/camera intrinsics and the IMU-IMU/camera spatiotemporal extrinsics as well as the image readout time of rolling-shutter cameras (if used). To this end, we develop a new analytic combined IMU integration with inertial intrinsics—termed ACI<jats:sup>3</jats:sup>—to pre-integrate IMU measurements, which is leveraged to fuse auxiliary IMUs and/or gyroscopes alongside a base IMU. We model the multi-inertial measurements to include all the necessary inertial intrinsic and IMU-IMU spatiotemporal extrinsic parameters, while leveraging IMU-IMU rigid-body constraints to eliminate the necessity of auxiliary inertial poses and thus reducing computational complexity. By performing observability analysis of MVIS, we prove that the standard four unobservable directions remain—no matter how many inertial sensors are used, and also identify, for the first time, degenerate motions for IMU-IMU spatiotemporal extrinsics and auxiliary inertial intrinsics. In addition to extensive simulations that validate our analysis and algorithms, we have built our own MVIS sensor rig and collected over 25 real-world datasets to experimentally verify the proposed calibration against the state-of-the-art calibration method Kalibr. We show that the proposed MVIS calibration is able to achieve competing accuracy with improved convergence and repeatability, which is open sourced to better benefit the community.","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142205792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploiting body redundancy to control supernumerary robotic limbs in human augmentation 利用肢体冗余控制增强人体功能的编外机器人肢体
Pub Date : 2024-08-22 DOI: 10.1177/02783649241265451
Tommaso Lisini Baldi, Nicole D’Aurizio, Chiara Gaudeni, Sergio Gurgone, Daniele Borzelli, Andrea d’Avella, Domenico Prattichizzo
In the last decades, supernumerary robotic limbs (SRLs) have been proposed as technological aids for rehabilitation, assistance, and functional augmentation. Whether they are in the form of wearable devices or grounded systems, SRLs can be used to compensate for lost motor functions in patients with disabilities, as well as to augment the human sensorimotor capabilities. By using SRLs, users gain the ability to perform a wide range of complex tasks that may otherwise be challenging or even impossible with their natural limbs. Designing effective strategies and policies for the control and operation of SRLs represents a substantial challenge in their development. A key aspect that remains insufficiently addressed is the formulation of successful and intuitive augmentation policies that do not hinder the functionality of a person’s natural limbs. This work introduces an innovative strategy based on the exploitation of the redundancy of the human kinematic chain involved in a task for commanding SRLs having one degree of freedom. This concept is summarized in the definition of the Intrinsic Kinematic Null Space (IKNS). The newly developed procedure encompasses a real-time analysis of body motion and a subsequent computation of the control signal for SRLs based on the IKNS for single-arm tasks. What sets our approach apart is its explicit emphasis on incorporating user-specific biomechanical and physiological characteristics and constraints. This ensures an efficient and intuitive approach to commanding SRLs, tailored to the individual user’s needs. Towards a complete evaluation of the proposed system, we studied the users’ capability of exploiting the IKNS both in virtual and real environments. Obtained results demonstrated that the exploitation of the Intrinsic Kinematic Null Space allows to perform complex tasks involving both biological and artificial limbs, and that practice improves the ability to accurately manage the coordination of human and supernumerary artificial limbs.
在过去的几十年里,人们提出将编外机器人肢体(SRL)作为康复、辅助和功能增强的技术辅助工具。无论是采用可穿戴设备还是接地系统的形式,SRL 都可用于补偿残疾患者丧失的运动功能,以及增强人类的感知运动能力。通过使用自恢复肢体运动器械,使用者可以完成各种复杂的任务,而这些任务如果使用他们的天然肢体可能会很困难,甚至是不可能完成的。设计有效的策略和政策来控制和操作自恢复肢体是自恢复肢体开发过程中的一项重大挑战。目前仍未充分解决的一个关键问题是,如何制定成功且直观的增强策略,同时又不妨碍个人自然肢体的功能。这项工作介绍了一种创新策略,其基础是利用任务中涉及的人体运动链的冗余来指挥具有一个自由度的 SRL。这一概念概括为 "内在运动学无效空间"(IKNS)的定义。新开发的程序包括对身体运动的实时分析,以及随后根据单臂任务的 IKNS 计算 SRL 的控制信号。我们的方法与众不同之处在于,它明确强调将用户特定的生物力学和生理特征及限制因素纳入其中。这确保了以高效、直观的方法指挥 SRL,满足用户的个性化需求。为了对所提议的系统进行全面评估,我们研究了用户在虚拟和真实环境中使用 IKNS 的能力。研究结果表明,利用本征运动学无效空间可以完成涉及生物肢体和人工肢体的复杂任务,而且通过练习可以提高准确管理人类肢体和编外人工肢体协调的能力。
{"title":"Exploiting body redundancy to control supernumerary robotic limbs in human augmentation","authors":"Tommaso Lisini Baldi, Nicole D’Aurizio, Chiara Gaudeni, Sergio Gurgone, Daniele Borzelli, Andrea d’Avella, Domenico Prattichizzo","doi":"10.1177/02783649241265451","DOIUrl":"https://doi.org/10.1177/02783649241265451","url":null,"abstract":"In the last decades, supernumerary robotic limbs (SRLs) have been proposed as technological aids for rehabilitation, assistance, and functional augmentation. Whether they are in the form of wearable devices or grounded systems, SRLs can be used to compensate for lost motor functions in patients with disabilities, as well as to augment the human sensorimotor capabilities. By using SRLs, users gain the ability to perform a wide range of complex tasks that may otherwise be challenging or even impossible with their natural limbs. Designing effective strategies and policies for the control and operation of SRLs represents a substantial challenge in their development. A key aspect that remains insufficiently addressed is the formulation of successful and intuitive augmentation policies that do not hinder the functionality of a person’s natural limbs. This work introduces an innovative strategy based on the exploitation of the redundancy of the human kinematic chain involved in a task for commanding SRLs having one degree of freedom. This concept is summarized in the definition of the Intrinsic Kinematic Null Space (IKNS). The newly developed procedure encompasses a real-time analysis of body motion and a subsequent computation of the control signal for SRLs based on the IKNS for single-arm tasks. What sets our approach apart is its explicit emphasis on incorporating user-specific biomechanical and physiological characteristics and constraints. This ensures an efficient and intuitive approach to commanding SRLs, tailored to the individual user’s needs. Towards a complete evaluation of the proposed system, we studied the users’ capability of exploiting the IKNS both in virtual and real environments. Obtained results demonstrated that the exploitation of the Intrinsic Kinematic Null Space allows to perform complex tasks involving both biological and artificial limbs, and that practice improves the ability to accurately manage the coordination of human and supernumerary artificial limbs.","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"9 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142205791","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A direct-drive five-bar manipulator with tuned directional first-order kinematics for low energy consumption in vertical loading 具有调整方向一阶运动学的直接驱动五杆机械手,可在垂直装载中实现低能耗
Pub Date : 2024-08-13 DOI: 10.1177/02783649241266852
Shashank Ramesh, Mark Plecnik
The kinematic configuration space of a manipulator determines the set of all possible motions that may occur, and its differential properties have a strong, albeit indirect, influence on both static and dynamic performance. By viewing first-order kinematics as a field of Jacobian-defined ellipses across a workspace, a novel two degree-of-freedom manipulator was designed, and is tested in this paper for its benefits. The manipulator exhibits a field of ellipses that biases transmission characteristics in Cartesian directions of the end-effector. The horizontal direction is biased toward speed in order to move across the width of the workspace quickly, while the vertical direction is biased toward force production in order to resist gravitational loads. The latter bias endows the manipulator with load capacity in the absence of gears. Such an exclusion can forego the extra weight, complexity, backlash, transmission losses, and fragility of gearboxes. Additionally, a direct drive set-up improves backdrivability and transparency. The latter is relevant to applications that involve interacting with the environment or people. Our novel design is set through an array of theoretical and experimental performance studies in comparison to a conventional direct drive manipulator. The experimental results showed a 3.75× increase in payload capacity, a 2× increase in dynamic tracking accuracy, a 2.07× increase in dynamic cycling frequency, and at least a 3.70× reduction in power consumption, considering both static and dynamic experiments.
机械手的运动学配置空间决定了可能发生的所有运动的集合,其差分特性对静态和动态性能都有很大的影响,尽管这种影响是间接的。通过将一阶运动学视为整个工作空间中雅各布定义的椭圆场,设计出了一种新型两自由度机械手,并在本文中对其优势进行了测试。该机械手表现出的椭圆场偏向于末端执行器笛卡尔方向的传动特性。水平方向偏向于速度,以便快速穿过工作空间的宽度,而垂直方向偏向于力的产生,以便抵抗重力负荷。后一种偏向赋予了机械手在没有齿轮的情况下的负载能力。这种排除可以避免齿轮箱的额外重量、复杂性、反向间隙、传动损耗和易损性。此外,直接驱动装置还能提高反向驱动能力和透明度。后者与涉及与环境或人互动的应用相关。与传统的直接驱动机械手相比,我们的新颖设计通过一系列理论和实验性能研究得以确定。实验结果表明,考虑到静态和动态实验,有效载荷能力提高了 3.75 倍,动态跟踪精度提高了 2 倍,动态循环频率提高了 2.07 倍,功耗至少降低了 3.70 倍。
{"title":"A direct-drive five-bar manipulator with tuned directional first-order kinematics for low energy consumption in vertical loading","authors":"Shashank Ramesh, Mark Plecnik","doi":"10.1177/02783649241266852","DOIUrl":"https://doi.org/10.1177/02783649241266852","url":null,"abstract":"The kinematic configuration space of a manipulator determines the set of all possible motions that may occur, and its differential properties have a strong, albeit indirect, influence on both static and dynamic performance. By viewing first-order kinematics as a field of Jacobian-defined ellipses across a workspace, a novel two degree-of-freedom manipulator was designed, and is tested in this paper for its benefits. The manipulator exhibits a field of ellipses that biases transmission characteristics in Cartesian directions of the end-effector. The horizontal direction is biased toward speed in order to move across the width of the workspace quickly, while the vertical direction is biased toward force production in order to resist gravitational loads. The latter bias endows the manipulator with load capacity in the absence of gears. Such an exclusion can forego the extra weight, complexity, backlash, transmission losses, and fragility of gearboxes. Additionally, a direct drive set-up improves backdrivability and transparency. The latter is relevant to applications that involve interacting with the environment or people. Our novel design is set through an array of theoretical and experimental performance studies in comparison to a conventional direct drive manipulator. The experimental results showed a 3.75× increase in payload capacity, a 2× increase in dynamic tracking accuracy, a 2.07× increase in dynamic cycling frequency, and at least a 3.70× reduction in power consumption, considering both static and dynamic experiments.","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"32 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142205793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Active perception network for non-myopic online exploration and visual surface coverage 用于非近视在线探索和视觉表面覆盖的主动感知网络
Pub Date : 2024-08-03 DOI: 10.1177/02783649241264577
David Vutetakis, Jing Xiao
This work addresses the problem of online exploration and visual sensor coverage of unknown environments. We introduce a novel perception roadmap we refer to as the Active Perception Network (APN) that serves as a hierarchical topological graph describing how to traverse and perceive an incrementally built spatial map of the environment. The APN state is incrementally updated to expand a connected configuration space that extends throughout as much of the known space as possible, using efficient difference-awareness techniques that track the discrete changes of the spatial map to inform the updates. A frontier-guided approach is presented for efficient evaluation of information gain and covisible information, which guides view sampling and refinement to ensure maximum coverage of the unmapped space is maintained within the APN. The updated roadmap is hierarchically decomposed into subgraph regions which we use to facilitate a non-myopic global view sequence planner. A comparative analysis to several state-of-the-art approaches was conducted, showing significant performance improvements in terms of total exploration time and surface coverage, and demonstrating high computational efficiency that is scalable to large and complex environments.
这项研究解决了在线探索和视觉传感器覆盖未知环境的问题。我们引入了一种新颖的感知路线图,我们称之为主动感知网络(APN),它是一个分层拓扑图,描述了如何穿越和感知增量构建的环境空间地图。APN 的状态会逐步更新,以扩展一个连接的配置空间,该空间会尽可能多地扩展到已知空间,并使用高效的差异感知技术来跟踪空间地图的离散变化,为更新提供信息。提出了一种前沿引导方法,用于高效评估信息增益和可视信息,指导视图采样和细化,以确保在 APN 内保持对未绘制空间的最大覆盖。我们将更新后的路线图分层分解为子图区域,用于促进非近视全局视图序列规划。我们对几种最先进的方法进行了比较分析,结果表明,在总探索时间和表面覆盖率方面,该方法的性能有了显著提高,而且计算效率很高,可扩展到大型复杂环境。
{"title":"Active perception network for non-myopic online exploration and visual surface coverage","authors":"David Vutetakis, Jing Xiao","doi":"10.1177/02783649241264577","DOIUrl":"https://doi.org/10.1177/02783649241264577","url":null,"abstract":"This work addresses the problem of online exploration and visual sensor coverage of unknown environments. We introduce a novel perception roadmap we refer to as the Active Perception Network (APN) that serves as a hierarchical topological graph describing how to traverse and perceive an incrementally built spatial map of the environment. The APN state is incrementally updated to expand a connected configuration space that extends throughout as much of the known space as possible, using efficient difference-awareness techniques that track the discrete changes of the spatial map to inform the updates. A frontier-guided approach is presented for efficient evaluation of information gain and covisible information, which guides view sampling and refinement to ensure maximum coverage of the unmapped space is maintained within the APN. The updated roadmap is hierarchically decomposed into subgraph regions which we use to facilitate a non-myopic global view sequence planner. A comparative analysis to several state-of-the-art approaches was conducted, showing significant performance improvements in terms of total exploration time and surface coverage, and demonstrating high computational efficiency that is scalable to large and complex environments.","PeriodicalId":501362,"journal":{"name":"The International Journal of Robotics Research","volume":"41 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141934159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
The International Journal of Robotics Research
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1