首页 > 最新文献

International Journal of Robotics Research最新文献

英文 中文
Automatic encoding and repair of reactive high-level tasks with learned abstract representations 具有学习抽象表示的反应式高级任务的自动编码和修复
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-04-18 DOI: 10.1177/02783649231167207
Adam Pacheck, Steven D. James, G. Konidaris, H. Kress-Gazit
We present a framework for the automatic encoding and repair of high-level tasks. Given a set of skills a robot can perform, our approach first abstracts sensor data into symbols and then automatically encodes the robot’s capabilities in Linear Temporal Logic (LTL). Using this encoding, a user can specify reactive high-level tasks, for which we can automatically synthesize a strategy that executes on the robot, if the task is feasible. If a task is not feasible given the robot’s capabilities, we present two methods, one enumeration-based and one synthesis-based, for automatically suggesting additional skills for the robot or modifications to existing skills that would make the task feasible. We demonstrate our framework on a Baxter robot manipulating blocks on a table, a Baxter robot manipulating plates on a table, and a Kinova arm manipulating vials, with multiple sensor modalities, including raw images.
我们提出了一个用于高级任务的自动编码和修复的框架。给定机器人可以执行的一组技能,我们的方法首先将传感器数据抽象为符号,然后用线性时序逻辑(LTL)自动编码机器人的能力。使用这种编码,用户可以指定反应性高级任务,如果任务可行,我们可以自动合成在机器人上执行的策略。如果一项任务在给定机器人能力的情况下不可行,我们提出了两种方法,一种是基于枚举的方法,另一种是根据综合的方法,用于自动建议机器人的额外技能或对现有技能的修改,使任务可行。我们在操作桌子上的块的Baxter机器人、操作桌子上板的Baxteer机器人和操作小瓶的Kinova臂上展示了我们的框架,具有多个传感器模态,包括原始图像。
{"title":"Automatic encoding and repair of reactive high-level tasks with learned abstract representations","authors":"Adam Pacheck, Steven D. James, G. Konidaris, H. Kress-Gazit","doi":"10.1177/02783649231167207","DOIUrl":"https://doi.org/10.1177/02783649231167207","url":null,"abstract":"We present a framework for the automatic encoding and repair of high-level tasks. Given a set of skills a robot can perform, our approach first abstracts sensor data into symbols and then automatically encodes the robot’s capabilities in Linear Temporal Logic (LTL). Using this encoding, a user can specify reactive high-level tasks, for which we can automatically synthesize a strategy that executes on the robot, if the task is feasible. If a task is not feasible given the robot’s capabilities, we present two methods, one enumeration-based and one synthesis-based, for automatically suggesting additional skills for the robot or modifications to existing skills that would make the task feasible. We demonstrate our framework on a Baxter robot manipulating blocks on a table, a Baxter robot manipulating plates on a table, and a Kinova arm manipulating vials, with multiple sensor modalities, including raw images.","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49515007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Magnetic concentric tube robots: Introduction and analysis 磁同心管机器人:介绍与分析
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-04-01 DOI: 10.1177/02783649211071113
Quentin Peyron, Q. Boehler, P. Rougeot, Pierre Roux, B. Nelson, N. Andreff, K. Rabenorosoa, P. Renaud
In this paper, we propose a new type of continuum robot, referred to as a magnetic concentric tube robot (M-CTR), for performing minimally invasive surgery in narrow and difficult-to-access areas. The robot combines concentric tubes and magnetic actuation to benefit from the ‘follow the leader’ behaviour, the dexterity and stability of existing robots, while targeting millimetre-sized external diameters. These three kinematic properties are assessed through numerical and experimental studies performed on a prototype of a M-CTR. They are performed with general forward and inverse kineto-static models of the robot, continuation and bifurcation analysis, and a specific experimental setup. The prototype presents unique capabilities in terms of deployment and active stability management, while its dexterity in terms of tip orientability is also among the best reported for other robots at its scale.
在本文中,我们提出了一种新型的连续体机器人,称为磁性同心管机器人(M-CTR),用于在狭窄且难以进入的区域进行微创手术。该机器人结合了同心管和磁性驱动,以受益于现有机器人的“跟随领导者”行为、灵活性和稳定性,同时瞄准毫米大小的外径。这三种运动学特性是通过对M-CTR原型进行的数值和实验研究来评估的。它们是通过机器人的一般正运动学和逆运动学静态模型、连续性和分岔分析以及特定的实验装置进行的。该原型在部署和主动稳定性管理方面表现出独特的能力,而其尖端可定向性方面的灵活性也在同类规模的其他机器人中名列前茅。
{"title":"Magnetic concentric tube robots: Introduction and analysis","authors":"Quentin Peyron, Q. Boehler, P. Rougeot, Pierre Roux, B. Nelson, N. Andreff, K. Rabenorosoa, P. Renaud","doi":"10.1177/02783649211071113","DOIUrl":"https://doi.org/10.1177/02783649211071113","url":null,"abstract":"In this paper, we propose a new type of continuum robot, referred to as a magnetic concentric tube robot (M-CTR), for performing minimally invasive surgery in narrow and difficult-to-access areas. The robot combines concentric tubes and magnetic actuation to benefit from the ‘follow the leader’ behaviour, the dexterity and stability of existing robots, while targeting millimetre-sized external diameters. These three kinematic properties are assessed through numerical and experimental studies performed on a prototype of a M-CTR. They are performed with general forward and inverse kineto-static models of the robot, continuation and bifurcation analysis, and a specific experimental setup. The prototype presents unique capabilities in terms of deployment and active stability management, while its dexterity in terms of tip orientability is also among the best reported for other robots at its scale.","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43318229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
RadarSLAM: A robust simultaneous localization and mapping system for all weather conditions RadarSLAM:一个适用于所有天气条件的强大的同时定位和绘图系统
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-04-01 DOI: 10.1177/02783649221080483
Ziyang Hong, Y. Pétillot, Andrew M. Wallace, Sen Wang
A Simultaneous Localization and Mapping (SLAM) system must be robust to support long-term mobile vehicle and robot applications. However, camera and LiDAR based SLAM systems can be fragile when facing challenging illumination or weather conditions which degrade the utility of imagery and point cloud data. Radar, whose operating electromagnetic spectrum is less affected by environmental changes, is promising although its distinct sensor model and noise characteristics bring open challenges when being exploited for SLAM. This paper studies the use of a Frequency Modulated Continuous Wave radar for SLAM in large-scale outdoor environments. We propose a full radar SLAM system, including a novel radar motion estimation algorithm that leverages radar geometry for reliable feature tracking. It also optimally compensates motion distortion and estimates pose by joint optimization. Its loop closure component is designed to be simple yet efficient for radar imagery by capturing and exploiting structural information of the surrounding environment. Extensive experiments on three public radar datasets, ranging from city streets and residential areas to countryside and highways, show competitive accuracy and reliability performance of the proposed radar SLAM system compared to the state-of-the-art LiDAR, vision and radar methods. The results show that our system is technically viable in achieving reliable SLAM in extreme weather conditions on the RADIATE Dataset, for example, heavy snow and dense fog, demonstrating the promising potential of using radar for all-weather localization and mapping.
同时定位和绘图(SLAM)系统必须具有鲁棒性,以支持长期的移动车辆和机器人应用。然而,当面对具有挑战性的照明或天气条件时,基于相机和激光雷达的SLAM系统可能会变得脆弱,这会降低图像和点云数据的效用。雷达的工作电磁频谱受环境变化的影响较小,虽然其独特的传感器模型和噪声特性在SLAM应用中带来了开放的挑战,但仍有发展前景。本文研究了调频连续波雷达在大规模室外环境下SLAM中的应用。我们提出了一个完整的雷达SLAM系统,包括一种新的雷达运动估计算法,该算法利用雷达几何结构进行可靠的特征跟踪。并通过关节优化对运动畸变进行最优补偿和姿态估计。它的闭环组件通过捕获和利用周围环境的结构信息,设计得简单而高效。在三个公共雷达数据集上进行了广泛的实验,从城市街道和居民区到农村和高速公路,与最先进的激光雷达、视觉和雷达方法相比,所提出的雷达SLAM系统具有竞争力的准确性和可靠性。结果表明,我们的系统在技术上是可行的,可以在辐射数据集的极端天气条件下实现可靠的SLAM,例如大雪和浓雾,展示了使用雷达进行全天候定位和测绘的潜力。
{"title":"RadarSLAM: A robust simultaneous localization and mapping system for all weather conditions","authors":"Ziyang Hong, Y. Pétillot, Andrew M. Wallace, Sen Wang","doi":"10.1177/02783649221080483","DOIUrl":"https://doi.org/10.1177/02783649221080483","url":null,"abstract":"A Simultaneous Localization and Mapping (SLAM) system must be robust to support long-term mobile vehicle and robot applications. However, camera and LiDAR based SLAM systems can be fragile when facing challenging illumination or weather conditions which degrade the utility of imagery and point cloud data. Radar, whose operating electromagnetic spectrum is less affected by environmental changes, is promising although its distinct sensor model and noise characteristics bring open challenges when being exploited for SLAM. This paper studies the use of a Frequency Modulated Continuous Wave radar for SLAM in large-scale outdoor environments. We propose a full radar SLAM system, including a novel radar motion estimation algorithm that leverages radar geometry for reliable feature tracking. It also optimally compensates motion distortion and estimates pose by joint optimization. Its loop closure component is designed to be simple yet efficient for radar imagery by capturing and exploiting structural information of the surrounding environment. Extensive experiments on three public radar datasets, ranging from city streets and residential areas to countryside and highways, show competitive accuracy and reliability performance of the proposed radar SLAM system compared to the state-of-the-art LiDAR, vision and radar methods. The results show that our system is technically viable in achieving reliable SLAM in extreme weather conditions on the RADIATE Dataset, for example, heavy snow and dense fog, demonstrating the promising potential of using radar for all-weather localization and mapping.","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47655744","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Sequential contact-based adaptive grasping for robotic hands 基于顺序接触的机器人手自适应抓取
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-04-01 DOI: 10.1177/02783649221081154
G. J. Pollayil, M. J. Pollayil, M. Catalano, A. Bicchi, G. Grioli
This paper proposes a novel type of grasping strategy that draws inspiration from the role of touch and the importance of wrist motions in human grasping. The proposed algorithm, which we call Sequential Contact-based Adaptive Grasping, can be used to reactively modify a given grasp plan according to contacts arising between the hand and the object. This technique, based on a systematic constraint categorization and an iterative task inversion procedure, is shown to lead to synchronized motions of the fingers and the wrist, as it can be observed in humans, and to increase grasp success rate by substantially mitigating the relevant problems of object slippage during hand closure and of uncertainties caused by the environment and by the perception system. After describing the grasping problem in its quasi-static aspects, the algorithm is derived and discussed with some simple simulations. The proposed method is general as it can be applied to different kinds of robotic hands. It refines a priori defined grasp plans and significantly reduces their accuracy requirements by relying only on a forward kinematic model and elementary contact information. The efficacy of our approach is confirmed by experimental results of tests performed on a collaborative robot manipulator equipped with a state-of-the-art underactuated soft hand.
本文提出了一种新的抓取策略,该策略的灵感来自于触觉的作用和手腕运动在人类抓取中的重要性。所提出的算法,我们称之为基于顺序接触的自适应抓取,可以根据手和物体之间产生的接触来反应性地修改给定的抓取计划。这种基于系统约束分类和迭代任务反演程序的技术被证明可以导致手指和手腕的同步运动,正如在人类中可以观察到的那样,并且通过大大减轻手部闭合时物体滑动以及由环境和感知系统引起的不确定性的相关问题来提高抓取成功率。在描述抓取问题的准静态方面后,推导了该算法,并进行了简单的仿真讨论。该方法具有通用性,可适用于不同类型的机械手。它改进了先验定义的抓取计划,并通过仅依赖正运动学模型和基本接触信息显著降低了抓取计划的精度要求。实验结果证实了该方法的有效性,该方法在配备了最先进的欠驱动软手的协作机器人机械手上进行了测试。
{"title":"Sequential contact-based adaptive grasping for robotic hands","authors":"G. J. Pollayil, M. J. Pollayil, M. Catalano, A. Bicchi, G. Grioli","doi":"10.1177/02783649221081154","DOIUrl":"https://doi.org/10.1177/02783649221081154","url":null,"abstract":"This paper proposes a novel type of grasping strategy that draws inspiration from the role of touch and the importance of wrist motions in human grasping. The proposed algorithm, which we call Sequential Contact-based Adaptive Grasping, can be used to reactively modify a given grasp plan according to contacts arising between the hand and the object. This technique, based on a systematic constraint categorization and an iterative task inversion procedure, is shown to lead to synchronized motions of the fingers and the wrist, as it can be observed in humans, and to increase grasp success rate by substantially mitigating the relevant problems of object slippage during hand closure and of uncertainties caused by the environment and by the perception system. After describing the grasping problem in its quasi-static aspects, the algorithm is derived and discussed with some simple simulations. The proposed method is general as it can be applied to different kinds of robotic hands. It refines a priori defined grasp plans and significantly reduces their accuracy requirements by relying only on a forward kinematic model and elementary contact information. The efficacy of our approach is confirmed by experimental results of tests performed on a collaborative robot manipulator equipped with a state-of-the-art underactuated soft hand.","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46066998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Planning to chronicle: Optimal policies for narrative observation of unpredictable events 计划编年史:对不可预测事件进行叙事观察的最佳策略
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-03-28 DOI: 10.1177/02783649211069154
Hazhar Rahmani, Dylan A. Shell, J. O’Kane
One important class of applications entails a robot scrutinizing, monitoring, or recording the evolution of an uncertain time-extended process. This sort of situation leads to an interesting family of active perception problems that can be cast as planning problems in which the robot is limited in what it sees and must, thus, choose what to pay attention to. The distinguishing characteristic of this setting is that the robot has influence over what it captures via its sensors, but exercises no causal authority over the process evolving in the world. As such, the robot’s objective is to observe the underlying process and to produce a “chronicle” of occurrent events, subject to a goal specification of the sorts of event sequences that may be of interest. This paper examines variants of such problems in which the robot aims to collect sets of observations to meet a rich specification of their sequential structure. We study this class of problems by modeling a stochastic process via a variant of a hidden Markov model and specify the event sequences of interest as a regular language, developing a vocabulary of “mutators” that enable sophisticated requirements to be expressed. Under different suppositions on the information gleaned about the event model, we formulate and solve different planning problems. The core underlying idea is the construction of a product between the event model and a specification automaton. Using this product, we compute a policy that minimizes the expected number of steps to reach a goal state. We introduce a general algorithm for this problem as well as several more efficient algorithms for important special cases. The paper reports and compares performance metrics by drawing on some small case studies analyzed in depth via simulation. Specifically, we study the effect of the robot’s observation model on the average time required for the robot to record a desired story. We also compare our algorithm with a baseline greedy algorithm, showing that our algorithm outperforms the greedy algorithm in terms of the average time to record a desired story. In addition, experiments show that the algorithms tailored to specialized variants of the problem are rather more efficient than the general algorithm.
一类重要的应用需要机器人仔细检查、监控或记录一个不确定的时间扩展过程的演变。这种情况导致了一系列有趣的主动感知问题,这些问题可以被视为计划问题,在这些问题中,机器人所看到的东西是有限的,因此必须选择关注什么。这种设置的显著特征是,机器人对其通过传感器捕获的内容具有影响力,但对世界的演变过程没有因果权威。因此,机器人的目标是观察潜在的过程,并根据可能感兴趣的事件序列的目标规范,生成发生事件的“编年史”。本文研究了此类问题的变体,其中机器人旨在收集观察集以满足其序列结构的丰富规范。我们通过一个隐马尔可夫模型的变体来建模一个随机过程,并将感兴趣的事件序列指定为一种规则语言来研究这类问题,开发了一个能够表达复杂需求的“突变子”词汇表。在对事件模型收集到的信息的不同假设下,我们制定和解决不同的规划问题。核心的基本思想是在事件模型和规范自动化之间构建产品。使用这个乘积,我们计算一个最小化达到目标状态所需步骤数的策略。我们介绍了解决该问题的一般算法以及针对重要特殊情况的几种更有效的算法。本文通过模拟深入分析了一些小型案例研究,报告并比较了性能指标。具体来说,我们研究了机器人的观察模型对机器人记录一个期望故事所需平均时间的影响。我们还将我们的算法与基线贪婪算法进行了比较,表明我们的算法在记录所需故事的平均时间方面优于贪婪算法。此外,实验表明,针对问题的特定变体定制的算法比通用算法效率更高。
{"title":"Planning to chronicle: Optimal policies for narrative observation of unpredictable events","authors":"Hazhar Rahmani, Dylan A. Shell, J. O’Kane","doi":"10.1177/02783649211069154","DOIUrl":"https://doi.org/10.1177/02783649211069154","url":null,"abstract":"One important class of applications entails a robot scrutinizing, monitoring, or recording the evolution of an uncertain time-extended process. This sort of situation leads to an interesting family of active perception problems that can be cast as planning problems in which the robot is limited in what it sees and must, thus, choose what to pay attention to. The distinguishing characteristic of this setting is that the robot has influence over what it captures via its sensors, but exercises no causal authority over the process evolving in the world. As such, the robot’s objective is to observe the underlying process and to produce a “chronicle” of occurrent events, subject to a goal specification of the sorts of event sequences that may be of interest. This paper examines variants of such problems in which the robot aims to collect sets of observations to meet a rich specification of their sequential structure. We study this class of problems by modeling a stochastic process via a variant of a hidden Markov model and specify the event sequences of interest as a regular language, developing a vocabulary of “mutators” that enable sophisticated requirements to be expressed. Under different suppositions on the information gleaned about the event model, we formulate and solve different planning problems. The core underlying idea is the construction of a product between the event model and a specification automaton. Using this product, we compute a policy that minimizes the expected number of steps to reach a goal state. We introduce a general algorithm for this problem as well as several more efficient algorithms for important special cases. The paper reports and compares performance metrics by drawing on some small case studies analyzed in depth via simulation. Specifically, we study the effect of the robot’s observation model on the average time required for the robot to record a desired story. We also compare our algorithm with a baseline greedy algorithm, showing that our algorithm outperforms the greedy algorithm in terms of the average time to record a desired story. In addition, experiments show that the algorithms tailored to specialized variants of the problem are rather more efficient than the general algorithm.","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48632765","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Boreas: A multi-season autonomous driving dataset Boreas:多季节自动驾驶数据集
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-03-18 DOI: 10.1177/02783649231160195
Keenan Burnett, David J. Yoon, Yuchen Wu, A. Z. Li, Haowei Zhang, Shichen Lu, Jingxing Qian, Wei-Kang Tseng, A. Lambert, K. Leung, Angela P. Schoellig, T. Barfoot
The Boreas dataset was collected by driving a repeated route over the course of 1 year, resulting in stark seasonal variations and adverse weather conditions such as rain and falling snow. In total, the Boreas dataset includes over 350 km of driving data featuring a 128-channel Velodyne Alpha-Prime lidar, a 360° Navtech CIR304-H scanning radar, a 5MP FLIR Blackfly S camera, and centimetre-accurate post-processed ground truth poses. Our dataset will support live leaderboards for odometry, metric localization, and 3D object detection. The dataset and development kit are available at boreas.utias.utoronto.ca.
Boreas的数据集是通过在一年的时间里沿着一条重复的路线行驶而收集的,这导致了明显的季节变化和恶劣的天气条件,比如下雨和下雪。总的来说,Boreas数据集包括超过350公里的驾驶数据,其中包括128通道Velodyne Alpha-Prime激光雷达,360°Navtech CIR304-H扫描雷达,500万FLIR Blackfly S摄像头以及厘米级精度的后处理地面真实姿势。我们的数据集将支持里程计、度量定位和3D物体检测的实时排行榜。数据集和开发工具包可在borase .utias.utoronto.ca获得。
{"title":"Boreas: A multi-season autonomous driving dataset","authors":"Keenan Burnett, David J. Yoon, Yuchen Wu, A. Z. Li, Haowei Zhang, Shichen Lu, Jingxing Qian, Wei-Kang Tseng, A. Lambert, K. Leung, Angela P. Schoellig, T. Barfoot","doi":"10.1177/02783649231160195","DOIUrl":"https://doi.org/10.1177/02783649231160195","url":null,"abstract":"The Boreas dataset was collected by driving a repeated route over the course of 1 year, resulting in stark seasonal variations and adverse weather conditions such as rain and falling snow. In total, the Boreas dataset includes over 350 km of driving data featuring a 128-channel Velodyne Alpha-Prime lidar, a 360° Navtech CIR304-H scanning radar, a 5MP FLIR Blackfly S camera, and centimetre-accurate post-processed ground truth poses. Our dataset will support live leaderboards for odometry, metric localization, and 3D object detection. The dataset and development kit are available at boreas.utias.utoronto.ca.","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48399630","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
An efficient, modular controller for flapping flight composing model-based and model-free components 一种高效、模块化的扑翼飞行控制器,由基于模型和无模型的组件组成
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-03-15 DOI: 10.1177/02783649211063225
Avik De, Rebecca McGill, R. Wood
We present a controller that combines model-based methods with model-free data-driven methods hierarchically, utilizing the predictive power of template models with the strengths of model-free methods to account for model error, such as due to manufacturing variability in the RoboBee, a 100 mg flapping-wing micro aerial vehicle (FWMAV). Using a large suite of numerical trials, we show that the model-predictive high-level component of the proposed controller is more performant, easier to tune, and able to stabilize more dynamic tasks than a baseline reactive controller, while the data-driven inverse dynamics controller is able to better compensate for biases arising from manufacturing variability. At the same time, the formulated controller is very computationally efficient, with the MPC implemented at 5 KHz on a Simulink embedded target, via which we empirically demonstrate controlled hovering on a RoboBee.
我们提出了一种控制器,该控制器将基于模型的方法与无模型数据驱动方法分层结合,利用模板模型的预测能力和无模型方法的优势来解释模型误差,例如由于100 mg扑翼微型飞行器RoboBee的制造可变性。通过大量的数值试验,我们表明,与基线反应控制器相比,所提出的控制器的模型预测高级组件更具性能,更容易调整,并且能够稳定更多的动态任务,而数据驱动的逆动力学控制器能够更好地补偿制造可变性引起的偏差。同时,公式化的控制器在计算上非常高效,MPC在Simulink嵌入式目标上以5KHz实现,通过它我们经验证明了RoboBee上的受控悬停。
{"title":"An efficient, modular controller for flapping flight composing model-based and model-free components","authors":"Avik De, Rebecca McGill, R. Wood","doi":"10.1177/02783649211063225","DOIUrl":"https://doi.org/10.1177/02783649211063225","url":null,"abstract":"We present a controller that combines model-based methods with model-free data-driven methods hierarchically, utilizing the predictive power of template models with the strengths of model-free methods to account for model error, such as due to manufacturing variability in the RoboBee, a 100 mg flapping-wing micro aerial vehicle (FWMAV). Using a large suite of numerical trials, we show that the model-predictive high-level component of the proposed controller is more performant, easier to tune, and able to stabilize more dynamic tasks than a baseline reactive controller, while the data-driven inverse dynamics controller is able to better compensate for biases arising from manufacturing variability. At the same time, the formulated controller is very computationally efficient, with the MPC implemented at 5 KHz on a Simulink embedded target, via which we empirically demonstrate controlled hovering on a RoboBee.","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41639077","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
BenchBot environments for active robotics (BEAR): Simulated data for active scene understanding research 用于主动机器人的BenchBot环境(BEAR):用于主动场景理解研究的模拟数据
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-03-01 DOI: 10.1177/02783649211069404
David Hall, Ben Talbot, S. Bista, Haoyang Zhang, Rohan Smith, Feras Dayoub, Niko Sünderhauf
We present a platform to foster research in active scene understanding, consisting of high-fidelity simulated environments and a simple yet powerful API that controls a mobile robot in simulation and reality. In contrast to static, pre-recorded datasets that focus on the perception aspect of scene understanding, agency is a top priority in our work. We provide three levels of robot agency, allowing users to control a robot at varying levels of difficulty and realism. While the most basic level provides pre-defined trajectories and ground-truth localisation, the more realistic levels allow us to evaluate integrated behaviours comprising perception, navigation, exploration and SLAM. In contrast to existing simulation environments, we focus on robust scene understanding research using our environment interface (BenchBot) that provides a simple API for seamless transition between the simulated environments and real robotic platforms. We believe this scaffolded design is an effective approach to bridge the gap between classical static datasets without any agency and the unique challenges of robotic evaluation in reality. Our BenchBot Environments for Active Robotics (BEAR) consist of 25 indoor environments under day and night lighting conditions, a total of 1443 objects to be identified and mapped, and ground-truth 3D bounding boxes for use in evaluation. BEAR website: https://qcr.github.io/dataset/benchbot-bear-data/.
我们提供了一个促进主动场景理解研究的平台,由高保真度模拟环境和一个简单而强大的API组成,该API在模拟和现实中控制移动机器人。与专注于场景理解的感知方面的静态、预先记录的数据集相比,代理是我们工作中的首要任务。我们提供三个级别的机器人代理,允许用户以不同的难度和逼真度控制机器人。虽然最基本的层面提供了预定义的轨迹和地面实况定位,但更现实的层面允许我们评估包括感知、导航、探索和SLAM在内的综合行为。与现有的模拟环境相比,我们专注于使用我们的环境接口(BenchBot)进行稳健的场景理解研究,该接口为模拟环境和真实机器人平台之间的无缝过渡提供了简单的API。我们相信,这种脚手架设计是一种有效的方法,可以在没有任何机构的情况下弥合经典静态数据集与现实中机器人评估的独特挑战之间的差距。我们的主动机器人BenchBot环境(BEAR)包括25个昼夜照明条件下的室内环境,总共1443个待识别和映射的对象,以及用于评估的地面实况3D边界框。BEAR网站:https://qcr.github.io/dataset/benchbot-bear-data/.
{"title":"BenchBot environments for active robotics (BEAR): Simulated data for active scene understanding research","authors":"David Hall, Ben Talbot, S. Bista, Haoyang Zhang, Rohan Smith, Feras Dayoub, Niko Sünderhauf","doi":"10.1177/02783649211069404","DOIUrl":"https://doi.org/10.1177/02783649211069404","url":null,"abstract":"We present a platform to foster research in active scene understanding, consisting of high-fidelity simulated environments and a simple yet powerful API that controls a mobile robot in simulation and reality. In contrast to static, pre-recorded datasets that focus on the perception aspect of scene understanding, agency is a top priority in our work. We provide three levels of robot agency, allowing users to control a robot at varying levels of difficulty and realism. While the most basic level provides pre-defined trajectories and ground-truth localisation, the more realistic levels allow us to evaluate integrated behaviours comprising perception, navigation, exploration and SLAM. In contrast to existing simulation environments, we focus on robust scene understanding research using our environment interface (BenchBot) that provides a simple API for seamless transition between the simulated environments and real robotic platforms. We believe this scaffolded design is an effective approach to bridge the gap between classical static datasets without any agency and the unique challenges of robotic evaluation in reality. Our BenchBot Environments for Active Robotics (BEAR) consist of 25 indoor environments under day and night lighting conditions, a total of 1443 objects to be identified and mapped, and ground-truth 3D bounding boxes for use in evaluation. BEAR website: https://qcr.github.io/dataset/benchbot-bear-data/.","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47712061","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
AURORA, a multi-sensor dataset for robotic ocean exploration AURORA,一个用于机器人海洋探测的多传感器数据集
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-02-07 DOI: 10.1177/02783649221078612
Marco Bernardi, Brett Hosking, C. Petrioli, B. Bett, Daniel Jones, V. Huvenne, Rachel Marlow, M. Furlong, S. McPhail, A. Munafò
The current maturity of autonomous underwater vehicles (AUVs) has made their deployment practical and cost-effective, such that many scientific, industrial and military applications now include AUV operations. However, the logistical difficulties and high costs of operating at sea are still critical limiting factors in further technology development, the benchmarking of new techniques and the reproducibility of research results. To overcome this problem, this paper presents a freely available dataset suitable to test control, navigation, sensor processing algorithms and others tasks. This dataset combines AUV navigation data, sidescan sonar, multibeam echosounder data and seafloor camera image data, and associated sensor acquisition metadata to provide a detailed characterisation of surveys carried out by the National Oceanography Centre (NOC) in the Greater Haig Fras Marine Conservation Zone (MCZ) of the U.K in 2015.
目前成熟的自主水下航行器(AUV)已经使其部署变得实用且具有成本效益,因此许多科学,工业和军事应用现在都包括AUV操作。然而,海上作业的后勤困难和高成本仍然是进一步技术发展、新技术基准和研究结果可重复性的关键限制因素。为了克服这一问题,本文提出了一个免费的数据集,适用于测试控制、导航、传感器处理算法和其他任务。该数据集结合了AUV导航数据、侧扫描声纳、多波束回声测深数据和海底相机图像数据,以及相关的传感器采集元数据,提供了2015年英国国家海洋学中心(NOC)在大黑格弗拉斯海洋保护区(MCZ)进行的调查的详细特征。
{"title":"AURORA, a multi-sensor dataset for robotic ocean exploration","authors":"Marco Bernardi, Brett Hosking, C. Petrioli, B. Bett, Daniel Jones, V. Huvenne, Rachel Marlow, M. Furlong, S. McPhail, A. Munafò","doi":"10.1177/02783649221078612","DOIUrl":"https://doi.org/10.1177/02783649221078612","url":null,"abstract":"The current maturity of autonomous underwater vehicles (AUVs) has made their deployment practical and cost-effective, such that many scientific, industrial and military applications now include AUV operations. However, the logistical difficulties and high costs of operating at sea are still critical limiting factors in further technology development, the benchmarking of new techniques and the reproducibility of research results. To overcome this problem, this paper presents a freely available dataset suitable to test control, navigation, sensor processing algorithms and others tasks. This dataset combines AUV navigation data, sidescan sonar, multibeam echosounder data and seafloor camera image data, and associated sensor acquisition metadata to provide a detailed characterisation of surveys carried out by the National Oceanography Centre (NOC) in the Greater Haig Fras Marine Conservation Zone (MCZ) of the U.K in 2015.","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"65097872","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Fundamental limits for sensor-based robot control 基于传感器的机器人控制的基本限制
IF 9.2 1区 计算机科学 Q1 Mathematics Pub Date : 2022-01-31 DOI: 10.1177/02783649231190947
Anirudha Majumdar, Zhi-Yong Mei, Vincent Pacelli
Our goal is to develop theory and algorithms for establishing fundamental limits on performance imposed by a robot’s sensors for a given task. In order to achieve this, we define a quantity that captures the amount of task-relevant information provided by a sensor. Using a novel version of the generalized Fano's inequality from information theory, we demonstrate that this quantity provides an upper bound on the highest achievable expected reward for one-step decision-making tasks. We then extend this bound to multi-step problems via a dynamic programming approach. We present algorithms for numerically computing the resulting bounds, and demonstrate our approach on three examples: (i) the lava problem from the literature on partially observable Markov decision processes, (ii) an example with continuous state and observation spaces corresponding to a robot catching a freely-falling object, and (iii) obstacle avoidance using a depth sensor with non-Gaussian noise. We demonstrate the ability of our approach to establish strong limits on achievable performance for these problems by comparing our upper bounds with achievable lower bounds (computed by synthesizing or learning concrete control policies).
我们的目标是开发理论和算法,以确定机器人传感器对给定任务的性能的基本限制。为了实现这一点,我们定义了一个量,该量捕获传感器提供的与任务相关的信息量。使用信息论中广义Fano不等式的一个新版本,我们证明了这个量为一步决策任务提供了最高可实现预期回报的上限。然后,我们通过动态编程方法将这一界限扩展到多步骤问题。我们提出了数值计算结果边界的算法,并在三个例子上演示了我们的方法:(i)部分可观测马尔可夫决策过程文献中的熔岩问题,(ii)具有连续状态和观测空间的例子,对应于机器人捕捉自由落体,以及(iii)使用具有非高斯噪声的深度传感器来避障。我们通过比较我们的上限和可实现的下限(通过综合或学习具体的控制策略计算),证明了我们的方法对这些问题的可实现性能建立强大限制的能力。
{"title":"Fundamental limits for sensor-based robot control","authors":"Anirudha Majumdar, Zhi-Yong Mei, Vincent Pacelli","doi":"10.1177/02783649231190947","DOIUrl":"https://doi.org/10.1177/02783649231190947","url":null,"abstract":"Our goal is to develop theory and algorithms for establishing fundamental limits on performance imposed by a robot’s sensors for a given task. In order to achieve this, we define a quantity that captures the amount of task-relevant information provided by a sensor. Using a novel version of the generalized Fano's inequality from information theory, we demonstrate that this quantity provides an upper bound on the highest achievable expected reward for one-step decision-making tasks. We then extend this bound to multi-step problems via a dynamic programming approach. We present algorithms for numerically computing the resulting bounds, and demonstrate our approach on three examples: (i) the lava problem from the literature on partially observable Markov decision processes, (ii) an example with continuous state and observation spaces corresponding to a robot catching a freely-falling object, and (iii) obstacle avoidance using a depth sensor with non-Gaussian noise. We demonstrate the ability of our approach to establish strong limits on achievable performance for these problems by comparing our upper bounds with achievable lower bounds (computed by synthesizing or learning concrete control policies).","PeriodicalId":54942,"journal":{"name":"International Journal of Robotics Research","volume":null,"pages":null},"PeriodicalIF":9.2,"publicationDate":"2022-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47184008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Journal of Robotics Research
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1