首页 > 最新文献

2022 Sixth IEEE International Conference on Robotic Computing (IRC)最新文献

英文 中文
Intelligent Adaptative Robotic System for Physical Interaction Tasks 物理交互任务智能自适应机器人系统
Pub Date : 2022-12-01 DOI: 10.1109/IRC55401.2022.00082
Benjamín Tapia Sal Paz, Gorka Sorrosal, Aitziber Mancisidor
Big steps in the last years have been made in robotics. From mobile robots for home tasks to fully automatized systems in industrial environments. In the beginning, the main focus of robotics was to provide robotics solutions to tackle the necessity of improving both, productivity in repetitive tasks and safeguarding people in dangerous environments. Nowadays, following the advances in technology and industry 4.0, these objectives have changed to more demanding ones. These require flexible and autonomous intelligent solutions, i.e. systems capable of performing a variety of tasks with the minimum programming or system specifications. With the rise of Artificial Intelligence, novel algorithms have been developed, and let improve robotics systems capabilities by becoming more intelligent and autonomous. The aim of this work is the development of an adaptative intelligent robotic system for physical interaction tasks. In this kind of task, the robot has a strong physical interaction with the environment, driving dynamical requirements to fulfill the task. To achieve this, a Three system framework made up of control, monitoring, and adaptative systems is proposed.
过去几年,机器人技术取得了重大进展。从用于家庭任务的移动机器人到工业环境中的全自动系统。一开始,机器人技术的主要重点是提供机器人解决方案,以解决提高重复任务的生产力和在危险环境中保护人员的必要性。如今,随着技术和工业4.0的进步,这些目标已经变成了更高的要求。这些都需要灵活和自主的智能解决方案,即能够以最少的编程或系统规格执行各种任务的系统。随着人工智能的兴起,新的算法被开发出来,并通过变得更加智能和自主来提高机器人系统的能力。这项工作的目的是为物理交互任务开发一种自适应智能机器人系统。在这类任务中,机器人与环境有很强的物理相互作用,需要驱动动力来完成任务。为了实现这一目标,提出了一个由控制、监测和自适应系统组成的三系统框架。
{"title":"Intelligent Adaptative Robotic System for Physical Interaction Tasks","authors":"Benjamín Tapia Sal Paz, Gorka Sorrosal, Aitziber Mancisidor","doi":"10.1109/IRC55401.2022.00082","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00082","url":null,"abstract":"Big steps in the last years have been made in robotics. From mobile robots for home tasks to fully automatized systems in industrial environments. In the beginning, the main focus of robotics was to provide robotics solutions to tackle the necessity of improving both, productivity in repetitive tasks and safeguarding people in dangerous environments. Nowadays, following the advances in technology and industry 4.0, these objectives have changed to more demanding ones. These require flexible and autonomous intelligent solutions, i.e. systems capable of performing a variety of tasks with the minimum programming or system specifications. With the rise of Artificial Intelligence, novel algorithms have been developed, and let improve robotics systems capabilities by becoming more intelligent and autonomous. The aim of this work is the development of an adaptative intelligent robotic system for physical interaction tasks. In this kind of task, the robot has a strong physical interaction with the environment, driving dynamical requirements to fulfill the task. To achieve this, a Three system framework made up of control, monitoring, and adaptative systems is proposed.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134026106","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implemention of Reinforcement Learning Environment for Mobile Manipulator Using Robo-gym 基于Robo-gym的移动机械手强化学习环境的实现
Pub Date : 2022-12-01 DOI: 10.1109/IRC55401.2022.00056
Myunghyun Kim, Sungwoo Yang, Soo-Hyek Kang, Wonha Kim, D. Kim
Many studies utilize reinforcement learning in simulation environments to control robots. Since simulation environments do not provide reinforcement learning environments for all robots, it is important for researchers to choose a simulation environment with the robots they use. This paper adds and expands a new robot-platform to the robot-gym environment, a reinforcement learning framework used in the Gazebo simulation environment. The added robot-platform is Husky-ur3, a mobile manipulator robot, and it can recognize the coordinates of the target point by itself through the camera. It was confirmed that the mobile manipulator learning environment was well established through experiments of recognizing and following target.
许多研究利用仿真环境中的强化学习来控制机器人。由于仿真环境不能为所有机器人提供强化学习环境,因此研究人员选择与他们使用的机器人相匹配的仿真环境是很重要的。本文在机器人健身环境中增加并扩展了一个新的机器人平台,一个用于Gazebo仿真环境的强化学习框架。增加的机器人平台为移动机械手Husky-ur3,它可以通过摄像头自行识别目标点的坐标。通过目标识别与跟踪实验,验证了该移动机械臂学习环境的建立。
{"title":"Implemention of Reinforcement Learning Environment for Mobile Manipulator Using Robo-gym","authors":"Myunghyun Kim, Sungwoo Yang, Soo-Hyek Kang, Wonha Kim, D. Kim","doi":"10.1109/IRC55401.2022.00056","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00056","url":null,"abstract":"Many studies utilize reinforcement learning in simulation environments to control robots. Since simulation environments do not provide reinforcement learning environments for all robots, it is important for researchers to choose a simulation environment with the robots they use. This paper adds and expands a new robot-platform to the robot-gym environment, a reinforcement learning framework used in the Gazebo simulation environment. The added robot-platform is Husky-ur3, a mobile manipulator robot, and it can recognize the coordinates of the target point by itself through the camera. It was confirmed that the mobile manipulator learning environment was well established through experiments of recognizing and following target.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134517377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Human-Aware Waypoint Planner for Mobile Robot in Indoor Environments 室内环境下移动机器人的人类感知路点规划器
Pub Date : 2022-12-01 DOI: 10.1109/IRC55401.2022.00055
Sungwoo Yang, Sumin Kang, Myunghyun Kim, D. Kim
As the utilization of robots in indoor environments increases, it has become common for humans and robots to co-exist in such environments. Most human-aware navigation algorithms only considered humans in the robot's field of view. However, in cases of L-shape corridors, there is a high possibility that human suddenly appears. To deal with this situation, we propose an improved corner detection algorithm and a novel waypoint planner, WPC. The proposed algorithm is validated through simulations using PedSim and Gazebo.
随着机器人在室内环境中应用的增加,人与机器人在室内环境中共存已经成为一种普遍现象。大多数人类感知导航算法只考虑机器人视野中的人类。但是,在l型走廊的情况下,人类突然出现的可能性很大。为了解决这种情况,我们提出了一种改进的角点检测算法和一种新的路点规划器WPC。通过PedSim和Gazebo仿真验证了该算法的有效性。
{"title":"Human-Aware Waypoint Planner for Mobile Robot in Indoor Environments","authors":"Sungwoo Yang, Sumin Kang, Myunghyun Kim, D. Kim","doi":"10.1109/IRC55401.2022.00055","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00055","url":null,"abstract":"As the utilization of robots in indoor environments increases, it has become common for humans and robots to co-exist in such environments. Most human-aware navigation algorithms only considered humans in the robot's field of view. However, in cases of L-shape corridors, there is a high possibility that human suddenly appears. To deal with this situation, we propose an improved corner detection algorithm and a novel waypoint planner, WPC. The proposed algorithm is validated through simulations using PedSim and Gazebo.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121940727","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Privacy Protection and Regulatory Aspects in the context of Medical Apps 医疗应用程序环境下的隐私保护和监管方面
Pub Date : 2022-12-01 DOI: 10.1109/IRC55401.2022.00053
D. D’Auria, Fabio Persia
Due to the COVID-19 pandemic, there has been a significant increase in the development of medical apps worldwide in recent years, both in research projects and in industry. However, unfortunately the development of such apps has often been significantly slowed down, if not stopped, due to bureaucratic problems frequently related to privacy. Therefore, in this paper we aim to summarize regulatory aspects and privacy protection in the context of medical apps, in order to provide suggestions and guidelines for app designers and developers.
由于2019冠状病毒病大流行,近年来全球医疗应用程序的开发显著增加,无论是在研究项目还是在工业领域。然而,不幸的是,由于与隐私相关的官僚主义问题,这些应用程序的开发经常被大大放慢,如果不是停止的话。因此,在本文中,我们旨在总结医疗应用的监管方面和隐私保护,以期为应用的设计者和开发者提供建议和指导。
{"title":"Privacy Protection and Regulatory Aspects in the context of Medical Apps","authors":"D. D’Auria, Fabio Persia","doi":"10.1109/IRC55401.2022.00053","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00053","url":null,"abstract":"Due to the COVID-19 pandemic, there has been a significant increase in the development of medical apps worldwide in recent years, both in research projects and in industry. However, unfortunately the development of such apps has often been significantly slowed down, if not stopped, due to bureaucratic problems frequently related to privacy. Therefore, in this paper we aim to summarize regulatory aspects and privacy protection in the context of medical apps, in order to provide suggestions and guidelines for app designers and developers.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121529002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Object-level 3D Semantic Mapping using a Network of Smart Edge Sensors 使用智能边缘传感器网络的对象级3D语义映射
Pub Date : 2022-11-21 DOI: 10.1109/IRC55401.2022.00041
Julian Hau, S. Bultmann, Sven Behnke
Autonomous robots that interact with their environment require a detailed semantic scene model. For this, volumetric semantic maps are frequently used. The scene understanding can further be improved by including object-level information in the map. In this work, we extend a multi-view 3D semantic mapping system consisting of a network of distributed smart edge sensors with object-level information, to enable downstream tasks that need object-level input. Objects are represented in the map via their 3D mesh model or as an object-centric volumetric sub-map that can model arbitrary object geometry when no detailed 3D model is available. We propose a keypoint-based approach to estimate object poses via PnP and refinement via ICP alignment of the 3D object model with the observed point cloud segments. Object instances are tracked to integrate observations over time and to be robust against temporary occlusions. Our method is evaluated on the public Behave dataset where it shows pose estimation accuracy within a few centimeters and in real-world experiments with the sensor network in a challenging lab environment where multiple chairs and a table are tracked through the scene online, in real time even under high occlusions.
与环境交互的自主机器人需要详细的语义场景模型。为此,经常使用体积语义图。通过在地图中包含对象级信息,可以进一步提高对场景的理解。在这项工作中,我们扩展了一个多视图3D语义映射系统,该系统由具有对象级信息的分布式智能边缘传感器网络组成,以支持需要对象级输入的下游任务。对象通过它们的3D网格模型在地图中表示,或者作为一个以对象为中心的体积子地图,当没有详细的3D模型可用时,它可以模拟任意对象的几何形状。我们提出了一种基于关键点的方法,通过PnP来估计物体的姿态,并通过将3D物体模型与观测到的点云段进行ICP对齐来进行细化。跟踪对象实例以整合随时间推移的观察结果,并对临时遮挡具有鲁棒性。我们的方法在公共行为数据集上进行了评估,该数据集显示了几厘米内的姿态估计精度,并在具有挑战性的实验室环境中使用传感器网络进行了实际实验,在这种环境中,即使在高闭塞的情况下,也可以在线实时跟踪多把椅子和一张桌子。
{"title":"Object-level 3D Semantic Mapping using a Network of Smart Edge Sensors","authors":"Julian Hau, S. Bultmann, Sven Behnke","doi":"10.1109/IRC55401.2022.00041","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00041","url":null,"abstract":"Autonomous robots that interact with their environment require a detailed semantic scene model. For this, volumetric semantic maps are frequently used. The scene understanding can further be improved by including object-level information in the map. In this work, we extend a multi-view 3D semantic mapping system consisting of a network of distributed smart edge sensors with object-level information, to enable downstream tasks that need object-level input. Objects are represented in the map via their 3D mesh model or as an object-centric volumetric sub-map that can model arbitrary object geometry when no detailed 3D model is available. We propose a keypoint-based approach to estimate object poses via PnP and refinement via ICP alignment of the 3D object model with the observed point cloud segments. Object instances are tracked to integrate observations over time and to be robust against temporary occlusions. Our method is evaluated on the public Behave dataset where it shows pose estimation accuracy within a few centimeters and in real-world experiments with the sensor network in a challenging lab environment where multiple chairs and a table are tracked through the scene online, in real time even under high occlusions.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"98 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134130282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Learning Implicit Probability Distribution Functions for Symmetric Orientation Estimation from RGB Images Without Pose Labels 无姿态标签RGB图像对称方向估计的隐式概率分布函数学习
Pub Date : 2022-11-21 DOI: 10.1109/IRC55401.2022.00044
Arul Selvam Periyasamy, Luis Denninger, Sven Behnke
Object pose estimation is a necessary prerequisite for autonomous robotic manipulation, but the presence of symmetry increases the complexity of the pose estimation task. Existing methods for object pose estimation output a single 6D pose. Thus, they lack the ability to reason about symmetries. Lately, modeling object orientation as a non-parametric probability distribution on the SO❨3❩ manifold by neural networks has shown impressive results. However, acquiring large-scale datasets to train pose estimation models remains a bottleneck. To address this limitation, we introduce an automatic pose labeling scheme. Given RGB-D images without object pose annotations and 3D object models, we design a two-stage pipeline consisting of point cloud registration and render-and-compare validation to generate multiple symmetrical pseudo-ground-truth pose labels for each image. Using the generated pose labels, we train an ImplicitPDF model to estimate the likelihood of an orientation hypothesis given an RGB image. An efficient hierarchical sampling of the SO❨3❩ manifold enables tractable generation of the complete set of symmetries at multiple resolutions. During inference, the most likely orientation of the target object is estimated using gradient ascent. We evaluate the proposed automatic pose labeling scheme and the ImplicitPDF model on a photorealistic dataset and the T-Less dataset, demonstrating the advantages of the proposed method.
物体姿态估计是机器人自主操作的必要前提,但对称性的存在增加了姿态估计任务的复杂性。现有的物体姿态估计方法输出一个单一的6D姿态。因此,他们缺乏对对称性进行推理的能力。最近,用神经网络将对象定向建模为SO v3:流形上的非参数概率分布已经显示出令人印象深刻的结果。然而,获取大规模数据集来训练姿态估计模型仍然是一个瓶颈。为了解决这一限制,我们引入了一种自动姿态标记方案。在没有物体姿态标注和三维物体模型的RGB-D图像中,我们设计了一个由点云配准和渲染比较验证组成的两阶段流水线,为每张图像生成多个对称的伪地真姿态标签。使用生成的姿态标签,我们训练了一个ImplicitPDF模型来估计给定RGB图像的方向假设的可能性。一个有效的分层采样的SO v3:歧管使可处理的生成完整的对称集在多个分辨率。在推理过程中,利用梯度上升估计目标物体最可能的方向。我们在一个逼真数据集和T-Less数据集上对所提出的自动姿态标记方案和ImplicitPDF模型进行了评估,证明了所提出方法的优点。
{"title":"Learning Implicit Probability Distribution Functions for Symmetric Orientation Estimation from RGB Images Without Pose Labels","authors":"Arul Selvam Periyasamy, Luis Denninger, Sven Behnke","doi":"10.1109/IRC55401.2022.00044","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00044","url":null,"abstract":"Object pose estimation is a necessary prerequisite for autonomous robotic manipulation, but the presence of symmetry increases the complexity of the pose estimation task. Existing methods for object pose estimation output a single 6D pose. Thus, they lack the ability to reason about symmetries. Lately, modeling object orientation as a non-parametric probability distribution on the SO❨3❩ manifold by neural networks has shown impressive results. However, acquiring large-scale datasets to train pose estimation models remains a bottleneck. To address this limitation, we introduce an automatic pose labeling scheme. Given RGB-D images without object pose annotations and 3D object models, we design a two-stage pipeline consisting of point cloud registration and render-and-compare validation to generate multiple symmetrical pseudo-ground-truth pose labels for each image. Using the generated pose labels, we train an ImplicitPDF model to estimate the likelihood of an orientation hypothesis given an RGB image. An efficient hierarchical sampling of the SO❨3❩ manifold enables tractable generation of the complete set of symmetries at multiple resolutions. During inference, the most likely orientation of the target object is estimated using gradient ascent. We evaluate the proposed automatic pose labeling scheme and the ImplicitPDF model on a photorealistic dataset and the T-Less dataset, demonstrating the advantages of the proposed method.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116346768","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
State Estimation for Hybrid Locomotion of Driving-Stepping Quadrupeds 驱动-步进四足混合运动的状态估计
Pub Date : 2022-11-21 DOI: 10.1109/IRC55401.2022.00027
M. Hosseini, D. Rodriguez, Sven Behnke
Fast and versatile locomotion can be achieved with wheeled quadruped robots that drive quickly on flat terrain, but are also able to overcome challenging terrain by adapting their body pose and by making steps. In this paper, we present a state estimation approach for four-legged robots with non-steerable wheels that enables hybrid driving-stepping locomotion capabilities. We formulate a Kalman Filter (KF) for state estimation that integrates driven wheels into the filter equations and estimates the robot state (position and velocity) as well as the contribution of driving with wheels to the above state. Our estimation approach allows us to use the control framework of the Mini Cheetah quadruped robot with minor modifications. We tested our approach on this robot that we augmented with actively driven wheels in simulation and in the real world. The experimental results are available at https://www.ais.uni-bonn.de/~hosseini/se-dsq.
轮式四足机器人可以实现快速和多用途的运动,它们可以在平坦的地形上快速行驶,但也可以通过调整身体姿势和迈步来克服具有挑战性的地形。在本文中,我们提出了一种四足机器人的状态估计方法,该方法具有不可转向的车轮,能够实现混合驱动-步进运动能力。我们制定了一个用于状态估计的卡尔曼滤波器(KF),该滤波器将驱动车轮集成到滤波器方程中,并估计机器人的状态(位置和速度)以及带车轮驾驶对上述状态的贡献。我们的估计方法允许我们使用Mini Cheetah四足机器人的控制框架,并进行微小的修改。我们在这个机器人上测试了我们的方法,我们在模拟和现实世界中增强了主动驱动的轮子。实验结果可在https://www.ais.uni-bonn.de/~hosseini/se-dsq上获得。
{"title":"State Estimation for Hybrid Locomotion of Driving-Stepping Quadrupeds","authors":"M. Hosseini, D. Rodriguez, Sven Behnke","doi":"10.1109/IRC55401.2022.00027","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00027","url":null,"abstract":"Fast and versatile locomotion can be achieved with wheeled quadruped robots that drive quickly on flat terrain, but are also able to overcome challenging terrain by adapting their body pose and by making steps. In this paper, we present a state estimation approach for four-legged robots with non-steerable wheels that enables hybrid driving-stepping locomotion capabilities. We formulate a Kalman Filter (KF) for state estimation that integrates driven wheels into the filter equations and estimates the robot state (position and velocity) as well as the contribution of driving with wheels to the above state. Our estimation approach allows us to use the control framework of the Mini Cheetah quadruped robot with minor modifications. We tested our approach on this robot that we augmented with actively driven wheels in simulation and in the real world. The experimental results are available at https://www.ais.uni-bonn.de/~hosseini/se-dsq.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"187 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122104122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Efficient Representations of Object Geometry for Reinforcement Learning of Interactive Grasping Policies 交互式抓取策略强化学习中物体几何的高效表示
Pub Date : 2022-11-20 DOI: 10.1109/IRC55401.2022.00034
Malte Mosbach, Sven Behnke
Grasping objects of different shapes and sizes-a foundational, effortless skill for humans-remains a challenging task in robotics. Although model-based approaches can predict stable grasp configurations for known object models, they struggle to generalize to novel objects and often operate in a non-interactive open-loop manner. In this work, we present a reinforcement learning framework that learns the interactive grasping of various geometrically distinct real-world objects by continuously controlling an anthropomorphic robotic hand. We explore several explicit representations of object geometry as input to the policy. Moreover, we propose to inform the policy implicitly through signed distances and show that this is naturally suited to guide the search through a shaped reward component. Finally, we demonstrate that the proposed framework is able to learn even in more challenging conditions, such as targeted grasping from a cluttered bin. Necessary pre-grasping behaviors such as object reorientation and utilization of environmental constraints emerge in this case. Videos of learned interactive policies are available at https://maltemosbach.github.io/geometry_aware_grasping policies.
抓取不同形状和大小的物体——这是人类毫不费力的基本技能——在机器人领域仍然是一项具有挑战性的任务。尽管基于模型的方法可以预测已知对象模型的稳定抓取配置,但它们难以推广到新的对象,并且通常以非交互式开环方式操作。在这项工作中,我们提出了一个强化学习框架,通过连续控制拟人化机械手来学习各种几何上不同的现实世界物体的交互抓取。我们探索了物体几何的几个显式表示作为策略的输入。此外,我们建议通过带符号的距离隐式地通知策略,并表明这自然适合于通过形状奖励组件指导搜索。最后,我们证明了所提出的框架甚至能够在更具挑战性的条件下学习,例如从杂乱的垃圾箱中有针对性地抓取。在这种情况下,出现了必要的预抓取行为,如物体重新定向和对环境约束的利用。学习互动政策的视频可以在https://maltemosbach.github.io/geometry_aware_grasping policies上找到。
{"title":"Efficient Representations of Object Geometry for Reinforcement Learning of Interactive Grasping Policies","authors":"Malte Mosbach, Sven Behnke","doi":"10.1109/IRC55401.2022.00034","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00034","url":null,"abstract":"Grasping objects of different shapes and sizes-a foundational, effortless skill for humans-remains a challenging task in robotics. Although model-based approaches can predict stable grasp configurations for known object models, they struggle to generalize to novel objects and often operate in a non-interactive open-loop manner. In this work, we present a reinforcement learning framework that learns the interactive grasping of various geometrically distinct real-world objects by continuously controlling an anthropomorphic robotic hand. We explore several explicit representations of object geometry as input to the policy. Moreover, we propose to inform the policy implicitly through signed distances and show that this is naturally suited to guide the search through a shaped reward component. Finally, we demonstrate that the proposed framework is able to learn even in more challenging conditions, such as targeted grasping from a cluttered bin. Necessary pre-grasping behaviors such as object reorientation and utilization of environmental constraints emerge in this case. Videos of learned interactive policies are available at https://maltemosbach.github.io/geometry_aware_grasping policies.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115058349","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A Flexible MATLAB/Simulink Simulator for Robotic Floating-base Systems in Contact with the Ground 一种柔性MATLAB/Simulink机器人浮基系统与地面接触模拟器
Pub Date : 2022-11-17 DOI: 10.1109/IRC55401.2022.00015
Nuno Guedelha, Venus Pasandi, Giuseppe L’Erario, Silvio Traversaro, Daniele Pucci Istituto Italiano di Tecnologia, Genova, Italy
Physics simulators are widely used in robotics fields, from mechanical design to dynamic simulation, and controller design. This paper presents an open-source MATLAB/Simulink simulator for rigid-body articulated systems, including manipulators and floating-base robots. Thanks to MATLAB/Simulink features like MATLAB system classes and Simulink function blocks, the presented simulator combines a programmatic and block-based approach, resulting in a flexible design in the sense that different parts, including its physics engine, robot-ground interaction model, and state evolution algorithm are simply accessible and editable. Moreover, through the use of Simulink dynamic mask blocks, the proposed simulation framework supports robot models integrating open-chain and closed-chain kinematics with any desired number of links interacting with the ground. The simulator can also integrate second-order actuator dynamics. Furthermore, the simulator benefits from a one-line installation and an easy-to-use Simulink interface.
物理模拟器广泛应用于机器人领域,从机械设计到动态仿真,再到控制器设计。本文介绍了一个开源的MATLAB/Simulink仿真器,用于刚体关节系统,包括机械手和浮基机器人。得益于MATLAB/Simulink的特性,如MATLAB系统类和Simulink功能块,所提出的模拟器结合了编程和基于块的方法,从而实现了灵活的设计,包括其物理引擎,机器人-地面交互模型和状态演化算法等不同部分都可以简单地访问和编辑。此外,通过使用Simulink动态掩模块,所提出的仿真框架支持集成开链和闭链运动学的机器人模型,并具有任意数量的与地面交互的链接。该模拟器还可以集成二阶作动器动力学。此外,模拟器得益于一行安装和易于使用的Simulink界面。
{"title":"A Flexible MATLAB/Simulink Simulator for Robotic Floating-base Systems in Contact with the Ground","authors":"Nuno Guedelha, Venus Pasandi, Giuseppe L’Erario, Silvio Traversaro, Daniele Pucci Istituto Italiano di Tecnologia, Genova, Italy","doi":"10.1109/IRC55401.2022.00015","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00015","url":null,"abstract":"Physics simulators are widely used in robotics fields, from mechanical design to dynamic simulation, and controller design. This paper presents an open-source MATLAB/Simulink simulator for rigid-body articulated systems, including manipulators and floating-base robots. Thanks to MATLAB/Simulink features like MATLAB system classes and Simulink function blocks, the presented simulator combines a programmatic and block-based approach, resulting in a flexible design in the sense that different parts, including its physics engine, robot-ground interaction model, and state evolution algorithm are simply accessible and editable. Moreover, through the use of Simulink dynamic mask blocks, the proposed simulation framework supports robot models integrating open-chain and closed-chain kinematics with any desired number of links interacting with the ground. The simulator can also integrate second-order actuator dynamics. Furthermore, the simulator benefits from a one-line installation and an easy-to-use Simulink interface.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126611740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Autonomous Golf Putting with Data-Driven and Physics-Based Methods 基于数据驱动和物理的自动高尔夫推杆方法
Pub Date : 2022-11-15 DOI: 10.1109/IRC55401.2022.00031
Annika Junker, Niklas Fittkau, Julia Timmermann, A. Trächtler
We are developing a self-learning mechatronic golf robot using combined data-driven and physics-based methods, to have the robot autonomously learn to putt the ball from an arbitrary point on the green. Apart from the mechatronic control design of the robot, this task is accomplished by a camera system with image recognition and a neural network for predicting the stroke velocity vector required for a successful hole-in-one. To minimize the number of time-consuming interactions with the real system, the neural network is pretrained by evaluating basic physical laws on a model, which approximates the golf ball dynamics on the green surface in a data-driven manner. Thus, we demonstrate the synergetic combination of data-driven and physics-based methods on the golf robot as a mechatronic example system.
我们正在开发一种自我学习的机电一体化高尔夫机器人,使用数据驱动和基于物理的方法相结合,让机器人自主学习从果岭上的任意点推杆。除了机器人的机电控制设计外,这项任务还由具有图像识别功能的摄像系统和用于预测成功一杆进洞所需的冲程速度矢量的神经网络完成。为了最大限度地减少与真实系统耗时的交互次数,神经网络通过评估模型上的基本物理定律进行预训练,该模型以数据驱动的方式近似于果岭表面上的高尔夫球动力学。因此,我们在高尔夫机器人作为机电一体化实例系统上展示了数据驱动和基于物理的方法的协同结合。
{"title":"Autonomous Golf Putting with Data-Driven and Physics-Based Methods","authors":"Annika Junker, Niklas Fittkau, Julia Timmermann, A. Trächtler","doi":"10.1109/IRC55401.2022.00031","DOIUrl":"https://doi.org/10.1109/IRC55401.2022.00031","url":null,"abstract":"We are developing a self-learning mechatronic golf robot using combined data-driven and physics-based methods, to have the robot autonomously learn to putt the ball from an arbitrary point on the green. Apart from the mechatronic control design of the robot, this task is accomplished by a camera system with image recognition and a neural network for predicting the stroke velocity vector required for a successful hole-in-one. To minimize the number of time-consuming interactions with the real system, the neural network is pretrained by evaluating basic physical laws on a model, which approximates the golf ball dynamics on the green surface in a data-driven manner. Thus, we demonstrate the synergetic combination of data-driven and physics-based methods on the golf robot as a mechatronic example system.","PeriodicalId":282759,"journal":{"name":"2022 Sixth IEEE International Conference on Robotic Computing (IRC)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126022799","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
2022 Sixth IEEE International Conference on Robotic Computing (IRC)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1