{"title":"Guided Robot Skill Learning: A User-Study on Learning Probabilistic Movement Primitives with Non-Experts","authors":"Moritz Knaust, Dorothea Koert","doi":"10.1109/HUMANOIDS47582.2021.9555785","DOIUrl":null,"url":null,"abstract":"Intelligent robots can potentially assist humans in everyday life and industrial production processes. However, the variety of different tasks for such robots renders pure preprogramming infeasible, and learning new tasks directly from non-expert users becomes desirable. Hereby, imitation learning and the concept of movement primitives are promising and widely used approaches. In particular, Probabilistic Movement Primitives (ProMPs) provide a representation that can capture and exploit the variance in human demonstrations. While ProMPs have already been applied for different robotic tasks, an evaluation of how non-expert users can actually teach full tasks based on ProMPs is missing in the literature. We present a framework for Guided Robot Skill Learning which enables inexperienced users to teach a robot combinations of ProMPs and basic robot motions such as gripper commands or Point-to-Point movements. The proposed approach represents the learned skills in the form of sequential Behavior Trees, which can be easily incorporated into more complex robotic behaviors. In a pilot user study with 10 participants, we investigate on two robotic tasks how inexperienced users train ProMP based skills and how they use the concept of modular skill creation. The experimental results show that ProMPs enable more successful task execution compared to teaching Point-to-Point motions. Additionally, our evaluation reveals specific problems that are relevant to consider in future ProMP based teaching systems for non-expert users such as multimodality and missing variance in the demonstrations.","PeriodicalId":320510,"journal":{"name":"2020 IEEE-RAS 20th International Conference on Humanoid Robots (Humanoids)","volume":"31 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE-RAS 20th International Conference on Humanoid Robots (Humanoids)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/HUMANOIDS47582.2021.9555785","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4
Abstract
Intelligent robots can potentially assist humans in everyday life and industrial production processes. However, the variety of different tasks for such robots renders pure preprogramming infeasible, and learning new tasks directly from non-expert users becomes desirable. Hereby, imitation learning and the concept of movement primitives are promising and widely used approaches. In particular, Probabilistic Movement Primitives (ProMPs) provide a representation that can capture and exploit the variance in human demonstrations. While ProMPs have already been applied for different robotic tasks, an evaluation of how non-expert users can actually teach full tasks based on ProMPs is missing in the literature. We present a framework for Guided Robot Skill Learning which enables inexperienced users to teach a robot combinations of ProMPs and basic robot motions such as gripper commands or Point-to-Point movements. The proposed approach represents the learned skills in the form of sequential Behavior Trees, which can be easily incorporated into more complex robotic behaviors. In a pilot user study with 10 participants, we investigate on two robotic tasks how inexperienced users train ProMP based skills and how they use the concept of modular skill creation. The experimental results show that ProMPs enable more successful task execution compared to teaching Point-to-Point motions. Additionally, our evaluation reveals specific problems that are relevant to consider in future ProMP based teaching systems for non-expert users such as multimodality and missing variance in the demonstrations.
智能机器人可以在日常生活和工业生产过程中帮助人类。然而,对于这样的机器人来说,各种不同的任务使得纯粹的预编程变得不可行,直接从非专业用户那里学习新任务变得可取。因此,模仿学习和运动原语的概念是有前途的和广泛使用的方法。特别是,概率运动原语(Probabilistic Movement Primitives, promp)提供了一种表示,可以捕获和利用人类演示中的差异。虽然promp已经应用于不同的机器人任务,但在文献中缺乏对非专业用户如何基于promp实际教授完整任务的评估。我们提出了一个指导机器人技能学习的框架,使没有经验的用户能够教机器人结合promp和基本的机器人运动,如抓手命令或点对点运动。提出的方法以顺序行为树的形式表示学习的技能,可以很容易地合并到更复杂的机器人行为中。在一项有10名参与者的试点用户研究中,我们调查了两个机器人任务中缺乏经验的用户如何训练基于ProMP的技能以及他们如何使用模块化技能创建的概念。实验结果表明,与点对点运动教学相比,promp能够更成功地执行任务。此外,我们的评估揭示了未来针对非专业用户的基于ProMP的教学系统中需要考虑的具体问题,例如演示中的多模态和缺失方差。