可推广运动原语增量学习的模型选择

Murtaza Hazara, V. Kyrki
{"title":"可推广运动原语增量学习的模型选择","authors":"Murtaza Hazara, V. Kyrki","doi":"10.1109/ICAR.2017.8023633","DOIUrl":null,"url":null,"abstract":"Although motor primitives (MPs) have been studied extensively, much less attention has been devoted to studying their generalization to new situations. To cope with varying conditions, a MP's policy encoding must support generalization over task parameters to avoid learning separate primitives for each condition. Local and linear parameterized models have been proposed to interpolate over task parameters to provide limited generalization. In this paper, we present a global parametric motion primitive which allows generalization beyond local or linear models. Primitives are modelled using a linear basis function model with global non-linear basis functions. Using the global parametric model, we developed an online incremental learning framework for constructing a database of MPs from a single human demonstration. Above all, we propose a model selection method that can choose an optimal model complexity even with few training samples, which makes it suitable for online incremental learning. Experiments with a ball-in-a-cup task with varying string lengths demonstrate that the global parametric approach can successfully extract underlying regularities in a database of MPs leading to enhanced generalization capability of the parametric MPs and increased speed (convergence rate) of learning. Furthermore, it significantly excels over locally weighted regression both in terms of inter- and extrapolation.","PeriodicalId":198633,"journal":{"name":"2017 18th International Conference on Advanced Robotics (ICAR)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"11","resultStr":"{\"title\":\"Model selection for incremental learning of generalizable movement primitives\",\"authors\":\"Murtaza Hazara, V. Kyrki\",\"doi\":\"10.1109/ICAR.2017.8023633\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Although motor primitives (MPs) have been studied extensively, much less attention has been devoted to studying their generalization to new situations. To cope with varying conditions, a MP's policy encoding must support generalization over task parameters to avoid learning separate primitives for each condition. Local and linear parameterized models have been proposed to interpolate over task parameters to provide limited generalization. In this paper, we present a global parametric motion primitive which allows generalization beyond local or linear models. Primitives are modelled using a linear basis function model with global non-linear basis functions. Using the global parametric model, we developed an online incremental learning framework for constructing a database of MPs from a single human demonstration. Above all, we propose a model selection method that can choose an optimal model complexity even with few training samples, which makes it suitable for online incremental learning. Experiments with a ball-in-a-cup task with varying string lengths demonstrate that the global parametric approach can successfully extract underlying regularities in a database of MPs leading to enhanced generalization capability of the parametric MPs and increased speed (convergence rate) of learning. Furthermore, it significantly excels over locally weighted regression both in terms of inter- and extrapolation.\",\"PeriodicalId\":198633,\"journal\":{\"name\":\"2017 18th International Conference on Advanced Robotics (ICAR)\",\"volume\":\"25 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2017-08-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"11\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2017 18th International Conference on Advanced Robotics (ICAR)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICAR.2017.8023633\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2017 18th International Conference on Advanced Robotics (ICAR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICAR.2017.8023633","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 11

摘要

虽然运动原语已经被广泛研究,但很少有人关注它们在新情况下的泛化。为了应对变化的条件,MP的策略编码必须支持对任务参数的泛化,以避免为每个条件学习单独的原语。提出了局部和线性参数化模型来插值任务参数,以提供有限的泛化。在本文中,我们提出了一个全局参数运动原语,它允许超越局部或线性模型的泛化。基元的建模采用线性基函数模型和全局非线性基函数。使用全局参数模型,我们开发了一个在线增量学习框架,用于从单个人类演示中构建MPs数据库。最重要的是,我们提出了一种模型选择方法,即使在训练样本很少的情况下也能选择出最优的模型复杂度,使其适合在线增量学习。在不同字符串长度的球-杯任务中进行的实验表明,全局参数化方法可以成功地从MPs数据库中提取出潜在的规律,从而增强了参数MPs的泛化能力,提高了学习的速度(收敛率)。此外,它在内推和外推方面都明显优于局部加权回归。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Model selection for incremental learning of generalizable movement primitives
Although motor primitives (MPs) have been studied extensively, much less attention has been devoted to studying their generalization to new situations. To cope with varying conditions, a MP's policy encoding must support generalization over task parameters to avoid learning separate primitives for each condition. Local and linear parameterized models have been proposed to interpolate over task parameters to provide limited generalization. In this paper, we present a global parametric motion primitive which allows generalization beyond local or linear models. Primitives are modelled using a linear basis function model with global non-linear basis functions. Using the global parametric model, we developed an online incremental learning framework for constructing a database of MPs from a single human demonstration. Above all, we propose a model selection method that can choose an optimal model complexity even with few training samples, which makes it suitable for online incremental learning. Experiments with a ball-in-a-cup task with varying string lengths demonstrate that the global parametric approach can successfully extract underlying regularities in a database of MPs leading to enhanced generalization capability of the parametric MPs and increased speed (convergence rate) of learning. Furthermore, it significantly excels over locally weighted regression both in terms of inter- and extrapolation.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Questionnaire experiment using networked service robots Model selection for incremental learning of generalizable movement primitives Safety evaluation method of robot arm considering energy of contact Robotman: A security robot for human-robot interaction Physical edge detection in clothing items for robotic manipulation
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1