基于学习的控制框架,用于快速准确地操纵柔性物体

IF 4.9 3区 计算机科学 Q1 ENGINEERING, MULTIDISCIPLINARY Journal of Bionic Engineering Pub Date : 2024-05-21 DOI:10.1007/s42235-024-00534-2
Junyi Wang, Xiaofeng Xiong, Silvia Tolu, Stanislav N. Gorb
{"title":"基于学习的控制框架,用于快速准确地操纵柔性物体","authors":"Junyi Wang,&nbsp;Xiaofeng Xiong,&nbsp;Silvia Tolu,&nbsp;Stanislav N. Gorb","doi":"10.1007/s42235-024-00534-2","DOIUrl":null,"url":null,"abstract":"<div><p>This paper presents a learning-based control framework for fast (&lt; 1.5 <i>s</i>) and accurate manipulation of a flexible object, i.e., whip targeting. The framework consists of a motion planner learned or optimized by an algorithm, Online Impedance Adaptation Control (OIAC), a sim2real mechanism, and a visual feedback component. The experimental results show that a soft actor-critic algorithm outperforms three Deep Reinforcement Learning (DRL), a nonlinear optimization, and a genetic algorithm in learning generalization of motion planning. It can greatly reduce average learning trials (to &lt; 20<span>\\(\\%\\)</span> of others) and maximize average rewards (to &gt; 3 times of others). Besides, motion tracking errors are greatly reduced to 13.29<span>\\(\\%\\)</span> and 22.36<span>\\(\\%\\)</span> of constant impedance control by the OIAC of the proposed framework. In addition, the trajectory similarity between simulated and physical whips is 89.09<span>\\(\\%\\)</span>. The presented framework provides a new method integrating data-driven and physics-based algorithms for controlling fast and accurate arm manipulation of a flexible object.</p></div>","PeriodicalId":614,"journal":{"name":"Journal of Bionic Engineering","volume":"21 4","pages":"1761 - 1774"},"PeriodicalIF":4.9000,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s42235-024-00534-2.pdf","citationCount":"0","resultStr":"{\"title\":\"A Learning-based Control Framework for Fast and Accurate Manipulation of a Flexible Object\",\"authors\":\"Junyi Wang,&nbsp;Xiaofeng Xiong,&nbsp;Silvia Tolu,&nbsp;Stanislav N. Gorb\",\"doi\":\"10.1007/s42235-024-00534-2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>This paper presents a learning-based control framework for fast (&lt; 1.5 <i>s</i>) and accurate manipulation of a flexible object, i.e., whip targeting. The framework consists of a motion planner learned or optimized by an algorithm, Online Impedance Adaptation Control (OIAC), a sim2real mechanism, and a visual feedback component. The experimental results show that a soft actor-critic algorithm outperforms three Deep Reinforcement Learning (DRL), a nonlinear optimization, and a genetic algorithm in learning generalization of motion planning. It can greatly reduce average learning trials (to &lt; 20<span>\\\\(\\\\%\\\\)</span> of others) and maximize average rewards (to &gt; 3 times of others). Besides, motion tracking errors are greatly reduced to 13.29<span>\\\\(\\\\%\\\\)</span> and 22.36<span>\\\\(\\\\%\\\\)</span> of constant impedance control by the OIAC of the proposed framework. In addition, the trajectory similarity between simulated and physical whips is 89.09<span>\\\\(\\\\%\\\\)</span>. The presented framework provides a new method integrating data-driven and physics-based algorithms for controlling fast and accurate arm manipulation of a flexible object.</p></div>\",\"PeriodicalId\":614,\"journal\":{\"name\":\"Journal of Bionic Engineering\",\"volume\":\"21 4\",\"pages\":\"1761 - 1774\"},\"PeriodicalIF\":4.9000,\"publicationDate\":\"2024-05-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://link.springer.com/content/pdf/10.1007/s42235-024-00534-2.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Bionic Engineering\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s42235-024-00534-2\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Bionic Engineering","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s42235-024-00534-2","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

本文介绍了一种基于学习的控制框架,用于快速(< 1.5 秒)、准确地操纵柔性物体,即鞭子瞄准。该框架由通过算法学习或优化的运动规划器、在线阻抗适应控制(OIAC)、模拟真实机制和视觉反馈组件组成。实验结果表明,在学习运动规划的泛化方面,软演员批评算法优于三种深度强化学习(DRL)、非线性优化和遗传算法。它可以大大减少平均学习次数(达到其他算法的20倍),最大化平均奖励(达到其他算法的3倍)。此外,通过所提出框架的OIAC,运动跟踪误差被大大降低到恒定阻抗控制的13.29和22.36。此外,模拟和物理鞭子之间的轨迹相似度达到了89.09%。所提出的框架提供了一种整合了数据驱动和基于物理的算法的新方法,用于控制手臂对柔性物体进行快速准确的操纵。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A Learning-based Control Framework for Fast and Accurate Manipulation of a Flexible Object

This paper presents a learning-based control framework for fast (< 1.5 s) and accurate manipulation of a flexible object, i.e., whip targeting. The framework consists of a motion planner learned or optimized by an algorithm, Online Impedance Adaptation Control (OIAC), a sim2real mechanism, and a visual feedback component. The experimental results show that a soft actor-critic algorithm outperforms three Deep Reinforcement Learning (DRL), a nonlinear optimization, and a genetic algorithm in learning generalization of motion planning. It can greatly reduce average learning trials (to < 20\(\%\) of others) and maximize average rewards (to > 3 times of others). Besides, motion tracking errors are greatly reduced to 13.29\(\%\) and 22.36\(\%\) of constant impedance control by the OIAC of the proposed framework. In addition, the trajectory similarity between simulated and physical whips is 89.09\(\%\). The presented framework provides a new method integrating data-driven and physics-based algorithms for controlling fast and accurate arm manipulation of a flexible object.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Bionic Engineering
Journal of Bionic Engineering 工程技术-材料科学:生物材料
CiteScore
7.10
自引率
10.00%
发文量
162
审稿时长
10.0 months
期刊介绍: The Journal of Bionic Engineering (JBE) is a peer-reviewed journal that publishes original research papers and reviews that apply the knowledge learned from nature and biological systems to solve concrete engineering problems. The topics that JBE covers include but are not limited to: Mechanisms, kinematical mechanics and control of animal locomotion, development of mobile robots with walking (running and crawling), swimming or flying abilities inspired by animal locomotion. Structures, morphologies, composition and physical properties of natural and biomaterials; fabrication of new materials mimicking the properties and functions of natural and biomaterials. Biomedical materials, artificial organs and tissue engineering for medical applications; rehabilitation equipment and devices. Development of bioinspired computation methods and artificial intelligence for engineering applications.
期刊最新文献
Sandwich-Structured Solar Cells with Accelerated Conversion Efficiency by Self-Cooling and Self-Cleaning Design From Perception to Action: Brain-to-Brain Information Transmission of Pigeons Design and Motion Characteristics of a Ray-Inspired Micro-Robot Made of Magnetic Film Bionic Jumping of Humanoid Robot via Online Centroid Trajectory Optimization and High Dynamic Motion Controller Multi-Sensor Fusion for State Estimation and Control of Cable-Driven Soft Robots
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1