单腿机器人高动态跳跃动作的感知驱动学习

IF 4.9 3区 计算机科学 Q1 ENGINEERING, MULTIDISCIPLINARY Journal of Bionic Engineering Pub Date : 2024-05-29 DOI:10.1007/s42235-024-00541-3
Nengxiang Sun, Fei Meng, Sai Gu, Botao Liu, Xuechao Chen, Zhangguo Yu, Qiang Huang
{"title":"单腿机器人高动态跳跃动作的感知驱动学习","authors":"Nengxiang Sun,&nbsp;Fei Meng,&nbsp;Sai Gu,&nbsp;Botao Liu,&nbsp;Xuechao Chen,&nbsp;Zhangguo Yu,&nbsp;Qiang Huang","doi":"10.1007/s42235-024-00541-3","DOIUrl":null,"url":null,"abstract":"<div><p>Legged robots show great potential for high-dynamic motions in continuous interaction with the physical environment, yet achieving animal-like agility remains significant challenges. Legged animals usually predict and plan their next locomotion by combining high-dimensional information from proprioception and exteroception, and adjust the stiffness of the body’s skeletal muscle system to adapt to the current environment. Traditional control methods have limitations in handling high-dimensional state information or complex robot motion that are difficult to plan manually, and Deep Reinforcement Learning (DRL) algorithms provide new solutions to robot motioncontrol problems. Inspired by biomimetics theory, we propose a perception-driven high-dynamic jump adaptive learning algorithm by combining DRL algorithms with Virtual Model Control (VMC) method. The robot will be fully trained in simulation to explore its motion potential by learning the factors related to continuous jumping while knowing its real-time jumping height. The policy trained in simulation is successfully deployed on the bio-inspired single-legged robot testing platform without further adjustments. Experimental results show that the robot can achieve continuous and ideal vertical jumping motion through simple training</p></div>","PeriodicalId":614,"journal":{"name":"Journal of Bionic Engineering","volume":"21 4","pages":"1733 - 1746"},"PeriodicalIF":4.9000,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Perception-Driven Learning of High-Dynamic Jumping Motions for Single-Legged Robots\",\"authors\":\"Nengxiang Sun,&nbsp;Fei Meng,&nbsp;Sai Gu,&nbsp;Botao Liu,&nbsp;Xuechao Chen,&nbsp;Zhangguo Yu,&nbsp;Qiang Huang\",\"doi\":\"10.1007/s42235-024-00541-3\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Legged robots show great potential for high-dynamic motions in continuous interaction with the physical environment, yet achieving animal-like agility remains significant challenges. Legged animals usually predict and plan their next locomotion by combining high-dimensional information from proprioception and exteroception, and adjust the stiffness of the body’s skeletal muscle system to adapt to the current environment. Traditional control methods have limitations in handling high-dimensional state information or complex robot motion that are difficult to plan manually, and Deep Reinforcement Learning (DRL) algorithms provide new solutions to robot motioncontrol problems. Inspired by biomimetics theory, we propose a perception-driven high-dynamic jump adaptive learning algorithm by combining DRL algorithms with Virtual Model Control (VMC) method. The robot will be fully trained in simulation to explore its motion potential by learning the factors related to continuous jumping while knowing its real-time jumping height. The policy trained in simulation is successfully deployed on the bio-inspired single-legged robot testing platform without further adjustments. Experimental results show that the robot can achieve continuous and ideal vertical jumping motion through simple training</p></div>\",\"PeriodicalId\":614,\"journal\":{\"name\":\"Journal of Bionic Engineering\",\"volume\":\"21 4\",\"pages\":\"1733 - 1746\"},\"PeriodicalIF\":4.9000,\"publicationDate\":\"2024-05-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Bionic Engineering\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s42235-024-00541-3\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Bionic Engineering","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s42235-024-00541-3","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

在与物理环境的持续互动中,腿部机器人在高动态运动方面展现出巨大潜力,但要实现动物般的敏捷性仍是一项重大挑战。有腿动物通常通过结合本体感觉和外部感觉的高维信息来预测和规划下一步运动,并调整身体骨骼肌系统的硬度以适应当前环境。传统的控制方法在处理人工难以规划的高维状态信息或复杂机器人运动时存在局限性,而深度强化学习(DRL)算法为机器人运动控制问题提供了新的解决方案。受生物仿生学理论的启发,我们将 DRL 算法与虚拟模型控制(VMC)方法相结合,提出了一种感知驱动的高动态跃迁自适应学习算法。在了解机器人实时跳跃高度的同时,通过学习与连续跳跃相关的因素,机器人将在仿真中接受全面训练,以挖掘其运动潜力。仿真训练后的策略无需进一步调整,即可成功部署到生物启发单足机器人测试平台上。实验结果表明,通过简单的训练,机器人可以实现理想的连续垂直跳跃运动。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Perception-Driven Learning of High-Dynamic Jumping Motions for Single-Legged Robots

Legged robots show great potential for high-dynamic motions in continuous interaction with the physical environment, yet achieving animal-like agility remains significant challenges. Legged animals usually predict and plan their next locomotion by combining high-dimensional information from proprioception and exteroception, and adjust the stiffness of the body’s skeletal muscle system to adapt to the current environment. Traditional control methods have limitations in handling high-dimensional state information or complex robot motion that are difficult to plan manually, and Deep Reinforcement Learning (DRL) algorithms provide new solutions to robot motioncontrol problems. Inspired by biomimetics theory, we propose a perception-driven high-dynamic jump adaptive learning algorithm by combining DRL algorithms with Virtual Model Control (VMC) method. The robot will be fully trained in simulation to explore its motion potential by learning the factors related to continuous jumping while knowing its real-time jumping height. The policy trained in simulation is successfully deployed on the bio-inspired single-legged robot testing platform without further adjustments. Experimental results show that the robot can achieve continuous and ideal vertical jumping motion through simple training

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Bionic Engineering
Journal of Bionic Engineering 工程技术-材料科学:生物材料
CiteScore
7.10
自引率
10.00%
发文量
162
审稿时长
10.0 months
期刊介绍: The Journal of Bionic Engineering (JBE) is a peer-reviewed journal that publishes original research papers and reviews that apply the knowledge learned from nature and biological systems to solve concrete engineering problems. The topics that JBE covers include but are not limited to: Mechanisms, kinematical mechanics and control of animal locomotion, development of mobile robots with walking (running and crawling), swimming or flying abilities inspired by animal locomotion. Structures, morphologies, composition and physical properties of natural and biomaterials; fabrication of new materials mimicking the properties and functions of natural and biomaterials. Biomedical materials, artificial organs and tissue engineering for medical applications; rehabilitation equipment and devices. Development of bioinspired computation methods and artificial intelligence for engineering applications.
期刊最新文献
Sandwich-Structured Solar Cells with Accelerated Conversion Efficiency by Self-Cooling and Self-Cleaning Design From Perception to Action: Brain-to-Brain Information Transmission of Pigeons Design and Motion Characteristics of a Ray-Inspired Micro-Robot Made of Magnetic Film Bionic Jumping of Humanoid Robot via Online Centroid Trajectory Optimization and High Dynamic Motion Controller Multi-Sensor Fusion for State Estimation and Control of Cable-Driven Soft Robots
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1