A Behavior-Based Mobile Robot Navigation Method with Deep Reinforcement Learning

Juncheng Li, Maopeng Ran, Han Wang, Lihua Xie
{"title":"A Behavior-Based Mobile Robot Navigation Method with Deep Reinforcement Learning","authors":"Juncheng Li, Maopeng Ran, Han Wang, Lihua Xie","doi":"10.1142/s2301385021410041","DOIUrl":null,"url":null,"abstract":"Deep reinforcement learning-based mobile robot navigation has attracted some recent interest. In the single-agent case, a robot can learn to navigate autonomously without a map of the environment. In the multi-agent case, robots can learn to avoid collisions with each other. In this work, we propose a behavior-based mobile robot navigation method which directly maps the raw sensor data and goal information to the control command. The learned navigation policy can be applied in both single-agent and multi-agent scenarios. Two basic navigation behaviors are considered in our method, which are goal reaching and collision avoidance. The two behaviors are fused based on the risk-level estimation of the current state. The navigation task is decomposed using the behavior-based framework, which is capable of reducing the complexity of the learning process. The simulations and real-world experiments demonstrate that the proposed method can enable the collision-free autonomous navigation of multiple mobile robots in unknown environments.","PeriodicalId":164619,"journal":{"name":"Unmanned Syst.","volume":"15 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"9","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Unmanned Syst.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1142/s2301385021410041","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 9

Abstract

Deep reinforcement learning-based mobile robot navigation has attracted some recent interest. In the single-agent case, a robot can learn to navigate autonomously without a map of the environment. In the multi-agent case, robots can learn to avoid collisions with each other. In this work, we propose a behavior-based mobile robot navigation method which directly maps the raw sensor data and goal information to the control command. The learned navigation policy can be applied in both single-agent and multi-agent scenarios. Two basic navigation behaviors are considered in our method, which are goal reaching and collision avoidance. The two behaviors are fused based on the risk-level estimation of the current state. The navigation task is decomposed using the behavior-based framework, which is capable of reducing the complexity of the learning process. The simulations and real-world experiments demonstrate that the proposed method can enable the collision-free autonomous navigation of multiple mobile robots in unknown environments.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于行为的深度强化学习移动机器人导航方法
基于深度强化学习的移动机器人导航最近引起了一些兴趣。在单智能体的情况下,机器人可以在没有环境地图的情况下学习自主导航。在多智能体的情况下,机器人可以学会避免相互碰撞。在这项工作中,我们提出了一种基于行为的移动机器人导航方法,该方法直接将原始传感器数据和目标信息映射到控制命令。学习到的导航策略可以应用于单智能体和多智能体场景。该方法考虑了两种基本的导航行为:到达目标行为和避免碰撞行为。基于对当前状态的风险级别估计,将这两种行为融合在一起。使用基于行为的框架对导航任务进行分解,降低了学习过程的复杂性。仿真和实际实验表明,该方法能够实现未知环境下多移动机器人的无碰撞自主导航。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Editorial: Special Issue on Perception, Decision and Control of Unmanned Systems Under Complex Conditions Modeling and Quantitative Evaluation Method of Environmental Complexity for Measuring Autonomous Capabilities of Military Unmanned Ground Vehicles Recent Developments in Event-Triggered Control of Nonlinear Systems: An Overview Physical Modeling, Simulation and Validation of Small Fixed-Wing UAV An Improved RRT* UAV Formation Path Planning Algorithm Based on Goal Bias and Node Rejection Strategy
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1