一种新的基于深度强化学习的无目标网络机器人路径规划算法

Yanan Cao, Dongbin Zhao, Xiang Cao
{"title":"一种新的基于深度强化学习的无目标网络机器人路径规划算法","authors":"Yanan Cao, Dongbin Zhao, Xiang Cao","doi":"10.1109/ISAS59543.2023.10164323","DOIUrl":null,"url":null,"abstract":"Intelligent agent navigation has broad application scenarios, one of the hot research directions in this field is agent dynamic path planning. For the target network in deep reinforcement learning to gradually deviate from online reinforcement learning, a new softmax operator is applied to replace the max operator in the original network after deleting the target network. New prioritized experience replay is applied to enhance the experience utilization of the agent and dueling network is employed to improve the perceptions of the environment in the path planning process. A modified dynamic ϵ-greedy algorithm is then developed to select actions. The experimental results in the simulation environment show that even after deleting the target network, the algorithm in this paper can still converge to a higher value within limited episodes, which proves its effectiveness.","PeriodicalId":199115,"journal":{"name":"2023 6th International Symposium on Autonomous Systems (ISAS)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A New Deep Reinforcement Learning Based Robot Path Planning Algorithm without Target Network\",\"authors\":\"Yanan Cao, Dongbin Zhao, Xiang Cao\",\"doi\":\"10.1109/ISAS59543.2023.10164323\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Intelligent agent navigation has broad application scenarios, one of the hot research directions in this field is agent dynamic path planning. For the target network in deep reinforcement learning to gradually deviate from online reinforcement learning, a new softmax operator is applied to replace the max operator in the original network after deleting the target network. New prioritized experience replay is applied to enhance the experience utilization of the agent and dueling network is employed to improve the perceptions of the environment in the path planning process. A modified dynamic ϵ-greedy algorithm is then developed to select actions. The experimental results in the simulation environment show that even after deleting the target network, the algorithm in this paper can still converge to a higher value within limited episodes, which proves its effectiveness.\",\"PeriodicalId\":199115,\"journal\":{\"name\":\"2023 6th International Symposium on Autonomous Systems (ISAS)\",\"volume\":\"10 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 6th International Symposium on Autonomous Systems (ISAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISAS59543.2023.10164323\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 6th International Symposium on Autonomous Systems (ISAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISAS59543.2023.10164323","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

智能agent导航具有广泛的应用场景,智能agent动态路径规划是该领域的研究热点之一。为了使深度强化学习中的目标网络逐渐偏离在线强化学习,在删除目标网络后,使用新的softmax算子代替原网络中的max算子。在路径规划过程中,采用新的优先级经验重播来提高智能体的经验利用率,并采用决斗网络来提高对环境的感知。然后开发了一个改进的动态ϵ-greedy算法来选择动作。仿真环境下的实验结果表明,即使在删除目标网络后,本文算法仍能在有限的集数内收敛到较高的值,证明了其有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A New Deep Reinforcement Learning Based Robot Path Planning Algorithm without Target Network
Intelligent agent navigation has broad application scenarios, one of the hot research directions in this field is agent dynamic path planning. For the target network in deep reinforcement learning to gradually deviate from online reinforcement learning, a new softmax operator is applied to replace the max operator in the original network after deleting the target network. New prioritized experience replay is applied to enhance the experience utilization of the agent and dueling network is employed to improve the perceptions of the environment in the path planning process. A modified dynamic ϵ-greedy algorithm is then developed to select actions. The experimental results in the simulation environment show that even after deleting the target network, the algorithm in this paper can still converge to a higher value within limited episodes, which proves its effectiveness.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A new type of video text automatic recognition method and its application in film and television works H∞ state feedback control for fuzzy singular Markovian jump systems with constant time delays and impulsive perturbations MMSTP: Multi-modal Spatiotemporal Feature Fusion Network for Precipitation Prediction Digital twin based bearing fault simulation modeling strategy and display dynamics End-to-End Model-Based Gait Recognition with Matching Module Based on Graph Neural Networks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1