基于 DQN 的线路交叉区域多代理系统覆盖控制

Zuo Lei, Tengfei Zhang, Zhang Jinqi, Yan Maode
{"title":"基于 DQN 的线路交叉区域多代理系统覆盖控制","authors":"Zuo Lei, Tengfei Zhang, Zhang Jinqi, Yan Maode","doi":"10.1049/cth2.12670","DOIUrl":null,"url":null,"abstract":"Generally, the coverage control is studied in a convex region, in which the agent kinematics and the coverage environment both have strong limitations. It is difficult to directly apply these results to practical scenarios, such as the road environment or indoor environment. In this study, the multi‐agent coverage control problems in a line intersection region is investigated, where the agents can only move along the given lines. To present the agents motion in this line intersection region, the moving directions and velocities of the agents are analyzed in the first part. Then, the coverage control model for the multi‐agent system in line intersection region is presented, in which the cost function is provided based on the agent's minimum moving distance and the agent motions are used as the constraints. To solve this constrained coverage problem, the deep Q‐learning network (DQN) is employed to find the optimal positions for each agent in the line intersection region. In final, numerical simulations are presented to validate the feasibility and effectiveness of proposed approaches.","PeriodicalId":502998,"journal":{"name":"IET Control Theory & Applications","volume":"5 11","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DQN based coverage control for multi‐agent system in line intersection region\",\"authors\":\"Zuo Lei, Tengfei Zhang, Zhang Jinqi, Yan Maode\",\"doi\":\"10.1049/cth2.12670\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Generally, the coverage control is studied in a convex region, in which the agent kinematics and the coverage environment both have strong limitations. It is difficult to directly apply these results to practical scenarios, such as the road environment or indoor environment. In this study, the multi‐agent coverage control problems in a line intersection region is investigated, where the agents can only move along the given lines. To present the agents motion in this line intersection region, the moving directions and velocities of the agents are analyzed in the first part. Then, the coverage control model for the multi‐agent system in line intersection region is presented, in which the cost function is provided based on the agent's minimum moving distance and the agent motions are used as the constraints. To solve this constrained coverage problem, the deep Q‐learning network (DQN) is employed to find the optimal positions for each agent in the line intersection region. In final, numerical simulations are presented to validate the feasibility and effectiveness of proposed approaches.\",\"PeriodicalId\":502998,\"journal\":{\"name\":\"IET Control Theory & Applications\",\"volume\":\"5 11\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-04-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Control Theory & Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1049/cth2.12670\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Control Theory & Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1049/cth2.12670","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

一般来说,覆盖控制是在一个凸区域内研究的,在这个区域内,代理运动学和覆盖环境都有很大的局限性。这些结果很难直接应用于实际场景,如道路环境或室内环境。在本研究中,研究了线形交叉区域中的多机器人覆盖控制问题,在该区域中,机器人只能沿着给定的线移动。为了呈现代理在该线路交叉区域的运动情况,首先分析了代理的移动方向和速度。然后,提出了线交叉区域内多代理系统的覆盖控制模型,其中成本函数基于代理的最小移动距离,代理运动作为约束条件。为了解决这个受约束的覆盖问题,采用了深度 Q-learning 网络(DQN)来找到每个代理在线路交叉区域的最佳位置。最后,通过数值模拟验证了建议方法的可行性和有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
DQN based coverage control for multi‐agent system in line intersection region
Generally, the coverage control is studied in a convex region, in which the agent kinematics and the coverage environment both have strong limitations. It is difficult to directly apply these results to practical scenarios, such as the road environment or indoor environment. In this study, the multi‐agent coverage control problems in a line intersection region is investigated, where the agents can only move along the given lines. To present the agents motion in this line intersection region, the moving directions and velocities of the agents are analyzed in the first part. Then, the coverage control model for the multi‐agent system in line intersection region is presented, in which the cost function is provided based on the agent's minimum moving distance and the agent motions are used as the constraints. To solve this constrained coverage problem, the deep Q‐learning network (DQN) is employed to find the optimal positions for each agent in the line intersection region. In final, numerical simulations are presented to validate the feasibility and effectiveness of proposed approaches.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Innovative hull cleaning robot design and control by Laguerre base model predictive control for impedance and vibration management A hybrid energy storage array group control strategy for wind power smoothing Optimal data injection attack design for spacecraft systems via a model free Q‐learning approach Smart line planning method for power transmission based on D3QN‐PER algorithm Lightweight environment sensing algorithm for intelligent driving based on improved YOLOv7
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1