基于多智能体深度强化学习的决策方法

Weiwei Bian, Chunguang Wang, Chan Liu, Kuihua Huang, Ying Mi, Yanxiang Jia
{"title":"基于多智能体深度强化学习的决策方法","authors":"Weiwei Bian, Chunguang Wang, Chan Liu, Kuihua Huang, Ying Mi, Yanxiang Jia","doi":"10.1109/ICUS55513.2022.9987201","DOIUrl":null,"url":null,"abstract":"Based on the decision-making architecture of information pooling and sharing in the hidden layer, the communication protocol is set manually, and the pooling method is used to integrate the information. Although the problem of communication and extension between agents is solved, it is difficult for tasks lacking prior knowledge to design effective communication protocols. The centralized decision- making architecture based on two-way RNN communication uses the information storage characteristics of two-way RNN structure. It can self learn the communication protocol between agents, which overcomes the rigid requirement of task prior knowledge in communication protocol design. The action distribution of a single agent is used as the output of the multi- agent network to replace the joint action distribution, and the global state information in the environment is used as the input instead of simply inputting the local information to different agents. The effectiveness of the method is verified by an example.","PeriodicalId":345773,"journal":{"name":"2022 IEEE International Conference on Unmanned Systems (ICUS)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Decision-making Method Based on Multi-agent Deep Reinforcement Learning\",\"authors\":\"Weiwei Bian, Chunguang Wang, Chan Liu, Kuihua Huang, Ying Mi, Yanxiang Jia\",\"doi\":\"10.1109/ICUS55513.2022.9987201\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Based on the decision-making architecture of information pooling and sharing in the hidden layer, the communication protocol is set manually, and the pooling method is used to integrate the information. Although the problem of communication and extension between agents is solved, it is difficult for tasks lacking prior knowledge to design effective communication protocols. The centralized decision- making architecture based on two-way RNN communication uses the information storage characteristics of two-way RNN structure. It can self learn the communication protocol between agents, which overcomes the rigid requirement of task prior knowledge in communication protocol design. The action distribution of a single agent is used as the output of the multi- agent network to replace the joint action distribution, and the global state information in the environment is used as the input instead of simply inputting the local information to different agents. The effectiveness of the method is verified by an example.\",\"PeriodicalId\":345773,\"journal\":{\"name\":\"2022 IEEE International Conference on Unmanned Systems (ICUS)\",\"volume\":\"9 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE International Conference on Unmanned Systems (ICUS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICUS55513.2022.9987201\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Conference on Unmanned Systems (ICUS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICUS55513.2022.9987201","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

基于隐层信息池和共享的决策体系结构,手工设置通信协议,采用池化方法对信息进行集成。虽然解决了智能体之间的通信和扩展问题,但缺乏先验知识的任务很难设计有效的通信协议。基于双向RNN通信的集中式决策体系结构利用了双向RNN结构的信息存储特性。它可以自学习智能体之间的通信协议,克服了通信协议设计中对任务先验知识的严格要求。采用单个智能体的动作分布作为多智能体网络的输出,取代联合动作分布;采用环境中的全局状态信息作为输入,而不是简单地将局部信息输入到不同的智能体中。通过算例验证了该方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Decision-making Method Based on Multi-agent Deep Reinforcement Learning
Based on the decision-making architecture of information pooling and sharing in the hidden layer, the communication protocol is set manually, and the pooling method is used to integrate the information. Although the problem of communication and extension between agents is solved, it is difficult for tasks lacking prior knowledge to design effective communication protocols. The centralized decision- making architecture based on two-way RNN communication uses the information storage characteristics of two-way RNN structure. It can self learn the communication protocol between agents, which overcomes the rigid requirement of task prior knowledge in communication protocol design. The action distribution of a single agent is used as the output of the multi- agent network to replace the joint action distribution, and the global state information in the environment is used as the input instead of simply inputting the local information to different agents. The effectiveness of the method is verified by an example.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
UNF-SLAM: Unsupervised Feature Extraction Network for Visual-Laser Fusion SLAM Automatic Spinal Ultrasound Image Segmentation and Deployment for Real-time Spine Volumetric Reconstruction Track Matching Method of Sea Surface Targets Based on Improved Longest Common Subsequence Algorithm A dynamic event-triggered leader-following consensus algorithm for multi-AUVs system Adaptive Multi-feature Fusion Improved ECO-HC Image Tracking Algorithm Based on Confidence Judgement for UAV Reconnaissance
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1