Suyu Wang, Quan Yue, Mengyu Zhao, Huazhi Zhang, Yan Li
{"title":"复杂环境中多机器人的快速优化协调方法","authors":"Suyu Wang, Quan Yue, Mengyu Zhao, Huazhi Zhang, Yan Li","doi":"10.1155/2024/5346187","DOIUrl":null,"url":null,"abstract":"<p>Facing the implementation problems such like low growth reward, long training time, and poor stability of the multiagent learning methods when dealing with complex environment and more agents, this paper proposes a fast optimal coordination method for multiagent in complex environment (FOC-MACE). Firstly, the environment exploration strategy is introduced into the policy network based on the MADDPG method for higher growth rewards. Then, the parallel computing technology is adopted in the critic network, in purpose to effectively reduce the training time. These tactics together are beneficial to enhance the stability of multiagent learning. Lastly, the optimal resource allocation is carried out to realize optimal coevolution of the multiagents and further improve the learning ability of the agents’ group. To verify the effectiveness of our proposal, the FOC-MACE is compared with several advanced methods at current stage in the MPE environment. Three different experiments prove that by using our method, the growth reward is increased by up to 37.1%, the training is speed up significantly, and the stability of the method, which represented by standardized variance, is also improved. In addition, this paper validated the fast optimal coordination method for multiagent systems in the context of UAV scenarios, demonstrating the practical performance of the approach. Through comprehensive experiments and scenario validations, the study successfully confirmed the effectiveness of the proposed fast optimal coordination method for multiagent systems in complex environments.</p>","PeriodicalId":14089,"journal":{"name":"International Journal of Intelligent Systems","volume":null,"pages":null},"PeriodicalIF":5.0000,"publicationDate":"2024-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Fast Optimal Coordination Method for Multiagent in Complex Environment\",\"authors\":\"Suyu Wang, Quan Yue, Mengyu Zhao, Huazhi Zhang, Yan Li\",\"doi\":\"10.1155/2024/5346187\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Facing the implementation problems such like low growth reward, long training time, and poor stability of the multiagent learning methods when dealing with complex environment and more agents, this paper proposes a fast optimal coordination method for multiagent in complex environment (FOC-MACE). Firstly, the environment exploration strategy is introduced into the policy network based on the MADDPG method for higher growth rewards. Then, the parallel computing technology is adopted in the critic network, in purpose to effectively reduce the training time. These tactics together are beneficial to enhance the stability of multiagent learning. Lastly, the optimal resource allocation is carried out to realize optimal coevolution of the multiagents and further improve the learning ability of the agents’ group. To verify the effectiveness of our proposal, the FOC-MACE is compared with several advanced methods at current stage in the MPE environment. Three different experiments prove that by using our method, the growth reward is increased by up to 37.1%, the training is speed up significantly, and the stability of the method, which represented by standardized variance, is also improved. In addition, this paper validated the fast optimal coordination method for multiagent systems in the context of UAV scenarios, demonstrating the practical performance of the approach. Through comprehensive experiments and scenario validations, the study successfully confirmed the effectiveness of the proposed fast optimal coordination method for multiagent systems in complex environments.</p>\",\"PeriodicalId\":14089,\"journal\":{\"name\":\"International Journal of Intelligent Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2024-02-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Intelligent Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1155/2024/5346187\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1155/2024/5346187","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A Fast Optimal Coordination Method for Multiagent in Complex Environment
Facing the implementation problems such like low growth reward, long training time, and poor stability of the multiagent learning methods when dealing with complex environment and more agents, this paper proposes a fast optimal coordination method for multiagent in complex environment (FOC-MACE). Firstly, the environment exploration strategy is introduced into the policy network based on the MADDPG method for higher growth rewards. Then, the parallel computing technology is adopted in the critic network, in purpose to effectively reduce the training time. These tactics together are beneficial to enhance the stability of multiagent learning. Lastly, the optimal resource allocation is carried out to realize optimal coevolution of the multiagents and further improve the learning ability of the agents’ group. To verify the effectiveness of our proposal, the FOC-MACE is compared with several advanced methods at current stage in the MPE environment. Three different experiments prove that by using our method, the growth reward is increased by up to 37.1%, the training is speed up significantly, and the stability of the method, which represented by standardized variance, is also improved. In addition, this paper validated the fast optimal coordination method for multiagent systems in the context of UAV scenarios, demonstrating the practical performance of the approach. Through comprehensive experiments and scenario validations, the study successfully confirmed the effectiveness of the proposed fast optimal coordination method for multiagent systems in complex environments.
期刊介绍:
The International Journal of Intelligent Systems serves as a forum for individuals interested in tapping into the vast theories based on intelligent systems construction. With its peer-reviewed format, the journal explores several fascinating editorials written by today''s experts in the field. Because new developments are being introduced each day, there''s much to be learned — examination, analysis creation, information retrieval, man–computer interactions, and more. The International Journal of Intelligent Systems uses charts and illustrations to demonstrate these ground-breaking issues, and encourages readers to share their thoughts and experiences.