Yang Shen , Xianbing Wang , Huajun Wang , Yongchen Guo , Xiang Chen , Jiaqi Han
{"title":"基于多智能体强化学习的航空应急救援动态任务分配模型","authors":"Yang Shen , Xianbing Wang , Huajun Wang , Yongchen Guo , Xiang Chen , Jiaqi Han","doi":"10.1016/j.jnlssr.2023.06.001","DOIUrl":null,"url":null,"abstract":"<div><p>China's natural disaster situation presents a complex and severe scenario, resulting in substantial human and material losses as a result of large-scale emergencies. Recognizing the significance of aviation emergency rescue, the state provides strong support for its development. However, China's current aviation emergency rescue system is still under construction and encounters various challenges; one such challenge is to match the dynamically changing multi-point rescue demands with the limited availability of aircraft dispatch. We propose a dynamic task assignment model and a trainable model framework for aviation emergency rescue based on multi-agent reinforcement learning. Combined with a targeted design, the scheduling matching problem is transformed into a stochastic game process from the rescue location perspective. Subsequently, an optimized strategy model with high robustness can be obtained by solving the training framework. Comparative experiments demonstrate that the proposed model is able to achieve higher assignment benefits by considering the dynamic nature of rescue demands and the limited availability of rescue helicopter crews. Additionally, the model is able to achieve higher task assignment rates and average time satisfaction by assigning tasks in a more efficient and timely manner. The results suggest that the proposed dynamic task assignment model is a promising approach for improving the efficiency of aviation emergency rescue.</p></div>","PeriodicalId":62710,"journal":{"name":"安全科学与韧性(英文)","volume":"4 3","pages":"Pages 284-293"},"PeriodicalIF":3.7000,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A dynamic task assignment model for aviation emergency rescue based on multi-agent reinforcement learning\",\"authors\":\"Yang Shen , Xianbing Wang , Huajun Wang , Yongchen Guo , Xiang Chen , Jiaqi Han\",\"doi\":\"10.1016/j.jnlssr.2023.06.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>China's natural disaster situation presents a complex and severe scenario, resulting in substantial human and material losses as a result of large-scale emergencies. Recognizing the significance of aviation emergency rescue, the state provides strong support for its development. However, China's current aviation emergency rescue system is still under construction and encounters various challenges; one such challenge is to match the dynamically changing multi-point rescue demands with the limited availability of aircraft dispatch. We propose a dynamic task assignment model and a trainable model framework for aviation emergency rescue based on multi-agent reinforcement learning. Combined with a targeted design, the scheduling matching problem is transformed into a stochastic game process from the rescue location perspective. Subsequently, an optimized strategy model with high robustness can be obtained by solving the training framework. Comparative experiments demonstrate that the proposed model is able to achieve higher assignment benefits by considering the dynamic nature of rescue demands and the limited availability of rescue helicopter crews. Additionally, the model is able to achieve higher task assignment rates and average time satisfaction by assigning tasks in a more efficient and timely manner. The results suggest that the proposed dynamic task assignment model is a promising approach for improving the efficiency of aviation emergency rescue.</p></div>\",\"PeriodicalId\":62710,\"journal\":{\"name\":\"安全科学与韧性(英文)\",\"volume\":\"4 3\",\"pages\":\"Pages 284-293\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2023-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"安全科学与韧性(英文)\",\"FirstCategoryId\":\"1087\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666449623000270\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"安全科学与韧性(英文)","FirstCategoryId":"1087","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666449623000270","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH","Score":null,"Total":0}
A dynamic task assignment model for aviation emergency rescue based on multi-agent reinforcement learning
China's natural disaster situation presents a complex and severe scenario, resulting in substantial human and material losses as a result of large-scale emergencies. Recognizing the significance of aviation emergency rescue, the state provides strong support for its development. However, China's current aviation emergency rescue system is still under construction and encounters various challenges; one such challenge is to match the dynamically changing multi-point rescue demands with the limited availability of aircraft dispatch. We propose a dynamic task assignment model and a trainable model framework for aviation emergency rescue based on multi-agent reinforcement learning. Combined with a targeted design, the scheduling matching problem is transformed into a stochastic game process from the rescue location perspective. Subsequently, an optimized strategy model with high robustness can be obtained by solving the training framework. Comparative experiments demonstrate that the proposed model is able to achieve higher assignment benefits by considering the dynamic nature of rescue demands and the limited availability of rescue helicopter crews. Additionally, the model is able to achieve higher task assignment rates and average time satisfaction by assigning tasks in a more efficient and timely manner. The results suggest that the proposed dynamic task assignment model is a promising approach for improving the efficiency of aviation emergency rescue.