{"title":"考虑管线路线的船舶多舱设备布局的多代理合作强化学习与 A* 搜索","authors":"Qiaoyu Zhang, Yan Lin","doi":"10.5957/jspd.01240001","DOIUrl":null,"url":null,"abstract":"\n \n The paper presents a novel approach of cooperative multiagent reinforcement learning (CMARL) combined with A* search to address ship multicabin equipment layout considering pipe route, aiming to minimize pipe cost while considering practical requirements. The formulation is established through equipment simplification and grid marking, and A* search is utilized to value the pipe route. By designing equipment states, the equipment layout in each cabin is solved using a CMARL approach that involves three actions. Subsequently, comparative experiments were conducted on an engine room case by CMARL against genetic algorithm and single multiagent reinforcement learning methods under the condition of coupling with A* search. The parameter values for these methods were sampled using Latin Hypercube. The findings demonstrate that CMARL has superior combination properties.\n \n \n \n ship equipment layout; multicabin layout; cooperative multiagent reinforcement learning; A* search; pipe route\n","PeriodicalId":0,"journal":{"name":"","volume":"144 2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Cooperative Multiagent Reinforcement Learning Coupled With A* Search for Ship Multicabin Equipment Layout Considering Pipe Route\",\"authors\":\"Qiaoyu Zhang, Yan Lin\",\"doi\":\"10.5957/jspd.01240001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n \\n The paper presents a novel approach of cooperative multiagent reinforcement learning (CMARL) combined with A* search to address ship multicabin equipment layout considering pipe route, aiming to minimize pipe cost while considering practical requirements. The formulation is established through equipment simplification and grid marking, and A* search is utilized to value the pipe route. By designing equipment states, the equipment layout in each cabin is solved using a CMARL approach that involves three actions. Subsequently, comparative experiments were conducted on an engine room case by CMARL against genetic algorithm and single multiagent reinforcement learning methods under the condition of coupling with A* search. The parameter values for these methods were sampled using Latin Hypercube. The findings demonstrate that CMARL has superior combination properties.\\n \\n \\n \\n ship equipment layout; multicabin layout; cooperative multiagent reinforcement learning; A* search; pipe route\\n\",\"PeriodicalId\":0,\"journal\":{\"name\":\"\",\"volume\":\"144 2\",\"pages\":\"\"},\"PeriodicalIF\":0.0,\"publicationDate\":\"2024-04-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.5957/jspd.01240001\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.5957/jspd.01240001","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Cooperative Multiagent Reinforcement Learning Coupled With A* Search for Ship Multicabin Equipment Layout Considering Pipe Route
The paper presents a novel approach of cooperative multiagent reinforcement learning (CMARL) combined with A* search to address ship multicabin equipment layout considering pipe route, aiming to minimize pipe cost while considering practical requirements. The formulation is established through equipment simplification and grid marking, and A* search is utilized to value the pipe route. By designing equipment states, the equipment layout in each cabin is solved using a CMARL approach that involves three actions. Subsequently, comparative experiments were conducted on an engine room case by CMARL against genetic algorithm and single multiagent reinforcement learning methods under the condition of coupling with A* search. The parameter values for these methods were sampled using Latin Hypercube. The findings demonstrate that CMARL has superior combination properties.
ship equipment layout; multicabin layout; cooperative multiagent reinforcement learning; A* search; pipe route