{"title":"考虑管线路线的船舶多舱设备布局的多代理合作强化学习与 A* 搜索","authors":"Qiaoyu Zhang, Yan Lin","doi":"10.5957/jspd.01240001","DOIUrl":null,"url":null,"abstract":"\n \n The paper presents a novel approach of cooperative multiagent reinforcement learning (CMARL) combined with A* search to address ship multicabin equipment layout considering pipe route, aiming to minimize pipe cost while considering practical requirements. The formulation is established through equipment simplification and grid marking, and A* search is utilized to value the pipe route. By designing equipment states, the equipment layout in each cabin is solved using a CMARL approach that involves three actions. Subsequently, comparative experiments were conducted on an engine room case by CMARL against genetic algorithm and single multiagent reinforcement learning methods under the condition of coupling with A* search. The parameter values for these methods were sampled using Latin Hypercube. The findings demonstrate that CMARL has superior combination properties.\n \n \n \n ship equipment layout; multicabin layout; cooperative multiagent reinforcement learning; A* search; pipe route\n","PeriodicalId":48791,"journal":{"name":"Journal of Ship Production and Design","volume":null,"pages":null},"PeriodicalIF":0.5000,"publicationDate":"2024-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Cooperative Multiagent Reinforcement Learning Coupled With A* Search for Ship Multicabin Equipment Layout Considering Pipe Route\",\"authors\":\"Qiaoyu Zhang, Yan Lin\",\"doi\":\"10.5957/jspd.01240001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n \\n The paper presents a novel approach of cooperative multiagent reinforcement learning (CMARL) combined with A* search to address ship multicabin equipment layout considering pipe route, aiming to minimize pipe cost while considering practical requirements. The formulation is established through equipment simplification and grid marking, and A* search is utilized to value the pipe route. By designing equipment states, the equipment layout in each cabin is solved using a CMARL approach that involves three actions. Subsequently, comparative experiments were conducted on an engine room case by CMARL against genetic algorithm and single multiagent reinforcement learning methods under the condition of coupling with A* search. The parameter values for these methods were sampled using Latin Hypercube. The findings demonstrate that CMARL has superior combination properties.\\n \\n \\n \\n ship equipment layout; multicabin layout; cooperative multiagent reinforcement learning; A* search; pipe route\\n\",\"PeriodicalId\":48791,\"journal\":{\"name\":\"Journal of Ship Production and Design\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.5000,\"publicationDate\":\"2024-04-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Ship Production and Design\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.5957/jspd.01240001\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ENGINEERING, MARINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Ship Production and Design","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.5957/jspd.01240001","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, MARINE","Score":null,"Total":0}
Cooperative Multiagent Reinforcement Learning Coupled With A* Search for Ship Multicabin Equipment Layout Considering Pipe Route
The paper presents a novel approach of cooperative multiagent reinforcement learning (CMARL) combined with A* search to address ship multicabin equipment layout considering pipe route, aiming to minimize pipe cost while considering practical requirements. The formulation is established through equipment simplification and grid marking, and A* search is utilized to value the pipe route. By designing equipment states, the equipment layout in each cabin is solved using a CMARL approach that involves three actions. Subsequently, comparative experiments were conducted on an engine room case by CMARL against genetic algorithm and single multiagent reinforcement learning methods under the condition of coupling with A* search. The parameter values for these methods were sampled using Latin Hypercube. The findings demonstrate that CMARL has superior combination properties.
ship equipment layout; multicabin layout; cooperative multiagent reinforcement learning; A* search; pipe route
期刊介绍:
Original and timely technical papers addressing problems of shipyard techniques and production of merchant and naval ships appear in this quarterly publication. Since its inception, the Journal of Ship Production and Design (formerly the Journal of Ship Production) has been a forum for peer-reviewed, professionally edited papers from academic and industry sources. As such it has influenced the worldwide development of ship production engineering as a fully qualified professional discipline. The expanded scope seeks papers in additional areas, specifically ship design, including design for production, plus other marine technology topics, such as ship operations, shipping economics, and safety. Each issue contains a well-rounded selection of technical papers relevant to marine professionals.