{"title":"基于深度强化学习的云制造随机到达任务动态调度","authors":"Leyao Chen, Longfei Zhou, Muer Zhou, Xilong Yu, Yipeng Zhu, Wenbo Song, Zixuan Lu, Jiayin Li","doi":"10.1109/UV56588.2022.10185485","DOIUrl":null,"url":null,"abstract":"Compared with the stable orders of traditional manufacturing, cloud manufacturing (CMfg) fulfilled with masses of random orders, so the CMfg server needs an algorithm with low time and space complexity to prevent the server from crashing due to excessive instantaneous data. Besides, the random changes of manufacturing resources and service must be considered when establishing a scheduling model for CMfg. To solve this problem, we propose an adaptive Deep Q-Networks (ADQN) method with a resizable network that converts cloud manufacturing scheduling problems with multiple objectives into specific reinforcement learning goal and can adapt to changing environments. Our experimental results show that ADQN is comparable to other real-time scheduling methods, the average subtask completion time and the standard deviation of occupation obtained by ADQN keep at a low level.","PeriodicalId":211011,"journal":{"name":"2022 6th International Conference on Universal Village (UV)","volume":"71 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning Based Dynamic Scheduling of Random Arrival Tasks in Cloud Manufacturing\",\"authors\":\"Leyao Chen, Longfei Zhou, Muer Zhou, Xilong Yu, Yipeng Zhu, Wenbo Song, Zixuan Lu, Jiayin Li\",\"doi\":\"10.1109/UV56588.2022.10185485\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Compared with the stable orders of traditional manufacturing, cloud manufacturing (CMfg) fulfilled with masses of random orders, so the CMfg server needs an algorithm with low time and space complexity to prevent the server from crashing due to excessive instantaneous data. Besides, the random changes of manufacturing resources and service must be considered when establishing a scheduling model for CMfg. To solve this problem, we propose an adaptive Deep Q-Networks (ADQN) method with a resizable network that converts cloud manufacturing scheduling problems with multiple objectives into specific reinforcement learning goal and can adapt to changing environments. Our experimental results show that ADQN is comparable to other real-time scheduling methods, the average subtask completion time and the standard deviation of occupation obtained by ADQN keep at a low level.\",\"PeriodicalId\":211011,\"journal\":{\"name\":\"2022 6th International Conference on Universal Village (UV)\",\"volume\":\"71 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 6th International Conference on Universal Village (UV)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/UV56588.2022.10185485\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 6th International Conference on Universal Village (UV)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/UV56588.2022.10185485","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Deep Reinforcement Learning Based Dynamic Scheduling of Random Arrival Tasks in Cloud Manufacturing
Compared with the stable orders of traditional manufacturing, cloud manufacturing (CMfg) fulfilled with masses of random orders, so the CMfg server needs an algorithm with low time and space complexity to prevent the server from crashing due to excessive instantaneous data. Besides, the random changes of manufacturing resources and service must be considered when establishing a scheduling model for CMfg. To solve this problem, we propose an adaptive Deep Q-Networks (ADQN) method with a resizable network that converts cloud manufacturing scheduling problems with multiple objectives into specific reinforcement learning goal and can adapt to changing environments. Our experimental results show that ADQN is comparable to other real-time scheduling methods, the average subtask completion time and the standard deviation of occupation obtained by ADQN keep at a low level.