Fuqing Zhao , Yuebao Liu , Tianpeng Xu , Jonrinaldi
{"title":"考虑紧急订单插入的分布式流程车间调度问题的强化学习超启发式算法","authors":"Fuqing Zhao , Yuebao Liu , Tianpeng Xu , Jonrinaldi","doi":"10.1016/j.asoc.2024.112461","DOIUrl":null,"url":null,"abstract":"<div><div>Large enterprises are composed of several subproduction centers. The production plan is changed based on the procedure of the manufacturing system. The distributed flowshop scheduling problem under consideration of emergence order insertion is challenging as the assignment of the product, and the scheduling of the process are coupled with each other. A general distributed flow shop scheduling problem regarding emergency order insertion (DFSP_EOI) is addressed under rescheduling circumstances in this paper. The Q-learning hyper-heuristic algorithm with dynamic insertion rule (QLHH_DIR) is proposed to solve the DFSP_EOI. Eight low-level heuristics (LLHs) for static job assignment. A dynamic insertion rule based on the state of each production center is designed for emergency order insertion. The Q-learning mechanism at high-level space selects appropriate LLH through learning the experience from the optimization process. The computational simulation is carried out, and the results confirm that the proposed algorithm is superior to the competitors in solving the distributed flow shop rescheduling problem. The results of the 720 problem instances show that the proposed algorithm is highly efficient in rescheduling problems.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112461"},"PeriodicalIF":7.2000,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A reinforcement learning hyper-heuristic algorithm for the distributed flowshops scheduling problem under consideration of emergency order insertion\",\"authors\":\"Fuqing Zhao , Yuebao Liu , Tianpeng Xu , Jonrinaldi\",\"doi\":\"10.1016/j.asoc.2024.112461\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Large enterprises are composed of several subproduction centers. The production plan is changed based on the procedure of the manufacturing system. The distributed flowshop scheduling problem under consideration of emergence order insertion is challenging as the assignment of the product, and the scheduling of the process are coupled with each other. A general distributed flow shop scheduling problem regarding emergency order insertion (DFSP_EOI) is addressed under rescheduling circumstances in this paper. The Q-learning hyper-heuristic algorithm with dynamic insertion rule (QLHH_DIR) is proposed to solve the DFSP_EOI. Eight low-level heuristics (LLHs) for static job assignment. A dynamic insertion rule based on the state of each production center is designed for emergency order insertion. The Q-learning mechanism at high-level space selects appropriate LLH through learning the experience from the optimization process. The computational simulation is carried out, and the results confirm that the proposed algorithm is superior to the competitors in solving the distributed flow shop rescheduling problem. The results of the 720 problem instances show that the proposed algorithm is highly efficient in rescheduling problems.</div></div>\",\"PeriodicalId\":50737,\"journal\":{\"name\":\"Applied Soft Computing\",\"volume\":\"167 \",\"pages\":\"Article 112461\"},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2024-11-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Soft Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1568494624012353\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Soft Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1568494624012353","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A reinforcement learning hyper-heuristic algorithm for the distributed flowshops scheduling problem under consideration of emergency order insertion
Large enterprises are composed of several subproduction centers. The production plan is changed based on the procedure of the manufacturing system. The distributed flowshop scheduling problem under consideration of emergence order insertion is challenging as the assignment of the product, and the scheduling of the process are coupled with each other. A general distributed flow shop scheduling problem regarding emergency order insertion (DFSP_EOI) is addressed under rescheduling circumstances in this paper. The Q-learning hyper-heuristic algorithm with dynamic insertion rule (QLHH_DIR) is proposed to solve the DFSP_EOI. Eight low-level heuristics (LLHs) for static job assignment. A dynamic insertion rule based on the state of each production center is designed for emergency order insertion. The Q-learning mechanism at high-level space selects appropriate LLH through learning the experience from the optimization process. The computational simulation is carried out, and the results confirm that the proposed algorithm is superior to the competitors in solving the distributed flow shop rescheduling problem. The results of the 720 problem instances show that the proposed algorithm is highly efficient in rescheduling problems.
期刊介绍:
Applied Soft Computing is an international journal promoting an integrated view of soft computing to solve real life problems.The focus is to publish the highest quality research in application and convergence of the areas of Fuzzy Logic, Neural Networks, Evolutionary Computing, Rough Sets and other similar techniques to address real world complexities.
Applied Soft Computing is a rolling publication: articles are published as soon as the editor-in-chief has accepted them. Therefore, the web site will continuously be updated with new articles and the publication time will be short.