{"title":"A literature review of reinforcement learning methods applied to job-shop scheduling problems","authors":"Xiehui Zhang, Guang-Yu Zhu","doi":"10.1016/j.cor.2024.106929","DOIUrl":null,"url":null,"abstract":"<div><div>The job-shop scheduling problem (JSP) is one of the most famous production scheduling problems, and it is an NP-hard problem. Reinforcement learning (RL), a machine learning method capable of feedback-based learning, holds great potential for solving shop scheduling problems. In this paper, the literature on applying RL to solve JSPs is taken as the review object and analyzed in terms of RL methods, the number of agents, and the agent upgrade strategy. We discuss three major issues faced by RL methods for solving JSPs: the curse of dimensionality, the generalizability and the training time. The interconnectedness of the three main issues is revealed and the main factors affecting them are identified. By discussing the current solutions to the above issues as well as other challenges that exist, suggestions for solving these problems are given, and future research trends are proposed.</div></div>","PeriodicalId":10542,"journal":{"name":"Computers & Operations Research","volume":"175 ","pages":"Article 106929"},"PeriodicalIF":4.1000,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers & Operations Research","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0305054824004015","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
The job-shop scheduling problem (JSP) is one of the most famous production scheduling problems, and it is an NP-hard problem. Reinforcement learning (RL), a machine learning method capable of feedback-based learning, holds great potential for solving shop scheduling problems. In this paper, the literature on applying RL to solve JSPs is taken as the review object and analyzed in terms of RL methods, the number of agents, and the agent upgrade strategy. We discuss three major issues faced by RL methods for solving JSPs: the curse of dimensionality, the generalizability and the training time. The interconnectedness of the three main issues is revealed and the main factors affecting them are identified. By discussing the current solutions to the above issues as well as other challenges that exist, suggestions for solving these problems are given, and future research trends are proposed.
期刊介绍:
Operations research and computers meet in a large number of scientific fields, many of which are of vital current concern to our troubled society. These include, among others, ecology, transportation, safety, reliability, urban planning, economics, inventory control, investment strategy and logistics (including reverse logistics). Computers & Operations Research provides an international forum for the application of computers and operations research techniques to problems in these and related fields.