{"title":"MQL-MM:基于元 Q 学习的高能效分布式模糊混合阻塞流车间调度问题多目标元启发式","authors":"Zhongshi Shao;Weishi Shao;Jianrui Chen;Dechang Pi","doi":"10.1109/TEVC.2024.3399314","DOIUrl":null,"url":null,"abstract":"Since severe environmental problem in manufacturing industries is becoming increasingly prominent, energy-efficient production scheduling has gained more and more attentions. This article studies an energy-efficient distributed fuzzy hybrid blocking flow-shop scheduling problem (EEDFHBFSP), where processing time and setup time are uncertain. The objective is to minimize fuzzy makespan and total fuzzy energy consumption simultaneously. To solve such problem, a mixed-integer linear programming model is first presented to format it. Then, a meta-Q-learning-based multiobjective metaheuristic (MQL-MM) is proposed. In MQL-MM, a machine-position-based dispatch rule is designed as the decoding scheme. A decomposition-based constructive heuristic (DCH) is employed to generate the initial population with high quality and diversity. Several problem-specific search operators are developed to explore and exploit the solution space. A meta-Q-learning-based multiobjective search framework is presented to guide the using of search operators, which includes a meta-training phase and an adaptive search phase. The meta-training phase is employed to train the search operators to construct the Q-learning model. The adaptation search phase utilizes such model to conduct the automatic selection of the search operators. Moreover, an energy-saving strategy is designed to improve the candidate solutions. Finally, we conduct extensive experiments. The experimental results show that the designs of MQL-MM are effective, and MQL-MM performs better than several well-performing methods on solving EEDFHBFSP.","PeriodicalId":13206,"journal":{"name":"IEEE Transactions on Evolutionary Computation","volume":"29 4","pages":"1183-1198"},"PeriodicalIF":11.7000,"publicationDate":"2024-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MQL-MM: A Meta-Q-Learning-Based Multiobjective Metaheuristic for Energy-Efficient Distributed Fuzzy Hybrid Blocking Flow-Shop Scheduling Problem\",\"authors\":\"Zhongshi Shao;Weishi Shao;Jianrui Chen;Dechang Pi\",\"doi\":\"10.1109/TEVC.2024.3399314\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Since severe environmental problem in manufacturing industries is becoming increasingly prominent, energy-efficient production scheduling has gained more and more attentions. This article studies an energy-efficient distributed fuzzy hybrid blocking flow-shop scheduling problem (EEDFHBFSP), where processing time and setup time are uncertain. The objective is to minimize fuzzy makespan and total fuzzy energy consumption simultaneously. To solve such problem, a mixed-integer linear programming model is first presented to format it. Then, a meta-Q-learning-based multiobjective metaheuristic (MQL-MM) is proposed. In MQL-MM, a machine-position-based dispatch rule is designed as the decoding scheme. A decomposition-based constructive heuristic (DCH) is employed to generate the initial population with high quality and diversity. Several problem-specific search operators are developed to explore and exploit the solution space. A meta-Q-learning-based multiobjective search framework is presented to guide the using of search operators, which includes a meta-training phase and an adaptive search phase. The meta-training phase is employed to train the search operators to construct the Q-learning model. The adaptation search phase utilizes such model to conduct the automatic selection of the search operators. Moreover, an energy-saving strategy is designed to improve the candidate solutions. Finally, we conduct extensive experiments. The experimental results show that the designs of MQL-MM are effective, and MQL-MM performs better than several well-performing methods on solving EEDFHBFSP.\",\"PeriodicalId\":13206,\"journal\":{\"name\":\"IEEE Transactions on Evolutionary Computation\",\"volume\":\"29 4\",\"pages\":\"1183-1198\"},\"PeriodicalIF\":11.7000,\"publicationDate\":\"2024-03-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Evolutionary Computation\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10529141/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Evolutionary Computation","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10529141/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
MQL-MM: A Meta-Q-Learning-Based Multiobjective Metaheuristic for Energy-Efficient Distributed Fuzzy Hybrid Blocking Flow-Shop Scheduling Problem
Since severe environmental problem in manufacturing industries is becoming increasingly prominent, energy-efficient production scheduling has gained more and more attentions. This article studies an energy-efficient distributed fuzzy hybrid blocking flow-shop scheduling problem (EEDFHBFSP), where processing time and setup time are uncertain. The objective is to minimize fuzzy makespan and total fuzzy energy consumption simultaneously. To solve such problem, a mixed-integer linear programming model is first presented to format it. Then, a meta-Q-learning-based multiobjective metaheuristic (MQL-MM) is proposed. In MQL-MM, a machine-position-based dispatch rule is designed as the decoding scheme. A decomposition-based constructive heuristic (DCH) is employed to generate the initial population with high quality and diversity. Several problem-specific search operators are developed to explore and exploit the solution space. A meta-Q-learning-based multiobjective search framework is presented to guide the using of search operators, which includes a meta-training phase and an adaptive search phase. The meta-training phase is employed to train the search operators to construct the Q-learning model. The adaptation search phase utilizes such model to conduct the automatic selection of the search operators. Moreover, an energy-saving strategy is designed to improve the candidate solutions. Finally, we conduct extensive experiments. The experimental results show that the designs of MQL-MM are effective, and MQL-MM performs better than several well-performing methods on solving EEDFHBFSP.
期刊介绍:
The IEEE Transactions on Evolutionary Computation is published by the IEEE Computational Intelligence Society on behalf of 13 societies: Circuits and Systems; Computer; Control Systems; Engineering in Medicine and Biology; Industrial Electronics; Industry Applications; Lasers and Electro-Optics; Oceanic Engineering; Power Engineering; Robotics and Automation; Signal Processing; Social Implications of Technology; and Systems, Man, and Cybernetics. The journal publishes original papers in evolutionary computation and related areas such as nature-inspired algorithms, population-based methods, optimization, and hybrid systems. It welcomes both purely theoretical papers and application papers that provide general insights into these areas of computation.