{"title":"深度强化学习辅助无人机记忆调度,用于铁路导轨除冰","authors":"Yu-Jun Zheng , Xi-Cheng Xie , Zhi-Yuan Zhang , Jin-Tang Shi","doi":"10.1016/j.swevo.2024.101719","DOIUrl":null,"url":null,"abstract":"<div><p>Icy rainfall and snowfall in 2024 Spring Festival struck the high-speed railway catenary systems and caused serious traffic disruptions in central and eastern China. Deicing drones are an effective method in response to these freezing events due to their fast speed and high environmental tolerance. However, the large disaster-affected area and the large scale and complexity of catenary networks make deicing drone scheduling a very difficult problem. In this paper, we formulate two versions of deicing drone scheduling problem, one for single drone scheduling and the other for multiple drone scheduling. Unlike most existing vehicle/drone routing problems, our problem aims to minimize the total negative effect caused by the freezing events on train operations, which reflects the prime concern of the decision-maker and is highly complex. To efficiently solve the problem, we propose a reinforcement learning assisted memetic optimization algorithm, which integrates global mutation and a set of neighborhood search operators adaptively selected by deep reinforcement learning. Computational results on real-world problem instances demonstrate its significant performance advantages over selected popular optimization algorithms in the literature.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":"91 ","pages":"Article 101719"},"PeriodicalIF":8.2000,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep reinforcement learning assisted memetic scheduling of drones for railway catenary deicing\",\"authors\":\"Yu-Jun Zheng , Xi-Cheng Xie , Zhi-Yuan Zhang , Jin-Tang Shi\",\"doi\":\"10.1016/j.swevo.2024.101719\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Icy rainfall and snowfall in 2024 Spring Festival struck the high-speed railway catenary systems and caused serious traffic disruptions in central and eastern China. Deicing drones are an effective method in response to these freezing events due to their fast speed and high environmental tolerance. However, the large disaster-affected area and the large scale and complexity of catenary networks make deicing drone scheduling a very difficult problem. In this paper, we formulate two versions of deicing drone scheduling problem, one for single drone scheduling and the other for multiple drone scheduling. Unlike most existing vehicle/drone routing problems, our problem aims to minimize the total negative effect caused by the freezing events on train operations, which reflects the prime concern of the decision-maker and is highly complex. To efficiently solve the problem, we propose a reinforcement learning assisted memetic optimization algorithm, which integrates global mutation and a set of neighborhood search operators adaptively selected by deep reinforcement learning. Computational results on real-world problem instances demonstrate its significant performance advantages over selected popular optimization algorithms in the literature.</p></div>\",\"PeriodicalId\":48682,\"journal\":{\"name\":\"Swarm and Evolutionary Computation\",\"volume\":\"91 \",\"pages\":\"Article 101719\"},\"PeriodicalIF\":8.2000,\"publicationDate\":\"2024-08-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Swarm and Evolutionary Computation\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2210650224002578\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Swarm and Evolutionary Computation","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2210650224002578","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Deep reinforcement learning assisted memetic scheduling of drones for railway catenary deicing
Icy rainfall and snowfall in 2024 Spring Festival struck the high-speed railway catenary systems and caused serious traffic disruptions in central and eastern China. Deicing drones are an effective method in response to these freezing events due to their fast speed and high environmental tolerance. However, the large disaster-affected area and the large scale and complexity of catenary networks make deicing drone scheduling a very difficult problem. In this paper, we formulate two versions of deicing drone scheduling problem, one for single drone scheduling and the other for multiple drone scheduling. Unlike most existing vehicle/drone routing problems, our problem aims to minimize the total negative effect caused by the freezing events on train operations, which reflects the prime concern of the decision-maker and is highly complex. To efficiently solve the problem, we propose a reinforcement learning assisted memetic optimization algorithm, which integrates global mutation and a set of neighborhood search operators adaptively selected by deep reinforcement learning. Computational results on real-world problem instances demonstrate its significant performance advantages over selected popular optimization algorithms in the literature.
期刊介绍:
Swarm and Evolutionary Computation is a pioneering peer-reviewed journal focused on the latest research and advancements in nature-inspired intelligent computation using swarm and evolutionary algorithms. It covers theoretical, experimental, and practical aspects of these paradigms and their hybrids, promoting interdisciplinary research. The journal prioritizes the publication of high-quality, original articles that push the boundaries of evolutionary computation and swarm intelligence. Additionally, it welcomes survey papers on current topics and novel applications. Topics of interest include but are not limited to: Genetic Algorithms, and Genetic Programming, Evolution Strategies, and Evolutionary Programming, Differential Evolution, Artificial Immune Systems, Particle Swarms, Ant Colony, Bacterial Foraging, Artificial Bees, Fireflies Algorithm, Harmony Search, Artificial Life, Digital Organisms, Estimation of Distribution Algorithms, Stochastic Diffusion Search, Quantum Computing, Nano Computing, Membrane Computing, Human-centric Computing, Hybridization of Algorithms, Memetic Computing, Autonomic Computing, Self-organizing systems, Combinatorial, Discrete, Binary, Constrained, Multi-objective, Multi-modal, Dynamic, and Large-scale Optimization.