Jianshu Zhou , Yue Xiang , Xin Zhang , Zhou Sun , Xuefei Liu , Junyong Liu
{"title":"基于多代理深度强化学习的公路电动汽车充电站最佳自耗调度","authors":"Jianshu Zhou , Yue Xiang , Xin Zhang , Zhou Sun , Xuefei Liu , Junyong Liu","doi":"10.1016/j.renene.2024.121982","DOIUrl":null,"url":null,"abstract":"<div><div>Due to the randomness of renewable energy and electric vehicles (EVs) in highway charging stations, it is difficult to ensure the consistency of renewable energy supply and EVs demand. Considering the randomness of EVs charging and renewable energy power generation, an optimal self-consumption scheduling of a highway EV charging station based on multi-agent deep reinforcement learning (MADRL) is proposed to realize the economy, self-consumption, low-carbon operation and ensure reliability of power supply. In day-ahead, the traffic flow prediction model based on the CNN-BiLSTM and the queuing model based on user psychology are built to predict the charging load. The 24-hour optimal charging price is obtained by solving the incentive price optimization model and guides the orderly charging of EVs. In intra-day, considering the prediction errors of day-ahead and the diversity of charging levels, an optimal scheduling based on the MADRL is proposed. Regarding the multi-objective scheduling of the highway charging station, the multi-objective nonlinear and non-convex problem is transformed into multi-agent Markov game model. Finally, the effectiveness and optimality of the proposed method are verified on a highway charging station The results show that the proposed method can realize the economy, self-consumption and low-carbon operation of the charging station.</div></div>","PeriodicalId":419,"journal":{"name":"Renewable Energy","volume":"238 ","pages":"Article 121982"},"PeriodicalIF":9.0000,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimal Self-Consumption Scheduling of Highway Electric Vehicle Charging Station Based on Multi-Agent Deep Reinforcement Learning\",\"authors\":\"Jianshu Zhou , Yue Xiang , Xin Zhang , Zhou Sun , Xuefei Liu , Junyong Liu\",\"doi\":\"10.1016/j.renene.2024.121982\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Due to the randomness of renewable energy and electric vehicles (EVs) in highway charging stations, it is difficult to ensure the consistency of renewable energy supply and EVs demand. Considering the randomness of EVs charging and renewable energy power generation, an optimal self-consumption scheduling of a highway EV charging station based on multi-agent deep reinforcement learning (MADRL) is proposed to realize the economy, self-consumption, low-carbon operation and ensure reliability of power supply. In day-ahead, the traffic flow prediction model based on the CNN-BiLSTM and the queuing model based on user psychology are built to predict the charging load. The 24-hour optimal charging price is obtained by solving the incentive price optimization model and guides the orderly charging of EVs. In intra-day, considering the prediction errors of day-ahead and the diversity of charging levels, an optimal scheduling based on the MADRL is proposed. Regarding the multi-objective scheduling of the highway charging station, the multi-objective nonlinear and non-convex problem is transformed into multi-agent Markov game model. Finally, the effectiveness and optimality of the proposed method are verified on a highway charging station The results show that the proposed method can realize the economy, self-consumption and low-carbon operation of the charging station.</div></div>\",\"PeriodicalId\":419,\"journal\":{\"name\":\"Renewable Energy\",\"volume\":\"238 \",\"pages\":\"Article 121982\"},\"PeriodicalIF\":9.0000,\"publicationDate\":\"2024-11-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Renewable Energy\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0960148124020500\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Renewable Energy","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0960148124020500","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
Optimal Self-Consumption Scheduling of Highway Electric Vehicle Charging Station Based on Multi-Agent Deep Reinforcement Learning
Due to the randomness of renewable energy and electric vehicles (EVs) in highway charging stations, it is difficult to ensure the consistency of renewable energy supply and EVs demand. Considering the randomness of EVs charging and renewable energy power generation, an optimal self-consumption scheduling of a highway EV charging station based on multi-agent deep reinforcement learning (MADRL) is proposed to realize the economy, self-consumption, low-carbon operation and ensure reliability of power supply. In day-ahead, the traffic flow prediction model based on the CNN-BiLSTM and the queuing model based on user psychology are built to predict the charging load. The 24-hour optimal charging price is obtained by solving the incentive price optimization model and guides the orderly charging of EVs. In intra-day, considering the prediction errors of day-ahead and the diversity of charging levels, an optimal scheduling based on the MADRL is proposed. Regarding the multi-objective scheduling of the highway charging station, the multi-objective nonlinear and non-convex problem is transformed into multi-agent Markov game model. Finally, the effectiveness and optimality of the proposed method are verified on a highway charging station The results show that the proposed method can realize the economy, self-consumption and low-carbon operation of the charging station.
期刊介绍:
Renewable Energy journal is dedicated to advancing knowledge and disseminating insights on various topics and technologies within renewable energy systems and components. Our mission is to support researchers, engineers, economists, manufacturers, NGOs, associations, and societies in staying updated on new developments in their respective fields and applying alternative energy solutions to current practices.
As an international, multidisciplinary journal in renewable energy engineering and research, we strive to be a premier peer-reviewed platform and a trusted source of original research and reviews in the field of renewable energy. Join us in our endeavor to drive innovation and progress in sustainable energy solutions.