{"title":"Local demand management of charging stations using vehicle-to-vehicle service: A welfare maximization-based soft actor-critic model","authors":"Akhtar Hussain , Van-Hai Bui , Petr Musilek","doi":"10.1016/j.etran.2023.100280","DOIUrl":null,"url":null,"abstract":"<div><p>Transportation electrification has the potential to reduce carbon emissions from the transport sector. However, the increased penetration of electric vehicles (EVs) can potentially overload the distribution systems. This becomes prominent in locations with multiple EV chargers and charging stations with many EVs. Therefore, this study proposes a welfare maximization-based soft actor critic (SAC) model to mitigate transformer overload in distribution systems due to the high penetration of EVs. The demand of each charging station is managed locally to avoid network overload during peak load hours in two steps. First, a welfare maximization-based optimization model is developed to maximize the welfare of electric vehicle owners by performing vehicle-to-vehicle(V2V) service. In this step, the sensitivity of EV owners to different parameters (energy level, battery degradation, and incentives provided by fleet operators) is considered. Then, a deep reinforcement learning-based method (soft-actor critic) is trained by incorporating the welfare value (obtained from the welfare maximization model) in the reward function. The total power demand (at the transformer level) and transformer capacity are also included in the reward function. The agent (fleet operator) learns the optimal pricing strategy for local demand management of EVs by interacting with the environment. Each electric vehicle responds to the action (price) by deciding the amount of power they are willing to charge/discharge (V2V) during that interval. Training is performed offline, and the trained model can be used for real-time demand management of different types of charging stations. The simulation results have shown that the proposed method can successfully manage the demand of different charging stations, via V2V, without violating the transformer capacity limits.</p></div>","PeriodicalId":36355,"journal":{"name":"Etransportation","volume":null,"pages":null},"PeriodicalIF":15.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Etransportation","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2590116823000553","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 1
Abstract
Transportation electrification has the potential to reduce carbon emissions from the transport sector. However, the increased penetration of electric vehicles (EVs) can potentially overload the distribution systems. This becomes prominent in locations with multiple EV chargers and charging stations with many EVs. Therefore, this study proposes a welfare maximization-based soft actor critic (SAC) model to mitigate transformer overload in distribution systems due to the high penetration of EVs. The demand of each charging station is managed locally to avoid network overload during peak load hours in two steps. First, a welfare maximization-based optimization model is developed to maximize the welfare of electric vehicle owners by performing vehicle-to-vehicle(V2V) service. In this step, the sensitivity of EV owners to different parameters (energy level, battery degradation, and incentives provided by fleet operators) is considered. Then, a deep reinforcement learning-based method (soft-actor critic) is trained by incorporating the welfare value (obtained from the welfare maximization model) in the reward function. The total power demand (at the transformer level) and transformer capacity are also included in the reward function. The agent (fleet operator) learns the optimal pricing strategy for local demand management of EVs by interacting with the environment. Each electric vehicle responds to the action (price) by deciding the amount of power they are willing to charge/discharge (V2V) during that interval. Training is performed offline, and the trained model can be used for real-time demand management of different types of charging stations. The simulation results have shown that the proposed method can successfully manage the demand of different charging stations, via V2V, without violating the transformer capacity limits.
期刊介绍:
eTransportation is a scholarly journal that aims to advance knowledge in the field of electric transportation. It focuses on all modes of transportation that utilize electricity as their primary source of energy, including electric vehicles, trains, ships, and aircraft. The journal covers all stages of research, development, and testing of new technologies, systems, and devices related to electrical transportation.
The journal welcomes the use of simulation and analysis tools at the system, transport, or device level. Its primary emphasis is on the study of the electrical and electronic aspects of transportation systems. However, it also considers research on mechanical parts or subsystems of vehicles if there is a clear interaction with electrical or electronic equipment.
Please note that this journal excludes other aspects such as sociological, political, regulatory, or environmental factors from its scope.