Local demand management of charging stations using vehicle-to-vehicle service: A welfare maximization-based soft actor-critic model

IF 15 1区 工程技术 Q1 ENERGY & FUELS Etransportation Pub Date : 2023-10-01 DOI:10.1016/j.etran.2023.100280
Akhtar Hussain , Van-Hai Bui , Petr Musilek
{"title":"Local demand management of charging stations using vehicle-to-vehicle service: A welfare maximization-based soft actor-critic model","authors":"Akhtar Hussain ,&nbsp;Van-Hai Bui ,&nbsp;Petr Musilek","doi":"10.1016/j.etran.2023.100280","DOIUrl":null,"url":null,"abstract":"<div><p>Transportation electrification has the potential to reduce carbon emissions from the transport sector. However, the increased penetration of electric vehicles (EVs) can potentially overload the distribution systems. This becomes prominent in locations with multiple EV chargers and charging stations with many EVs. Therefore, this study proposes a welfare maximization-based soft actor critic (SAC) model to mitigate transformer overload in distribution systems due to the high penetration of EVs. The demand of each charging station is managed locally to avoid network overload during peak load hours in two steps. First, a welfare maximization-based optimization model is developed to maximize the welfare of electric vehicle owners by performing vehicle-to-vehicle(V2V) service. In this step, the sensitivity of EV owners to different parameters (energy level, battery degradation, and incentives provided by fleet operators) is considered. Then, a deep reinforcement learning-based method (soft-actor critic) is trained by incorporating the welfare value (obtained from the welfare maximization model) in the reward function. The total power demand (at the transformer level) and transformer capacity are also included in the reward function. The agent (fleet operator) learns the optimal pricing strategy for local demand management of EVs by interacting with the environment. Each electric vehicle responds to the action (price) by deciding the amount of power they are willing to charge/discharge (V2V) during that interval. Training is performed offline, and the trained model can be used for real-time demand management of different types of charging stations. The simulation results have shown that the proposed method can successfully manage the demand of different charging stations, via V2V, without violating the transformer capacity limits.</p></div>","PeriodicalId":36355,"journal":{"name":"Etransportation","volume":null,"pages":null},"PeriodicalIF":15.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Etransportation","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2590116823000553","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 1

Abstract

Transportation electrification has the potential to reduce carbon emissions from the transport sector. However, the increased penetration of electric vehicles (EVs) can potentially overload the distribution systems. This becomes prominent in locations with multiple EV chargers and charging stations with many EVs. Therefore, this study proposes a welfare maximization-based soft actor critic (SAC) model to mitigate transformer overload in distribution systems due to the high penetration of EVs. The demand of each charging station is managed locally to avoid network overload during peak load hours in two steps. First, a welfare maximization-based optimization model is developed to maximize the welfare of electric vehicle owners by performing vehicle-to-vehicle(V2V) service. In this step, the sensitivity of EV owners to different parameters (energy level, battery degradation, and incentives provided by fleet operators) is considered. Then, a deep reinforcement learning-based method (soft-actor critic) is trained by incorporating the welfare value (obtained from the welfare maximization model) in the reward function. The total power demand (at the transformer level) and transformer capacity are also included in the reward function. The agent (fleet operator) learns the optimal pricing strategy for local demand management of EVs by interacting with the environment. Each electric vehicle responds to the action (price) by deciding the amount of power they are willing to charge/discharge (V2V) during that interval. Training is performed offline, and the trained model can be used for real-time demand management of different types of charging stations. The simulation results have shown that the proposed method can successfully manage the demand of different charging stations, via V2V, without violating the transformer capacity limits.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于车对车服务的充电站本地需求管理:基于福利最大化的软行为者批评模型
交通电气化有可能减少交通部门的碳排放。然而,电动汽车(ev)的日益普及可能会使配电系统过载。这在拥有多个电动汽车充电器和拥有许多电动汽车的充电站的地方变得突出。因此,本研究提出了一个基于福利最大化的软行为者评价(SAC)模型,以减轻配电系统中由于电动汽车的高渗透率而导致的变压器过载。分两步对各充电站的需求进行局部管理,避免高峰负荷时段网络过载。首先,建立了基于福利最大化的优化模型,通过车对车(V2V)服务实现电动汽车车主福利最大化。在这一步中,考虑了电动汽车车主对不同参数(能量水平、电池退化和车队运营商提供的激励)的敏感性。然后,通过将福利值(从福利最大化模型中获得)纳入奖励函数,训练基于深度强化学习的方法(软行为者批评家)。总电力需求(在变压器层面)和变压器容量也包含在奖励函数中。代理(车队运营商)通过与环境的交互学习电动汽车本地需求管理的最优定价策略。每辆电动汽车通过决定在这段时间内他们愿意充电/放电的电量(V2V)来响应动作(价格)。离线训练,训练后的模型可用于不同类型充电站的实时需求管理。仿真结果表明,该方法可以在不违反变压器容量限制的情况下,通过V2V对不同充电站的需求进行有效管理。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Etransportation
Etransportation Engineering-Automotive Engineering
CiteScore
19.80
自引率
12.60%
发文量
57
审稿时长
39 days
期刊介绍: eTransportation is a scholarly journal that aims to advance knowledge in the field of electric transportation. It focuses on all modes of transportation that utilize electricity as their primary source of energy, including electric vehicles, trains, ships, and aircraft. The journal covers all stages of research, development, and testing of new technologies, systems, and devices related to electrical transportation. The journal welcomes the use of simulation and analysis tools at the system, transport, or device level. Its primary emphasis is on the study of the electrical and electronic aspects of transportation systems. However, it also considers research on mechanical parts or subsystems of vehicles if there is a clear interaction with electrical or electronic equipment. Please note that this journal excludes other aspects such as sociological, political, regulatory, or environmental factors from its scope.
期刊最新文献
Explosion characteristics of two-phase ejecta from large-capacity lithium iron phosphate batteries Deep learning driven battery voltage-capacity curve prediction utilizing short-term relaxation voltage Experimental analysis and optimal control of temperature with adaptive control objective for fuel cells Advanced data-driven fault diagnosis in lithium-ion battery management systems for electric vehicles: Progress, challenges, and future perspectives Trustworthy V2G scheduling and energy trading: A blockchain-based framework
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1