Liu Hong , Li Qizhe , Zhang Qiang , Xu Zhengyang , Lu Shaohan
{"title":"基于安全强化学习的具有相位变化软开点的不平衡配电网络优化调度","authors":"Liu Hong , Li Qizhe , Zhang Qiang , Xu Zhengyang , Lu Shaohan","doi":"10.1016/j.segan.2024.101521","DOIUrl":null,"url":null,"abstract":"<div><p>Distributed energy resources and uneven load allocation cause the three-phase unbalance in distribution networks, which may harm the health of power equipment and increase the operational costs. There is emerging opportunity to dispatch soft open points to improve the operation performance of active distribution network. This paper proposes an optimal dispatch strategy to improve the network balancing performance, where a new type of phase-changing soft open point is installed. First, a new type of phase-changing soft open point with full-phase changing ability is introduced to balance the three-phase power flow. Then, the optimization model is formulated for phase-changing soft open points dispatching to minimize the total cost of distribution network. Furthermore, the model is formed as a constrained Markov decision process and efficiently solved by the augmented Lagrangian-based safe deep reinforcement learning algorithm featuring the soft actor-critic method. Finally, numerical simulations are conducted to validate the effectiveness, accuracy, and efficiency of the proposed method.</p></div>","PeriodicalId":56142,"journal":{"name":"Sustainable Energy Grids & Networks","volume":"40 ","pages":"Article 101521"},"PeriodicalIF":4.8000,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimal dispatch of unbalanced distribution networks with phase-changing soft open points based on safe reinforcement learning\",\"authors\":\"Liu Hong , Li Qizhe , Zhang Qiang , Xu Zhengyang , Lu Shaohan\",\"doi\":\"10.1016/j.segan.2024.101521\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Distributed energy resources and uneven load allocation cause the three-phase unbalance in distribution networks, which may harm the health of power equipment and increase the operational costs. There is emerging opportunity to dispatch soft open points to improve the operation performance of active distribution network. This paper proposes an optimal dispatch strategy to improve the network balancing performance, where a new type of phase-changing soft open point is installed. First, a new type of phase-changing soft open point with full-phase changing ability is introduced to balance the three-phase power flow. Then, the optimization model is formulated for phase-changing soft open points dispatching to minimize the total cost of distribution network. Furthermore, the model is formed as a constrained Markov decision process and efficiently solved by the augmented Lagrangian-based safe deep reinforcement learning algorithm featuring the soft actor-critic method. Finally, numerical simulations are conducted to validate the effectiveness, accuracy, and efficiency of the proposed method.</p></div>\",\"PeriodicalId\":56142,\"journal\":{\"name\":\"Sustainable Energy Grids & Networks\",\"volume\":\"40 \",\"pages\":\"Article 101521\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2024-09-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Sustainable Energy Grids & Networks\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2352467724002509\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Sustainable Energy Grids & Networks","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352467724002509","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
Optimal dispatch of unbalanced distribution networks with phase-changing soft open points based on safe reinforcement learning
Distributed energy resources and uneven load allocation cause the three-phase unbalance in distribution networks, which may harm the health of power equipment and increase the operational costs. There is emerging opportunity to dispatch soft open points to improve the operation performance of active distribution network. This paper proposes an optimal dispatch strategy to improve the network balancing performance, where a new type of phase-changing soft open point is installed. First, a new type of phase-changing soft open point with full-phase changing ability is introduced to balance the three-phase power flow. Then, the optimization model is formulated for phase-changing soft open points dispatching to minimize the total cost of distribution network. Furthermore, the model is formed as a constrained Markov decision process and efficiently solved by the augmented Lagrangian-based safe deep reinforcement learning algorithm featuring the soft actor-critic method. Finally, numerical simulations are conducted to validate the effectiveness, accuracy, and efficiency of the proposed method.
期刊介绍:
Sustainable Energy, Grids and Networks (SEGAN)is an international peer-reviewed publication for theoretical and applied research dealing with energy, information grids and power networks, including smart grids from super to micro grid scales. SEGAN welcomes papers describing fundamental advances in mathematical, statistical or computational methods with application to power and energy systems, as well as papers on applications, computation and modeling in the areas of electrical and energy systems with coupled information and communication technologies.