Dengao Li , Zhuokai Zhang , Ding Feng , Yu Zhou , Xiaodong Bai , Jumin Zhao
{"title":"基于元多代理强化学习的风力/光伏/火力发电系统多目标两阶段鲁棒优化","authors":"Dengao Li , Zhuokai Zhang , Ding Feng , Yu Zhou , Xiaodong Bai , Jumin Zhao","doi":"10.1016/j.ijepes.2024.110273","DOIUrl":null,"url":null,"abstract":"<div><div>The integration of renewable energy into the power grid poses significant challenges for optimization and scheduling of the power system. In recent years, methods based on deep reinforcement learning have surpassed traditional methods on the high complexity and long-term decision-making of power system optimization and scheduling. However, faced with the inherent uncertainty of renewable energy generation and the different optimization objectives in power system, the deep reinforcement learning methods are unable to effectively address them. This paper proposes a method that combines meta reinforcement learning with multi-agent reinforcement learning to solve the multi-objective two-stage robust optimization of wind/PV/thermal power system. We conducts optimization and scheduling experiments on the IEEE39 bus system. The results indicate that our method not only enhances the robustness of the scheduling strategy, but also outperforms baseline methods in terms of convergence, diversity, and uniformity of the Pareto frontier.</div></div>","PeriodicalId":50326,"journal":{"name":"International Journal of Electrical Power & Energy Systems","volume":"162 ","pages":"Article 110273"},"PeriodicalIF":5.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-objective two-stage robust optimization of wind/PV/thermal power system based on meta multi-agent reinforcement learning\",\"authors\":\"Dengao Li , Zhuokai Zhang , Ding Feng , Yu Zhou , Xiaodong Bai , Jumin Zhao\",\"doi\":\"10.1016/j.ijepes.2024.110273\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The integration of renewable energy into the power grid poses significant challenges for optimization and scheduling of the power system. In recent years, methods based on deep reinforcement learning have surpassed traditional methods on the high complexity and long-term decision-making of power system optimization and scheduling. However, faced with the inherent uncertainty of renewable energy generation and the different optimization objectives in power system, the deep reinforcement learning methods are unable to effectively address them. This paper proposes a method that combines meta reinforcement learning with multi-agent reinforcement learning to solve the multi-objective two-stage robust optimization of wind/PV/thermal power system. We conducts optimization and scheduling experiments on the IEEE39 bus system. The results indicate that our method not only enhances the robustness of the scheduling strategy, but also outperforms baseline methods in terms of convergence, diversity, and uniformity of the Pareto frontier.</div></div>\",\"PeriodicalId\":50326,\"journal\":{\"name\":\"International Journal of Electrical Power & Energy Systems\",\"volume\":\"162 \",\"pages\":\"Article 110273\"},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2024-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Electrical Power & Energy Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0142061524004952\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Electrical Power & Energy Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0142061524004952","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Multi-objective two-stage robust optimization of wind/PV/thermal power system based on meta multi-agent reinforcement learning
The integration of renewable energy into the power grid poses significant challenges for optimization and scheduling of the power system. In recent years, methods based on deep reinforcement learning have surpassed traditional methods on the high complexity and long-term decision-making of power system optimization and scheduling. However, faced with the inherent uncertainty of renewable energy generation and the different optimization objectives in power system, the deep reinforcement learning methods are unable to effectively address them. This paper proposes a method that combines meta reinforcement learning with multi-agent reinforcement learning to solve the multi-objective two-stage robust optimization of wind/PV/thermal power system. We conducts optimization and scheduling experiments on the IEEE39 bus system. The results indicate that our method not only enhances the robustness of the scheduling strategy, but also outperforms baseline methods in terms of convergence, diversity, and uniformity of the Pareto frontier.
期刊介绍:
The journal covers theoretical developments in electrical power and energy systems and their applications. The coverage embraces: generation and network planning; reliability; long and short term operation; expert systems; neural networks; object oriented systems; system control centres; database and information systems; stock and parameter estimation; system security and adequacy; network theory, modelling and computation; small and large system dynamics; dynamic model identification; on-line control including load and switching control; protection; distribution systems; energy economics; impact of non-conventional systems; and man-machine interfaces.
As well as original research papers, the journal publishes short contributions, book reviews and conference reports. All papers are peer-reviewed by at least two referees.