Yaohua Liao, Xin Jin, Zhiming Gu, Bo Li, Tingzhe Pan
{"title":"Harnessing solar power with adaptive control of PV-enriched microgrids using A3C-driven deep reinforcement learning","authors":"Yaohua Liao, Xin Jin, Zhiming Gu, Bo Li, Tingzhe Pan","doi":"10.1049/gtd2.70012","DOIUrl":null,"url":null,"abstract":"<p>This research introduces an advanced adaptive control framework utilizing deep reinforcement learning, specifically the Asynchronous Advantage Actor-Critic algorithm, to optimize the operation of photovoltaic-enriched microgrids integrated with solar electric vehicles. The integration of solar electric vehicles within microgrids not only addresses transportation needs and energy sustainability by acting as dynamic energy storage systems. The inherent intermittency of solar power and the dynamic energy demands of solar electric vehicles pose significant operational challenges, requiring robust, flexible control systems capable of real-time optimization. Our framework leverages the Asynchronous Advantage Actor-Critic algorithm for its efficiency in handling high-dimensional state spaces and its capability for rapid, concurrent learning processes, making it well-suited for the dynamic and complex environment of photovoltaic-enriched microgrids. The proposed model innovatively combines solar energy generation with solar electric vehicle energy storage and consumption dynamics, providing a holistic approach to microgrid management that optimizes energy flows, reduces reliance on traditional energy sources, and minimizes environmental impact.</p>","PeriodicalId":13261,"journal":{"name":"Iet Generation Transmission & Distribution","volume":"19 1","pages":""},"PeriodicalIF":2.0000,"publicationDate":"2025-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/gtd2.70012","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Iet Generation Transmission & Distribution","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/gtd2.70012","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
This research introduces an advanced adaptive control framework utilizing deep reinforcement learning, specifically the Asynchronous Advantage Actor-Critic algorithm, to optimize the operation of photovoltaic-enriched microgrids integrated with solar electric vehicles. The integration of solar electric vehicles within microgrids not only addresses transportation needs and energy sustainability by acting as dynamic energy storage systems. The inherent intermittency of solar power and the dynamic energy demands of solar electric vehicles pose significant operational challenges, requiring robust, flexible control systems capable of real-time optimization. Our framework leverages the Asynchronous Advantage Actor-Critic algorithm for its efficiency in handling high-dimensional state spaces and its capability for rapid, concurrent learning processes, making it well-suited for the dynamic and complex environment of photovoltaic-enriched microgrids. The proposed model innovatively combines solar energy generation with solar electric vehicle energy storage and consumption dynamics, providing a holistic approach to microgrid management that optimizes energy flows, reduces reliance on traditional energy sources, and minimizes environmental impact.
期刊介绍:
IET Generation, Transmission & Distribution is intended as a forum for the publication and discussion of current practice and future developments in electric power generation, transmission and distribution. Practical papers in which examples of good present practice can be described and disseminated are particularly sought. Papers of high technical merit relying on mathematical arguments and computation will be considered, but authors are asked to relegate, as far as possible, the details of analysis to an appendix.
The scope of IET Generation, Transmission & Distribution includes the following:
Design of transmission and distribution systems
Operation and control of power generation
Power system management, planning and economics
Power system operation, protection and control
Power system measurement and modelling
Computer applications and computational intelligence in power flexible AC or DC transmission systems
Special Issues. Current Call for papers:
Next Generation of Synchrophasor-based Power System Monitoring, Operation and Control - https://digital-library.theiet.org/files/IET_GTD_CFP_NGSPSMOC.pdf