{"title":"A Predictive Control Method Based on Neural Predictor and Soft Actor–Critic for Power Converters","authors":"Chenghao Liu;Jien Ma;Xing Liu;Lin Qiu;Wenjie Wu;Youtong Fang","doi":"10.1109/TIE.2024.3472285","DOIUrl":null,"url":null,"abstract":"This article focuses on introducing soft reinforcement learning (RL) techniques into the finite control-set model predictive control (FCS-MPC) framework to enhance robust performance. More precisely, building upon a neural predictor, an intelligent agent trained using the soft actor–critic algorithm is developed to explore the optimal control input embedded within the MPC framework. Meanwhile, during training, a constraint based on a Lyapunov function is introduced, and a corresponding update law for the weights is provided. Furthermore, this proposed method guarantees the stability of the system integrated with the RL intelligent agent. Finally, both simulation and experimental results validate the superiority of this approach compared to the existing FCS-MPC methods.","PeriodicalId":13402,"journal":{"name":"IEEE Transactions on Industrial Electronics","volume":"72 5","pages":"4556-4566"},"PeriodicalIF":7.2000,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Industrial Electronics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10738219/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
This article focuses on introducing soft reinforcement learning (RL) techniques into the finite control-set model predictive control (FCS-MPC) framework to enhance robust performance. More precisely, building upon a neural predictor, an intelligent agent trained using the soft actor–critic algorithm is developed to explore the optimal control input embedded within the MPC framework. Meanwhile, during training, a constraint based on a Lyapunov function is introduced, and a corresponding update law for the weights is provided. Furthermore, this proposed method guarantees the stability of the system integrated with the RL intelligent agent. Finally, both simulation and experimental results validate the superiority of this approach compared to the existing FCS-MPC methods.
期刊介绍:
Journal Name: IEEE Transactions on Industrial Electronics
Publication Frequency: Monthly
Scope:
The scope of IEEE Transactions on Industrial Electronics encompasses the following areas:
Applications of electronics, controls, and communications in industrial and manufacturing systems and processes.
Power electronics and drive control techniques.
System control and signal processing.
Fault detection and diagnosis.
Power systems.
Instrumentation, measurement, and testing.
Modeling and simulation.
Motion control.
Robotics.
Sensors and actuators.
Implementation of neural networks, fuzzy logic, and artificial intelligence in industrial systems.
Factory automation.
Communication and computer networks.