{"title":"基于深度强化学习算法的PMSM电机控制混合动力汽车能量管理","authors":"S. Muthurajan, R. Loganathan, R. Hemamalini","doi":"10.37394/232016.2023.18.3","DOIUrl":null,"url":null,"abstract":"Hybrid electric vehicles (HEV) have great potential to reduce emissions and improve fuel economy. The application of artificial intelligence-based control algorithms for controlling the electric motor speed and torque yields excellent fuel economy by reducing the losses drastically. In this paper, a novel strategy to improve the performance of an electric motor-like control system for Permanent Magnet Synchronous Motor (PMSM) with the help of a sensorless vector control method where a trained reinforcement learning agent is used and provides accurate signals which will be added to the control signals. Control Signals referred to here are direct and quadrature voltage signals with reference quadrature current signals. The types of reinforcement learning used are the Deep Deterministic Policy Gradient (DDPG) and Deep Q Network (DQN) agents. Integration and implementation of these control systems are presented, and results are published in this paper. The advantages of the proposed method over the conventional vector control strategy are validated by numerical simulation results.","PeriodicalId":38993,"journal":{"name":"WSEAS Transactions on Power Systems","volume":"1 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning Algorithm based PMSM Motor Control for Energy Management of Hybrid Electric Vehicles\",\"authors\":\"S. Muthurajan, R. Loganathan, R. Hemamalini\",\"doi\":\"10.37394/232016.2023.18.3\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Hybrid electric vehicles (HEV) have great potential to reduce emissions and improve fuel economy. The application of artificial intelligence-based control algorithms for controlling the electric motor speed and torque yields excellent fuel economy by reducing the losses drastically. In this paper, a novel strategy to improve the performance of an electric motor-like control system for Permanent Magnet Synchronous Motor (PMSM) with the help of a sensorless vector control method where a trained reinforcement learning agent is used and provides accurate signals which will be added to the control signals. Control Signals referred to here are direct and quadrature voltage signals with reference quadrature current signals. The types of reinforcement learning used are the Deep Deterministic Policy Gradient (DDPG) and Deep Q Network (DQN) agents. Integration and implementation of these control systems are presented, and results are published in this paper. The advantages of the proposed method over the conventional vector control strategy are validated by numerical simulation results.\",\"PeriodicalId\":38993,\"journal\":{\"name\":\"WSEAS Transactions on Power Systems\",\"volume\":\"1 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-03-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"WSEAS Transactions on Power Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.37394/232016.2023.18.3\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Engineering\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"WSEAS Transactions on Power Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.37394/232016.2023.18.3","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Engineering","Score":null,"Total":0}
Deep Reinforcement Learning Algorithm based PMSM Motor Control for Energy Management of Hybrid Electric Vehicles
Hybrid electric vehicles (HEV) have great potential to reduce emissions and improve fuel economy. The application of artificial intelligence-based control algorithms for controlling the electric motor speed and torque yields excellent fuel economy by reducing the losses drastically. In this paper, a novel strategy to improve the performance of an electric motor-like control system for Permanent Magnet Synchronous Motor (PMSM) with the help of a sensorless vector control method where a trained reinforcement learning agent is used and provides accurate signals which will be added to the control signals. Control Signals referred to here are direct and quadrature voltage signals with reference quadrature current signals. The types of reinforcement learning used are the Deep Deterministic Policy Gradient (DDPG) and Deep Q Network (DQN) agents. Integration and implementation of these control systems are presented, and results are published in this paper. The advantages of the proposed method over the conventional vector control strategy are validated by numerical simulation results.
期刊介绍:
WSEAS Transactions on Power Systems publishes original research papers relating to electric power and energy. We aim to bring important work to a wide international audience and therefore only publish papers of exceptional scientific value that advance our understanding of these particular areas. The research presented must transcend the limits of case studies, while both experimental and theoretical studies are accepted. It is a multi-disciplinary journal and therefore its content mirrors the diverse interests and approaches of scholars involved with generation, transmission & distribution planning, alternative energy systems, power market, switching and related areas. We also welcome scholarly contributions from officials with government agencies, international agencies, and non-governmental organizations.