{"title":"Twin delayed deep deterministic reinforcement learning application in vehicle electrical suspension control","authors":"Daoyu Shen, Shilei Zhou, Nong Zhang","doi":"10.1504/ijvp.2023.133852","DOIUrl":null,"url":null,"abstract":"Coming with the rising focus of the driving comfort request, more efforts are being delivered into the study of suspension system. Comparing with other traditional control methods, the machine learning control strategy has demonstrated its optimality in dealing with different class of roads. The work presented in this paper is to apply twin delayed deep deterministic policy gradients (TD3) in suspension control which enables suspension controller to go beyond searching for an optimal set of system parameters from traditional control method in dealing with different class of pavements. To achieve this, a suspension model has been established together with a reinforcement learning algorithm and an input signal of pavement. The performance of the twin delayed reinforcement agent is compared against deep deterministic policy gradients (DDPG) and deep Q-learning (DQN) algorithms under different types of pavement. The simulation result shows its superiority, robustness and learning efficiency over other reinforcement learning algorithms.","PeriodicalId":52169,"journal":{"name":"International Journal of Vehicle Performance","volume":"39 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Vehicle Performance","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1504/ijvp.2023.133852","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Engineering","Score":null,"Total":0}
引用次数: 0
Abstract
Coming with the rising focus of the driving comfort request, more efforts are being delivered into the study of suspension system. Comparing with other traditional control methods, the machine learning control strategy has demonstrated its optimality in dealing with different class of roads. The work presented in this paper is to apply twin delayed deep deterministic policy gradients (TD3) in suspension control which enables suspension controller to go beyond searching for an optimal set of system parameters from traditional control method in dealing with different class of pavements. To achieve this, a suspension model has been established together with a reinforcement learning algorithm and an input signal of pavement. The performance of the twin delayed reinforcement agent is compared against deep deterministic policy gradients (DDPG) and deep Q-learning (DQN) algorithms under different types of pavement. The simulation result shows its superiority, robustness and learning efficiency over other reinforcement learning algorithms.