Rendi Liu, Ju Jiang, Xiang Liu, Haowei Sun, Tingyu Ma
{"title":"基于深度强化学习的舰载机着陆控制技术","authors":"Rendi Liu, Ju Jiang, Xiang Liu, Haowei Sun, Tingyu Ma","doi":"10.1109/ISAS59543.2023.10164523","DOIUrl":null,"url":null,"abstract":"In this paper, a pitching control method based on Deep Deterministic Policy Gradient (DDPG) algorithm for carrier aircraft landing and descending stage is studied. DDPG controller takes pitch angle rate error, pitch angle error and altitude error as input, and output as elevator deflection, realizing the rapid pitch angle response of carrier-aircraft under different landing states. Compared with traditional PID controller, network training of Actor-Critic for DDPG attitude controller greatly improves the calculation efficiency of control quantity, and reduces the difficulty of parameter optimization. The simulation experiment in this paper was based on the F/A-18 aircraft aerodynamics model constructed in Matlab/Simulink, and the intensive learning and training environment built on PyCharm platform was used to realize the data interaction between the two platforms through UDP communication. The simulation results show that the attitude controller based on reinforcement learning designed in this paper has the characteristics of fast response speed and small dynamic error, and meets the control accuracy requirements in the experiment.","PeriodicalId":199115,"journal":{"name":"2023 6th International Symposium on Autonomous Systems (ISAS)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Carrier Aircraft Landing Control Technology Based on Deep Reinforcement Learning\",\"authors\":\"Rendi Liu, Ju Jiang, Xiang Liu, Haowei Sun, Tingyu Ma\",\"doi\":\"10.1109/ISAS59543.2023.10164523\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, a pitching control method based on Deep Deterministic Policy Gradient (DDPG) algorithm for carrier aircraft landing and descending stage is studied. DDPG controller takes pitch angle rate error, pitch angle error and altitude error as input, and output as elevator deflection, realizing the rapid pitch angle response of carrier-aircraft under different landing states. Compared with traditional PID controller, network training of Actor-Critic for DDPG attitude controller greatly improves the calculation efficiency of control quantity, and reduces the difficulty of parameter optimization. The simulation experiment in this paper was based on the F/A-18 aircraft aerodynamics model constructed in Matlab/Simulink, and the intensive learning and training environment built on PyCharm platform was used to realize the data interaction between the two platforms through UDP communication. The simulation results show that the attitude controller based on reinforcement learning designed in this paper has the characteristics of fast response speed and small dynamic error, and meets the control accuracy requirements in the experiment.\",\"PeriodicalId\":199115,\"journal\":{\"name\":\"2023 6th International Symposium on Autonomous Systems (ISAS)\",\"volume\":\"19 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 6th International Symposium on Autonomous Systems (ISAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISAS59543.2023.10164523\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 6th International Symposium on Autonomous Systems (ISAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISAS59543.2023.10164523","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Carrier Aircraft Landing Control Technology Based on Deep Reinforcement Learning
In this paper, a pitching control method based on Deep Deterministic Policy Gradient (DDPG) algorithm for carrier aircraft landing and descending stage is studied. DDPG controller takes pitch angle rate error, pitch angle error and altitude error as input, and output as elevator deflection, realizing the rapid pitch angle response of carrier-aircraft under different landing states. Compared with traditional PID controller, network training of Actor-Critic for DDPG attitude controller greatly improves the calculation efficiency of control quantity, and reduces the difficulty of parameter optimization. The simulation experiment in this paper was based on the F/A-18 aircraft aerodynamics model constructed in Matlab/Simulink, and the intensive learning and training environment built on PyCharm platform was used to realize the data interaction between the two platforms through UDP communication. The simulation results show that the attitude controller based on reinforcement learning designed in this paper has the characteristics of fast response speed and small dynamic error, and meets the control accuracy requirements in the experiment.