Xiaobin Lian , Suyi Liu , Xuyang Cao , Hongyan Wang , Wudong Deng , Xin Ning
{"title":"基于PINN-DDPG的无拖卫星试验质量敏捷控制。","authors":"Xiaobin Lian , Suyi Liu , Xuyang Cao , Hongyan Wang , Wudong Deng , Xin Ning","doi":"10.1016/j.isatra.2024.11.049","DOIUrl":null,"url":null,"abstract":"<div><div>Agile control after the release of test mass is related to the success or failure of China's space gravitational wave detection program, such as TianQin and Taiji. In the release process, the test mass’s motion state is complex and susceptible to collisions with the satellite cavity. In addition, the release capture control of the test mass uses electrostatic force, which is extremely small. These factors pose a significant challenge to the control system design. For this purpose, this paper proposes a real-time predictive control method for PINN-DDPG based on Physical Information Neural Network (PINN), Long Short-Term Memory (LSTM), and Deep Deterministic Policy Gradient (DDPG) to solve the problem of agile capture control under weak electrostatic force. First, a PINN-LSTM network for real-time state prediction is designed based on PINN and LSTM to solve the problems of interpretability and time-dependent state prediction. Subsequently, a DDPG controller was designed to solve the reinforcement learning control problem in continuous action space. Finally, simulation results demonstrate that, in comparison to the traditional PINN, the PINN-LSTM markedly hastens the training convergence, cutting the time by 60 %. Compared to traditional DDPG control, the PINN-DDPG diminish the stabilization time of position and velocity errors by 70 %.</div></div>","PeriodicalId":14660,"journal":{"name":"ISA transactions","volume":"157 ","pages":"Pages 306-317"},"PeriodicalIF":6.3000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Agile control of test mass based on PINN-DDPG for drag-free satellite\",\"authors\":\"Xiaobin Lian , Suyi Liu , Xuyang Cao , Hongyan Wang , Wudong Deng , Xin Ning\",\"doi\":\"10.1016/j.isatra.2024.11.049\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Agile control after the release of test mass is related to the success or failure of China's space gravitational wave detection program, such as TianQin and Taiji. In the release process, the test mass’s motion state is complex and susceptible to collisions with the satellite cavity. In addition, the release capture control of the test mass uses electrostatic force, which is extremely small. These factors pose a significant challenge to the control system design. For this purpose, this paper proposes a real-time predictive control method for PINN-DDPG based on Physical Information Neural Network (PINN), Long Short-Term Memory (LSTM), and Deep Deterministic Policy Gradient (DDPG) to solve the problem of agile capture control under weak electrostatic force. First, a PINN-LSTM network for real-time state prediction is designed based on PINN and LSTM to solve the problems of interpretability and time-dependent state prediction. Subsequently, a DDPG controller was designed to solve the reinforcement learning control problem in continuous action space. Finally, simulation results demonstrate that, in comparison to the traditional PINN, the PINN-LSTM markedly hastens the training convergence, cutting the time by 60 %. Compared to traditional DDPG control, the PINN-DDPG diminish the stabilization time of position and velocity errors by 70 %.</div></div>\",\"PeriodicalId\":14660,\"journal\":{\"name\":\"ISA transactions\",\"volume\":\"157 \",\"pages\":\"Pages 306-317\"},\"PeriodicalIF\":6.3000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISA transactions\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0019057824005603\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISA transactions","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0019057824005603","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Agile control of test mass based on PINN-DDPG for drag-free satellite
Agile control after the release of test mass is related to the success or failure of China's space gravitational wave detection program, such as TianQin and Taiji. In the release process, the test mass’s motion state is complex and susceptible to collisions with the satellite cavity. In addition, the release capture control of the test mass uses electrostatic force, which is extremely small. These factors pose a significant challenge to the control system design. For this purpose, this paper proposes a real-time predictive control method for PINN-DDPG based on Physical Information Neural Network (PINN), Long Short-Term Memory (LSTM), and Deep Deterministic Policy Gradient (DDPG) to solve the problem of agile capture control under weak electrostatic force. First, a PINN-LSTM network for real-time state prediction is designed based on PINN and LSTM to solve the problems of interpretability and time-dependent state prediction. Subsequently, a DDPG controller was designed to solve the reinforcement learning control problem in continuous action space. Finally, simulation results demonstrate that, in comparison to the traditional PINN, the PINN-LSTM markedly hastens the training convergence, cutting the time by 60 %. Compared to traditional DDPG control, the PINN-DDPG diminish the stabilization time of position and velocity errors by 70 %.
期刊介绍:
ISA Transactions serves as a platform for showcasing advancements in measurement and automation, catering to both industrial practitioners and applied researchers. It covers a wide array of topics within measurement, including sensors, signal processing, data analysis, and fault detection, supported by techniques such as artificial intelligence and communication systems. Automation topics encompass control strategies, modelling, system reliability, and maintenance, alongside optimization and human-machine interaction. The journal targets research and development professionals in control systems, process instrumentation, and automation from academia and industry.