{"title":"Learning-Based Reconfiguration of Charged Spacecraft Formation in Geomagnetic Field","authors":"Qingyu Qu;Lian Geng;Kexin Liu;Jinhu Lü","doi":"10.1109/TCYB.2024.3476078","DOIUrl":null,"url":null,"abstract":"This article introduces a novel approach for spacecraft formation flying utilizing Lorentz-augmented techniques. It demonstrates that the relative motion among spacecraft, driven by the Lorentz force, possesses equilibrium states beneficial for formation maintenance. However, for effective formation reconfiguration, reliance solely on the Lorentz force is insufficient; low thrust is also necessary. To address this, this article proposes an optimal control framework based on reinforcement learning (RL). It derives the nonlinear dynamics of relative motion within the geomagnetic field, considering intersatellite Lorentz force, atmospheric drag, and Earth’s gravitational harmonics. The study employs Lagrangian coherent structure analysis to identify relative equilibrium configurations and develops an RL-based optimal control strategy for real-time formation reconfiguration. By leveraging optimal demonstrations, the framework guides the agent’s actions to match these demonstrations over time, especially when encountering out-of-distribution states. Numerical simulations confirm the method’s optimality, robustness, and real-time performance, highlighting its potential in achieving optimal control and adapting to varying environment in future space missions.","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"55 2","pages":"588-599"},"PeriodicalIF":10.5000,"publicationDate":"2024-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cybernetics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10720927/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
This article introduces a novel approach for spacecraft formation flying utilizing Lorentz-augmented techniques. It demonstrates that the relative motion among spacecraft, driven by the Lorentz force, possesses equilibrium states beneficial for formation maintenance. However, for effective formation reconfiguration, reliance solely on the Lorentz force is insufficient; low thrust is also necessary. To address this, this article proposes an optimal control framework based on reinforcement learning (RL). It derives the nonlinear dynamics of relative motion within the geomagnetic field, considering intersatellite Lorentz force, atmospheric drag, and Earth’s gravitational harmonics. The study employs Lagrangian coherent structure analysis to identify relative equilibrium configurations and develops an RL-based optimal control strategy for real-time formation reconfiguration. By leveraging optimal demonstrations, the framework guides the agent’s actions to match these demonstrations over time, especially when encountering out-of-distribution states. Numerical simulations confirm the method’s optimality, robustness, and real-time performance, highlighting its potential in achieving optimal control and adapting to varying environment in future space missions.
期刊介绍:
The scope of the IEEE Transactions on Cybernetics includes computational approaches to the field of cybernetics. Specifically, the transactions welcomes papers on communication and control across machines or machine, human, and organizations. The scope includes such areas as computational intelligence, computer vision, neural networks, genetic algorithms, machine learning, fuzzy systems, cognitive systems, decision making, and robotics, to the extent that they contribute to the theme of cybernetics or demonstrate an application of cybernetics principles.