{"title":"基于多智能体强化学习的相对轨道框架运动目标三角定位卫星制导","authors":"Nicholas Yielding, Joe Curro, S. Cain","doi":"10.1109/PLANS53410.2023.10139951","DOIUrl":null,"url":null,"abstract":"Multi-agent systems and swarms in spacecraft formation flying are of ever-increasing importance in a contested space environment-use of multiple spacecraft to contribute to a cooperative mission potentially increases positive outcomes on orbit, while autonomy becomes an ever increasing requirement to increase reaction time to dynamic situations and lower the burden on space operators. This research explores difficult swarm Guidance Navigation and Control (GNC) scenarios using Deep Reinforcement Learning (DRL). DRL polices are trained to provide guidance inputs to agents in multi-agent swarm environments for completing complex, teamwork focused objectives in geosynchronous orbit. An example scenario is explored for a group of satellite agents moving to triangulate an object in a relative orbit space that potentially maneuvers. Reward shaping is used to encourage learning guidance that positions swarm members to maximize cooperative triangulation accuracy, using angles-only sensor information for navigation relative to the target. Results show the policies successfully learn guidance through reward shaping to improve triangulation accuracy by a significant factor.","PeriodicalId":344794,"journal":{"name":"2023 IEEE/ION Position, Location and Navigation Symposium (PLANS)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Satellite Guidance with Multi-Agent Reinforce Learning for Triangulating a Moving Object in a Relative Orbit Frame\",\"authors\":\"Nicholas Yielding, Joe Curro, S. Cain\",\"doi\":\"10.1109/PLANS53410.2023.10139951\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Multi-agent systems and swarms in spacecraft formation flying are of ever-increasing importance in a contested space environment-use of multiple spacecraft to contribute to a cooperative mission potentially increases positive outcomes on orbit, while autonomy becomes an ever increasing requirement to increase reaction time to dynamic situations and lower the burden on space operators. This research explores difficult swarm Guidance Navigation and Control (GNC) scenarios using Deep Reinforcement Learning (DRL). DRL polices are trained to provide guidance inputs to agents in multi-agent swarm environments for completing complex, teamwork focused objectives in geosynchronous orbit. An example scenario is explored for a group of satellite agents moving to triangulate an object in a relative orbit space that potentially maneuvers. Reward shaping is used to encourage learning guidance that positions swarm members to maximize cooperative triangulation accuracy, using angles-only sensor information for navigation relative to the target. Results show the policies successfully learn guidance through reward shaping to improve triangulation accuracy by a significant factor.\",\"PeriodicalId\":344794,\"journal\":{\"name\":\"2023 IEEE/ION Position, Location and Navigation Symposium (PLANS)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE/ION Position, Location and Navigation Symposium (PLANS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/PLANS53410.2023.10139951\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE/ION Position, Location and Navigation Symposium (PLANS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PLANS53410.2023.10139951","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Satellite Guidance with Multi-Agent Reinforce Learning for Triangulating a Moving Object in a Relative Orbit Frame
Multi-agent systems and swarms in spacecraft formation flying are of ever-increasing importance in a contested space environment-use of multiple spacecraft to contribute to a cooperative mission potentially increases positive outcomes on orbit, while autonomy becomes an ever increasing requirement to increase reaction time to dynamic situations and lower the burden on space operators. This research explores difficult swarm Guidance Navigation and Control (GNC) scenarios using Deep Reinforcement Learning (DRL). DRL polices are trained to provide guidance inputs to agents in multi-agent swarm environments for completing complex, teamwork focused objectives in geosynchronous orbit. An example scenario is explored for a group of satellite agents moving to triangulate an object in a relative orbit space that potentially maneuvers. Reward shaping is used to encourage learning guidance that positions swarm members to maximize cooperative triangulation accuracy, using angles-only sensor information for navigation relative to the target. Results show the policies successfully learn guidance through reward shaping to improve triangulation accuracy by a significant factor.