{"title":"Ga-DQN:基于重力感知DQN的无人机路径规划算法","authors":"Zhicheng Xu, Qi Wang, Fuchen Kong, Hualong Yu, Shang Gao, Demin Pan","doi":"10.1109/ICUS55513.2022.9986557","DOIUrl":null,"url":null,"abstract":"Unmanned aerial vehicles (UAVs) path planning refers to exploring the optimal flight trajectory from the starting point to the destination that satisfies the UAV under specific constraints such as maneuverability and environmental information constraints, which is a crucial technology for the UAV mission planning. In order to enhance the efficiency and safety of the UAV path planning task, a new autonomous UAV path planning system based on deep reinforcement learning is proposed in this article. At the beginning, a new action guidance strategy based on the Deep Q-Network (DQN) algorithm is introduced via deploying the Gravity-aware Deep Q-Network (Ga-DQN) method. This strategy can effectively assist the UAVs to avoid the obstacles in the specific state. For balancing the efficiency and safety of the task, a reward scheme that introduces a safety counting mechanism is proposed to provide global guidance for the agent in Deep Reinforcement Learning (DRL). The simulation results under different obstacle densities show that the proposed novel strategy can obviously behave robust and greater efficiency compared to the traditional methods.","PeriodicalId":345773,"journal":{"name":"2022 IEEE International Conference on Unmanned Systems (ICUS)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Ga-DQN: A Gravity-aware DQN Based UAV Path Planning Algorithm\",\"authors\":\"Zhicheng Xu, Qi Wang, Fuchen Kong, Hualong Yu, Shang Gao, Demin Pan\",\"doi\":\"10.1109/ICUS55513.2022.9986557\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Unmanned aerial vehicles (UAVs) path planning refers to exploring the optimal flight trajectory from the starting point to the destination that satisfies the UAV under specific constraints such as maneuverability and environmental information constraints, which is a crucial technology for the UAV mission planning. In order to enhance the efficiency and safety of the UAV path planning task, a new autonomous UAV path planning system based on deep reinforcement learning is proposed in this article. At the beginning, a new action guidance strategy based on the Deep Q-Network (DQN) algorithm is introduced via deploying the Gravity-aware Deep Q-Network (Ga-DQN) method. This strategy can effectively assist the UAVs to avoid the obstacles in the specific state. For balancing the efficiency and safety of the task, a reward scheme that introduces a safety counting mechanism is proposed to provide global guidance for the agent in Deep Reinforcement Learning (DRL). The simulation results under different obstacle densities show that the proposed novel strategy can obviously behave robust and greater efficiency compared to the traditional methods.\",\"PeriodicalId\":345773,\"journal\":{\"name\":\"2022 IEEE International Conference on Unmanned Systems (ICUS)\",\"volume\":\"11 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE International Conference on Unmanned Systems (ICUS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICUS55513.2022.9986557\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Conference on Unmanned Systems (ICUS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICUS55513.2022.9986557","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Ga-DQN: A Gravity-aware DQN Based UAV Path Planning Algorithm
Unmanned aerial vehicles (UAVs) path planning refers to exploring the optimal flight trajectory from the starting point to the destination that satisfies the UAV under specific constraints such as maneuverability and environmental information constraints, which is a crucial technology for the UAV mission planning. In order to enhance the efficiency and safety of the UAV path planning task, a new autonomous UAV path planning system based on deep reinforcement learning is proposed in this article. At the beginning, a new action guidance strategy based on the Deep Q-Network (DQN) algorithm is introduced via deploying the Gravity-aware Deep Q-Network (Ga-DQN) method. This strategy can effectively assist the UAVs to avoid the obstacles in the specific state. For balancing the efficiency and safety of the task, a reward scheme that introduces a safety counting mechanism is proposed to provide global guidance for the agent in Deep Reinforcement Learning (DRL). The simulation results under different obstacle densities show that the proposed novel strategy can obviously behave robust and greater efficiency compared to the traditional methods.