Stratospheric airship trajectory planning in wind field using deep reinforcement learning

Stratospheric airships, with their long endurance, high flight altitude, and large payload capacity, show promise in earth observation and mobile internet applications. However, challenges arise due to their low flight speed, limited maneuverability and energy constraints when planning trajectories in dynamic wind fields. This paper proposes a deep reinforcement learning-based method for trajectory planning of stratospheric airships. The model considers the motion characteristics of stratospheric airships and environmental factors like wind fields and solar radiation. The soft actor-critic (SAC) algorithm is utilized to assess the effectiveness of the method in various scenarios. A comparison between time-optimized and energy-optimized trajectories reveals that time-optimized trajectories are smoother with a higher speed, while energy-optimized trajectories can save up to 10% energy by utilizing wind fields and solar energy absorption. Overall, the deep reinforcement learning approach proves effective in trajectory planning for stratospheric airships in deterministic and dynamic wind fields, offering valuable insights for flight design and optimization.