Deep Reinforcement Learning-Based Computation Offloading for Mobile Edge Computing in 6G

Abstract

The impending 6G network is envisioned to seamlessly interconnect a myriad of consumer electronics (CEs), facilitating a wide array of applications accessible from any location and at any time. To advance this objective, our paper proposes the integration of Mobile Edge Computing (MEC) with a multi-rotor Unmanned Aerial Vehicle (UAV), aiming to furnish computation offloading services for CEs of Ground Devices (GDs). Additionally, charging stations (CSs) are utilized to wirelessly charge the UAVs. Our objective is to minimize the UAV’s energy consumption for the entire mission by jointly optimizing both resource allocation and the UAV’s trajectory simultaneously. This entails solving a mixed-integer nonlinear programming (MINLP) optimization problem. Initially, we decompose the UAV’s trajectory into discrete offloading and charging locations, guided by a decision matrix. we decompose the optimization problem into two sub-problems. The first one determines offloading locations and resource allocation using Particle Swarm Optimization (PSO). The second one optimizes the decision matrix by incorporating PSO outputs and employing Double Deep Q-Network (DDQN), a form of deep reinforcement learning. Simulation results demonstrate that the proposed solution significantly reduces energy consumption compared to baseline schemes.