Energy- and Spectral- Efficient Optimization in Cloud RAN based on Dueling Double Deep Q-Network

Abstract

Cloud radio access network (CRAN) has gained considerable attention for the upcoming cellular network that can offload the mobile data traffic and reduce energy consumption by deploying intelligent distributed multiple remote radio units (RRHs). However, it is still very challenging to achieve an optimal global strategy to maximize the performance of energy efficiency (EE) and spectral efficiency (SE) simultaneously due to non-convex and combinatorial features. Deep reinforcement learning (DRL)-based framework becomes an imperative solution to jointly maximize the EE-SE performance and guarantee the user quality of service (QoS) demands in downlink CRAN. Furthermore, in order to deal with the large state-action space problem, we leverage dueling double deep Q-network (D3QN) to achieve the nearly optimal control strategy. In the end, extensive simulation results demonstrate the effectiveness of the proposed D3QN method over the conventional-DRL methods.