Make Power Allocation More Adaptive in Ultra Dense Networks: Priority-Driven Deep Reinforcement Learning via Noise-Perturbations

Abstract

Efficient and stable resource management in ultra-dense networks is essential for interference reduction and quality of service guarantee for large-scale users. Although reinforcement learning is currently the most talked-about method for achieving efficient resource allocation, it still faces significant challenges when dealing with the key adaptive issues, such as strong interference, large-scale users dynamic demands, and differentiated user priority requirements. In the case, this paper proposes a pervasive power allocation method in the framework of deep reinforcement learning. Concretely, we develop a noisy deep Q-network for guaranteeing stable exploration of average rate and accelerating the model convergence, where the parameterized noise is incorporated into the connection weights of neural networks. On the other hand, considering the varying priority levels of different users, we devise a prioritized experience replay mechanism aimed at enhancing the service quality for users with high importance. Simulation results demonstrate that our proposal can surpass the state-of-the-art methods in terms of average rate, convergence, stability, and model complexity, achieving more adaptive power allocation.