DDQN-Based Centralized Spectrum Allocation and Distributed Power Control for V2X Communications

Abstract

With the widespread use of machine learning, especially deep learning, in high-mobility vehicular networks, vehicle-to-everything (V2X) communication has received lots of attention from academia and industry. However, the fast dynamic network environment brings out big challenges to the resource allocation issue in V2X communications. Considering the difficulty of accurately obtaining channel state information (CSI) in dynamic vehicular network environments, we propose a joint double deep Q-network (DDQN) based centralized spectrum allocation and distributed power control algorithm for V2X communications to utilize the spectrum resource more effectively and reduce the multiple interference between V2X links. The proposed algorithm decouples the channel matching and transmission power selection to balance the resource utilization and quality of user experience satisfaction levels. In the first stage, we present a graph theory based centralized spectrum matching scheme to reduce the multiple interference between vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) links, and improve the system capacity of vehicular networks. Secondly, through predicting the future dynamic CSI trends of terminal vehicles based on the locally obtained CSI information, we propose a distributed DDQN based power control scheme to enhance the system reliability and meet the quality of terminal user experience requirements. The simulation results show that our proposed algorithm performs better compared the traditional existing schemes.