RECC: A Relationship-Enhanced Content Caching Algorithm Using Deep Reinforcement Learning

Abstract

Mobile edge caching (MEC) is a promising technology to alleviate traffic congestion in the network. Current studies explored deep reinforcement learning (DRL)-based MEC methods. These methods consider the dynamics of the request size to maximize the cache hit rate. However, they usually ignored the potential request relationships among contents. Two contents with a strong relationship are usually requested sequentially. Inspired by this assumption, this paper proposes a relationship-enhanced content caching algorithm using DRL, named RECC. Our RECC infers user preferences by mining the request relationships among contents. In this work, the relationships are modeled as request sequences, and the request features are learned by using graph embedding. These features will be used as input of state in our DRL-based algorithm. We utilize the Wolpertinger architecture to solve the limitation of large discrete action space. The simulation results indicate that our RECC outperformed the traditional cache policies and state-of-the-art DRL-based method in cache hit rate. Furthermore, the proposed RECC has advantages in long-term stability in the environment where content popularity changes dynamically, and also has a higher cache hit rate when handling the requests with number changes dynamically.