{"title":"基于深度q学习的雾式无线接入网协同缓存策略","authors":"Fan Jiang, Jin Wang, Changyin Sun","doi":"10.1109/ICCC52777.2021.9580239","DOIUrl":null,"url":null,"abstract":"To reduce the burden on fronthaul link as well as transmission delay, this paper proposes a cooperative edge caching strategy based on the deep Q-learning (DQN) algorithm considering the cooperative caching behavior between fog access points (F-APs) for Fog Radio Access Network (F-RAN). Specifically, to obtain the desired content popularity, we first predict the user preference probability with the topic model. Furthermore, considering the coupled multi-variable nature of the optimizing problem, a deep reinforcement learning (DRL) based content caching strategy is adopted to acquire the optimal content placement policy by combining the content popularity prediction results and content popularity. Finally, numerical simulation results prove the proposed scheme can reduce the average download delay compared with the existing algorithms.","PeriodicalId":425118,"journal":{"name":"2021 IEEE/CIC International Conference on Communications in China (ICCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Deep Q-Learning-Based Cooperative Caching Strategy for Fog Radio Access Networks\",\"authors\":\"Fan Jiang, Jin Wang, Changyin Sun\",\"doi\":\"10.1109/ICCC52777.2021.9580239\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"To reduce the burden on fronthaul link as well as transmission delay, this paper proposes a cooperative edge caching strategy based on the deep Q-learning (DQN) algorithm considering the cooperative caching behavior between fog access points (F-APs) for Fog Radio Access Network (F-RAN). Specifically, to obtain the desired content popularity, we first predict the user preference probability with the topic model. Furthermore, considering the coupled multi-variable nature of the optimizing problem, a deep reinforcement learning (DRL) based content caching strategy is adopted to acquire the optimal content placement policy by combining the content popularity prediction results and content popularity. Finally, numerical simulation results prove the proposed scheme can reduce the average download delay compared with the existing algorithms.\",\"PeriodicalId\":425118,\"journal\":{\"name\":\"2021 IEEE/CIC International Conference on Communications in China (ICCC)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-07-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE/CIC International Conference on Communications in China (ICCC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCC52777.2021.9580239\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE/CIC International Conference on Communications in China (ICCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCC52777.2021.9580239","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Deep Q-Learning-Based Cooperative Caching Strategy for Fog Radio Access Networks
To reduce the burden on fronthaul link as well as transmission delay, this paper proposes a cooperative edge caching strategy based on the deep Q-learning (DQN) algorithm considering the cooperative caching behavior between fog access points (F-APs) for Fog Radio Access Network (F-RAN). Specifically, to obtain the desired content popularity, we first predict the user preference probability with the topic model. Furthermore, considering the coupled multi-variable nature of the optimizing problem, a deep reinforcement learning (DRL) based content caching strategy is adopted to acquire the optimal content placement policy by combining the content popularity prediction results and content popularity. Finally, numerical simulation results prove the proposed scheme can reduce the average download delay compared with the existing algorithms.