{"title":"车联网中基于深度强化学习的移动感知边缘合作缓存方案","authors":"Weidi Tian;Yujian Chen;Feng Ke;Hui Song","doi":"10.1109/TVT.2024.3501364","DOIUrl":null,"url":null,"abstract":"The number of computation-intensive apps and content requests within the Internet of Vehicles (IoV) has dramatically expanded with the swift advancement of 5G communication technologies and next-generation Internet technology. To address the issue of excessive response latency caused by the surge in data traffic, edge caching (EC) technology has proven to be effective. However, accurately predicting the popularity of content in different regions is challenging due to the high degree of mobility of the vehicles. Additionally, as vehicles typically do not remain in the same region for a long period of time, making the content popularity within a region highly dynamic. To address this issue, we propose a deep reinforcement learning-based mobile-aware edge cooperative caching scheme (MAECCD). Our approach utilizes an AutoEncoder to capture user features from local vehicle user data and accurately forecast content popularity in both vehicle-local and edge regions. Furthermore, the MAECCD incorporates a cooperation model between edge nodes to optimize cache utilization and employs techniques in Deep Reinforcement Learning (DRL) to refresh cached content and reduce transmission delay. Experimental results indicate that our MAECCD scheme outperforms other baseline algorithms in terms of cache hit ratio and content transmission delay.","PeriodicalId":13421,"journal":{"name":"IEEE Transactions on Vehicular Technology","volume":"74 3","pages":"5053-5068"},"PeriodicalIF":7.1000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning-Based Mobile-Aware Edge Cooperative Caching Scheme in the Internet of Vehicles\",\"authors\":\"Weidi Tian;Yujian Chen;Feng Ke;Hui Song\",\"doi\":\"10.1109/TVT.2024.3501364\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The number of computation-intensive apps and content requests within the Internet of Vehicles (IoV) has dramatically expanded with the swift advancement of 5G communication technologies and next-generation Internet technology. To address the issue of excessive response latency caused by the surge in data traffic, edge caching (EC) technology has proven to be effective. However, accurately predicting the popularity of content in different regions is challenging due to the high degree of mobility of the vehicles. Additionally, as vehicles typically do not remain in the same region for a long period of time, making the content popularity within a region highly dynamic. To address this issue, we propose a deep reinforcement learning-based mobile-aware edge cooperative caching scheme (MAECCD). Our approach utilizes an AutoEncoder to capture user features from local vehicle user data and accurately forecast content popularity in both vehicle-local and edge regions. Furthermore, the MAECCD incorporates a cooperation model between edge nodes to optimize cache utilization and employs techniques in Deep Reinforcement Learning (DRL) to refresh cached content and reduce transmission delay. Experimental results indicate that our MAECCD scheme outperforms other baseline algorithms in terms of cache hit ratio and content transmission delay.\",\"PeriodicalId\":13421,\"journal\":{\"name\":\"IEEE Transactions on Vehicular Technology\",\"volume\":\"74 3\",\"pages\":\"5053-5068\"},\"PeriodicalIF\":7.1000,\"publicationDate\":\"2024-11-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Vehicular Technology\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10756644/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Vehicular Technology","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10756644/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Deep Reinforcement Learning-Based Mobile-Aware Edge Cooperative Caching Scheme in the Internet of Vehicles
The number of computation-intensive apps and content requests within the Internet of Vehicles (IoV) has dramatically expanded with the swift advancement of 5G communication technologies and next-generation Internet technology. To address the issue of excessive response latency caused by the surge in data traffic, edge caching (EC) technology has proven to be effective. However, accurately predicting the popularity of content in different regions is challenging due to the high degree of mobility of the vehicles. Additionally, as vehicles typically do not remain in the same region for a long period of time, making the content popularity within a region highly dynamic. To address this issue, we propose a deep reinforcement learning-based mobile-aware edge cooperative caching scheme (MAECCD). Our approach utilizes an AutoEncoder to capture user features from local vehicle user data and accurately forecast content popularity in both vehicle-local and edge regions. Furthermore, the MAECCD incorporates a cooperation model between edge nodes to optimize cache utilization and employs techniques in Deep Reinforcement Learning (DRL) to refresh cached content and reduce transmission delay. Experimental results indicate that our MAECCD scheme outperforms other baseline algorithms in terms of cache hit ratio and content transmission delay.
期刊介绍:
The scope of the Transactions is threefold (which was approved by the IEEE Periodicals Committee in 1967) and is published on the journal website as follows: Communications: The use of mobile radio on land, sea, and air, including cellular radio, two-way radio, and one-way radio, with applications to dispatch and control vehicles, mobile radiotelephone, radio paging, and status monitoring and reporting. Related areas include spectrum usage, component radio equipment such as cavities and antennas, compute control for radio systems, digital modulation and transmission techniques, mobile radio circuit design, radio propagation for vehicular communications, effects of ignition noise and radio frequency interference, and consideration of the vehicle as part of the radio operating environment. Transportation Systems: The use of electronic technology for the control of ground transportation systems including, but not limited to, traffic aid systems; traffic control systems; automatic vehicle identification, location, and monitoring systems; automated transport systems, with single and multiple vehicle control; and moving walkways or people-movers. Vehicular Electronics: The use of electronic or electrical components and systems for control, propulsion, or auxiliary functions, including but not limited to, electronic controls for engineer, drive train, convenience, safety, and other vehicle systems; sensors, actuators, and microprocessors for onboard use; electronic fuel control systems; vehicle electrical components and systems collision avoidance systems; electromagnetic compatibility in the vehicle environment; and electric vehicles and controls.