{"title":"服务缓存辅助移动边缘计算中基于深度强化学习的任务卸载和服务迁移策略","authors":"Hongchang Ke, Wang Hui, Hongbin Sun, Halvin Yang","doi":"10.23919/JCC.fa.2023-0474.202404","DOIUrl":null,"url":null,"abstract":"Emerging mobile edge computing (MEC) is considered a feasible solution for offloading the computation-intensive request tasks generated from mobile wireless equipment (MWE) with limited computational resources and energy. Due to the homogeneity of request tasks from one MWE during a long-term time period, it is vital to predeploy the particular service cachings required by the request tasks at the MEC server. In this paper, we model a service caching-assisted MEC framework that takes into account the constraint on the number of service cachings hosted by each edge server and the migration of request tasks from the current edge server to another edge server with service caching required by tasks. Furthermore, we propose a multiagent deep reinforcement learning-based computation offloading and task migrating decision-making scheme (MBOMS) to minimize the long-term average weighted cost. The proposed MBOMS can learn the near-optimal offloading and migrating decision-making policy by centralized training and decentralized execution. Systematic and comprehensive simulation results reveal that our proposed MBOMS can converge well after training and outperforms the other five baseline algorithms.","PeriodicalId":504777,"journal":{"name":"China Communications","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing\",\"authors\":\"Hongchang Ke, Wang Hui, Hongbin Sun, Halvin Yang\",\"doi\":\"10.23919/JCC.fa.2023-0474.202404\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Emerging mobile edge computing (MEC) is considered a feasible solution for offloading the computation-intensive request tasks generated from mobile wireless equipment (MWE) with limited computational resources and energy. Due to the homogeneity of request tasks from one MWE during a long-term time period, it is vital to predeploy the particular service cachings required by the request tasks at the MEC server. In this paper, we model a service caching-assisted MEC framework that takes into account the constraint on the number of service cachings hosted by each edge server and the migration of request tasks from the current edge server to another edge server with service caching required by tasks. Furthermore, we propose a multiagent deep reinforcement learning-based computation offloading and task migrating decision-making scheme (MBOMS) to minimize the long-term average weighted cost. The proposed MBOMS can learn the near-optimal offloading and migrating decision-making policy by centralized training and decentralized execution. Systematic and comprehensive simulation results reveal that our proposed MBOMS can converge well after training and outperforms the other five baseline algorithms.\",\"PeriodicalId\":504777,\"journal\":{\"name\":\"China Communications\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"China Communications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23919/JCC.fa.2023-0474.202404\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"China Communications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/JCC.fa.2023-0474.202404","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing
Emerging mobile edge computing (MEC) is considered a feasible solution for offloading the computation-intensive request tasks generated from mobile wireless equipment (MWE) with limited computational resources and energy. Due to the homogeneity of request tasks from one MWE during a long-term time period, it is vital to predeploy the particular service cachings required by the request tasks at the MEC server. In this paper, we model a service caching-assisted MEC framework that takes into account the constraint on the number of service cachings hosted by each edge server and the migration of request tasks from the current edge server to another edge server with service caching required by tasks. Furthermore, we propose a multiagent deep reinforcement learning-based computation offloading and task migrating decision-making scheme (MBOMS) to minimize the long-term average weighted cost. The proposed MBOMS can learn the near-optimal offloading and migrating decision-making policy by centralized training and decentralized execution. Systematic and comprehensive simulation results reveal that our proposed MBOMS can converge well after training and outperforms the other five baseline algorithms.