Ying Chen, Wei Gu, Jiajie Xu, Yongchao Zhang, Geyong Min
{"title":"通过深度强化学习实现数字孪生移动边缘计算的动态任务卸载","authors":"Ying Chen, Wei Gu, Jiajie Xu, Yongchao Zhang, Geyong Min","doi":"10.23919/jcc.ea.2022-0372.202302","DOIUrl":null,"url":null,"abstract":"Limited by battery and computing resources, the computing-intensive tasks generated by Internet of Things (IoT) devices cannot be processed all by themselves. Mobile edge computing (MEC) is a suitable solution for this problem, and the generated tasks can be offloaded from IoT devices to MEC. In this paper, we study the problem of dynamic task offloading for digital twin-empowered MEC. Digital twin techniques are applied to provide information of environment and share the training data of agent deployed on IoT devices. We formulate the task offloading problem with the goal of maximizing the energy efficiency and the workload balance among the ESs. Then, we reformulate the problem as an MDP problem and design DRL-based energy efficient task offloading (DEETO) algorithm to solve it. Comparative experiments are carried out which show the superiority of our DEETO algorithm in improving energy efficiency and balancing the workload.","PeriodicalId":9814,"journal":{"name":"China Communications","volume":"1 1","pages":"164-175"},"PeriodicalIF":3.1000,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"17","resultStr":"{\"title\":\"Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning\",\"authors\":\"Ying Chen, Wei Gu, Jiajie Xu, Yongchao Zhang, Geyong Min\",\"doi\":\"10.23919/jcc.ea.2022-0372.202302\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Limited by battery and computing resources, the computing-intensive tasks generated by Internet of Things (IoT) devices cannot be processed all by themselves. Mobile edge computing (MEC) is a suitable solution for this problem, and the generated tasks can be offloaded from IoT devices to MEC. In this paper, we study the problem of dynamic task offloading for digital twin-empowered MEC. Digital twin techniques are applied to provide information of environment and share the training data of agent deployed on IoT devices. We formulate the task offloading problem with the goal of maximizing the energy efficiency and the workload balance among the ESs. Then, we reformulate the problem as an MDP problem and design DRL-based energy efficient task offloading (DEETO) algorithm to solve it. Comparative experiments are carried out which show the superiority of our DEETO algorithm in improving energy efficiency and balancing the workload.\",\"PeriodicalId\":9814,\"journal\":{\"name\":\"China Communications\",\"volume\":\"1 1\",\"pages\":\"164-175\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2023-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"17\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"China Communications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.23919/jcc.ea.2022-0372.202302\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"China Communications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.23919/jcc.ea.2022-0372.202302","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning
Limited by battery and computing resources, the computing-intensive tasks generated by Internet of Things (IoT) devices cannot be processed all by themselves. Mobile edge computing (MEC) is a suitable solution for this problem, and the generated tasks can be offloaded from IoT devices to MEC. In this paper, we study the problem of dynamic task offloading for digital twin-empowered MEC. Digital twin techniques are applied to provide information of environment and share the training data of agent deployed on IoT devices. We formulate the task offloading problem with the goal of maximizing the energy efficiency and the workload balance among the ESs. Then, we reformulate the problem as an MDP problem and design DRL-based energy efficient task offloading (DEETO) algorithm to solve it. Comparative experiments are carried out which show the superiority of our DEETO algorithm in improving energy efficiency and balancing the workload.
期刊介绍:
China Communications (ISSN 1673-5447) is an English-language monthly journal cosponsored by the China Institute of Communications (CIC) and IEEE Communications Society (IEEE ComSoc). It is aimed at readers in industry, universities, research and development organizations, and government agencies in the field of Information and Communications Technologies (ICTs) worldwide.
The journal's main objective is to promote academic exchange in the ICTs sector and publish high-quality papers to contribute to the global ICTs industry. It provides instant access to the latest articles and papers, presenting leading-edge research achievements, tutorial overviews, and descriptions of significant practical applications of technology.
China Communications has been indexed in SCIE (Science Citation Index-Expanded) since January 2007. Additionally, all articles have been available in the IEEE Xplore digital library since January 2013.