{"title":"5G网络切片中资源映射的强化学习","authors":"Liyuan Zhao, Li Li","doi":"10.1109/ICCCS49078.2020.9118446","DOIUrl":null,"url":null,"abstract":"In the era of 5G, network slicing is considered to be an effective solution for flexible network deployment and diversified services. It based on network virtualization technology to divide into multiple end-to-end virtual networks on the substrate physical network and in the form of services to meet the user that has customized appeal to network resource. This paper proposes a reinforcement learning algorithm based on collaborative relationship between node mapping and link mapping(RLCO). In the node mapping stage, we apply the policy network to calculate the probability of the physical node mapping to a virtual node. In the link mapping stage, we apply the Dijkstra algorithm. After the success of node and link mapping, the algorithm evaluates the mapping results respectively, and on this basis, defines the reward function of the RLCO algorithm. The difference characteristics of node and link are introduced into the reward function. The RLCO algorithm based on this reward function can make the result of network slicing mapping reach the global optimal. Furthermore, we compare the RLCO algorithm with the other three algorithms. The results show that the RLCO algorithm is superior to other three algorithms in terms of the acceptance rate of network slice requests and the long-term earning/cost ratio.","PeriodicalId":105556,"journal":{"name":"2020 5th International Conference on Computer and Communication Systems (ICCCS)","volume":"31 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Reinforcement Learning for Resource Mapping in 5G Network Slicing\",\"authors\":\"Liyuan Zhao, Li Li\",\"doi\":\"10.1109/ICCCS49078.2020.9118446\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the era of 5G, network slicing is considered to be an effective solution for flexible network deployment and diversified services. It based on network virtualization technology to divide into multiple end-to-end virtual networks on the substrate physical network and in the form of services to meet the user that has customized appeal to network resource. This paper proposes a reinforcement learning algorithm based on collaborative relationship between node mapping and link mapping(RLCO). In the node mapping stage, we apply the policy network to calculate the probability of the physical node mapping to a virtual node. In the link mapping stage, we apply the Dijkstra algorithm. After the success of node and link mapping, the algorithm evaluates the mapping results respectively, and on this basis, defines the reward function of the RLCO algorithm. The difference characteristics of node and link are introduced into the reward function. The RLCO algorithm based on this reward function can make the result of network slicing mapping reach the global optimal. Furthermore, we compare the RLCO algorithm with the other three algorithms. The results show that the RLCO algorithm is superior to other three algorithms in terms of the acceptance rate of network slice requests and the long-term earning/cost ratio.\",\"PeriodicalId\":105556,\"journal\":{\"name\":\"2020 5th International Conference on Computer and Communication Systems (ICCCS)\",\"volume\":\"31 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 5th International Conference on Computer and Communication Systems (ICCCS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCCS49078.2020.9118446\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 5th International Conference on Computer and Communication Systems (ICCCS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCCS49078.2020.9118446","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Reinforcement Learning for Resource Mapping in 5G Network Slicing
In the era of 5G, network slicing is considered to be an effective solution for flexible network deployment and diversified services. It based on network virtualization technology to divide into multiple end-to-end virtual networks on the substrate physical network and in the form of services to meet the user that has customized appeal to network resource. This paper proposes a reinforcement learning algorithm based on collaborative relationship between node mapping and link mapping(RLCO). In the node mapping stage, we apply the policy network to calculate the probability of the physical node mapping to a virtual node. In the link mapping stage, we apply the Dijkstra algorithm. After the success of node and link mapping, the algorithm evaluates the mapping results respectively, and on this basis, defines the reward function of the RLCO algorithm. The difference characteristics of node and link are introduced into the reward function. The RLCO algorithm based on this reward function can make the result of network slicing mapping reach the global optimal. Furthermore, we compare the RLCO algorithm with the other three algorithms. The results show that the RLCO algorithm is superior to other three algorithms in terms of the acceptance rate of network slice requests and the long-term earning/cost ratio.