{"title":"基于Dueling-DDQN的5G HUDN网络选择算法研究","authors":"Jianli Xie, Binhan Zhu, Cuiran Li","doi":"10.1186/s13638-023-02323-7","DOIUrl":null,"url":null,"abstract":"Abstract Due to the dense deployment and the diversity of user service types in the 5G HUDN environment, a more flexible network selection algorithm is required to reduce the network blocking rate and improve the user’s quality of service (QoS). Considering the QoS requirements and preferences of the users, a network selection algorithm based on Dueling-DDQN is proposed by using deep reinforcement learning. Firstly, the state, action space and reward function of the user-selected network are designed. Then, by calculating the network selection benefits for different types of services initiated by users, the analytic hierarchy process is used to establish the weight relationship between the different user services and the network attributes. Finally, a deep Q neural network is used to solve and optimize the proposed target and obtain the user’s best network selection strategy and long-term network selection benefits. The simulation results show that compared with other algorithms, the proposed algorithm can effectively reduce the network blocking rate while reducing the switching times.","PeriodicalId":12040,"journal":{"name":"EURASIP Journal on Wireless Communications and Networking","volume":"18 6","pages":"0"},"PeriodicalIF":2.3000,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research of 5G HUDN network selection algorithm based on Dueling-DDQN\",\"authors\":\"Jianli Xie, Binhan Zhu, Cuiran Li\",\"doi\":\"10.1186/s13638-023-02323-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract Due to the dense deployment and the diversity of user service types in the 5G HUDN environment, a more flexible network selection algorithm is required to reduce the network blocking rate and improve the user’s quality of service (QoS). Considering the QoS requirements and preferences of the users, a network selection algorithm based on Dueling-DDQN is proposed by using deep reinforcement learning. Firstly, the state, action space and reward function of the user-selected network are designed. Then, by calculating the network selection benefits for different types of services initiated by users, the analytic hierarchy process is used to establish the weight relationship between the different user services and the network attributes. Finally, a deep Q neural network is used to solve and optimize the proposed target and obtain the user’s best network selection strategy and long-term network selection benefits. The simulation results show that compared with other algorithms, the proposed algorithm can effectively reduce the network blocking rate while reducing the switching times.\",\"PeriodicalId\":12040,\"journal\":{\"name\":\"EURASIP Journal on Wireless Communications and Networking\",\"volume\":\"18 6\",\"pages\":\"0\"},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2023-11-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"EURASIP Journal on Wireless Communications and Networking\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1186/s13638-023-02323-7\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"EURASIP Journal on Wireless Communications and Networking","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s13638-023-02323-7","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Research of 5G HUDN network selection algorithm based on Dueling-DDQN
Abstract Due to the dense deployment and the diversity of user service types in the 5G HUDN environment, a more flexible network selection algorithm is required to reduce the network blocking rate and improve the user’s quality of service (QoS). Considering the QoS requirements and preferences of the users, a network selection algorithm based on Dueling-DDQN is proposed by using deep reinforcement learning. Firstly, the state, action space and reward function of the user-selected network are designed. Then, by calculating the network selection benefits for different types of services initiated by users, the analytic hierarchy process is used to establish the weight relationship between the different user services and the network attributes. Finally, a deep Q neural network is used to solve and optimize the proposed target and obtain the user’s best network selection strategy and long-term network selection benefits. The simulation results show that compared with other algorithms, the proposed algorithm can effectively reduce the network blocking rate while reducing the switching times.
期刊介绍:
The overall aim of the EURASIP Journal on Wireless Communications and Networking (EURASIP JWCN) is to bring together science and applications of wireless communications and networking technologies with emphasis on signal processing techniques and tools. It is directed at both practicing engineers and academic researchers. EURASIP Journal on Wireless Communications and Networking will highlight the continued growth and new challenges in wireless technology, for both application development and basic research. Articles should emphasize original results relating to the theory and/or applications of wireless communications and networking. Review articles, especially those emphasizing multidisciplinary views of communications and networking, are also welcome. EURASIP Journal on Wireless Communications and Networking employs a paperless, electronic submission and evaluation system to promote a rapid turnaround in the peer-review process.
The journal is an Open Access journal since 2004.