Hong Xia, Jianguo Li, Yanping Chen, Ning Lv, Zhongmin Wang, Qingyi Dong
{"title":"CLSDRL:A routing optimization method for traffic feature extraction","authors":"Hong Xia, Jianguo Li, Yanping Chen, Ning Lv, Zhongmin Wang, Qingyi Dong","doi":"10.1109/NaNA53684.2021.00052","DOIUrl":null,"url":null,"abstract":"In order to solve the impact of the temporal and spatial characteristics of traffic on network routing optimization, this paper proposes convolution long-short memory neural network deep reinforcement learning (CLSDRL) model for routing optimization. The CLSDRL model consists of deep deterministic policy gradients (DDPG) deep couple with convolution neural network (CNN) and long-short memory neural network (LSTM). After extracting the spatial and temporal characteristics of network traffic with CNN and LSTM, routing decisions are made with DDPG algorithm. Experiments are conducted under different load intensities, and the network performance is evaluated by the average network delay and packet loss rate, experimental results show that this method can improve significantly network performance.","PeriodicalId":414672,"journal":{"name":"2021 International Conference on Networking and Network Applications (NaNA)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Conference on Networking and Network Applications (NaNA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NaNA53684.2021.00052","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In order to solve the impact of the temporal and spatial characteristics of traffic on network routing optimization, this paper proposes convolution long-short memory neural network deep reinforcement learning (CLSDRL) model for routing optimization. The CLSDRL model consists of deep deterministic policy gradients (DDPG) deep couple with convolution neural network (CNN) and long-short memory neural network (LSTM). After extracting the spatial and temporal characteristics of network traffic with CNN and LSTM, routing decisions are made with DDPG algorithm. Experiments are conducted under different load intensities, and the network performance is evaluated by the average network delay and packet loss rate, experimental results show that this method can improve significantly network performance.