{"title":"基于深度强化学习的SDN数据中心网络拥塞控制算法","authors":"Pengfei Guo, Lixing Liang, Hongxiao Liu, Li Du","doi":"10.1117/12.2639258","DOIUrl":null,"url":null,"abstract":"Aiming at the TCP Incast problem in Software Defined Networks (SDN) data center networks, a new congestion control algorithm based on deep reinforcement learning is proposed in this paper. By the way of continuously interacting between the agent and the environment to obtain the optimal strategy, the SDN controller plays the role as agent and many-to-one model of data center networks plays the role as environment. Under the condition that queue length of the buffer of the bottleneck switch does not exceed the preset congestion threshold, data transmission rates of multiple servers are trained using deep reinforcement learning algorithms, and finally the optimal transmission rates which will not cause congestion are acquired. The simulation results show that the algorithm proposed in this paper can effectively avoid congestion in many-to-one scenarios in SDN data center networks and can improve the overall performance of networks.","PeriodicalId":336892,"journal":{"name":"Neural Networks, Information and Communication Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"A congestion control algorithm based on deep reinforcement learning in SDN data center networks\",\"authors\":\"Pengfei Guo, Lixing Liang, Hongxiao Liu, Li Du\",\"doi\":\"10.1117/12.2639258\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Aiming at the TCP Incast problem in Software Defined Networks (SDN) data center networks, a new congestion control algorithm based on deep reinforcement learning is proposed in this paper. By the way of continuously interacting between the agent and the environment to obtain the optimal strategy, the SDN controller plays the role as agent and many-to-one model of data center networks plays the role as environment. Under the condition that queue length of the buffer of the bottleneck switch does not exceed the preset congestion threshold, data transmission rates of multiple servers are trained using deep reinforcement learning algorithms, and finally the optimal transmission rates which will not cause congestion are acquired. The simulation results show that the algorithm proposed in this paper can effectively avoid congestion in many-to-one scenarios in SDN data center networks and can improve the overall performance of networks.\",\"PeriodicalId\":336892,\"journal\":{\"name\":\"Neural Networks, Information and Communication Engineering\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-06-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neural Networks, Information and Communication Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2639258\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks, Information and Communication Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2639258","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A congestion control algorithm based on deep reinforcement learning in SDN data center networks
Aiming at the TCP Incast problem in Software Defined Networks (SDN) data center networks, a new congestion control algorithm based on deep reinforcement learning is proposed in this paper. By the way of continuously interacting between the agent and the environment to obtain the optimal strategy, the SDN controller plays the role as agent and many-to-one model of data center networks plays the role as environment. Under the condition that queue length of the buffer of the bottleneck switch does not exceed the preset congestion threshold, data transmission rates of multiple servers are trained using deep reinforcement learning algorithms, and finally the optimal transmission rates which will not cause congestion are acquired. The simulation results show that the algorithm proposed in this paper can effectively avoid congestion in many-to-one scenarios in SDN data center networks and can improve the overall performance of networks.