I. Shames, Nima Najmaei, Mohammad Zamani, A. Safavi
{"title":"强化学习在新型自适应智能交通整形器开发中的应用","authors":"I. Shames, Nima Najmaei, Mohammad Zamani, A. Safavi","doi":"10.1109/ICMLA.2006.16","DOIUrl":null,"url":null,"abstract":"In this paper, we have taken advantage of reinforcement learning to develop a new traffic shaper in order to obtain a reasonable utilization of bandwidth while preventing traffic overload in other part of the network and as a result, reducing total number of packet dropping in the whole network.. We used a modified version of Q-learning in which a combination of neural networks keeps the data of Q-table in order to make the operation faster while keeping the required storage as small as possible. This method shows satisfactory results in simulations from the aspects of keeping dropping probability low while injecting as many packets as possible into the network in order to utilize the free bandwidth as much as possible. On the other hand the results show that the system can perform in situations that are not originally designed to act in","PeriodicalId":297071,"journal":{"name":"2006 5th International Conference on Machine Learning and Applications (ICMLA'06)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2006-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Application of Reinforcement Learning in Development of a New Adaptive Intelligent Traffic Shaper\",\"authors\":\"I. Shames, Nima Najmaei, Mohammad Zamani, A. Safavi\",\"doi\":\"10.1109/ICMLA.2006.16\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we have taken advantage of reinforcement learning to develop a new traffic shaper in order to obtain a reasonable utilization of bandwidth while preventing traffic overload in other part of the network and as a result, reducing total number of packet dropping in the whole network.. We used a modified version of Q-learning in which a combination of neural networks keeps the data of Q-table in order to make the operation faster while keeping the required storage as small as possible. This method shows satisfactory results in simulations from the aspects of keeping dropping probability low while injecting as many packets as possible into the network in order to utilize the free bandwidth as much as possible. On the other hand the results show that the system can perform in situations that are not originally designed to act in\",\"PeriodicalId\":297071,\"journal\":{\"name\":\"2006 5th International Conference on Machine Learning and Applications (ICMLA'06)\",\"volume\":\"18 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2006-12-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2006 5th International Conference on Machine Learning and Applications (ICMLA'06)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICMLA.2006.16\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2006 5th International Conference on Machine Learning and Applications (ICMLA'06)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICMLA.2006.16","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Application of Reinforcement Learning in Development of a New Adaptive Intelligent Traffic Shaper
In this paper, we have taken advantage of reinforcement learning to develop a new traffic shaper in order to obtain a reasonable utilization of bandwidth while preventing traffic overload in other part of the network and as a result, reducing total number of packet dropping in the whole network.. We used a modified version of Q-learning in which a combination of neural networks keeps the data of Q-table in order to make the operation faster while keeping the required storage as small as possible. This method shows satisfactory results in simulations from the aspects of keeping dropping probability low while injecting as many packets as possible into the network in order to utilize the free bandwidth as much as possible. On the other hand the results show that the system can perform in situations that are not originally designed to act in