{"title":"基于强化学习算法的城市交叉口红绿灯智能控制","authors":"Moein Raeisi, Amir Soltany Mahboob","doi":"10.1109/CSICC52343.2021.9420622","DOIUrl":null,"url":null,"abstract":"The increasing number of vehicles, followed by traffic congestion, has posed a great challenge to the optimal control of traffic for human societies. Therefore, in order to achieve sustainable development in the field of integrated urban management, control of transportation networks is inevitable. The proper method for optimal traffic control should certainly be adaptable in order to be able to manage urban traffic that has a dynamic, complex and changeable nature. In this regard, the method of reinforcement learning that does not require a mathematical model of the environment is very important. In this paper, an intelligent method for controlling urban traffic based on reinforcement learning is presented in which a 4-way intersection is modeled with two different scenarios for low and high traffic congestion. The results obtained after repeated experiments of implementing the proposed method and also its improved model on the mentioned intersection show that the amount of travel time delay has been reduced compared to the usual fixed time methods. After comparing with the two fixed time methods, the waiting time of vehicles at the intersection is 15% and 86% improved for the scenario with low and high traffic congestion respectively, compared to the first method and 37% and 16% compared to the second method.","PeriodicalId":374593,"journal":{"name":"2021 26th International Computer Conference, Computer Society of Iran (CSICC)","volume":"59 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Intelligent Control of Urban Intersection Traffic Light Based on Reinforcement Learning Algorithm\",\"authors\":\"Moein Raeisi, Amir Soltany Mahboob\",\"doi\":\"10.1109/CSICC52343.2021.9420622\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The increasing number of vehicles, followed by traffic congestion, has posed a great challenge to the optimal control of traffic for human societies. Therefore, in order to achieve sustainable development in the field of integrated urban management, control of transportation networks is inevitable. The proper method for optimal traffic control should certainly be adaptable in order to be able to manage urban traffic that has a dynamic, complex and changeable nature. In this regard, the method of reinforcement learning that does not require a mathematical model of the environment is very important. In this paper, an intelligent method for controlling urban traffic based on reinforcement learning is presented in which a 4-way intersection is modeled with two different scenarios for low and high traffic congestion. The results obtained after repeated experiments of implementing the proposed method and also its improved model on the mentioned intersection show that the amount of travel time delay has been reduced compared to the usual fixed time methods. After comparing with the two fixed time methods, the waiting time of vehicles at the intersection is 15% and 86% improved for the scenario with low and high traffic congestion respectively, compared to the first method and 37% and 16% compared to the second method.\",\"PeriodicalId\":374593,\"journal\":{\"name\":\"2021 26th International Computer Conference, Computer Society of Iran (CSICC)\",\"volume\":\"59 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-03-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 26th International Computer Conference, Computer Society of Iran (CSICC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CSICC52343.2021.9420622\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 26th International Computer Conference, Computer Society of Iran (CSICC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CSICC52343.2021.9420622","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Intelligent Control of Urban Intersection Traffic Light Based on Reinforcement Learning Algorithm
The increasing number of vehicles, followed by traffic congestion, has posed a great challenge to the optimal control of traffic for human societies. Therefore, in order to achieve sustainable development in the field of integrated urban management, control of transportation networks is inevitable. The proper method for optimal traffic control should certainly be adaptable in order to be able to manage urban traffic that has a dynamic, complex and changeable nature. In this regard, the method of reinforcement learning that does not require a mathematical model of the environment is very important. In this paper, an intelligent method for controlling urban traffic based on reinforcement learning is presented in which a 4-way intersection is modeled with two different scenarios for low and high traffic congestion. The results obtained after repeated experiments of implementing the proposed method and also its improved model on the mentioned intersection show that the amount of travel time delay has been reduced compared to the usual fixed time methods. After comparing with the two fixed time methods, the waiting time of vehicles at the intersection is 15% and 86% improved for the scenario with low and high traffic congestion respectively, compared to the first method and 37% and 16% compared to the second method.