Kaixuan Chen, Guangqiang Wu, Shang Peng, Xiang Zeng, Lijuan Ju
{"title":"基于强化学习的双红绿灯车速策略","authors":"Kaixuan Chen, Guangqiang Wu, Shang Peng, Xiang Zeng, Lijuan Ju","doi":"10.1504/ijvp.2023.131974","DOIUrl":null,"url":null,"abstract":"This paper proposes a speed strategy based on reinforcement learning on the basis of double traffic lights. This strategy can ensure that vehicles can pass traffic lights without stopping or with little stopping. First of all, Prescan software is used to build traffic lights, roads, and vehicles and other scenario models. Simulink software is used for vehicles, traffic lights control, and other models. Secondly, the double traffic lights scenario has analysed in detail. And then, the improved Q-learning algorithm is used to build the vehicle speed decision model and train the Q table. Q table is used for subsequent real vehicle tests and simulation verification. Finally, the feasibility of the strategy is verified in a variety of conditions, and the results show that the strategy can guarantee fuel economy and get through the double traffic lights as smoothly as possible.","PeriodicalId":52169,"journal":{"name":"International Journal of Vehicle Performance","volume":"58 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"The vehicle speed strategy with double traffic lights based on reinforcement learning\",\"authors\":\"Kaixuan Chen, Guangqiang Wu, Shang Peng, Xiang Zeng, Lijuan Ju\",\"doi\":\"10.1504/ijvp.2023.131974\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper proposes a speed strategy based on reinforcement learning on the basis of double traffic lights. This strategy can ensure that vehicles can pass traffic lights without stopping or with little stopping. First of all, Prescan software is used to build traffic lights, roads, and vehicles and other scenario models. Simulink software is used for vehicles, traffic lights control, and other models. Secondly, the double traffic lights scenario has analysed in detail. And then, the improved Q-learning algorithm is used to build the vehicle speed decision model and train the Q table. Q table is used for subsequent real vehicle tests and simulation verification. Finally, the feasibility of the strategy is verified in a variety of conditions, and the results show that the strategy can guarantee fuel economy and get through the double traffic lights as smoothly as possible.\",\"PeriodicalId\":52169,\"journal\":{\"name\":\"International Journal of Vehicle Performance\",\"volume\":\"58 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Vehicle Performance\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1504/ijvp.2023.131974\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Engineering\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Vehicle Performance","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1504/ijvp.2023.131974","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Engineering","Score":null,"Total":0}
The vehicle speed strategy with double traffic lights based on reinforcement learning
This paper proposes a speed strategy based on reinforcement learning on the basis of double traffic lights. This strategy can ensure that vehicles can pass traffic lights without stopping or with little stopping. First of all, Prescan software is used to build traffic lights, roads, and vehicles and other scenario models. Simulink software is used for vehicles, traffic lights control, and other models. Secondly, the double traffic lights scenario has analysed in detail. And then, the improved Q-learning algorithm is used to build the vehicle speed decision model and train the Q table. Q table is used for subsequent real vehicle tests and simulation verification. Finally, the feasibility of the strategy is verified in a variety of conditions, and the results show that the strategy can guarantee fuel economy and get through the double traffic lights as smoothly as possible.