{"title":"A reinforcement learning based autonomous vehicle control in diverse daytime and weather scenarios","authors":"Badr Ben Elallid , Miloud Bagaa , Nabil Benamar , Nabil Mrani","doi":"10.1080/15472450.2024.2370010","DOIUrl":null,"url":null,"abstract":"<div><div>Autonomous driving holds significant promise for substantially reducing road fatalities. Unlike traditional machine learning methods that have conventionally been applied to enhance the motion control of Autonomous Vehicles (AVs), recent attention has shifted toward the utilization of Deep Learning (DL) and Deep Reinforcement Learning (DRL) techniques. These advanced approaches have the potential to greatly improve AV vehicle control and empower vehicles to learn from their surroundings. However, the majority of existing research has concentrated on straightforward scenarios, often neglecting the intricate challenges posed by vulnerable road users such as pedestrians, cyclists, and motorcyclists, as well as the influence of varying weather conditions. In this study, we propose a novel model founded on DRL, specifically leveraging Deep-Q Networks (DQN), to effectively manage AVs in complex scenarios characterized by heavy traffic, diverse road users, and diverse weather conditions. Our approach involves training the model in diverse weather conditions, encompassing clear daytime and nighttime as well as challenging weather conditions like heavy rainfall during both the day and sunset. Through this comprehensive training, the AV becomes proficient in navigating safely through intersections and reaching its destination without any accidents. To rigorously evaluate and validate our proposed approach, extensive testing was conducted employing the CARLA simulator. The simulation results unequivocally demonstrate that our model not only reduces travel delays but also minimizes the occurrence of collisions, marking a significant step forward in achieving safer and more efficient autonomous driving.</div></div>","PeriodicalId":54792,"journal":{"name":"Journal of Intelligent Transportation Systems","volume":"29 6","pages":"Pages 626-639"},"PeriodicalIF":2.8000,"publicationDate":"2025-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Intelligent Transportation Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/org/science/article/pii/S1547245024000252","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"TRANSPORTATION","Score":null,"Total":0}
引用次数: 0
Abstract
Autonomous driving holds significant promise for substantially reducing road fatalities. Unlike traditional machine learning methods that have conventionally been applied to enhance the motion control of Autonomous Vehicles (AVs), recent attention has shifted toward the utilization of Deep Learning (DL) and Deep Reinforcement Learning (DRL) techniques. These advanced approaches have the potential to greatly improve AV vehicle control and empower vehicles to learn from their surroundings. However, the majority of existing research has concentrated on straightforward scenarios, often neglecting the intricate challenges posed by vulnerable road users such as pedestrians, cyclists, and motorcyclists, as well as the influence of varying weather conditions. In this study, we propose a novel model founded on DRL, specifically leveraging Deep-Q Networks (DQN), to effectively manage AVs in complex scenarios characterized by heavy traffic, diverse road users, and diverse weather conditions. Our approach involves training the model in diverse weather conditions, encompassing clear daytime and nighttime as well as challenging weather conditions like heavy rainfall during both the day and sunset. Through this comprehensive training, the AV becomes proficient in navigating safely through intersections and reaching its destination without any accidents. To rigorously evaluate and validate our proposed approach, extensive testing was conducted employing the CARLA simulator. The simulation results unequivocally demonstrate that our model not only reduces travel delays but also minimizes the occurrence of collisions, marking a significant step forward in achieving safer and more efficient autonomous driving.
期刊介绍:
The Journal of Intelligent Transportation Systems is devoted to scholarly research on the development, planning, management, operation and evaluation of intelligent transportation systems. Intelligent transportation systems are innovative solutions that address contemporary transportation problems. They are characterized by information, dynamic feedback and automation that allow people and goods to move efficiently. They encompass the full scope of information technologies used in transportation, including control, computation and communication, as well as the algorithms, databases, models and human interfaces. The emergence of these technologies as a new pathway for transportation is relatively new.
The Journal of Intelligent Transportation Systems is especially interested in research that leads to improved planning and operation of the transportation system through the application of new technologies. The journal is particularly interested in research that adds to the scientific understanding of the impacts that intelligent transportation systems can have on accessibility, congestion, pollution, safety, security, noise, and energy and resource consumption.
The journal is inter-disciplinary, and accepts work from fields of engineering, economics, planning, policy, business and management, as well as any other disciplines that contribute to the scientific understanding of intelligent transportation systems. The journal is also multi-modal, and accepts work on intelligent transportation for all forms of ground, air and water transportation. Example topics include the role of information systems in transportation, traffic flow and control, vehicle control, routing and scheduling, traveler response to dynamic information, planning for ITS innovations, evaluations of ITS field operational tests, ITS deployment experiences, automated highway systems, vehicle control systems, diffusion of ITS, and tools/software for analysis of ITS.