Pub Date : 2023-12-01DOI: 10.26599/JICV.2023.9210021
Wenfeng Lin;Xiaowei Hu;Jian Wang
Reinforcement learning (RL) can free automated vehicles (AVs) from the car-following constraints and provide more possible explorations for mixed behavior. This study uses deep RL as AVs' longitudinal control and designs a multi-level objectives framework for AVs' trajectory decision-making based on multi-agent DRL. The saturated signalized intersection is taken as the research object to seek the upper limit of traffic efficiency and realize the specific target control. The simulation results demonstrate the convergence of the proposed framework in complex scenarios. When prioritizing throughputs as the primary objective and emissions as the secondary objective, both indicators exhibit a linear growth pattern with increasing market penetration rate (MPR). Compared with MPR is 0%, the throughputs can be increased by 69.2% when MPR is 100%. Compared with linear adaptive cruise control (LACC) under the same MPR, the emissions can also be reduced by up to 78.8%. Under the control of the fixed throughputs, compared with LACC, the emission benefits grow nearly linearly as MPR increases, it can reach 79.4% at 80% MPR. This study employs experimental results to analyze the behavioral changes of mixed flow and the mechanism of mixed autonomy to improve traffic efficiency. The proposed method is flexible and serves as a valuable tool for exploring and studying the behavior of mixed flow behavior and the patterns of mixed autonomy.
{"title":"Multi-Level Objective Control of AVs at a Saturated Signalized Intersection with Multi-Agent Deep Reinforcement Learning Approach","authors":"Wenfeng Lin;Xiaowei Hu;Jian Wang","doi":"10.26599/JICV.2023.9210021","DOIUrl":"https://doi.org/10.26599/JICV.2023.9210021","url":null,"abstract":"Reinforcement learning (RL) can free automated vehicles (AVs) from the car-following constraints and provide more possible explorations for mixed behavior. This study uses deep RL as AVs' longitudinal control and designs a multi-level objectives framework for AVs' trajectory decision-making based on multi-agent DRL. The saturated signalized intersection is taken as the research object to seek the upper limit of traffic efficiency and realize the specific target control. The simulation results demonstrate the convergence of the proposed framework in complex scenarios. When prioritizing throughputs as the primary objective and emissions as the secondary objective, both indicators exhibit a linear growth pattern with increasing market penetration rate (MPR). Compared with MPR is 0%, the throughputs can be increased by 69.2% when MPR is 100%. Compared with linear adaptive cruise control (LACC) under the same MPR, the emissions can also be reduced by up to 78.8%. Under the control of the fixed throughputs, compared with LACC, the emission benefits grow nearly linearly as MPR increases, it can reach 79.4% at 80% MPR. This study employs experimental results to analyze the behavioral changes of mixed flow and the mechanism of mixed autonomy to improve traffic efficiency. The proposed method is flexible and serves as a valuable tool for exploring and studying the behavior of mixed flow behavior and the patterns of mixed autonomy.","PeriodicalId":100793,"journal":{"name":"Journal of Intelligent and Connected Vehicles","volume":"6 4","pages":"250-263"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10409224","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139504514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-01DOI: 10.26599/JICV.2023.9210023
Lan Yang;Jiaqi Yuan;Xiangmo Zhao;Shan Fang;Zeyu He;Jiahao Zhan;Zhiqiang Hu;Xia Li
With the increasing level of automation of autonomous vehicles, it is important to conduct comprehensive and extensive testing before releasing autonomous vehicles into the market. Traditional public road and closed-field testing failed to meet the requirements of high testing efficiency and scenario coverage. Therefore, scenario-based autonomous vehicle simulation testing has emerged. Many scenarios form the basis of simulation testing. Generating additional scenarios from an existing scenario library is a significant problem. Taking the scenarios of a proceeding vehicle cutting into an adjacent lane on highways as an example, based on an autoencoder and a generative adversarial network (GAN), a method that combines Transformer to capture the features of a long-time series, called SceGAN, is proposed to model and generate scenarios of autonomous vehicles on highways. An evaluation system is established to analyze the reliability of SceGAN using discriminative and predictive scores and further evaluate the effect of scenario generation in terms of similarity and coverage. Experiments showed that compared with TimeGAN and AEGAN, SceGAN is superior in data fidelity and availability, and their similarity increased by 27.22% and 21.39%, respectively. The coverage increased from 79.84% to 93.98% as generated scenarios increased from 2,547 to 50,000, indicating that the proposed method has a strong generalization capability for generating multiple trajectories, providing a basis for generating test scenarios and promoting autonomous vehicle testing.
{"title":"SceGAN: A Method for Generating Autonomous Vehicle Cut-In Scenarios on Highways Based on Deep Learning","authors":"Lan Yang;Jiaqi Yuan;Xiangmo Zhao;Shan Fang;Zeyu He;Jiahao Zhan;Zhiqiang Hu;Xia Li","doi":"10.26599/JICV.2023.9210023","DOIUrl":"https://doi.org/10.26599/JICV.2023.9210023","url":null,"abstract":"With the increasing level of automation of autonomous vehicles, it is important to conduct comprehensive and extensive testing before releasing autonomous vehicles into the market. Traditional public road and closed-field testing failed to meet the requirements of high testing efficiency and scenario coverage. Therefore, scenario-based autonomous vehicle simulation testing has emerged. Many scenarios form the basis of simulation testing. Generating additional scenarios from an existing scenario library is a significant problem. Taking the scenarios of a proceeding vehicle cutting into an adjacent lane on highways as an example, based on an autoencoder and a generative adversarial network (GAN), a method that combines Transformer to capture the features of a long-time series, called SceGAN, is proposed to model and generate scenarios of autonomous vehicles on highways. An evaluation system is established to analyze the reliability of SceGAN using discriminative and predictive scores and further evaluate the effect of scenario generation in terms of similarity and coverage. Experiments showed that compared with TimeGAN and AEGAN, SceGAN is superior in data fidelity and availability, and their similarity increased by 27.22% and 21.39%, respectively. The coverage increased from 79.84% to 93.98% as generated scenarios increased from 2,547 to 50,000, indicating that the proposed method has a strong generalization capability for generating multiple trajectories, providing a basis for generating test scenarios and promoting autonomous vehicle testing.","PeriodicalId":100793,"journal":{"name":"Journal of Intelligent and Connected Vehicles","volume":"6 4","pages":"264-274"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10409210","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139504506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.26599/JICV.2023.9210022
Lan Yang;Zeyu He;Xiangmo Zhao;Shan Fang;Jiaqi Yuan;Yixu He;Shijie Li;Songyan Liu
Real-time and accurate traffic light status recognition can provide reliable data support for autonomous vehicle decision-making and control systems. To address potential problems such as the minor component of traffic lights in the perceptual domain of visual sensors and the complexity of recognition scenarios, we propose an end-to-end traffic light status recognition method, ResNeSt50-CBAM-DINO (RC-DINO). First, we performed data cleaning on the Tsinghua-Tencent traffic lights (TTTL) and fused it with the Shanghai Jiao Tong University's traffic light dataset (S2TLD) to form a Chinese urban traffic light dataset (CUTLD). Second, we combined residual network with split-attention module-50 (ResNeSt50) and the convolutional block attention module (CBAM) to extract more significant traffic light features. Finally, the proposed RC-DINO and mainstream recognition algorithms were trained and analyzed using CUTLD. The experimental results show that, compared to the original DINO, RC-DINO improved the average precision (AP), AP at intersection over union (IOU) = 0.5 (AP 50