首页 > 最新文献

IEEE Transactions on Intelligent Vehicles最新文献

英文 中文
Scenario Engineering for Autonomous Transportation: A New Stage in Open-Pit Mines 自主运输的情景工程:露天矿的新阶段
IF 8.2 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-08 DOI: 10.1109/TIV.2024.3373495
Siyu Teng;Xuan Li;Yuchen Li;Lingxi Li;Zhe Xuanyuan;Yunfeng Ai;Long Chen
In recent years, open-pit mining has seen significant advancement, the cooperative operation of various specialized machinery substantially enhancing the efficiency of mineral extraction. However, the harsh environment and complex conditions in open-pit mines present substantial challenges for the implementation of autonomous transportation systems. This research introduces a novel paradigm that integrates Scenario Engineering (SE) with autonomous transportation systems to significantly improve the trustworthiness, robustness, and efficiency in open-pit mines by incorporating the four key components of SE, including Scenario Feature Extractor, Intelligence and Index, Calibration and Certification, and Verification and Validation. This paradigm has been validated in two famous open-pit mines, the experiment results demonstrate marked improvements in robustness, trustworthiness, and efficiency. By enhancing the capacity, scalability, and diversity of autonomous transportation, this paradigm fosters the integration of SE and parallel driving and finally propels the achievement of the ‘6S’ objectives.
近年来,露天采矿业取得了长足的进步,各种专用机械的协同作业大大提高了矿物开采的效率。然而,露天矿环境恶劣、条件复杂,给自主运输系统的实施带来了巨大挑战。本研究提出了一种将情景工程(SE)与自主运输系统相结合的新范例,通过结合情景工程的四个关键组成部分,包括情景特征提取器、智能与索引、校准与认证以及验证与确认,显著提高露天矿的可信度、稳健性和效率。这一范例已在两个著名的露天矿中得到验证,实验结果表明其在稳健性、可信度和效率方面都有明显改善。通过提高自主运输的能力、可扩展性和多样性,该范例促进了 SE 与并行驾驶的整合,并最终推动了 "6S "目标的实现。
{"title":"Scenario Engineering for Autonomous Transportation: A New Stage in Open-Pit Mines","authors":"Siyu Teng;Xuan Li;Yuchen Li;Lingxi Li;Zhe Xuanyuan;Yunfeng Ai;Long Chen","doi":"10.1109/TIV.2024.3373495","DOIUrl":"https://doi.org/10.1109/TIV.2024.3373495","url":null,"abstract":"In recent years, open-pit mining has seen significant advancement, the cooperative operation of various specialized machinery substantially enhancing the efficiency of mineral extraction. However, the harsh environment and complex conditions in open-pit mines present substantial challenges for the implementation of autonomous transportation systems. This research introduces a novel paradigm that integrates Scenario Engineering (SE) with autonomous transportation systems to significantly improve the trustworthiness, robustness, and efficiency in open-pit mines by incorporating the four key components of SE, including Scenario Feature Extractor, Intelligence and Index, Calibration and Certification, and Verification and Validation. This paradigm has been validated in two famous open-pit mines, the experiment results demonstrate marked improvements in robustness, trustworthiness, and efficiency. By enhancing the capacity, scalability, and diversity of autonomous transportation, this paradigm fosters the integration of SE and parallel driving and finally propels the achievement of the ‘6S’ objectives.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 3","pages":"4394-4404"},"PeriodicalIF":8.2,"publicationDate":"2024-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140820331","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-Time Multi-Learning Deep Neural Network on an MPSoC-FPGA for Intelligent Vehicles: Harnessing Hardware Acceleration With Pipeline 用于智能汽车的 MPSoC-FPGA 实时多学习深度神经网络:利用流水线实现硬件加速
IF 14 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-08 DOI: 10.1109/TIV.2024.3398215
Güner Tatar;Salih Bayar;İhsan Çiçek
This study introduces a new method to enhance ADAS's safety and error prevention capabilities in intelligent vehicles. We address the significant computational and memory demands required for real-time video processing by leveraging BDD100 K, KITTI, CityScape, and Waymo datasets. Our proposed hardware-software co-design integrates an MPSoC-FPGA accelerator for real-time multi-learning models. Our experimental results exhibit that, despite an increase in ADAS tasks and model parameters compared to the state-of-the-art studies, our model achieves 24,715 GOP performance with 4% lower power consumption (6.920 W) and 18.86% less logic resource consumption. The model processes highway scenes at 22.45 FPS and attains 50.06% mAP for object detection, 57.05% mIoU for segmentation, 43.76% mIoU for lane detection, 81.63% IoU for drivable area segmentation, and 9.78% SILog error for depth estimation. These findings confirm the system's effectiveness, reliability, and adaptability for ADAS applications and represent a significant advancement in intelligent vehicle technology, with the potential for further improvements in accuracy and memory efficiency.
本研究介绍了一种新方法,用于增强 ADAS 在智能车辆中的安全性和防错能力。我们利用 BDD100 K、KITTI、CityScape 和 Waymo 数据集解决了实时视频处理所需的大量计算和内存需求。我们提出的软硬件协同设计集成了用于实时多学习模型的 MPSoC-FPGA 加速器。我们的实验结果表明,尽管 ADAS 任务和模型参数比最先进的研究有所增加,但我们的模型实现了 24,715 GOP 的性能,功耗降低了 4%(6.920 W),逻辑资源消耗减少了 18.86%。该模型处理高速公路场景的速度为 22.45 FPS,物体检测的 mAP 率为 50.06%,分割的 mIoU 率为 57.05%,车道检测的 mIoU 率为 43.76%,可驾驶区域分割的 IoU 率为 81.63%,深度估计的 SILog 误差为 9.78%。这些发现证实了该系统的有效性、可靠性和对 ADAS 应用的适应性,代表了智能汽车技术的重大进步,并有可能进一步提高准确性和内存效率。
{"title":"Real-Time Multi-Learning Deep Neural Network on an MPSoC-FPGA for Intelligent Vehicles: Harnessing Hardware Acceleration With Pipeline","authors":"Güner Tatar;Salih Bayar;İhsan Çiçek","doi":"10.1109/TIV.2024.3398215","DOIUrl":"https://doi.org/10.1109/TIV.2024.3398215","url":null,"abstract":"This study introduces a new method to enhance ADAS's safety and error prevention capabilities in intelligent vehicles. We address the significant computational and memory demands required for real-time video processing by leveraging BDD100 K, KITTI, CityScape, and Waymo datasets. Our proposed hardware-software co-design integrates an MPSoC-FPGA accelerator for real-time multi-learning models. Our experimental results exhibit that, despite an increase in ADAS tasks and model parameters compared to the state-of-the-art studies, our model achieves 24,715 GOP performance with 4% lower power consumption (6.920 W) and 18.86% less logic resource consumption. The model processes highway scenes at 22.45 FPS and attains 50.06% mAP for object detection, 57.05% mIoU for segmentation, 43.76% mIoU for lane detection, 81.63% IoU for drivable area segmentation, and 9.78% SILog error for depth estimation. These findings confirm the system's effectiveness, reliability, and adaptability for ADAS applications and represent a significant advancement in intelligent vehicle technology, with the potential for further improvements in accuracy and memory efficiency.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 6","pages":"5021-5032"},"PeriodicalIF":14.0,"publicationDate":"2024-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141965419","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Choose Your Simulator Wisely: A Review on Open-Source Simulators for Autonomous Driving 明智选择模拟器:自动驾驶开源模拟器评述
IF 14 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-06 DOI: 10.1109/TIV.2024.3374044
Yueyuan Li;Wei Yuan;Songan Zhang;Weihao Yan;Qiyuan Shen;Chunxiang Wang;Ming Yang
Simulators play a crucial role in autonomous driving, offering significant time, cost, and labor savings. Over the past few years, the number of simulators for autonomous driving has grown substantially. However, there is a growing concern about the validity of algorithms developed and evaluated in simulators, indicating a need for a thorough analysis of the development status of the simulators. To address existing gaps in research, this paper undertakes a comprehensive review of the history of simulators, proposes a utility-based taxonomy, and investigates the critical issues within open-source simulators. Analysis of the past thirty years' development trajectory reveals a trend characterized by an increase in open-source simulators and an expansion of their functionality scope. The categorization of simulators based on feature functionalities delineates five primary classes: traffic flow, sensory data, driving policy, vehicle dynamics, and comprehensive simulators. Furthermore, the paper identifies critical unresolved issues in open-source simulators, including concerns regarding the fidelity of sensory data, representation of traffic scenarios, and accuracy in vehicle dynamics simulation, all of which have the potential to undermine experimental confidence. Additionally, challenges in data format inconsistency, labor-intensive map construction processes, sluggish step updating, and insufficient support for Hardware-In-the-Loop testing are discussed as hindrances to experimental efficiency. In light of these findings, the survey furnishes task-oriented recommendations to aid in the selection of simulators, taking into account factors such as accessibility, maintenance status, and quality, while highlighting the inherent limitations of existing open-source simulators in validating algorithms and facilitating real-world experimentation.
模拟器在自动驾驶中发挥着至关重要的作用,可大大节省时间、成本和人力。在过去几年中,自动驾驶模拟器的数量大幅增加。然而,人们越来越关注在模拟器中开发和评估的算法的有效性,这表明有必要对模拟器的开发状况进行全面分析。针对现有的研究空白,本文对模拟器的历史进行了全面回顾,提出了基于效用的分类法,并对开源模拟器中的关键问题进行了研究。对过去三十年发展轨迹的分析表明,开源模拟器呈现出不断增加、功能范围不断扩大的趋势。根据特征功能对模拟器进行分类,划分出五个主要类别:交通流、感官数据、驾驶政策、车辆动力学和综合模拟器。此外,论文还指出了开源模拟器中尚未解决的关键问题,包括感官数据的保真度、交通场景的表现力以及车辆动态模拟的准确性,所有这些问题都有可能削弱实验的可信度。此外,数据格式不一致、地图构建过程耗费大量人力、步骤更新缓慢以及对硬件在环测试的支持不足等挑战也被视为实验效率的障碍。鉴于这些发现,调查提供了以任务为导向的建议,以帮助选择模拟器,同时考虑到可访问性、维护状态和质量等因素,并强调了现有开源模拟器在验证算法和促进真实世界实验方面的固有局限性。
{"title":"Choose Your Simulator Wisely: A Review on Open-Source Simulators for Autonomous Driving","authors":"Yueyuan Li;Wei Yuan;Songan Zhang;Weihao Yan;Qiyuan Shen;Chunxiang Wang;Ming Yang","doi":"10.1109/TIV.2024.3374044","DOIUrl":"https://doi.org/10.1109/TIV.2024.3374044","url":null,"abstract":"Simulators play a crucial role in autonomous driving, offering significant time, cost, and labor savings. Over the past few years, the number of simulators for autonomous driving has grown substantially. However, there is a growing concern about the validity of algorithms developed and evaluated in simulators, indicating a need for a thorough analysis of the development status of the simulators. To address existing gaps in research, this paper undertakes a comprehensive review of the history of simulators, proposes a utility-based taxonomy, and investigates the critical issues within open-source simulators. Analysis of the past thirty years' development trajectory reveals a trend characterized by an increase in open-source simulators and an expansion of their functionality scope. The categorization of simulators based on feature functionalities delineates five primary classes: traffic flow, sensory data, driving policy, vehicle dynamics, and comprehensive simulators. Furthermore, the paper identifies critical unresolved issues in open-source simulators, including concerns regarding the fidelity of sensory data, representation of traffic scenarios, and accuracy in vehicle dynamics simulation, all of which have the potential to undermine experimental confidence. Additionally, challenges in data format inconsistency, labor-intensive map construction processes, sluggish step updating, and insufficient support for Hardware-In-the-Loop testing are discussed as hindrances to experimental efficiency. In light of these findings, the survey furnishes task-oriented recommendations to aid in the selection of simulators, taking into account factors such as accessibility, maintenance status, and quality, while highlighting the inherent limitations of existing open-source simulators in validating algorithms and facilitating real-world experimentation.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 5","pages":"4861-4876"},"PeriodicalIF":14.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141964748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Augmenting Reinforcement Learning With Transformer-Based Scene Representation Learning for Decision-Making of Autonomous Driving 用基于变压器的场景表征学习增强强化学习,促进自动驾驶的决策制定
IF 8.2 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-05 DOI: 10.1109/TIV.2024.3372625
Haochen Liu;Zhiyu Huang;Xiaoyu Mo;Chen Lv
Decision-making for urban autonomous driving is challenging due to the stochastic nature of interactive traffic participants and the complexity of road structures. Although reinforcement learning (RL)-based decision-making schemes are promising to handle urban driving scenarios, they suffer from low sample efficiency and poor adaptability. In this paper, we propose the Scene-Rep Transformer to enhance RL decision-making capabilities through improved scene representation encoding and sequential predictive latent distillation. Specifically, a multi-stage Transformer (MST) encoder is constructed to model not only the interaction awareness between the ego vehicle and its neighbors but also intention awareness between the agents and their candidate routes. A sequential latent Transformer (SLT) with self-supervised learning objectives is employed to distill future predictive information into the latent scene representation, in order to reduce the exploration space and speed up training. The final decision-making module based on soft actor-critic (SAC) takes as input the refined latent scene representation from the Scene-Rep Transformer and generates decisions. The framework is validated in five challenging simulated urban scenarios with dense traffic, and its performance is manifested quantitatively by substantial improvements in data efficiency and performance in terms of success rate, safety, and efficiency. Qualitative results reveal that our framework is able to extract the intentions of neighbor agents, enabling better decision-making and more diversified driving behaviors.
由于交互式交通参与者的随机性和道路结构的复杂性,城市自动驾驶的决策具有挑战性。虽然基于强化学习(RL)的决策方案有望处理城市驾驶场景,但它们存在样本效率低和适应性差的问题。在本文中,我们提出了 Scene-Rep Transformer,以通过改进场景表示编码和顺序预测潜在蒸馏来增强 RL 决策能力。具体来说,我们构建了一个多阶段变换器(MST)编码器,不仅能模拟自我车辆与其邻居之间的交互意识,还能模拟代理与其候选路线之间的意图意识。为了缩小探索空间并加快训练速度,我们采用了一种具有自我监督学习目标的序列潜在变换器(SLT),将未来预测信息提炼到潜在场景表示中。基于软演员批评(SAC)的最终决策模块将场景-预测转换器提炼的潜在场景表示作为输入,并生成决策。该框架在五个具有挑战性的高密度交通模拟城市场景中进行了验证,其性能表现为数据效率和成功率、安全性和效率方面的性能大幅提高。定性结果表明,我们的框架能够提取相邻代理的意图,从而做出更好的决策和更多样化的驾驶行为。
{"title":"Augmenting Reinforcement Learning With Transformer-Based Scene Representation Learning for Decision-Making of Autonomous Driving","authors":"Haochen Liu;Zhiyu Huang;Xiaoyu Mo;Chen Lv","doi":"10.1109/TIV.2024.3372625","DOIUrl":"https://doi.org/10.1109/TIV.2024.3372625","url":null,"abstract":"Decision-making for urban autonomous driving is challenging due to the stochastic nature of interactive traffic participants and the complexity of road structures. Although reinforcement learning (RL)-based decision-making schemes are promising to handle urban driving scenarios, they suffer from low sample efficiency and poor adaptability. In this paper, we propose the Scene-Rep Transformer to enhance RL decision-making capabilities through improved scene representation encoding and sequential predictive latent distillation. Specifically, a multi-stage Transformer (MST) encoder is constructed to model not only the interaction awareness between the ego vehicle and its neighbors but also intention awareness between the agents and their candidate routes. A sequential latent Transformer (SLT) with self-supervised learning objectives is employed to distill future predictive information into the latent scene representation, in order to reduce the exploration space and speed up training. The final decision-making module based on soft actor-critic (SAC) takes as input the refined latent scene representation from the Scene-Rep Transformer and generates decisions. The framework is validated in five challenging simulated urban scenarios with dense traffic, and its performance is manifested quantitatively by substantial improvements in data efficiency and performance in terms of success rate, safety, and efficiency. Qualitative results reveal that our framework is able to extract the intentions of neighbor agents, enabling better decision-making and more diversified driving behaviors.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 3","pages":"4405-4421"},"PeriodicalIF":8.2,"publicationDate":"2024-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140820328","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Energy Efficient Solution for Connected Electric Vehicle and Battery Health Management Using Eco-Driving Under Uncertain Environmental Conditions 在不确定环境条件下利用生态驾驶实现互联电动汽车和电池健康管理的节能解决方案
IF 8.2 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-05 DOI: 10.1109/TIV.2024.3373012
Hafiz Muhammad Yasir Naeem;Aamer Iqbal Bhatti;Yasir Awais Butt;Qadeer Ahmed;Xiaoshan Bai
Adopting energy-efficient driving practices can harness the full benefits of EVs. This work uses a multi-objective optimization strategy to perform eco-driving to reduce the energy consumption of EVs and to prolong the health of batteries. The problem jointly considers constraints of conflicting nature; such as traffic signals, preceding vehicles, limitations on speed and acceleration, checks on input torque and its rate of change and bounds on battery's SoC and charging/discharging rates. This research also explores how adhering strictly to one constraint may compromise other constraints. A comprehensive control strategy using MPC is adopted to formulate eco-driving as nonlinear programming and to achieve a realistic and optimal solution. The proposed strategy has successfully achieved eco-driving along with satisfying all the conflicting constraints in uncertain environmental conditions. Furthermore, results are compared with PMP to validate the optimal solution. SoH analysis indicates that the inclusion of battery-related constraints improves the battery's health. Finally, Lyapunov stability analysis is conducted to check the systems' stability with parametric uncertainty.
采用节能驾驶方法可以充分发挥电动汽车的优势。这项工作采用多目标优化策略来执行生态驾驶,以降低电动汽车的能耗并延长电池的寿命。该问题共同考虑了相互冲突的约束条件,如交通信号、前车、速度和加速度限制、输入扭矩及其变化率检查以及电池 SoC 和充电/放电速率约束。这项研究还探讨了严格遵守一个约束条件会如何损害其他约束条件。采用 MPC 综合控制策略,将生态驾驶表述为非线性编程,并获得现实的最优解。所提出的策略成功地实现了生态驾驶,同时满足了不确定环境条件下所有相互冲突的约束条件。此外,还将结果与 PMP 进行了比较,以验证最佳解决方案。SoH分析表明,加入电池相关约束能改善电池的健康状况。最后,还进行了 Lyapunov 稳定性分析,以检验系统在参数不确定情况下的稳定性。
{"title":"Energy Efficient Solution for Connected Electric Vehicle and Battery Health Management Using Eco-Driving Under Uncertain Environmental Conditions","authors":"Hafiz Muhammad Yasir Naeem;Aamer Iqbal Bhatti;Yasir Awais Butt;Qadeer Ahmed;Xiaoshan Bai","doi":"10.1109/TIV.2024.3373012","DOIUrl":"https://doi.org/10.1109/TIV.2024.3373012","url":null,"abstract":"Adopting energy-efficient driving practices can harness the full benefits of EVs. This work uses a multi-objective optimization strategy to perform eco-driving to reduce the energy consumption of EVs and to prolong the health of batteries. The problem jointly considers constraints of conflicting nature; such as traffic signals, preceding vehicles, limitations on speed and acceleration, checks on input torque and its rate of change and bounds on battery's SoC and charging/discharging rates. This research also explores how adhering strictly to one constraint may compromise other constraints. A comprehensive control strategy using MPC is adopted to formulate eco-driving as nonlinear programming and to achieve a realistic and optimal solution. The proposed strategy has successfully achieved eco-driving along with satisfying all the conflicting constraints in uncertain environmental conditions. Furthermore, results are compared with PMP to validate the optimal solution. SoH analysis indicates that the inclusion of battery-related constraints improves the battery's health. Finally, Lyapunov stability analysis is conducted to check the systems' stability with parametric uncertainty.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 4","pages":"4621-4631"},"PeriodicalIF":8.2,"publicationDate":"2024-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141315189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Event-Triggered Parallel Control Using Deep Reinforcement Learning With Application to Comfortable Autonomous Driving 使用深度强化学习的事件触发并行控制技术在舒适性自动驾驶中的应用
IF 8.2 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-04 DOI: 10.1109/TIV.2024.3372522
Jingwei Lu;Lefei Li;Fei-Yue Wang
A novel event-triggered control (ETC) method, called deep event-triggered parallel control (deep-ETPC), is presented to achieve path tracking for comfortable autonomous driving (CAD) using parallel control and deep deterministic policy gradient (DDPG). Based on parallel control, the developed deep-ETPC method constructs a dynamic control policy by introducing variation rates of controls. By employing variation rates of controls, the developed deep-ETPC method is capable of indicating communication loss and comfortable driving indices in the reward, and then enables reinforcement learning (RL) agents to learn comfortable ETC driving policies directly. Moreover, the communication loss, which reflects ETC, is integrated into the reward, so there is no need to additionally design/train triggering conditions, which can be considered a type of multi-tasking learning. Furthermore, an ETPC-oriented DDPG algorithm is developed to achieve the developed deep-ETPC method, making DDPG applicable to ETC. Empirical results, including tracking a simple straight line trajectory and a complicated sinusoidal trajectory, demonstrate the effectiveness of the developed deep-ETPC method.
本文提出了一种名为深度事件触发并行控制(deep-ETPC)的新型事件触发控制(ETC)方法,利用并行控制和深度确定性策略梯度(DDPG)实现舒适自动驾驶(CAD)的路径跟踪。基于并行控制,所开发的深度-ETPC 方法通过引入控制的变化率来构建动态控制策略。通过使用控制的变化率,所开发的深度-ETPC 方法能够显示奖励中的通信损失和舒适驾驶指数,然后使强化学习(RL)代理能够直接学习舒适的 ETC 驾驶策略。此外,反映 ETC 的通信损失已被整合到奖励中,因此无需额外设计/训练触发条件,这可以被视为一种多任务学习。此外,还开发了一种面向 ETPC 的 DDPG 算法,以实现所开发的深度-ETPC 方法,从而使 DDPG 适用于 ETC。包括跟踪简单直线轨迹和复杂正弦轨迹在内的实证结果证明了所开发的深度-ETPC方法的有效性。
{"title":"Event-Triggered Parallel Control Using Deep Reinforcement Learning With Application to Comfortable Autonomous Driving","authors":"Jingwei Lu;Lefei Li;Fei-Yue Wang","doi":"10.1109/TIV.2024.3372522","DOIUrl":"https://doi.org/10.1109/TIV.2024.3372522","url":null,"abstract":"A novel event-triggered control (ETC) method, called deep event-triggered parallel control (deep-ETPC), is presented to achieve path tracking for comfortable autonomous driving (CAD) using parallel control and deep deterministic policy gradient (DDPG). Based on parallel control, the developed deep-ETPC method constructs a dynamic control policy by introducing variation rates of controls. By employing variation rates of controls, the developed deep-ETPC method is capable of indicating communication loss and comfortable driving indices in the reward, and then enables reinforcement learning (RL) agents to learn comfortable ETC driving policies directly. Moreover, the communication loss, which reflects ETC, is integrated into the reward, so there is no need to additionally design/train triggering conditions, which can be considered a type of multi-tasking learning. Furthermore, an ETPC-oriented DDPG algorithm is developed to achieve the developed deep-ETPC method, making DDPG applicable to ETC. Empirical results, including tracking a simple straight line trajectory and a complicated sinusoidal trajectory, demonstrate the effectiveness of the developed deep-ETPC method.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 3","pages":"4470-4479"},"PeriodicalIF":8.2,"publicationDate":"2024-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140820420","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tracking a Planar Target Using Image-Based Visual Servoing Technique 利用基于图像的视觉伺服技术跟踪平面目标
IF 8.2 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-04 DOI: 10.1109/TIV.2024.3372590
Yogesh Kumar;Bassam Pervez Shamsi;Sayan Basu Roy;Sujit P B
In this paper, we design and validate a kinematic controller for a quadrotor tracking a planar moving target using image-based visual servoing (IBVS). Most of the current literature on IBVS for moving targets often consider restrictive assumptions on the target dynamics that limits its generalizability for any arbitrary motion. We propose a model-free target velocity estimator augmented kinematic controller based on appropriately derived feature dynamics in a virtual image plane. We show how the inner-loop mismatch affects the kinematic controller performance through a comprehensive theoretical analysis based on the Lyapunov direct method. We prove that the system errors converge exponentially to an ultimate bound in general and asymptotically to zero for the purely translational and constant target motions and vanishing inner-loop mismatch. Extensive simulations, including model-in-the-loop and software-in-the-loop settings, along with experimental validation in an outdoor environment, confirm the utility of the proposed visual servoing technique.
在本文中,我们设计并验证了四旋翼飞行器使用基于图像的视觉伺服(IBVS)跟踪平面移动目标的运动控制器。目前大多数关于移动目标 IBVS 的文献通常都考虑了目标动态的限制性假设,从而限制了其对任意运动的通用性。我们提出了一种基于虚拟图像平面中适当推导的特征动力学的无模型目标速度估计增强运动控制器。通过基于 Lyapunov 直接法的综合理论分析,我们展示了内环失配如何影响运动控制器的性能。我们证明,在一般情况下,系统误差会以指数形式收敛到一个终极边界,而在纯平移和恒定目标运动以及内环失配消失的情况下,系统误差会逐渐趋近于零。广泛的模拟(包括模型在环和软件在环设置)以及室外环境下的实验验证证实了所提出的视觉伺服技术的实用性。
{"title":"Tracking a Planar Target Using Image-Based Visual Servoing Technique","authors":"Yogesh Kumar;Bassam Pervez Shamsi;Sayan Basu Roy;Sujit P B","doi":"10.1109/TIV.2024.3372590","DOIUrl":"https://doi.org/10.1109/TIV.2024.3372590","url":null,"abstract":"In this paper, we design and validate a kinematic controller for a quadrotor tracking a planar moving target using image-based visual servoing (IBVS). Most of the current literature on IBVS for moving targets often consider restrictive assumptions on the target dynamics that limits its generalizability for any arbitrary motion. We propose a model-free target velocity estimator augmented kinematic controller based on appropriately derived feature dynamics in a virtual image plane. We show how the inner-loop mismatch affects the kinematic controller performance through a comprehensive theoretical analysis based on the Lyapunov direct method. We prove that the system errors converge exponentially to an ultimate bound in general and asymptotically to zero for the purely translational and constant target motions and vanishing inner-loop mismatch. Extensive simulations, including model-in-the-loop and software-in-the-loop settings, along with experimental validation in an outdoor environment, confirm the utility of the proposed visual servoing technique.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 3","pages":"4362-4372"},"PeriodicalIF":8.2,"publicationDate":"2024-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140820424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fully Distributed Target Encircling Control of Autonomous Surface Vehicles Based on Noncooperative Games 基于非合作博弈的自主水面飞行器全分布式目标包围控制
IF 8.2 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-04 DOI: 10.1109/TIV.2024.3372652
Yue Jiang;Zhongkui Li
This paper addresses cooperative target encircling of multiple autonomous surface vehicles (ASVs) with private and potentially competitive objectives. A fully distributed encircling control approach is proposed based on noncooperative games. Specifically, a fully distributed estimator with an adaptive gain is developed to estimate the target information without using global state or topology knowledge. Based on a low-frequency learning technique, a fuzzy predictor is presented to approximate the unknown vehicle kinematics induced by uncertain nonlinearities and environmental disturbances. By decoupling the cooperative target encircling into an encircling task and a spacing task, an encircling control law and a spacing control law are designed based on fully distributed Nash equilibrium seeking for achieving the private control objective of each ASV. The input-to-state stability of the closed-loop system is proven via cascade analysis. Simulation results are provided to illustrate the effectiveness of the noncooperative game-based control method for ASVs in circumnavigation missions.
本文论述了多个自主水面飞行器(ASV)合作包围目标的问题,这些飞行器具有私人目标和潜在竞争目标。本文提出了一种基于非合作博弈的全分布式包围控制方法。具体来说,开发了一种具有自适应增益的全分布式估计器,以在不使用全局状态或拓扑知识的情况下估计目标信息。在低频学习技术的基础上,提出了一种模糊预测器,用于近似由不确定非线性和环境干扰引起的未知车辆运动学。通过将合作目标包围解耦为包围任务和间隔任务,设计了基于全分布纳什均衡寻求的包围控制法则和间隔控制法则,以实现每个 ASV 的私有控制目标。通过级联分析证明了闭环系统的输入到状态稳定性。仿真结果说明了基于非合作博弈的控制方法在 ASV 环绕飞行任务中的有效性。
{"title":"Fully Distributed Target Encircling Control of Autonomous Surface Vehicles Based on Noncooperative Games","authors":"Yue Jiang;Zhongkui Li","doi":"10.1109/TIV.2024.3372652","DOIUrl":"https://doi.org/10.1109/TIV.2024.3372652","url":null,"abstract":"This paper addresses cooperative target encircling of multiple autonomous surface vehicles (ASVs) with private and potentially competitive objectives. A fully distributed encircling control approach is proposed based on noncooperative games. Specifically, a fully distributed estimator with an adaptive gain is developed to estimate the target information without using global state or topology knowledge. Based on a low-frequency learning technique, a fuzzy predictor is presented to approximate the unknown vehicle kinematics induced by uncertain nonlinearities and environmental disturbances. By decoupling the cooperative target encircling into an encircling task and a spacing task, an encircling control law and a spacing control law are designed based on fully distributed Nash equilibrium seeking for achieving the private control objective of each ASV. The input-to-state stability of the closed-loop system is proven via cascade analysis. Simulation results are provided to illustrate the effectiveness of the noncooperative game-based control method for ASVs in circumnavigation missions.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 4","pages":"4769-4779"},"PeriodicalIF":8.2,"publicationDate":"2024-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141315207","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Editorial Intelligent Vehicles for Sustainability Industry: Call for Nomination and Participation 可持续发展工业的智能车辆》编辑部:征集提名和参与
IF 8.2 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-01 DOI: 10.1109/TIV.2024.3384837
Fei-Yue Wang
From Jan. 1 to Mar. 23, we have received 1735 submissions. The current average number of submissions per day (SPD) rate is 21.12 [1], [2]. However, such a vibrated SPD also indicates a tremendous workload for our editorial board. Therefore, I would like to expand our team to include at least 240 members. If you have suitable candidates for potential associate editors, please send a Short BioSketch and a Resume to feiyue@ieee.org and danielyenew22@gmail.com.
从 1 月 1 日到 3 月 23 日,我们共收到 1735 份意见书。目前的平均日投稿量(SPD)为 21.12 [1], [2]。然而,如此振动的 SPD 也表明我们编辑部的工作量巨大。因此,我希望扩大我们的团队,使其至少包括 240 名成员。如果您有合适的潜在副主编人选,请将简历发送至 feiyue@ieee.org 和 danielyenew22@gmail.com。
{"title":"Editorial Intelligent Vehicles for Sustainability Industry: Call for Nomination and Participation","authors":"Fei-Yue Wang","doi":"10.1109/TIV.2024.3384837","DOIUrl":"https://doi.org/10.1109/TIV.2024.3384837","url":null,"abstract":"From Jan. 1 to Mar. 23, we have received 1735 submissions. The current average number of submissions per day (SPD) rate is \u0000<bold>21.12</b>\u0000 [1], [2]. However, such a vibrated SPD also indicates a tremendous workload for our editorial board. Therefore, I would like to expand our team to include at least 240 members. If you have suitable candidates for potential associate editors, please send a Short BioSketch and a Resume to feiyue@ieee.org and danielyenew22@gmail.com.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 3","pages":"4233-4239"},"PeriodicalIF":8.2,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140820406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving 面向 V2X 通信辅助自动驾驶的中断感知合作感知
IF 8.2 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-03-01 DOI: 10.1109/TIV.2024.3371974
Shunli Ren;Zixing Lei;Zi Wang;Mehrdad Dianati;Yafei Wang;Siheng Chen;Wenjun Zhang
Cooperative perception can significantly improve the perception performance of autonomous vehicles beyond the limited perception ability of individual vehicles by exchanging information with neighbor agents through V2X communication. However, most existing work assume ideal communication among agents, ignoring the significant and common interruption issues caused by imperfect V2X communication, where cooperation agents can not receive cooperative messages successfully and thus fail to achieve cooperative perception, leading to safety risks. To fully reap the benefits of cooperative perception in practice, we propose V2X communication INterruption-aware COoperative Perception (V2X-INCOP), a cooperative perception system robust to communication interruption for V2X communication-aided autonomous driving, which leverages historical cooperation information to recover missing information due to the interruptions and alleviate the impact of the interruption issue. To achieve comprehensive recovery, we design a communication-adaptive multi-scale spatial-temporal prediction model to extract multi-scale spatial-temporal features based on V2X communication conditions and capture the most significant information for the prediction of the missing information. To further improve recovery performance, we adopt a knowledge distillation framework to give explicit and direct supervision to the prediction model and a curriculum learning strategy to stabilize the training of the model. Experiments on three public cooperative perception datasets demonstrate that the proposed method is effective in alleviating the impacts of communication interruption on cooperative perception. V2X-INCOP outperforms state-of-the-art cooperative perception methods and has a cooperative perception gain up to 14.06%, 13.9%, and 12.07% over individual perception on average of different packet drop rates on OPV2V, V2X-Sim, and Dair-V2X datasets, respectively.
通过 V2X 通信与相邻代理交换信息,合作感知可以大大提高自动驾驶车辆的感知性能,从而超越单个车辆有限的感知能力。然而,现有工作大多假定代理之间的通信是理想的,忽略了不完善的 V2X 通信所导致的重大且常见的中断问题,即合作代理无法成功接收合作信息,从而无法实现合作感知,导致安全风险。为了在实践中充分发挥合作感知的优势,我们提出了V2X通信中断感知合作感知(V2X-INCOP),这是一种针对V2X通信辅助自动驾驶的鲁棒性通信中断的合作感知系统,它利用历史合作信息来恢复因中断而缺失的信息,减轻中断问题的影响。为了实现全面恢复,我们设计了一种通信自适应多尺度时空预测模型,根据 V2X 通信条件提取多尺度时空特征,捕捉最重要的信息用于预测缺失信息。为了进一步提高恢复性能,我们采用了知识提炼框架来对预测模型进行明确而直接的监督,并采用课程学习策略来稳定模型的训练。在三个公共合作感知数据集上的实验证明,所提出的方法能有效减轻通信中断对合作感知的影响。V2X-INCOP 优于最先进的合作感知方法,在 OPV2V、V2X-Sim 和 Dair-V2X 数据集上,不同丢包率下的平均合作感知增益分别高达 14.06%、13.9% 和 12.07%。
{"title":"Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving","authors":"Shunli Ren;Zixing Lei;Zi Wang;Mehrdad Dianati;Yafei Wang;Siheng Chen;Wenjun Zhang","doi":"10.1109/TIV.2024.3371974","DOIUrl":"https://doi.org/10.1109/TIV.2024.3371974","url":null,"abstract":"Cooperative perception can significantly improve the perception performance of autonomous vehicles beyond the limited perception ability of individual vehicles by exchanging information with neighbor agents through V2X communication. However, most existing work assume ideal communication among agents, ignoring the significant and common \u0000<italic>interruption issues</i>\u0000 caused by imperfect V2X communication, where cooperation agents can not receive cooperative messages successfully and thus fail to achieve cooperative perception, leading to safety risks. To fully reap the benefits of cooperative perception in practice, we propose V2X communication INterruption-aware COoperative Perception (V2X-INCOP), a cooperative perception system robust to communication interruption for V2X communication-aided autonomous driving, which leverages historical cooperation information to recover missing information due to the interruptions and alleviate the impact of the interruption issue. To achieve comprehensive recovery, we design a communication-adaptive multi-scale spatial-temporal prediction model to extract multi-scale spatial-temporal features based on V2X communication conditions and capture the most significant information for the prediction of the missing information. To further improve recovery performance, we adopt a knowledge distillation framework to give explicit and direct supervision to the prediction model and a curriculum learning strategy to stabilize the training of the model. Experiments on three public cooperative perception datasets demonstrate that the proposed method is effective in alleviating the impacts of communication interruption on cooperative perception. V2X-INCOP outperforms state-of-the-art cooperative perception methods and has a cooperative perception gain up to 14.06%, 13.9%, and 12.07% over individual perception on average of different packet drop rates on OPV2V, V2X-Sim, and Dair-V2X datasets, respectively.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 4","pages":"4698-4714"},"PeriodicalIF":8.2,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141315148","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Transactions on Intelligent Vehicles
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1