Pub Date : 2024-02-01DOI: 10.1109/TIV.2024.3394589
{"title":"Share Your Preprint Research with the World!","authors":"","doi":"10.1109/TIV.2024.3394589","DOIUrl":"https://doi.org/10.1109/TIV.2024.3394589","url":null,"abstract":"","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 2","pages":"4232-4232"},"PeriodicalIF":8.2,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10510218","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140813984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-01DOI: 10.1109/TIV.2024.3376575
Hongkai Yu;Xinyu Liu;Yonglin Tian;Yutong Wang;Chao Gou;Fei-Yue Wang
There are a large number of functional sensors installed on the modern intelligent vehicles. Many Artificial Intelligence based foundation models have been proposed for smart sensing to recognize the known object classes in the new but similar scenarios. However, it is still challenging for the foundation models of smart sensing to detect all the object classes in both seen and unseen scenarios. This letter aims at pushing the boundary of smart sensing research for intelligent vehicles. We first summarize the current widely-used foundation models and the foundation intelligence needed for smart sensing of intelligent vehicles. We then explain Sora-based Parallel Vision to boost the foundation models of smart sensing from basic intelligence (1.0) to enhanced intelligence (2.0) and final generalized intelligence (3.0). Several representative case studies are discussed to show the potential usages of Sora-based Parallel Vision, followed by its future research direction.
现代智能车辆上安装了大量功能传感器。人们提出了许多基于人工智能的智能传感基础模型,以便在新的但相似的场景中识别已知的物体类别。然而,智能传感的基础模型要在看到和看不到的场景中检测到所有物体类别,仍然具有挑战性。这封信旨在推动智能车辆的智能传感研究。我们首先总结了目前广泛使用的基础模型以及智能车辆智能感知所需的基础智能。然后,我们解释了基于 Sora 的并行视觉如何将智能感知的基础模型从基本智能(1.0)提升到增强智能(2.0)和最终的通用智能(3.0)。我们还讨论了几个具有代表性的案例研究,以展示基于 Sora 的并行视觉的潜在用途,以及其未来的研究方向。
{"title":"Sora-Based Parallel Vision for Smart Sensing of Intelligent Vehicles: From Foundation Models to Foundation Intelligence","authors":"Hongkai Yu;Xinyu Liu;Yonglin Tian;Yutong Wang;Chao Gou;Fei-Yue Wang","doi":"10.1109/TIV.2024.3376575","DOIUrl":"https://doi.org/10.1109/TIV.2024.3376575","url":null,"abstract":"There are a large number of functional sensors installed on the modern intelligent vehicles. Many Artificial Intelligence based foundation models have been proposed for smart sensing to recognize the known object classes in the new but similar scenarios. However, it is still challenging for the foundation models of smart sensing to detect all the object classes in both seen and unseen scenarios. This letter aims at pushing the boundary of smart sensing research for intelligent vehicles. We first summarize the current widely-used foundation models and the foundation intelligence needed for smart sensing of intelligent vehicles. We then explain Sora-based Parallel Vision to boost the foundation models of smart sensing from basic intelligence (1.0) to enhanced intelligence (2.0) and final generalized intelligence (3.0). Several representative case studies are discussed to show the potential usages of Sora-based Parallel Vision, followed by its future research direction.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 2","pages":"3123-3126"},"PeriodicalIF":8.2,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140814020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-01DOI: 10.1109/TIV.2024.3376461
Zhibin Shuai;Zheng Hu;Jiangtao Gai;Yijie Chen;Jicheng Chen;Hui Zhang;Fei-Yue Wang
Open-terrain field vehicle (OTFV) fleets, including mining trucks, construction machinery, and agricultural machinery, often encounter significantly more intricate scenarios and unique challenges than road vehicles. Enhancing the intelligence level of OTFV fleets can significantly enhance their operational effectiveness and improve energy efficiency. This perspective paper introduces a metaverse-enabled framework to improve the intelligence levels of OTFV fleets. The metaverse-enabled framework consists of the parallel intelligence-based vehicle fleet control and edge computing-based vehicle dynamics control levels. We first delve into the framework's specifics, covering open-terrain field metaverse, parallel intelligence, edge computing, and human-vehicle cooperation. We further discuss critical issues such as artificial general intelligence (AGI) enabled large control models, vehicle teleoperation, communication privacy, and edge scenario engineering. Additionally, we provide a detailed account of edge computing and integrated domain control within the vehicle dynamics control level, illustrating the interactions among human drivers, domain controllers, vehicle systems and open-terrain field metaverse. Ultimately, the proposed framework can potentially empower intelligence to OTFV fleets and other equipment clusters with complicated system compositions and challenging missions in complex environments.
{"title":"Metaverse-Enabled Intelligence for Open-Terrain Field Vehicle Fleets: Leveraging Parallel Intelligence and Edge Computing","authors":"Zhibin Shuai;Zheng Hu;Jiangtao Gai;Yijie Chen;Jicheng Chen;Hui Zhang;Fei-Yue Wang","doi":"10.1109/TIV.2024.3376461","DOIUrl":"https://doi.org/10.1109/TIV.2024.3376461","url":null,"abstract":"Open-terrain field vehicle (OTFV) fleets, including mining trucks, construction machinery, and agricultural machinery, often encounter significantly more intricate scenarios and unique challenges than road vehicles. Enhancing the intelligence level of OTFV fleets can significantly enhance their operational effectiveness and improve energy efficiency. This perspective paper introduces a metaverse-enabled framework to improve the intelligence levels of OTFV fleets. The metaverse-enabled framework consists of the parallel intelligence-based vehicle fleet control and edge computing-based vehicle dynamics control levels. We first delve into the framework's specifics, covering open-terrain field metaverse, parallel intelligence, edge computing, and human-vehicle cooperation. We further discuss critical issues such as artificial general intelligence (AGI) enabled large control models, vehicle teleoperation, communication privacy, and edge scenario engineering. Additionally, we provide a detailed account of edge computing and integrated domain control within the vehicle dynamics control level, illustrating the interactions among human drivers, domain controllers, vehicle systems and open-terrain field metaverse. Ultimately, the proposed framework can potentially empower intelligence to OTFV fleets and other equipment clusters with complicated system compositions and challenging missions in complex environments.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 2","pages":"3111-3116"},"PeriodicalIF":8.2,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140814069","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}