Zhengxing Lan , Yilong Ren , Haiyang Yu , Lingshan Liu , Zhenning Li , Yinhai Wang , Zhiyong Cui
{"title":"Hi-SCL: Fighting long-tailed challenges in trajectory prediction with hierarchical wave-semantic contrastive learning","authors":"Zhengxing Lan , Yilong Ren , Haiyang Yu , Lingshan Liu , Zhenning Li , Yinhai Wang , Zhiyong Cui","doi":"10.1016/j.trc.2024.104735","DOIUrl":null,"url":null,"abstract":"<div><p>Predicting the future trajectories of traffic agents is a pivotal aspect in achieving collision-free driving for autonomous vehicles. Although the overall accuracy of existing prediction methods appears promising, most of them overlook the long-tailed challenge in trajectory prediction. They tend to excuse or overlook the disastrous performance in rare yet safety-critical tail events. This paper puts forward a novel framework called hierarchical wave-semantic contrastive learning (Hi-SCL), which attempts to fight the long-tailed challenge in the trajectory prediction task. Our approach innovatively represents each traffic scene as “waves”, and implicitly models traffic multi-stream interactions through wave superposition at both local and global levels. This pioneering incorporation of the wave concept enhances the in-depth comprehension of the traffic scene. On this basis, we introduce the feature hierarchical reshaping method, empowering our network to cope with formidable infrequent cases effectively. This module maintains a collection of feature-enhanced hierarchical prototypes, dynamically steering trajectory samples closer or pushing them farther away in an unsupervised learning setup. Extensive experiments on real-world datasets validate Hi-SCL’s robust overall prediction performance and its effectiveness in addressing long-tailed challenges. Compared to several baseline models, Hi-SCL demonstrates remarkable improvements in general predictive accuracy, with long-term prediction error reductions ranging from 14% to 54% for minADE and 27% to 79% for minFDE. The outcomes of long-tailed experiments further underscore the capacity of Hi-SCL, offering accuracy gains ranging from 2% to 17% in tailed samples. The thorough empirical analyses confirm Hi-SCL’s exceptional capability of wave-semantic representation learning and its effectiveness in reshaping the feature space via hierarchical contrastive learning mechanisms. The proposed new paradigm paves the way for substantial advancements in trajectory prediction, especially in overcoming long-tailed issues, bringing us closer to realizing safer autonomous driving systems.</p></div>","PeriodicalId":54417,"journal":{"name":"Transportation Research Part C-Emerging Technologies","volume":null,"pages":null},"PeriodicalIF":7.6000,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transportation Research Part C-Emerging Technologies","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0968090X24002560","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TRANSPORTATION SCIENCE & TECHNOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Predicting the future trajectories of traffic agents is a pivotal aspect in achieving collision-free driving for autonomous vehicles. Although the overall accuracy of existing prediction methods appears promising, most of them overlook the long-tailed challenge in trajectory prediction. They tend to excuse or overlook the disastrous performance in rare yet safety-critical tail events. This paper puts forward a novel framework called hierarchical wave-semantic contrastive learning (Hi-SCL), which attempts to fight the long-tailed challenge in the trajectory prediction task. Our approach innovatively represents each traffic scene as “waves”, and implicitly models traffic multi-stream interactions through wave superposition at both local and global levels. This pioneering incorporation of the wave concept enhances the in-depth comprehension of the traffic scene. On this basis, we introduce the feature hierarchical reshaping method, empowering our network to cope with formidable infrequent cases effectively. This module maintains a collection of feature-enhanced hierarchical prototypes, dynamically steering trajectory samples closer or pushing them farther away in an unsupervised learning setup. Extensive experiments on real-world datasets validate Hi-SCL’s robust overall prediction performance and its effectiveness in addressing long-tailed challenges. Compared to several baseline models, Hi-SCL demonstrates remarkable improvements in general predictive accuracy, with long-term prediction error reductions ranging from 14% to 54% for minADE and 27% to 79% for minFDE. The outcomes of long-tailed experiments further underscore the capacity of Hi-SCL, offering accuracy gains ranging from 2% to 17% in tailed samples. The thorough empirical analyses confirm Hi-SCL’s exceptional capability of wave-semantic representation learning and its effectiveness in reshaping the feature space via hierarchical contrastive learning mechanisms. The proposed new paradigm paves the way for substantial advancements in trajectory prediction, especially in overcoming long-tailed issues, bringing us closer to realizing safer autonomous driving systems.
期刊介绍:
Transportation Research: Part C (TR_C) is dedicated to showcasing high-quality, scholarly research that delves into the development, applications, and implications of transportation systems and emerging technologies. Our focus lies not solely on individual technologies, but rather on their broader implications for the planning, design, operation, control, maintenance, and rehabilitation of transportation systems, services, and components. In essence, the intellectual core of the journal revolves around the transportation aspect rather than the technology itself. We actively encourage the integration of quantitative methods from diverse fields such as operations research, control systems, complex networks, computer science, and artificial intelligence. Join us in exploring the intersection of transportation systems and emerging technologies to drive innovation and progress in the field.