László Lindenmaier;Balázs Czibere;Szilárd Aradi;Tamás Bécsi
{"title":"A Robust and Runtime-Efficient Track-to-Track Fusion for Automotive Perception Systems","authors":"László Lindenmaier;Balázs Czibere;Szilárd Aradi;Tamás Bécsi","doi":"10.1109/JSEN.2025.3548899","DOIUrl":null,"url":null,"abstract":"Advanced driver assistance and autonomous systems require an enhanced perception system, fusing the data of multiple sensors. Many automotive sensors provide high-level data, such as tracked objects, i.e., tracks, usually fused in a track-to-track manner. The core of this fusion is the track-to-track association (T2TA), intending to create assignments between the tracks. In conventional T2TA, the assignment likelihood function is derived from “diffuse prior,” neglecting that the sensors may provide duplicated tracks of a target. Moreover, conventional association algorithms are usually computationally demanding due to the combinatorial nature of the problem. The first motivation of this work is to obtain a computationally efficient and robust solution, reflecting these problems. Another crucial element of track-to-track fusion is track management, which maintains the list of tracks by initializing and deleting tracks, thus having a great impact on the reliability of the fusion output. In this article, we propose a novel track-to-track fusion architecture in which the fused tracks are fed back to the association. The proposed method comprises two main contributions. First, a computationally efficient association algorithm is provided in which the “diffuse prior” is replaced with an informative prior, exploiting the feedback loop of the fused tracks. Moreover, it tackles duplicated tracks. Second, a track management system (TMS) relying on a revamped track existence probability fusion is proposed, contributing to efficient false track filtering and continuous object tracking. The proposed methodology is evaluated on real-world data of a frontal perception system. The results show that the proposed association outperforms the conventional methods; still, it maintains a favorable complexity, contributing to real-time applicability. The TMS relying on the revamped existence probability fusion can efficiently filter false tracks and continuously track objects. Moreover, the resulting overall track-to-track fusion outperforms the state-of-the-art multiobject tracking-based fusion algorithms.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 8","pages":"14022-14035"},"PeriodicalIF":4.3000,"publicationDate":"2025-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10925581","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10925581/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Advanced driver assistance and autonomous systems require an enhanced perception system, fusing the data of multiple sensors. Many automotive sensors provide high-level data, such as tracked objects, i.e., tracks, usually fused in a track-to-track manner. The core of this fusion is the track-to-track association (T2TA), intending to create assignments between the tracks. In conventional T2TA, the assignment likelihood function is derived from “diffuse prior,” neglecting that the sensors may provide duplicated tracks of a target. Moreover, conventional association algorithms are usually computationally demanding due to the combinatorial nature of the problem. The first motivation of this work is to obtain a computationally efficient and robust solution, reflecting these problems. Another crucial element of track-to-track fusion is track management, which maintains the list of tracks by initializing and deleting tracks, thus having a great impact on the reliability of the fusion output. In this article, we propose a novel track-to-track fusion architecture in which the fused tracks are fed back to the association. The proposed method comprises two main contributions. First, a computationally efficient association algorithm is provided in which the “diffuse prior” is replaced with an informative prior, exploiting the feedback loop of the fused tracks. Moreover, it tackles duplicated tracks. Second, a track management system (TMS) relying on a revamped track existence probability fusion is proposed, contributing to efficient false track filtering and continuous object tracking. The proposed methodology is evaluated on real-world data of a frontal perception system. The results show that the proposed association outperforms the conventional methods; still, it maintains a favorable complexity, contributing to real-time applicability. The TMS relying on the revamped existence probability fusion can efficiently filter false tracks and continuously track objects. Moreover, the resulting overall track-to-track fusion outperforms the state-of-the-art multiobject tracking-based fusion algorithms.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice