首页 > 最新文献

2022 25th International Conference on Information Fusion (FUSION)最新文献

英文 中文
Combined Road Tracking for Paved Roads and Dirt Roads: LiDAR Measurements and Image Color Modes 路面和土路的综合道路跟踪:激光雷达测量和图像颜色模式
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841321
Bianca Forkel, Hans-Joachim Wünsche
Much research has been done on the detection and tracking of paved, preferably marked roads. Less work is available on the detection of dirt roads. The challenge is to provide a framework to track both paved roads and dirt roads. In this paper, we are addressing the problem of developing measurement approaches working for both kinds of roads likewise. For that we fuse LiDAR with vision: First, we present indirect measurements from a static environment model populated with LiDAR data, as well as a new approach for LiDAR measurements from a segmented point cloud. Second, we investigate different image color modes to improve the effectiveness of locating dirt road boundaries using local oriented edge detection. We demonstrate the robustness of our measurements on difficult roads by showing qualitative results from our autonomous vehicles.
在检测和跟踪铺砌的道路(最好是有标记的道路)方面已经做了很多研究。检测土路的工作较少。挑战在于提供一个框架来跟踪铺砌道路和土路。在本文中,我们正在解决开发同样适用于这两种道路的测量方法的问题。为此,我们将激光雷达与视觉融合在一起:首先,我们提出了一个由激光雷达数据填充的静态环境模型的间接测量,以及一种从分割点云进行激光雷达测量的新方法。其次,我们研究了不同的图像颜色模式,以提高使用局部定向边缘检测定位土路边界的有效性。我们通过展示自动驾驶汽车的定性结果,证明了我们在困难道路上测量的稳健性。
{"title":"Combined Road Tracking for Paved Roads and Dirt Roads: LiDAR Measurements and Image Color Modes","authors":"Bianca Forkel, Hans-Joachim Wünsche","doi":"10.23919/fusion49751.2022.9841321","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841321","url":null,"abstract":"Much research has been done on the detection and tracking of paved, preferably marked roads. Less work is available on the detection of dirt roads. The challenge is to provide a framework to track both paved roads and dirt roads. In this paper, we are addressing the problem of developing measurement approaches working for both kinds of roads likewise. For that we fuse LiDAR with vision: First, we present indirect measurements from a static environment model populated with LiDAR data, as well as a new approach for LiDAR measurements from a segmented point cloud. Second, we investigate different image color modes to improve the effectiveness of locating dirt road boundaries using local oriented edge detection. We demonstrate the robustness of our measurements on difficult roads by showing qualitative results from our autonomous vehicles.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115712987","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A Learning Distributed Gaussian Process Approach for Target Tracking over Sensor Networks 传感器网络目标跟踪的学习分布高斯过程方法
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841315
Xingchi Liu, Chenyi Lyu, Jemin George, T. Pham, L. Mihaylova
Tracking manoeuvring targets often relies on complex models with non-stationary parameters. Gaussian process (GP) based model-free methods can achieve accurate performance in a data-driven manner but face scalability challenges. Aiming to address such challenges, this paper proposes a distributed GP-based tracking approach able to learn the kernel hyperparameters in an online manner, to improve the tracking performance and scalability. It caters to the inherent distributed feature of sensor networks and does not need measurements to be transmitted among sensors for target states predictions. Theoretical upper confidence bounds about the tracking error are derived within the regret bound setting. Through this theoretical analysis, the tracking error per time step is upper bounded as a function of predictive variances from local sensors. The theoretical results are supported by simulation based ones over a case study for tracking over wireless sensor networks. With evaluation on challenging target trajectories, a comparison on state-of-the-art centralised and distributed GP approaches, numerical results demonstrate that the proposed approach achieves competitively high and robust tracking performance.
机动目标的跟踪往往依赖于具有非平稳参数的复杂模型。基于高斯过程(GP)的无模型方法可以在数据驱动的情况下获得准确的性能,但面临可扩展性的挑战。针对这些挑战,本文提出了一种基于分布式gp的跟踪方法,该方法能够在线学习内核超参数,以提高跟踪性能和可扩展性。它迎合了传感器网络固有的分布式特征,并且不需要在传感器之间传输测量值来进行目标状态预测。在后悔界设置范围内推导了跟踪误差的理论置信上限。通过理论分析,每个时间步长的跟踪误差作为局部传感器预测方差的函数是有上限的。基于无线传感器网络跟踪实例的仿真结果支持了理论结果。通过对具有挑战性的目标轨迹进行评估,比较了目前最先进的集中式和分布式GP方法,数值结果表明,该方法具有较高的鲁棒性。
{"title":"A Learning Distributed Gaussian Process Approach for Target Tracking over Sensor Networks","authors":"Xingchi Liu, Chenyi Lyu, Jemin George, T. Pham, L. Mihaylova","doi":"10.23919/fusion49751.2022.9841315","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841315","url":null,"abstract":"Tracking manoeuvring targets often relies on complex models with non-stationary parameters. Gaussian process (GP) based model-free methods can achieve accurate performance in a data-driven manner but face scalability challenges. Aiming to address such challenges, this paper proposes a distributed GP-based tracking approach able to learn the kernel hyperparameters in an online manner, to improve the tracking performance and scalability. It caters to the inherent distributed feature of sensor networks and does not need measurements to be transmitted among sensors for target states predictions. Theoretical upper confidence bounds about the tracking error are derived within the regret bound setting. Through this theoretical analysis, the tracking error per time step is upper bounded as a function of predictive variances from local sensors. The theoretical results are supported by simulation based ones over a case study for tracking over wireless sensor networks. With evaluation on challenging target trajectories, a comparison on state-of-the-art centralised and distributed GP approaches, numerical results demonstrate that the proposed approach achieves competitively high and robust tracking performance.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114829127","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Drone Ego-Noise Cancellation for Improved Speech Capture using Deep Convolutional Autoencoder Assisted Multistage Beamforming 使用深度卷积自编码器辅助多级波束形成改进语音捕获的无人机自我噪声消除
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841383
Yanjue Song, Stijn Kindt, N. Madhu
We propose a multistage approach for enhancing speech captured by a drone-mounted microphone array. The key challenge is suppressing the drone ego-noise, which is the major source of interference in such captures. Since the location of the target is not known a priori, we first apply a UNet-based deep convolutional autoencoder (AE) individually to each microphone signal. The AE generates a time-frequency mask ∈ [0, 1] per signal, where high values correspond to time-frequency points with relatively good signal-to-noise ratios (SNRs). The masks are pooled across all microphones and the aggregated mask is used to steer an adaptive, frequency domain beamformer, yielding a signal with an improved SNR. This beamformer output, after being fed back to the AE, now yields an improved mask - which is used for re-focussing the beamformer. This combination of AE and beamformer, which can be applied to the signals in multiple ‘passes' is termed multistage beamforming. The approach is developed and evaluated on a self-collected database. For the AE - when used to steer a beamformer - a training target that preserves more speech at the cost of less noise suppression outperforms an aggressive training target that suppresses more noise at the cost of more speech distortion. This, in combination with max-pooling of the multi-channel mask - which also lets through more speech (and noise) compared with median pooling - performs best. The experiments further demonstrate that the multistage approach brings extra benefit to the speech quality and intelligibility when the input SNR is 2:-10 dB, and yields comprehensible outputs when the input has a SNR above -5 dB.
我们提出了一种多阶段的方法来增强由无人机安装的麦克风阵列捕获的语音。关键的挑战是抑制无人机的自我噪声,这是这种捕获的主要干扰源。由于目标位置先验未知,我们首先对每个麦克风信号分别应用基于unet的深度卷积自编码器(AE)。声发射对每个信号产生时频掩模∈[0,1],其中高值对应于信噪比相对较好的时频点。掩模汇集在所有麦克风上,聚合掩模用于引导自适应频域波束形成器,产生具有改进信噪比的信号。这个波束形成器输出,被反馈到AE后,现在产生一个改进的掩模-用于重新聚焦波束形成器。这种声发射和波束形成的结合,可以应用于多个“通道”的信号,称为多级波束形成。该方法是在一个自行收集的数据库上开发和评估的。对于声发射,当用于引导波束形成器时,以较少噪声抑制为代价保留更多语音的训练目标优于以更多语音失真为代价抑制更多噪声的激进训练目标。这与多通道掩码的最大池化相结合——与中位数池化相比,它也允许通过更多的语音(和噪声)——表现最好。实验进一步证明,当输入信噪比为2:-10 dB时,多级方法对语音质量和可理解性有额外的好处,当输入信噪比大于-5 dB时,多级方法可以产生可理解的输出。
{"title":"Drone Ego-Noise Cancellation for Improved Speech Capture using Deep Convolutional Autoencoder Assisted Multistage Beamforming","authors":"Yanjue Song, Stijn Kindt, N. Madhu","doi":"10.23919/fusion49751.2022.9841383","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841383","url":null,"abstract":"We propose a multistage approach for enhancing speech captured by a drone-mounted microphone array. The key challenge is suppressing the drone ego-noise, which is the major source of interference in such captures. Since the location of the target is not known a priori, we first apply a UNet-based deep convolutional autoencoder (AE) individually to each microphone signal. The AE generates a time-frequency mask ∈ [0, 1] per signal, where high values correspond to time-frequency points with relatively good signal-to-noise ratios (SNRs). The masks are pooled across all microphones and the aggregated mask is used to steer an adaptive, frequency domain beamformer, yielding a signal with an improved SNR. This beamformer output, after being fed back to the AE, now yields an improved mask - which is used for re-focussing the beamformer. This combination of AE and beamformer, which can be applied to the signals in multiple ‘passes' is termed multistage beamforming. The approach is developed and evaluated on a self-collected database. For the AE - when used to steer a beamformer - a training target that preserves more speech at the cost of less noise suppression outperforms an aggressive training target that suppresses more noise at the cost of more speech distortion. This, in combination with max-pooling of the multi-channel mask - which also lets through more speech (and noise) compared with median pooling - performs best. The experiments further demonstrate that the multistage approach brings extra benefit to the speech quality and intelligibility when the input SNR is 2:-10 dB, and yields comprehensible outputs when the input has a SNR above -5 dB.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127427684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Multimodal feature fusion for concreteness estimation 基于多模态特征融合的混凝土估计
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841390
Francesca Incitti, L. Snidaro
In recent years the idea of fusing diverse type of information has often been employed to solve various Deep Learning tasks. Whether these regard an NLP problem or a Machine Vision one, the concept of using more inputs of the same type has been the basis of many studies. Considering NLP problems, attempts of different word embeddings have already been tried, managing to make improvements to the most common benchmarks. Here we want to explore the combination not only of different types of input together, but also different data modalities. This is done by fusing two popular word embeddings together, mainly ELMo and BERT, with other inputs that embed a visual description of the analysed text. Doing so, different modalities -textual and visual- are both employed to solve a textual problem, a concreteness task. Multimodal feature fusion is here explored through several techniques: input redundancy, concatenation, average, dimensionality reduction and augmentation. By combining these techniques it is possible to generate different vector representations: the goal is to understand which feature fusion techniques allow to obtain more accurate embeddings.
近年来,融合不同类型信息的思想经常被用于解决各种深度学习任务。无论是NLP问题还是机器视觉问题,使用相同类型的更多输入的概念已经成为许多研究的基础。考虑到NLP问题,已经尝试了不同的词嵌入,设法对最常见的基准进行改进。在这里,我们不仅要探索不同类型输入的组合,还要探索不同数据模式的组合。这是通过融合两种流行的词嵌入来完成的,主要是ELMo和BERT,以及其他嵌入分析文本的视觉描述的输入。这样,不同的模式——文本和视觉——都被用来解决文本问题,一个具体的任务。本文通过输入冗余、连接、平均、降维和增强等技术探讨了多模态特征融合。通过结合这些技术,可以生成不同的向量表示:目标是了解哪种特征融合技术可以获得更准确的嵌入。
{"title":"Multimodal feature fusion for concreteness estimation","authors":"Francesca Incitti, L. Snidaro","doi":"10.23919/fusion49751.2022.9841390","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841390","url":null,"abstract":"In recent years the idea of fusing diverse type of information has often been employed to solve various Deep Learning tasks. Whether these regard an NLP problem or a Machine Vision one, the concept of using more inputs of the same type has been the basis of many studies. Considering NLP problems, attempts of different word embeddings have already been tried, managing to make improvements to the most common benchmarks. Here we want to explore the combination not only of different types of input together, but also different data modalities. This is done by fusing two popular word embeddings together, mainly ELMo and BERT, with other inputs that embed a visual description of the analysed text. Doing so, different modalities -textual and visual- are both employed to solve a textual problem, a concreteness task. Multimodal feature fusion is here explored through several techniques: input redundancy, concatenation, average, dimensionality reduction and augmentation. By combining these techniques it is possible to generate different vector representations: the goal is to understand which feature fusion techniques allow to obtain more accurate embeddings.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"60 7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127582579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Improved B-spline Extended Object Tracking Model using the Iterative Closest Point Method 基于迭代最近点法的改进b样条扩展目标跟踪模型
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841363
Karl-Magnus Dahlen, Christopher Lindberg, Masaki Yoneda, T. Ogawa
A star-convex shape based on Cartesian B-splines provides a good model for detailed extended target tracking, suited for, e.g., high resolution automotive sensors. Motivated by real-world sensor data from traffic scenarios, we present an extended object tracking filter that (i) solves the problem of bad object initialization for contour tracking of mixed-size vehicles in a range of common traffic scenarios; (ii) enables accurate tracking of objects such as motorcycles, that generates detections distributed on the surface, rather than on the contour. Our approach is based on star-convex Cartesian B-spline polynomials, iterative closest point (ICP) and the convex hull. In particular, we implement the ICP algorithm to find the translation and rotation of the contour that best fit the sensor point cloud. We show that, while the original B-spline filter with a “second-time-step-initialization-procedure” fails to robustly track the object, our approach performs on par to the original B-spline filter with ground truth initialization. Furthermore, for targets generating detections on the surface, we utilize the convex hull algorithm on the point cloud. We show that our algorithm successfully tracks the object, while the original B-spline filter fails to robustly track the contour of a motorcycle.
基于笛卡尔b样条的星凸形状为详细的扩展目标跟踪提供了良好的模型,适用于高分辨率汽车传感器等。基于来自交通场景的真实传感器数据,我们提出了一种扩展的目标跟踪滤波器,该滤波器(i)解决了一系列常见交通场景中混合大小车辆轮廓跟踪的不良目标初始化问题;(ii)能够精确跟踪诸如摩托车之类的物体,从而产生分布在表面而不是轮廓上的检测。我们的方法是基于星凸笛卡尔b样条多项式,迭代最近点(ICP)和凸包。特别地,我们实现了ICP算法来寻找最适合传感器点云的轮廓的平移和旋转。我们表明,虽然具有“第二次时间步初始化过程”的原始b样条滤波器不能鲁棒地跟踪对象,但我们的方法与具有ground truth初始化的原始b样条滤波器的性能相当。此外,对于在表面上生成检测的目标,我们在点云上使用凸包算法。我们的算法成功地跟踪了目标,而原始的b样条滤波器无法鲁棒跟踪摩托车的轮廓。
{"title":"An Improved B-spline Extended Object Tracking Model using the Iterative Closest Point Method","authors":"Karl-Magnus Dahlen, Christopher Lindberg, Masaki Yoneda, T. Ogawa","doi":"10.23919/fusion49751.2022.9841363","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841363","url":null,"abstract":"A star-convex shape based on Cartesian B-splines provides a good model for detailed extended target tracking, suited for, e.g., high resolution automotive sensors. Motivated by real-world sensor data from traffic scenarios, we present an extended object tracking filter that (i) solves the problem of bad object initialization for contour tracking of mixed-size vehicles in a range of common traffic scenarios; (ii) enables accurate tracking of objects such as motorcycles, that generates detections distributed on the surface, rather than on the contour. Our approach is based on star-convex Cartesian B-spline polynomials, iterative closest point (ICP) and the convex hull. In particular, we implement the ICP algorithm to find the translation and rotation of the contour that best fit the sensor point cloud. We show that, while the original B-spline filter with a “second-time-step-initialization-procedure” fails to robustly track the object, our approach performs on par to the original B-spline filter with ground truth initialization. Furthermore, for targets generating detections on the surface, we utilize the convex hull algorithm on the point cloud. We show that our algorithm successfully tracks the object, while the original B-spline filter fails to robustly track the contour of a motorcycle.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"34 50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123083179","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Efficient Factorisation-based Gaussian Process Approaches for Online Tracking 基于因式高斯过程的在线跟踪方法
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841257
Chenyi Lyu, Xingchi Liu, L. Mihaylova
Target tracking often relies on complex models with non-stationary parameters. Gaussian process (GP) is a model-free method that can achieve accurate performance. However, the inverse of the covariance matrix poses scalability challenges. Since the covariance matrix is typically dense, direct inversion and determinant evaluation methods suffer from cubic complexity to data size. This bottleneck limits the GP for long-term tracking or high-speed tracking. We present an efficient factorisation-based GP approach without any additional hyperparameters. The proposed approach reduces the computational complexity of the Cholesky decomposition by hierarchically factorising the covariance matrix into off-diagonal low-rank parts. Meanwhile, the resulting low-rank approximated Cholesky factor can also reduce the computation complexity of the inverse and the determinant operations. Numerical results based on offline and online tracking problems demonstrate the effectiveness of the proposed approach.
目标跟踪往往依赖于具有非平稳参数的复杂模型。高斯过程(GP)是一种无模型的方法,可以达到精确的性能。然而,协方差矩阵的逆带来了可扩展性的挑战。由于协方差矩阵通常是密集的,直接反演和行列式求值方法在数据大小上存在三次复杂性。这个瓶颈限制了GP进行长期跟踪或高速跟踪。我们提出了一种有效的基于因子分解的GP方法,不需要任何额外的超参数。该方法通过将协方差矩阵分层分解为非对角线低秩部分,降低了Cholesky分解的计算复杂度。同时,得到的低秩近似Cholesky因子也可以降低逆运算和行列式运算的计算复杂度。基于离线和在线跟踪问题的数值结果验证了该方法的有效性。
{"title":"Efficient Factorisation-based Gaussian Process Approaches for Online Tracking","authors":"Chenyi Lyu, Xingchi Liu, L. Mihaylova","doi":"10.23919/fusion49751.2022.9841257","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841257","url":null,"abstract":"Target tracking often relies on complex models with non-stationary parameters. Gaussian process (GP) is a model-free method that can achieve accurate performance. However, the inverse of the covariance matrix poses scalability challenges. Since the covariance matrix is typically dense, direct inversion and determinant evaluation methods suffer from cubic complexity to data size. This bottleneck limits the GP for long-term tracking or high-speed tracking. We present an efficient factorisation-based GP approach without any additional hyperparameters. The proposed approach reduces the computational complexity of the Cholesky decomposition by hierarchically factorising the covariance matrix into off-diagonal low-rank parts. Meanwhile, the resulting low-rank approximated Cholesky factor can also reduce the computation complexity of the inverse and the determinant operations. Numerical results based on offline and online tracking problems demonstrate the effectiveness of the proposed approach.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"1994 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125545699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Residual Colour Scale-Space Gradients for Reference-based Face Morphing Attack Detection 基于参考的人脸变形攻击检测残差色阶空间梯度
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841318
Raghavendra Ramachandra, Guoqiang Li
Face biometrics has become an integral part of the various security and law enforcement applications, including border control scenarios. However, the face recognition systems are vulnerable to the morphing attacks, and thus, it is essential to develop a reliable and robust face Morphing Attack Detection (MAD) techniques. This paper presents a novel approach based on the residual gradients computed from the face image's colour scale-space representation in the reference-based or differential set-up. Thus, the proposed method will take two facial images (one from the passport and another from the trusted device) to compute the residual gradients, which is then classified using Spectral Regression Kernel Discriminant Analysis (SRKDA) to reliable detect the face morphing attacks. Extensive experiments are carried out on two different datasets to benchmark the performance of the proposed method, especially to different morph generation methods, morphing data mediums (digital, print-scan and print-scan compression) and ageing variations. Experimental results demonstrate the improved performance of the proposed method over the state-of-the-art reference-based face MAD in all evaluation protocols.
面部生物识别技术已经成为各种安全和执法应用中不可或缺的一部分,包括边境控制场景。然而,人脸识别系统容易受到变形攻击的攻击,因此,开发一种可靠、鲁棒的人脸变形攻击检测技术至关重要。本文提出了一种基于参考或差分设置中人脸图像颜色尺度空间表示计算残差梯度的新方法。因此,该方法将取两张人脸图像(一张来自护照,另一张来自可信设备)来计算残差梯度,然后使用光谱回归核判别分析(SRKDA)对其进行分类,以可靠地检测人脸变形攻击。在两个不同的数据集上进行了大量的实验,以基准测试所提出方法的性能,特别是不同的变形生成方法,变形数据介质(数字,打印扫描和打印扫描压缩)和老化变化。实验结果表明,在所有评估协议中,所提出的方法都比最先进的基于参考的人脸识别方法具有更高的性能。
{"title":"Residual Colour Scale-Space Gradients for Reference-based Face Morphing Attack Detection","authors":"Raghavendra Ramachandra, Guoqiang Li","doi":"10.23919/fusion49751.2022.9841318","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841318","url":null,"abstract":"Face biometrics has become an integral part of the various security and law enforcement applications, including border control scenarios. However, the face recognition systems are vulnerable to the morphing attacks, and thus, it is essential to develop a reliable and robust face Morphing Attack Detection (MAD) techniques. This paper presents a novel approach based on the residual gradients computed from the face image's colour scale-space representation in the reference-based or differential set-up. Thus, the proposed method will take two facial images (one from the passport and another from the trusted device) to compute the residual gradients, which is then classified using Spectral Regression Kernel Discriminant Analysis (SRKDA) to reliable detect the face morphing attacks. Extensive experiments are carried out on two different datasets to benchmark the performance of the proposed method, especially to different morph generation methods, morphing data mediums (digital, print-scan and print-scan compression) and ageing variations. Experimental results demonstrate the improved performance of the proposed method over the state-of-the-art reference-based face MAD in all evaluation protocols.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130382504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Notes on the Product Multi-Sensor Generalized Labeled Multi-Bernoulli Filter and its Implementation 乘积多传感器广义标记多伯努利滤波器及其实现注解
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841275
M. Herrmann, Tim Luchterhand, Charlotte Hermann, Thomas Wodtko, Jan Strohbeck, M. Buchholz
We previously presented the product multi-sensor generalized labeled multi-Bernoulli filter, which constitutes a multi-object filter for centralized and distributed multi-sensor systems with centralized estimator. It implements the Bayes parallel combination rule for generalized labeled multi-Bernoulli densities, simplifying the NP-hard multidimensional k-best assignment problem of the multi-sensor multi-object update to a polynomial-time k-shortest path problem. This way, the filter allows for efficient, parallelizable, and distributed calculation of the multi-sensor multi-object update, while showing excellent performance. However, the derivation of the filter formulas relies on a well-established approximation of the fundamental multi-sensor Gaussian identity, which was inadvertently not labeled as such in our original article. Thus, on the one hand, we clarify this mistake, discuss its consequences, and present a mathematically clean derivation of the filter yet to establish the claim of Bayes-optimality. On the other hand, we discuss implementation details and present extensive evaluations, that complete the previous publication of the filter.
我们提出了积多传感器广义标记多伯努利滤波器,它构成了具有集中估计器的集中式和分布式多传感器系统的多目标滤波器。它实现了广义标记多伯努利密度的贝叶斯并行组合规则,将多传感器多目标更新的np困难多维k-最佳分配问题简化为多项式时间k-最短路径问题。通过这种方式,该滤波器可以高效、并行和分布式地计算多传感器多目标更新,同时表现出优异的性能。然而,滤波器公式的推导依赖于基本多传感器高斯恒等式的一个完善的近似,这在我们的原始文章中无意中没有被标记为这样。因此,一方面,我们澄清了这个错误,讨论了它的后果,并提出了一个数学上清晰的过滤器推导,但尚未建立贝叶斯最优性的声明。另一方面,我们讨论了实现细节,并给出了广泛的评估,以完成之前发布的过滤器。
{"title":"Notes on the Product Multi-Sensor Generalized Labeled Multi-Bernoulli Filter and its Implementation","authors":"M. Herrmann, Tim Luchterhand, Charlotte Hermann, Thomas Wodtko, Jan Strohbeck, M. Buchholz","doi":"10.23919/fusion49751.2022.9841275","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841275","url":null,"abstract":"We previously presented the product multi-sensor generalized labeled multi-Bernoulli filter, which constitutes a multi-object filter for centralized and distributed multi-sensor systems with centralized estimator. It implements the Bayes parallel combination rule for generalized labeled multi-Bernoulli densities, simplifying the NP-hard multidimensional k-best assignment problem of the multi-sensor multi-object update to a polynomial-time k-shortest path problem. This way, the filter allows for efficient, parallelizable, and distributed calculation of the multi-sensor multi-object update, while showing excellent performance. However, the derivation of the filter formulas relies on a well-established approximation of the fundamental multi-sensor Gaussian identity, which was inadvertently not labeled as such in our original article. Thus, on the one hand, we clarify this mistake, discuss its consequences, and present a mathematically clean derivation of the filter yet to establish the claim of Bayes-optimality. On the other hand, we discuss implementation details and present extensive evaluations, that complete the previous publication of the filter.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116530456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Message passing multitarget tracking with out-of-sequence measurements 消息传递多目标跟踪与乱序测量
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841339
Jingling Li, G. Battistelli, L. Chisci, P. Wei, Lin Gao
This paper considers multitarget tracking under out-of-sequence measurements (OOSMs), i.e. when the measurements processed by the tracker might be out of order. In order to fully exploit information provided by the sensor, OOSMs should be re-utilized rather than being simply discarded so as to improve tracking performance. To this end, this paper proposes a message passing (MP) multitarget tracking algorithm under OOSMs, where MP is adopted to perform efficient association between target and (in-sequence and out-of-sequence) measurements. Simulation experiments show that, compared to simply discarding OOSMs, the accuracy in terms of target number and state estimates can be greatly enhanced by incorporating OOSMs, thus demonstrating the effectiveness of the proposed approach.
本文研究了乱序测量下的多目标跟踪问题,即跟踪器处理的测量可能是乱序的。为了充分利用传感器提供的信息,应该重新利用oosm,而不是简单地丢弃,以提高跟踪性能。为此,本文提出了一种OOSMs下的消息传递(message passing, MP)多目标跟踪算法,该算法采用消息传递(message passing, MP)来实现目标和(序内和序外)测量之间的高效关联。仿真实验表明,与简单地丢弃oosm相比,引入oosm可以大大提高目标数和状态估计的准确性,从而证明了所提方法的有效性。
{"title":"Message passing multitarget tracking with out-of-sequence measurements","authors":"Jingling Li, G. Battistelli, L. Chisci, P. Wei, Lin Gao","doi":"10.23919/fusion49751.2022.9841339","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841339","url":null,"abstract":"This paper considers multitarget tracking under out-of-sequence measurements (OOSMs), i.e. when the measurements processed by the tracker might be out of order. In order to fully exploit information provided by the sensor, OOSMs should be re-utilized rather than being simply discarded so as to improve tracking performance. To this end, this paper proposes a message passing (MP) multitarget tracking algorithm under OOSMs, where MP is adopted to perform efficient association between target and (in-sequence and out-of-sequence) measurements. Simulation experiments show that, compared to simply discarding OOSMs, the accuracy in terms of target number and state estimates can be greatly enhanced by incorporating OOSMs, thus demonstrating the effectiveness of the proposed approach.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129986428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Extended Target Tracking with Constrained PMHT 约束PMHT下的扩展目标跟踪
Pub Date : 2022-07-04 DOI: 10.23919/fusion49751.2022.9841232
Jean-Francois Bariant, Llarina Lobo Palacios, Julia Granitzka, Hanne Groener
This paper aims at adressing specific issues of extended target tracking. Firstly, we propose a method to accurately model the origin of the measurements on the surface of the target. This is achieved by removing the usual hypothesis of the independence of the association of the measurements to possible measurement sources to allow us to assume that a certain number of measurements shall be originating from some specific sources. Secondly, a Gaussian distribution is a poor representation for the length of a target. We developed a method discretizing the length to estimate its distribution without the Gaussian assumption but avoiding the computational burden of a multi-hypothesis tracking for each target. The implementation effectiveness is shown on simulated as well as real data from RADAR.
本文旨在解决扩展目标跟踪的具体问题。首先,我们提出了一种在目标表面精确建模测量原点的方法。这是通过消除通常的假设来实现的,即测量与可能的测量源的关联是独立的,从而允许我们假设一定数量的测量应起源于某些特定的来源。其次,高斯分布不能很好地表示目标的长度。我们提出了一种不使用高斯假设对长度进行离散化来估计其分布的方法,避免了对每个目标进行多假设跟踪的计算负担。仿真和实际雷达数据验证了该方法的有效性。
{"title":"Extended Target Tracking with Constrained PMHT","authors":"Jean-Francois Bariant, Llarina Lobo Palacios, Julia Granitzka, Hanne Groener","doi":"10.23919/fusion49751.2022.9841232","DOIUrl":"https://doi.org/10.23919/fusion49751.2022.9841232","url":null,"abstract":"This paper aims at adressing specific issues of extended target tracking. Firstly, we propose a method to accurately model the origin of the measurements on the surface of the target. This is achieved by removing the usual hypothesis of the independence of the association of the measurements to possible measurement sources to allow us to assume that a certain number of measurements shall be originating from some specific sources. Secondly, a Gaussian distribution is a poor representation for the length of a target. We developed a method discretizing the length to estimate its distribution without the Gaussian assumption but avoiding the computational burden of a multi-hypothesis tracking for each target. The implementation effectiveness is shown on simulated as well as real data from RADAR.","PeriodicalId":176447,"journal":{"name":"2022 25th International Conference on Information Fusion (FUSION)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132643755","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2022 25th International Conference on Information Fusion (FUSION)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1