首页 > 最新文献

2021 IEEE 24th International Conference on Information Fusion (FUSION)最新文献

英文 中文
Bayesian Estimation with Artificial Neural Network 基于人工神经网络的贝叶斯估计
Pub Date : 2021-11-01 DOI: 10.23919/fusion49465.2021.9626979
Sehyun Yun, Renato Zanetti
A nonlinear filter based on an artificial neural network (ANN) is proposed to accurately estimate the state of a nonlinear dynamic system. The ANN is trained to learn the nonlinear mapping between the inputs and outputs of training data. The proposed filter is computationally efficient for online applications because estimation error can be directly estimated once the ANN is trained offline. The unscented transformation (UT) is employed in this filter to approximate the first two moments of the estimate. Under the scenarios considered in this paper, it is shown through numerical simulation that the proposed filter leads to better performance than the extended Kalman filter (EKF), unscented Kalman filter (UKF), and a state-of-the-art nonlinear filter.
为了准确估计非线性动态系统的状态,提出了一种基于人工神经网络的非线性滤波器。训练人工神经网络学习训练数据输入和输出之间的非线性映射。所提出的滤波器对于在线应用具有计算效率,因为一旦人工神经网络离线训练,就可以直接估计估计误差。该滤波器采用unscented变换(UT)来近似估计的前两个矩。在本文所考虑的场景下,通过数值模拟表明,所提出的滤波器比扩展卡尔曼滤波器(EKF)、无气味卡尔曼滤波器(UKF)和最先进的非线性滤波器具有更好的性能。
{"title":"Bayesian Estimation with Artificial Neural Network","authors":"Sehyun Yun, Renato Zanetti","doi":"10.23919/fusion49465.2021.9626979","DOIUrl":"https://doi.org/10.23919/fusion49465.2021.9626979","url":null,"abstract":"A nonlinear filter based on an artificial neural network (ANN) is proposed to accurately estimate the state of a nonlinear dynamic system. The ANN is trained to learn the nonlinear mapping between the inputs and outputs of training data. The proposed filter is computationally efficient for online applications because estimation error can be directly estimated once the ANN is trained offline. The unscented transformation (UT) is employed in this filter to approximate the first two moments of the estimate. Under the scenarios considered in this paper, it is shown through numerical simulation that the proposed filter leads to better performance than the extended Kalman filter (EKF), unscented Kalman filter (UKF), and a state-of-the-art nonlinear filter.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128809802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Overview of Machine Learning Methods for Multiple Target Tracking 多目标跟踪的机器学习方法综述
Pub Date : 2021-11-01 DOI: 10.23919/fusion49465.2021.9627045
C. Chong
Traditional multiple target tracking (MTT) algorithms are model-based. Target and sensor models are used to associate measurements, perform track filtering, score possible associations, and find the best association hypothesis. Recent advances in machine learning (ML) have resulted in data-driven model-free methods for MTT, especially in computer vision, where MTT is called multiple object tracking (MOT). This paper presents an overview of ML methods for detection, track filtering, data association, and end-to-end MTT. It assesses the state-of-the-art and presents future research directions.
传统的多目标跟踪算法是基于模型的。目标和传感器模型用于关联测量,执行跟踪过滤,对可能的关联进行评分,并找到最佳关联假设。机器学习(ML)的最新进展导致了MTT的数据驱动无模型方法,特别是在计算机视觉中,MTT被称为多目标跟踪(MOT)。本文概述了用于检测、跟踪过滤、数据关联和端到端MTT的ML方法。它评估了目前的状况,并提出了未来的研究方向。
{"title":"An Overview of Machine Learning Methods for Multiple Target Tracking","authors":"C. Chong","doi":"10.23919/fusion49465.2021.9627045","DOIUrl":"https://doi.org/10.23919/fusion49465.2021.9627045","url":null,"abstract":"Traditional multiple target tracking (MTT) algorithms are model-based. Target and sensor models are used to associate measurements, perform track filtering, score possible associations, and find the best association hypothesis. Recent advances in machine learning (ML) have resulted in data-driven model-free methods for MTT, especially in computer vision, where MTT is called multiple object tracking (MOT). This paper presents an overview of ML methods for detection, track filtering, data association, and end-to-end MTT. It assesses the state-of-the-art and presents future research directions.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131404210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Optimal Sensor Placement for Shooter Localization Using a Genetic Algorithm 基于遗传算法的射击定位传感器优化配置
Pub Date : 2021-11-01 DOI: 10.23919/fusion49465.2021.9626955
Luisa Still, M. Oispuu, W. Koch
This paper proposes a method to find an optimal set of sensor positions for the shooter localization task. Here, optimality is defined in terms of best possible state estimation accuracy given by the Cramér-Rao bound. We derive an optimality criterion, present an application specific genetic algorithm to solve the optimization problem and investigate different scenarios with complete and incomplete measurement data sets and varying number of sensors. As an intermediate step we assume that the shooter state is exactly known. The results show that depending on the available measurement data set, the recommended optimal sensor positions are often unexpected. For all considered scenarios, the applied optimization approach determines the optimal positions reliably.
本文提出了一种寻找射手定位任务中最优传感器位置集的方法。这里,最优性是根据cram - rao界给出的最佳可能状态估计精度来定义的。我们推导了一个最优性准则,提出了一个特定应用的遗传算法来解决优化问题,并研究了具有完整和不完整测量数据集和不同数量传感器的不同场景。作为中间步骤,我们假设射击状态是已知的。结果表明,根据现有的测量数据集,推荐的最佳传感器位置往往是意想不到的。对于所有考虑的场景,应用的优化方法可靠地确定了最优位置。
{"title":"Optimal Sensor Placement for Shooter Localization Using a Genetic Algorithm","authors":"Luisa Still, M. Oispuu, W. Koch","doi":"10.23919/fusion49465.2021.9626955","DOIUrl":"https://doi.org/10.23919/fusion49465.2021.9626955","url":null,"abstract":"This paper proposes a method to find an optimal set of sensor positions for the shooter localization task. Here, optimality is defined in terms of best possible state estimation accuracy given by the Cramér-Rao bound. We derive an optimality criterion, present an application specific genetic algorithm to solve the optimization problem and investigate different scenarios with complete and incomplete measurement data sets and varying number of sensors. As an intermediate step we assume that the shooter state is exactly known. The results show that depending on the available measurement data set, the recommended optimal sensor positions are often unexpected. For all considered scenarios, the applied optimization approach determines the optimal positions reliably.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124365876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Improved Explainability through Uncertainty Estimation in Automatic Target Recognition of SAR Images 利用不确定性估计提高SAR图像自动目标识别的可解释性
Pub Date : 2021-11-01 DOI: 10.23919/fusion49465.2021.9627066
N.D. Blomerus, J. D. Villiers, Willie Nel
There have been numerous advancements in machine learning technologies in recent years, which has led to the application of machine learning algorithms to automatic target recognition. Two key challenges for these methods are the lack of sufficient training datasets and non-transparent deep models. In this paper, experiments are conducted that investigate the application of target detection using a model trained on the MSTAR to detect targets in another dataset, as well as the investigation of uncertainty estimates in Bayesian convolutional neural networks and how these outputs can improve confidence in the model’s predictions. The model can correctly detect targets in the test scene’s, as well as targets not seen from the MSTAR dataset. The output of the Bayesian convolutional neural network is used to create uncertainty heat maps. The epistemic uncertainty is the uncertainty created by the model and aleatoric is created by the data. These heat maps are overlaid on SAR images, thereby aiding in explainability by highlighting regions in the SAR images that exhibit high uncertainty from a classification point of view. Hence, uncertainty estimates from the Bayesian model give insight into the confidence of its predictions and show promise to improve trust between users and the model.
近年来,机器学习技术取得了许多进步,这导致了机器学习算法在自动目标识别中的应用。这些方法面临的两个关键挑战是缺乏足够的训练数据集和不透明的深度模型。本文进行了实验,研究了使用MSTAR训练的模型检测另一个数据集中的目标的应用,以及贝叶斯卷积神经网络中的不确定性估计以及这些输出如何提高模型预测的置信度。该模型可以正确地检测出测试场景中的目标,以及MSTAR数据集中未看到的目标。贝叶斯卷积神经网络的输出用于创建不确定性热图。认知不确定性是由模型产生的不确定性,而任意不确定性是由数据产生的。这些热图叠加在SAR图像上,从而通过突出显示SAR图像中从分类角度来看表现出高度不确定性的区域来帮助解释。因此,来自贝叶斯模型的不确定性估计可以深入了解其预测的可信度,并有望提高用户与模型之间的信任。
{"title":"Improved Explainability through Uncertainty Estimation in Automatic Target Recognition of SAR Images","authors":"N.D. Blomerus, J. D. Villiers, Willie Nel","doi":"10.23919/fusion49465.2021.9627066","DOIUrl":"https://doi.org/10.23919/fusion49465.2021.9627066","url":null,"abstract":"There have been numerous advancements in machine learning technologies in recent years, which has led to the application of machine learning algorithms to automatic target recognition. Two key challenges for these methods are the lack of sufficient training datasets and non-transparent deep models. In this paper, experiments are conducted that investigate the application of target detection using a model trained on the MSTAR to detect targets in another dataset, as well as the investigation of uncertainty estimates in Bayesian convolutional neural networks and how these outputs can improve confidence in the model’s predictions. The model can correctly detect targets in the test scene’s, as well as targets not seen from the MSTAR dataset. The output of the Bayesian convolutional neural network is used to create uncertainty heat maps. The epistemic uncertainty is the uncertainty created by the model and aleatoric is created by the data. These heat maps are overlaid on SAR images, thereby aiding in explainability by highlighting regions in the SAR images that exhibit high uncertainty from a classification point of view. Hence, uncertainty estimates from the Bayesian model give insight into the confidence of its predictions and show promise to improve trust between users and the model.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121968734","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Tuning Multi Object Tracking Systems using Bayesian Optimization 基于贝叶斯优化的多目标跟踪系统调优
Pub Date : 2021-11-01 DOI: 10.23919/fusion49465.2021.9626895
Tobias Fleck, Johann Marius Zöllner
Tracking-by-Detection has become the major paradigm in Multi Object Tracking (MOT) for a large variety of sensors. Regardless of the type of tracking system, hyper parameters are often chosen manually instead of doing a structured search to reveal the full potential of the system.In this work we tackle this problem by utilizing Bayesian Optimization (BO) to tune tracking systems, enabling to find the best combination of hyper parameters for Gaussian Mixture Probability Hypothesis Density Trackers (GM-PHD) in two different tracking applications. We use the Tree-structured Parzen Estimator (TPE) algorithm [1] [2] with an Expected Improvement (EI) acquisition function as a blackbox optimizer. TPE supports to conveniently incorporate domain expert knowledge by modeling prior probability distributions of the search space. In our experiments we use the popular MOTA metric as optimization objective.Evaluation is performed in a simulation scenario with an in depth discussion of the found parameters and a real world example that uses the MOT-20 challenge dataset [3] demonstrates the unconditional applicability of the approach. We finish with a conclusion on Bayesian Optimization for MOT systems and future research.
检测跟踪已成为多目标跟踪(MOT)的主要模式,适用于各种传感器。无论哪种类型的跟踪系统,通常都是手动选择超参数,而不是进行结构化搜索以揭示系统的全部潜力。在这项工作中,我们通过利用贝叶斯优化(BO)来调整跟踪系统来解决这个问题,从而能够在两种不同的跟踪应用中为高斯混合概率假设密度跟踪器(GM-PHD)找到超参数的最佳组合。我们使用树形结构Parzen Estimator (TPE)算法[1][2]和期望改进(EI)获取函数作为黑盒优化器。TPE支持通过对搜索空间的先验概率分布建模,方便地整合领域专家知识。在我们的实验中,我们使用流行的MOTA指标作为优化目标。评估是在模拟场景中进行的,对发现的参数进行了深入的讨论,使用MOT-20挑战数据集的真实世界示例[3]证明了该方法的无条件适用性。最后对交通运输系统的贝叶斯优化进行了总结,并展望了未来的研究方向。
{"title":"Tuning Multi Object Tracking Systems using Bayesian Optimization","authors":"Tobias Fleck, Johann Marius Zöllner","doi":"10.23919/fusion49465.2021.9626895","DOIUrl":"https://doi.org/10.23919/fusion49465.2021.9626895","url":null,"abstract":"Tracking-by-Detection has become the major paradigm in Multi Object Tracking (MOT) for a large variety of sensors. Regardless of the type of tracking system, hyper parameters are often chosen manually instead of doing a structured search to reveal the full potential of the system.In this work we tackle this problem by utilizing Bayesian Optimization (BO) to tune tracking systems, enabling to find the best combination of hyper parameters for Gaussian Mixture Probability Hypothesis Density Trackers (GM-PHD) in two different tracking applications. We use the Tree-structured Parzen Estimator (TPE) algorithm [1] [2] with an Expected Improvement (EI) acquisition function as a blackbox optimizer. TPE supports to conveniently incorporate domain expert knowledge by modeling prior probability distributions of the search space. In our experiments we use the popular MOTA metric as optimization objective.Evaluation is performed in a simulation scenario with an in depth discussion of the found parameters and a real world example that uses the MOT-20 challenge dataset [3] demonstrates the unconditional applicability of the approach. We finish with a conclusion on Bayesian Optimization for MOT systems and future research.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128696248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An embedded platform approach to privacy-centric person re-identification 以隐私为中心的个人身份再识别的嵌入式平台方法
Pub Date : 2021-11-01 DOI: 10.23919/fusion49465.2021.9626896
Nicholas Pym, A. D. Freitas
Systems capable of intelligently monitoring the traffic of people at entrances to enclosed areas enable a variety of useful applications such as improved retail store analytics. However, the real-world implementation of such a system is typically hindered by computationally expensive algorithms and privacy concerns. In this paper, a low-cost privacy-sensitive intelligent monitoring system based on an embedded platform is presented. The key components of the system include a people classification model and a people re-identification model. A detailed description of the optimisation of these components is presented. The developed system is able to detect people entering/exiting a closed area with an accuracy above 99% in real-time. In addition, the system is able to achieve re-identification accuracy above 93% in under 0.7 seconds on an embedded system. Data collected by the system was used for training and it was tested under real-world conditions.
能够在封闭区域入口处智能监控人员流量的系统可以实现各种有用的应用,例如改进零售商店分析。然而,这种系统在现实世界中的实现通常会受到计算成本高昂的算法和隐私问题的阻碍。本文提出了一种基于嵌入式平台的低成本隐私敏感智能监控系统。该系统的关键组件包括人员分类模型和人员再识别模型。详细描述了这些组件的优化。开发的系统能够实时检测进出封闭区域的人员,准确率超过99%。此外,在嵌入式系统上,该系统能够在0.7秒内实现93%以上的再识别精度。该系统收集的数据用于训练,并在实际条件下进行了测试。
{"title":"An embedded platform approach to privacy-centric person re-identification","authors":"Nicholas Pym, A. D. Freitas","doi":"10.23919/fusion49465.2021.9626896","DOIUrl":"https://doi.org/10.23919/fusion49465.2021.9626896","url":null,"abstract":"Systems capable of intelligently monitoring the traffic of people at entrances to enclosed areas enable a variety of useful applications such as improved retail store analytics. However, the real-world implementation of such a system is typically hindered by computationally expensive algorithms and privacy concerns. In this paper, a low-cost privacy-sensitive intelligent monitoring system based on an embedded platform is presented. The key components of the system include a people classification model and a people re-identification model. A detailed description of the optimisation of these components is presented. The developed system is able to detect people entering/exiting a closed area with an accuracy above 99% in real-time. In addition, the system is able to achieve re-identification accuracy above 93% in under 0.7 seconds on an embedded system. Data collected by the system was used for training and it was tested under real-world conditions.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130580749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Toward the Automated Construction of Probabilistic Knowledge Graphs for the Maritime Domain 面向海事领域的概率知识图自动构建研究
Pub Date : 2021-11-01 DOI: 10.23919/FUSION49465.2021.9626935
Fatemeh Shiri, Teresa Wang, Shirui Pan, Xiaojun Chang, Yuan-Fang Li, Gholamreza Haffari, V. Nguyen, Shuang Yu
International maritime crime is becoming increasingly sophisticated, often associated with wider criminal networks. Detecting maritime threats by means of fusing data purely related to physical movement (i.e., those generated by physical sensors, or hard data) is not sufficient. This has led to research and development efforts aimed at combining hard data with other types of data (especially human-generated or soft data). Existing work often assumes that input soft data is available in a structured format, or is focused on extracting certain relevant entities or concepts to accompany or annotate hard data. Much less attention has been given to extracting the rich knowledge about the situations of interest implicitly embedded in the large amount of soft data existing in unstructured formats (such as intelligence reports and news articles). In order to exploit the potentially useful and rich information from such sources, it is necessary to extract not only the relevant entities and concepts, but also their semantic relations, together with the uncertainty associated with the extracted knowledge (i.e., in the form of probabilistic knowledge graphs). This will increase the accuracy of, and confidence in, the extracted knowledge and facilitate subsequent reasoning and learning. To this end, we propose Maritime DeepDive, an initial prototype for the automated construction of probabilistic knowledge graphs from natural language data for the maritime domain. In this paper, we report on the current implementation of Maritime DeepDive, together with preliminary results on extracting probabilistic events from maritime piracy incidents. This pipeline was evaluated on a manually crafted gold standard, yielding promising results.
国际海上犯罪正变得越来越复杂,往往与更广泛的犯罪网络有关。通过融合纯粹与物理运动相关的数据(即由物理传感器或硬数据产生的数据)来检测海上威胁是不够的。这导致了旨在将硬数据与其他类型的数据(特别是人为生成的或软数据)相结合的研究和开发工作。现有的工作通常假设输入的软数据以结构化格式可用,或者专注于提取某些相关实体或概念来伴随或注释硬数据。很少有人关注如何从存在于非结构化格式(如情报报告和新闻文章)中的大量软数据中提取有关感兴趣的情况的丰富知识。为了从这些资源中挖掘潜在的有用和丰富的信息,不仅需要提取相关的实体和概念,还需要提取它们的语义关系,以及与提取的知识相关的不确定性(即以概率知识图的形式)。这将增加提取知识的准确性和信心,并促进后续的推理和学习。为此,我们提出了Maritime DeepDive,这是一个从海事领域的自然语言数据自动构建概率知识图的初始原型。在本文中,我们报告了海上深潜的当前实施情况,以及从海盗事件中提取概率事件的初步结果。该管道在手工制作的金标准上进行评估,产生了有希望的结果。
{"title":"Toward the Automated Construction of Probabilistic Knowledge Graphs for the Maritime Domain","authors":"Fatemeh Shiri, Teresa Wang, Shirui Pan, Xiaojun Chang, Yuan-Fang Li, Gholamreza Haffari, V. Nguyen, Shuang Yu","doi":"10.23919/FUSION49465.2021.9626935","DOIUrl":"https://doi.org/10.23919/FUSION49465.2021.9626935","url":null,"abstract":"International maritime crime is becoming increasingly sophisticated, often associated with wider criminal networks. Detecting maritime threats by means of fusing data purely related to physical movement (i.e., those generated by physical sensors, or hard data) is not sufficient. This has led to research and development efforts aimed at combining hard data with other types of data (especially human-generated or soft data). Existing work often assumes that input soft data is available in a structured format, or is focused on extracting certain relevant entities or concepts to accompany or annotate hard data. Much less attention has been given to extracting the rich knowledge about the situations of interest implicitly embedded in the large amount of soft data existing in unstructured formats (such as intelligence reports and news articles). In order to exploit the potentially useful and rich information from such sources, it is necessary to extract not only the relevant entities and concepts, but also their semantic relations, together with the uncertainty associated with the extracted knowledge (i.e., in the form of probabilistic knowledge graphs). This will increase the accuracy of, and confidence in, the extracted knowledge and facilitate subsequent reasoning and learning. To this end, we propose Maritime DeepDive, an initial prototype for the automated construction of probabilistic knowledge graphs from natural language data for the maritime domain. In this paper, we report on the current implementation of Maritime DeepDive, together with preliminary results on extracting probabilistic events from maritime piracy incidents. This pipeline was evaluated on a manually crafted gold standard, yielding promising results.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132508589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Real-time Activation Pattern Monitoring and Uncertainty Characterisation in Image Classification 图像分类中的实时激活模式监测与不确定度表征
Pub Date : 2021-11-01 DOI: 10.23919/fusion49465.2021.9627071
Shenglin Wang, Peng Wang, L. Mihaylova, Matthew Hill
Deep neural networks (DNNs) have become very popular recently and have proven their potential especially for image classification. However, their performance depends significantly on the network structure and data quality. This paper investigates the performance of DNNs and especially of faster region based convolutional neural networks (R-CNNs), called faster R-CNN when the network testing data differ significantly from the training data. This paper proposes a framework for monitoring the neuron patterns within a faster R-CNN by representing distributions of neuron activation patterns and by calculating corresponding distances between them, with the Kullback-Leibler divergence. The patterns of the activation states of ‘neurons’ within the network can therefore be observed if the faster R-CNN is ‘outside the comfort zone’, mostly when it works with noisy data and data that are significantly different from those used in the training stage. The validation is performed on publicly available datasets: MNIST [1] and PASCAL [2] and demonstrates that the proposed framework can be used for real-time monitoring of supervised classifiers.
深度神经网络(dnn)近年来变得非常流行,并证明了其潜力,特别是在图像分类方面。然而,它们的性能在很大程度上取决于网络结构和数据质量。本文研究了当网络测试数据与训练数据有显著差异时,深度神经网络的性能,特别是基于更快区域的卷积神经网络(R-CNN)的性能,称为更快R-CNN。本文提出了一个框架,通过表示神经元激活模式的分布,并通过计算它们之间的相应距离,用Kullback-Leibler散度来监测更快的R-CNN中的神经元模式。因此,如果更快的R-CNN处于“舒适区之外”,则可以观察到网络中“神经元”的激活状态模式,主要是当它处理噪声数据和与训练阶段使用的数据明显不同的数据时。验证是在公开可用的数据集上进行的:MNIST[1]和PASCAL[2],并证明了所提出的框架可以用于实时监控监督分类器。
{"title":"Real-time Activation Pattern Monitoring and Uncertainty Characterisation in Image Classification","authors":"Shenglin Wang, Peng Wang, L. Mihaylova, Matthew Hill","doi":"10.23919/fusion49465.2021.9627071","DOIUrl":"https://doi.org/10.23919/fusion49465.2021.9627071","url":null,"abstract":"Deep neural networks (DNNs) have become very popular recently and have proven their potential especially for image classification. However, their performance depends significantly on the network structure and data quality. This paper investigates the performance of DNNs and especially of faster region based convolutional neural networks (R-CNNs), called faster R-CNN when the network testing data differ significantly from the training data. This paper proposes a framework for monitoring the neuron patterns within a faster R-CNN by representing distributions of neuron activation patterns and by calculating corresponding distances between them, with the Kullback-Leibler divergence. The patterns of the activation states of ‘neurons’ within the network can therefore be observed if the faster R-CNN is ‘outside the comfort zone’, mostly when it works with noisy data and data that are significantly different from those used in the training stage. The validation is performed on publicly available datasets: MNIST [1] and PASCAL [2] and demonstrates that the proposed framework can be used for real-time monitoring of supervised classifiers.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128027468","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
GPS and IMU Fusion for Human Gait Estimation GPS和IMU融合用于人体步态估计
Pub Date : 2021-11-01 DOI: 10.23919/fusion49465.2021.9627008
J. J. Steckenrider, Brock Crawford, Penny Zheng
This paper proposes a framework for fusing information coming from an independent inertial measurement unit (IMU) and global positioning system (GPS) to deliver robust estimation of human gait. Because these two sensors provide very different kinds of data at different scales and frequencies, a novel approach which fuses global trajectory estimates and back-propagates this information to correct step vectors is put forth here. In several high-fidelity simulations, the proposed technique is shown to improve step estimation error up to 40% in comparison with an IMU-only approach. This work has implications for not only in-the-field biomechanics research, but also cooperative field robotic systems where it may be critical to accurately monitor a person’s position and state in real-time.
本文提出了一种融合独立惯性测量单元(IMU)和全球定位系统(GPS)信息的框架,以实现对人体步态的鲁棒估计。由于这两种传感器在不同的尺度和频率下提供了非常不同的数据,因此提出了一种融合全局轨迹估计并反向传播该信息以校正阶跃向量的新方法。在一些高保真仿真中,与仅使用imu的方法相比,所提出的技术可将步长估计误差提高40%。这项工作不仅对现场生物力学研究有意义,而且对协作式现场机器人系统也有意义,在这些系统中,准确实时监测人的位置和状态可能至关重要。
{"title":"GPS and IMU Fusion for Human Gait Estimation","authors":"J. J. Steckenrider, Brock Crawford, Penny Zheng","doi":"10.23919/fusion49465.2021.9627008","DOIUrl":"https://doi.org/10.23919/fusion49465.2021.9627008","url":null,"abstract":"This paper proposes a framework for fusing information coming from an independent inertial measurement unit (IMU) and global positioning system (GPS) to deliver robust estimation of human gait. Because these two sensors provide very different kinds of data at different scales and frequencies, a novel approach which fuses global trajectory estimates and back-propagates this information to correct step vectors is put forth here. In several high-fidelity simulations, the proposed technique is shown to improve step estimation error up to 40% in comparison with an IMU-only approach. This work has implications for not only in-the-field biomechanics research, but also cooperative field robotic systems where it may be critical to accurately monitor a person’s position and state in real-time.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116542861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Combining LSTM and MDN Networks for traffic forecasting using the Argoverse Dataset 结合LSTM和MDN网络使用Argoverse数据集进行流量预测
Pub Date : 2021-11-01 DOI: 10.23919/fusion49465.2021.9627009
David Schwab, Sean M. O’Rourke, Breton L. Minnehan
Trajectory forecasting is vital to target tracking, autonomous decision making, and other fields critical to the future of autonomous systems. Tracking algorithms, such as the Kalman Filter, require accurate motion models in order to forecast target trajectories and update state estimates given observation data. Unfortunately, accurate motion models are not always easily de- fined. Of particular interest is forecasting in systems with complex agent-to-agent and agent-to-scene interactions, which are often best represented as a multimodal distribution. Various network architectures tackle this multimodal problem in different ways, but the method used in this work is a mixture density network. The network architecture examined in this work, LSTM2MDN, builds off previous research in combining the renowned long- short term memory (LSTM) network with a mixture density network (MDN) in order to develop accurate distributions for output trajectories.
轨迹预测对于目标跟踪、自主决策以及其他对未来自主系统至关重要的领域至关重要。跟踪算法,如卡尔曼滤波,需要精确的运动模型来预测目标轨迹和更新给定观测数据的状态估计。不幸的是,精确的运动模型并不总是容易定义的。特别感兴趣的是具有复杂代理对代理和代理对场景交互的系统的预测,这些交互通常最好表示为多模态分布。不同的网络架构以不同的方式解决这个多模态问题,但在这项工作中使用的方法是混合密度网络。在这项工作中研究的网络架构LSTM2MDN建立在之前的研究基础上,该研究将著名的长短期记忆(LSTM)网络与混合密度网络(MDN)相结合,以便为输出轨迹开发准确的分布。
{"title":"Combining LSTM and MDN Networks for traffic forecasting using the Argoverse Dataset","authors":"David Schwab, Sean M. O’Rourke, Breton L. Minnehan","doi":"10.23919/fusion49465.2021.9627009","DOIUrl":"https://doi.org/10.23919/fusion49465.2021.9627009","url":null,"abstract":"Trajectory forecasting is vital to target tracking, autonomous decision making, and other fields critical to the future of autonomous systems. Tracking algorithms, such as the Kalman Filter, require accurate motion models in order to forecast target trajectories and update state estimates given observation data. Unfortunately, accurate motion models are not always easily de- fined. Of particular interest is forecasting in systems with complex agent-to-agent and agent-to-scene interactions, which are often best represented as a multimodal distribution. Various network architectures tackle this multimodal problem in different ways, but the method used in this work is a mixture density network. The network architecture examined in this work, LSTM2MDN, builds off previous research in combining the renowned long- short term memory (LSTM) network with a mixture density network (MDN) in order to develop accurate distributions for output trajectories.","PeriodicalId":226850,"journal":{"name":"2021 IEEE 24th International Conference on Information Fusion (FUSION)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125299870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2021 IEEE 24th International Conference on Information Fusion (FUSION)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1