{"title":"Imbalanced Aircraft Data Anomaly Detection","authors":"Junyu Gao;Hao Yang;Da Zhang;Yuan Yuan;Xuelong Li","doi":"10.1109/TAES.2024.3456748","DOIUrl":null,"url":null,"abstract":"Anomaly detection in temporal data from sensors under aviation scenarios is a practical but challenging task. First, long temporal data are difficult to extract contextual information with temporal correlation, and second, the anomalous data are rare in time series, causing normal/abnormal imbalance in anomaly detection, making the detector classification degenerate or even fail. To remedy the aforementioned problems, we propose a graphical temporal data analysis framework. It consists of three modules, named series-to-image (S2I), cluster-based resampling approach using Euclidean distance (CRD), and variance-based loss (VBL). Specifically, to better extract global information in temporal data from sensors, S2I converts the data to curve images to demonstrate abnormalities in data changes. CRD and VBL balance the classification to mitigate the unequal distribution of classes. CRD extracts minority samples with similar features to majority samples by clustering and oversamples them. And VBL fine-tunes the decision boundary by balancing the fitting degree of the network to each class. Ablation experiments on the Flights dataset indicate the effectiveness of CRD and VBL on precision and recall, respectively. Extensive experiments demonstrate the synergistic advantages of CRD and VBL on F1-score on Flights and three other temporal datasets.","PeriodicalId":13157,"journal":{"name":"IEEE Transactions on Aerospace and Electronic Systems","volume":"61 2","pages":"1422-1432"},"PeriodicalIF":5.7000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Aerospace and Electronic Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10670577/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, AEROSPACE","Score":null,"Total":0}
引用次数: 0
Abstract
Anomaly detection in temporal data from sensors under aviation scenarios is a practical but challenging task. First, long temporal data are difficult to extract contextual information with temporal correlation, and second, the anomalous data are rare in time series, causing normal/abnormal imbalance in anomaly detection, making the detector classification degenerate or even fail. To remedy the aforementioned problems, we propose a graphical temporal data analysis framework. It consists of three modules, named series-to-image (S2I), cluster-based resampling approach using Euclidean distance (CRD), and variance-based loss (VBL). Specifically, to better extract global information in temporal data from sensors, S2I converts the data to curve images to demonstrate abnormalities in data changes. CRD and VBL balance the classification to mitigate the unequal distribution of classes. CRD extracts minority samples with similar features to majority samples by clustering and oversamples them. And VBL fine-tunes the decision boundary by balancing the fitting degree of the network to each class. Ablation experiments on the Flights dataset indicate the effectiveness of CRD and VBL on precision and recall, respectively. Extensive experiments demonstrate the synergistic advantages of CRD and VBL on F1-score on Flights and three other temporal datasets.
航空场景下传感器时序数据的异常检测是一项实际但具有挑战性的任务。首先,长时间数据难以提取具有时间相关性的上下文信息,其次,异常数据在时间序列中很少出现,导致异常检测中的正常/异常不平衡,使检测器分类退化甚至失败。为了解决上述问题,我们提出了一个图形化的时间数据分析框架。它由三个模块组成,分别是序列到图像(S2I)、基于聚类的欧几里得距离(CRD)重采样方法和基于方差的损失(VBL)。具体来说,为了更好地从传感器的时间数据中提取全局信息,S2I将数据转换为曲线图像,以显示数据变化中的异常情况。CRD和VBL平衡了分类,缓解了分类分布的不平等。CRD通过聚类提取与多数样本特征相似的少数样本,并对其进行过采样。VBL通过平衡网络对各类的拟合程度来微调决策边界。在Flights数据集上进行的烧蚀实验表明,CRD和VBL分别在查准率和查全率上具有较好的效果。大量的实验证明了CRD和VBL在F1-score on Flights和其他三个时间数据集上的协同优势。
期刊介绍:
IEEE Transactions on Aerospace and Electronic Systems focuses on the organization, design, development, integration, and operation of complex systems for space, air, ocean, or ground environment. These systems include, but are not limited to, navigation, avionics, spacecraft, aerospace power, radar, sonar, telemetry, defense, transportation, automated testing, and command and control.