{"title":"Adversarial Transformer-Based Anomaly Detection for Multivariate Time Series","authors":"Xinying Yu;Kejun Zhang;Yaqi Liu;Bing Zou;Jun Wang;Wenbin Wang;Rong Qian","doi":"10.1109/TII.2024.3507211","DOIUrl":null,"url":null,"abstract":"Anomaly detection in multivariate time series is crucial to monitor system status, such as fault detection in industrial systems. However, detecting anomalies in multivariate time series is challenging due to few labels, complex spatiotemporal correlations, and ultrafast detecting demands. Existing anomaly detection methods rarely address these challenges simultaneously. Herein, we design an adversarial transformers-based unsupervised anomaly detection model (ATUAD). In ATUAD, a Transformer-based encoder–decoder is constructed to learn sequence features, and adversarial training is adopted to amplify mild anomalies and enhance the robustness. Besides, we propose a peak-over-threshold-based dynamic threshold mechanism to improve the anomaly detection performance of ATUAD by automatically determining the threshold. In addition, we provide an anomaly explanation method to help ATUAD pinpoint root causes for anomalies. Comparison experiments, ablation studies, and overhead analysis on public datasets show that ATUAD can outperform the state-of-the-art baseline methods.","PeriodicalId":13301,"journal":{"name":"IEEE Transactions on Industrial Informatics","volume":"21 3","pages":"2471-2480"},"PeriodicalIF":9.9000,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Industrial Informatics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10799207/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Anomaly detection in multivariate time series is crucial to monitor system status, such as fault detection in industrial systems. However, detecting anomalies in multivariate time series is challenging due to few labels, complex spatiotemporal correlations, and ultrafast detecting demands. Existing anomaly detection methods rarely address these challenges simultaneously. Herein, we design an adversarial transformers-based unsupervised anomaly detection model (ATUAD). In ATUAD, a Transformer-based encoder–decoder is constructed to learn sequence features, and adversarial training is adopted to amplify mild anomalies and enhance the robustness. Besides, we propose a peak-over-threshold-based dynamic threshold mechanism to improve the anomaly detection performance of ATUAD by automatically determining the threshold. In addition, we provide an anomaly explanation method to help ATUAD pinpoint root causes for anomalies. Comparison experiments, ablation studies, and overhead analysis on public datasets show that ATUAD can outperform the state-of-the-art baseline methods.
期刊介绍:
The IEEE Transactions on Industrial Informatics is a multidisciplinary journal dedicated to publishing technical papers that connect theory with practical applications of informatics in industrial settings. It focuses on the utilization of information in intelligent, distributed, and agile industrial automation and control systems. The scope includes topics such as knowledge-based and AI-enhanced automation, intelligent computer control systems, flexible and collaborative manufacturing, industrial informatics in software-defined vehicles and robotics, computer vision, industrial cyber-physical and industrial IoT systems, real-time and networked embedded systems, security in industrial processes, industrial communications, systems interoperability, and human-machine interaction.