Yan Gao , Qingquan Lin , Shuang Ye , Yu Cheng , Tao Zhang , Bin Liang , Weining Lu
{"title":"Outlier detection in temporal and spatial sequences via correlation analysis based on graph neural networks","authors":"Yan Gao , Qingquan Lin , Shuang Ye , Yu Cheng , Tao Zhang , Bin Liang , Weining Lu","doi":"10.1016/j.displa.2024.102775","DOIUrl":null,"url":null,"abstract":"<div><p>Outlier detection is essential for identifying patterns that deviate from expected normal representations in data. Real-world challenges such as the lack of labeled data, noise, and high dimensionality significantly impact the effectiveness of existing methods. Understanding the temporal or spatial correlation of normal data is crucial for detecting or forecasting anomalous patterns. In this paper, we introduce UOSC-GNN, a novel Unsupervised Outlier detection architecture by Sequential Correlation analysis with Graph Neural Network. The architecture includes a deviation generation module to measure the variance between expected and actual states of sequential data. This module incorporates a Generic Feature Extraction component to extract intrinsic features from outliers and normal instances tailored to specific tasks, and an Expected State Estimator component based on Graph Neural Network to learn sequential patterns. To ensure the forecast of outliers with high confidence and improve alarm accuracy, an Outlier Probability Assessment module is introduced. This module combines a rule-based index derived from expert knowledge and a statistical index calculated based on generated deviations. Our method is evaluated on two real-world tasks: medical imaging analysis utilizing spatial-related data and early fault detection of instruments leveraging temporal-related data. The results show that our method triggers alarms about 70 min earlier than the best models on the run-to-failure bearing dataset and achieves an accuracy of 92.82% and a sensitivity of 88.51% on the wireless capsule endoscopy image dataset, outperforming traditional outlier detection algorithms consistently.</p></div>","PeriodicalId":50570,"journal":{"name":"Displays","volume":"84 ","pages":"Article 102775"},"PeriodicalIF":3.7000,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Displays","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0141938224001392","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0
Abstract
Outlier detection is essential for identifying patterns that deviate from expected normal representations in data. Real-world challenges such as the lack of labeled data, noise, and high dimensionality significantly impact the effectiveness of existing methods. Understanding the temporal or spatial correlation of normal data is crucial for detecting or forecasting anomalous patterns. In this paper, we introduce UOSC-GNN, a novel Unsupervised Outlier detection architecture by Sequential Correlation analysis with Graph Neural Network. The architecture includes a deviation generation module to measure the variance between expected and actual states of sequential data. This module incorporates a Generic Feature Extraction component to extract intrinsic features from outliers and normal instances tailored to specific tasks, and an Expected State Estimator component based on Graph Neural Network to learn sequential patterns. To ensure the forecast of outliers with high confidence and improve alarm accuracy, an Outlier Probability Assessment module is introduced. This module combines a rule-based index derived from expert knowledge and a statistical index calculated based on generated deviations. Our method is evaluated on two real-world tasks: medical imaging analysis utilizing spatial-related data and early fault detection of instruments leveraging temporal-related data. The results show that our method triggers alarms about 70 min earlier than the best models on the run-to-failure bearing dataset and achieves an accuracy of 92.82% and a sensitivity of 88.51% on the wireless capsule endoscopy image dataset, outperforming traditional outlier detection algorithms consistently.
期刊介绍:
Displays is the international journal covering the research and development of display technology, its effective presentation and perception of information, and applications and systems including display-human interface.
Technical papers on practical developments in Displays technology provide an effective channel to promote greater understanding and cross-fertilization across the diverse disciplines of the Displays community. Original research papers solving ergonomics issues at the display-human interface advance effective presentation of information. Tutorial papers covering fundamentals intended for display technologies and human factor engineers new to the field will also occasionally featured.