Xichao Yue, Chaoqun Wang, Yong Wang, Le Chen, Weifei Wang, Yuhang Lei
{"title":"基于融合LOF-DBSCAN算法的气体流量计异常数据检测","authors":"Xichao Yue, Chaoqun Wang, Yong Wang, Le Chen, Weifei Wang, Yuhang Lei","doi":"10.1145/3581807.3581881","DOIUrl":null,"url":null,"abstract":"Anomaly detection for gas flowmeter data is one of the important means to improve the reliability of fair trade of natural gas transmission and distribution. However, the field environment of natural gas in the industrial scene has the characteristics of complex anomaly categories and difficult to distinguish some anomalies. At the same time, the traditional anomaly detection methods are difficult to accurately analyze the abnormal state for a period of time, and are easy to be disturbed by many factors. For example, although DBSCAN (density based spatial clustering of applications with noise) can cluster dense data sets of arbitrary shape, it will greatly affect the classification effect of data sets with uneven density, and the noise points will also interfere to a certain extent, resulting in the weakening of the ability of the algorithm to distinguish anomalies. LOF(local outliers factor) algorithm realizes outlier detection by calculating the local density deviation of a given data point relative to its neighborhood. In view of the above problems. A more accurate anomaly detection strategy is proposed. Firstly, the local anomaly factor algorithm is used to eliminate outliers with too large LOF value, so as to reduce the clustering effect of DBSCAN due to uneven density as much as possible. Experiments show that the clustering effect of this strategy is significantly improved compared with the traditional detection methods.","PeriodicalId":292813,"journal":{"name":"Proceedings of the 2022 11th International Conference on Computing and Pattern Recognition","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Gas flow meter anomaly data detection based on fused LOF-DBSCAN algorithm\",\"authors\":\"Xichao Yue, Chaoqun Wang, Yong Wang, Le Chen, Weifei Wang, Yuhang Lei\",\"doi\":\"10.1145/3581807.3581881\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Anomaly detection for gas flowmeter data is one of the important means to improve the reliability of fair trade of natural gas transmission and distribution. However, the field environment of natural gas in the industrial scene has the characteristics of complex anomaly categories and difficult to distinguish some anomalies. At the same time, the traditional anomaly detection methods are difficult to accurately analyze the abnormal state for a period of time, and are easy to be disturbed by many factors. For example, although DBSCAN (density based spatial clustering of applications with noise) can cluster dense data sets of arbitrary shape, it will greatly affect the classification effect of data sets with uneven density, and the noise points will also interfere to a certain extent, resulting in the weakening of the ability of the algorithm to distinguish anomalies. LOF(local outliers factor) algorithm realizes outlier detection by calculating the local density deviation of a given data point relative to its neighborhood. In view of the above problems. A more accurate anomaly detection strategy is proposed. Firstly, the local anomaly factor algorithm is used to eliminate outliers with too large LOF value, so as to reduce the clustering effect of DBSCAN due to uneven density as much as possible. Experiments show that the clustering effect of this strategy is significantly improved compared with the traditional detection methods.\",\"PeriodicalId\":292813,\"journal\":{\"name\":\"Proceedings of the 2022 11th International Conference on Computing and Pattern Recognition\",\"volume\":\"12 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2022 11th International Conference on Computing and Pattern Recognition\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3581807.3581881\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2022 11th International Conference on Computing and Pattern Recognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3581807.3581881","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
天然气流量计数据异常检测是提高天然气输配公平交易可靠性的重要手段之一。然而,工业场景天然气现场环境具有异常类别复杂、部分异常难以识别的特点。同时,传统的异常检测方法难以对一段时间内的异常状态进行准确分析,容易受到多种因素的干扰。例如,DBSCAN (density based spatial clustering of applications with noise)虽然可以对任意形状的密集数据集进行聚类,但会极大地影响密度不均匀数据集的分类效果,并且噪声点也会在一定程度上产生干扰,导致算法区分异常的能力减弱。LOF(local outliers factor)算法通过计算给定数据点相对于其邻域的局部密度偏差来实现离群点检测。鉴于以上问题。提出了一种更精确的异常检测策略。首先,采用局部异常因子算法剔除LOF值过大的离群点,尽可能降低DBSCAN因密度不均匀造成的聚类效果。实验表明,与传统检测方法相比,该策略的聚类效果有了显著提高。
Gas flow meter anomaly data detection based on fused LOF-DBSCAN algorithm
Anomaly detection for gas flowmeter data is one of the important means to improve the reliability of fair trade of natural gas transmission and distribution. However, the field environment of natural gas in the industrial scene has the characteristics of complex anomaly categories and difficult to distinguish some anomalies. At the same time, the traditional anomaly detection methods are difficult to accurately analyze the abnormal state for a period of time, and are easy to be disturbed by many factors. For example, although DBSCAN (density based spatial clustering of applications with noise) can cluster dense data sets of arbitrary shape, it will greatly affect the classification effect of data sets with uneven density, and the noise points will also interfere to a certain extent, resulting in the weakening of the ability of the algorithm to distinguish anomalies. LOF(local outliers factor) algorithm realizes outlier detection by calculating the local density deviation of a given data point relative to its neighborhood. In view of the above problems. A more accurate anomaly detection strategy is proposed. Firstly, the local anomaly factor algorithm is used to eliminate outliers with too large LOF value, so as to reduce the clustering effect of DBSCAN due to uneven density as much as possible. Experiments show that the clustering effect of this strategy is significantly improved compared with the traditional detection methods.