基于融合LOF-DBSCAN算法的气体流量计异常数据检测

Xichao Yue, Chaoqun Wang, Yong Wang, Le Chen, Weifei Wang, Yuhang Lei
{"title":"基于融合LOF-DBSCAN算法的气体流量计异常数据检测","authors":"Xichao Yue, Chaoqun Wang, Yong Wang, Le Chen, Weifei Wang, Yuhang Lei","doi":"10.1145/3581807.3581881","DOIUrl":null,"url":null,"abstract":"Anomaly detection for gas flowmeter data is one of the important means to improve the reliability of fair trade of natural gas transmission and distribution. However, the field environment of natural gas in the industrial scene has the characteristics of complex anomaly categories and difficult to distinguish some anomalies. At the same time, the traditional anomaly detection methods are difficult to accurately analyze the abnormal state for a period of time, and are easy to be disturbed by many factors. For example, although DBSCAN (density based spatial clustering of applications with noise) can cluster dense data sets of arbitrary shape, it will greatly affect the classification effect of data sets with uneven density, and the noise points will also interfere to a certain extent, resulting in the weakening of the ability of the algorithm to distinguish anomalies. LOF(local outliers factor) algorithm realizes outlier detection by calculating the local density deviation of a given data point relative to its neighborhood. In view of the above problems. A more accurate anomaly detection strategy is proposed. Firstly, the local anomaly factor algorithm is used to eliminate outliers with too large LOF value, so as to reduce the clustering effect of DBSCAN due to uneven density as much as possible. Experiments show that the clustering effect of this strategy is significantly improved compared with the traditional detection methods.","PeriodicalId":292813,"journal":{"name":"Proceedings of the 2022 11th International Conference on Computing and Pattern Recognition","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Gas flow meter anomaly data detection based on fused LOF-DBSCAN algorithm\",\"authors\":\"Xichao Yue, Chaoqun Wang, Yong Wang, Le Chen, Weifei Wang, Yuhang Lei\",\"doi\":\"10.1145/3581807.3581881\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Anomaly detection for gas flowmeter data is one of the important means to improve the reliability of fair trade of natural gas transmission and distribution. However, the field environment of natural gas in the industrial scene has the characteristics of complex anomaly categories and difficult to distinguish some anomalies. At the same time, the traditional anomaly detection methods are difficult to accurately analyze the abnormal state for a period of time, and are easy to be disturbed by many factors. For example, although DBSCAN (density based spatial clustering of applications with noise) can cluster dense data sets of arbitrary shape, it will greatly affect the classification effect of data sets with uneven density, and the noise points will also interfere to a certain extent, resulting in the weakening of the ability of the algorithm to distinguish anomalies. LOF(local outliers factor) algorithm realizes outlier detection by calculating the local density deviation of a given data point relative to its neighborhood. In view of the above problems. A more accurate anomaly detection strategy is proposed. Firstly, the local anomaly factor algorithm is used to eliminate outliers with too large LOF value, so as to reduce the clustering effect of DBSCAN due to uneven density as much as possible. Experiments show that the clustering effect of this strategy is significantly improved compared with the traditional detection methods.\",\"PeriodicalId\":292813,\"journal\":{\"name\":\"Proceedings of the 2022 11th International Conference on Computing and Pattern Recognition\",\"volume\":\"12 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2022 11th International Conference on Computing and Pattern Recognition\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3581807.3581881\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2022 11th International Conference on Computing and Pattern Recognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3581807.3581881","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

天然气流量计数据异常检测是提高天然气输配公平交易可靠性的重要手段之一。然而,工业场景天然气现场环境具有异常类别复杂、部分异常难以识别的特点。同时,传统的异常检测方法难以对一段时间内的异常状态进行准确分析,容易受到多种因素的干扰。例如,DBSCAN (density based spatial clustering of applications with noise)虽然可以对任意形状的密集数据集进行聚类,但会极大地影响密度不均匀数据集的分类效果,并且噪声点也会在一定程度上产生干扰,导致算法区分异常的能力减弱。LOF(local outliers factor)算法通过计算给定数据点相对于其邻域的局部密度偏差来实现离群点检测。鉴于以上问题。提出了一种更精确的异常检测策略。首先,采用局部异常因子算法剔除LOF值过大的离群点,尽可能降低DBSCAN因密度不均匀造成的聚类效果。实验表明,与传统检测方法相比,该策略的聚类效果有了显著提高。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Gas flow meter anomaly data detection based on fused LOF-DBSCAN algorithm
Anomaly detection for gas flowmeter data is one of the important means to improve the reliability of fair trade of natural gas transmission and distribution. However, the field environment of natural gas in the industrial scene has the characteristics of complex anomaly categories and difficult to distinguish some anomalies. At the same time, the traditional anomaly detection methods are difficult to accurately analyze the abnormal state for a period of time, and are easy to be disturbed by many factors. For example, although DBSCAN (density based spatial clustering of applications with noise) can cluster dense data sets of arbitrary shape, it will greatly affect the classification effect of data sets with uneven density, and the noise points will also interfere to a certain extent, resulting in the weakening of the ability of the algorithm to distinguish anomalies. LOF(local outliers factor) algorithm realizes outlier detection by calculating the local density deviation of a given data point relative to its neighborhood. In view of the above problems. A more accurate anomaly detection strategy is proposed. Firstly, the local anomaly factor algorithm is used to eliminate outliers with too large LOF value, so as to reduce the clustering effect of DBSCAN due to uneven density as much as possible. Experiments show that the clustering effect of this strategy is significantly improved compared with the traditional detection methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Multi-Scale Channel Attention for Chinese Scene Text Recognition Vehicle Re-identification Based on Multi-Scale Attention Feature Fusion Comparative Study on EEG Feature Recognition based on Deep Belief Network VA-TransUNet: A U-shaped Medical Image Segmentation Network with Visual Attention Traffic Flow Forecasting Research Based on Delay Reconstruction and GRU-SVR
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1