{"title":"基于 C-LSTM 的复杂网络数据流中连续异常值的检测方法","authors":"Zhinian Shu, Xiaorong Li","doi":"10.1007/s13198-024-02475-9","DOIUrl":null,"url":null,"abstract":"<p>To enhance the effective detection of abnormal points in complex network data flow, perform multi-dimensional dynamic detection, and establish a more stable and reliable data flow abnormal detection method, a continuous abnormal point detection method for complex network data flow based on C-LSTM is proposed. The features of continuous outliers in complex network data streams are extracted, and a data anomaly detection model is established according to the features. The input features of continuous outliers in complex network data streams are qualitatively and quantitatively transformed into multi-scale anomalies, and the outlier detection based on C-LSTM is realized. The experimental results show that the maximum sensitivity of the proposed method reaches 42%, and the average routing overhead is less than 24 Mb. Regardless of the data in any scenario, the detection accuracy is higher than 0.92, the recall is higher than 0.81, and the F1 value is higher than 0.62. Although there may be some misjudgments or omissions due to noise, the overall detection performance is good.</p>","PeriodicalId":14463,"journal":{"name":"International Journal of System Assurance Engineering and Management","volume":null,"pages":null},"PeriodicalIF":1.6000,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The detection method of continuous outliers in complex network data streams based on C-LSTM\",\"authors\":\"Zhinian Shu, Xiaorong Li\",\"doi\":\"10.1007/s13198-024-02475-9\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>To enhance the effective detection of abnormal points in complex network data flow, perform multi-dimensional dynamic detection, and establish a more stable and reliable data flow abnormal detection method, a continuous abnormal point detection method for complex network data flow based on C-LSTM is proposed. The features of continuous outliers in complex network data streams are extracted, and a data anomaly detection model is established according to the features. The input features of continuous outliers in complex network data streams are qualitatively and quantitatively transformed into multi-scale anomalies, and the outlier detection based on C-LSTM is realized. The experimental results show that the maximum sensitivity of the proposed method reaches 42%, and the average routing overhead is less than 24 Mb. Regardless of the data in any scenario, the detection accuracy is higher than 0.92, the recall is higher than 0.81, and the F1 value is higher than 0.62. Although there may be some misjudgments or omissions due to noise, the overall detection performance is good.</p>\",\"PeriodicalId\":14463,\"journal\":{\"name\":\"International Journal of System Assurance Engineering and Management\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2024-08-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of System Assurance Engineering and Management\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/s13198-024-02475-9\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of System Assurance Engineering and Management","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s13198-024-02475-9","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
The detection method of continuous outliers in complex network data streams based on C-LSTM
To enhance the effective detection of abnormal points in complex network data flow, perform multi-dimensional dynamic detection, and establish a more stable and reliable data flow abnormal detection method, a continuous abnormal point detection method for complex network data flow based on C-LSTM is proposed. The features of continuous outliers in complex network data streams are extracted, and a data anomaly detection model is established according to the features. The input features of continuous outliers in complex network data streams are qualitatively and quantitatively transformed into multi-scale anomalies, and the outlier detection based on C-LSTM is realized. The experimental results show that the maximum sensitivity of the proposed method reaches 42%, and the average routing overhead is less than 24 Mb. Regardless of the data in any scenario, the detection accuracy is higher than 0.92, the recall is higher than 0.81, and the F1 value is higher than 0.62. Although there may be some misjudgments or omissions due to noise, the overall detection performance is good.
期刊介绍:
This Journal is established with a view to cater to increased awareness for high quality research in the seamless integration of heterogeneous technologies to formulate bankable solutions to the emergent complex engineering problems.
Assurance engineering could be thought of as relating to the provision of higher confidence in the reliable and secure implementation of a system’s critical characteristic features through the espousal of a holistic approach by using a wide variety of cross disciplinary tools and techniques. Successful realization of sustainable and dependable products, systems and services involves an extensive adoption of Reliability, Quality, Safety and Risk related procedures for achieving high assurancelevels of performance; also pivotal are the management issues related to risk and uncertainty that govern the practical constraints encountered in their deployment. It is our intention to provide a platform for the modeling and analysis of large engineering systems, among the other aforementioned allied goals of systems assurance engineering, leading to the enforcement of performance enhancement measures. Achieving a fine balance between theory and practice is the primary focus. The Journal only publishes high quality papers that have passed the rigorous peer review procedure of an archival scientific Journal. The aim is an increasing number of submissions, wide circulation and a high impact factor.