An adaptive identification method for outliers in dam deformation monitoring data based on Bayesian model selection and least trimmed squares estimation
Sheng Xiao, Lin Cheng, Chunhui Ma, Jie Yang, Xiaoyan Xu, Jiamin Chen
{"title":"An adaptive identification method for outliers in dam deformation monitoring data based on Bayesian model selection and least trimmed squares estimation","authors":"Sheng Xiao, Lin Cheng, Chunhui Ma, Jie Yang, Xiaoyan Xu, Jiamin Chen","doi":"10.1007/s13349-023-00752-y","DOIUrl":null,"url":null,"abstract":"<p>An important technique for the quantitative analysis of dam deformation state is to establish safety monitoring models using deformation monitoring data. To address the shortcomings of conventional monitoring models, such as difficulty in selecting influencing factors and poor ability to resist the interference of outliers, this paper develops a structural safety monitoring model that can realize adaptive identification of various types of outliers in dam deformation monitoring data. The Bayesian model selection (BMS) method is first introduced to select the explanatory variables with a significant impact on the modeling process. On this basis, robust regression analysis of dam deformation monitoring data is performed by using the least trimmed squares (LTS) estimation. In particular, the recovery of clean data and the regression learning are conducted jointly. Furthermore, the double wedge plot is proposed, a graphical display which indicates outliers and potential level shifts. The engineering example demonstrates that, compared with the widely used multiple linear regression (MLR) model based on least squares (LS) fitting, the robust regression model based on BMS-LTS can not only effectively determine the key influencing factors but also adaptively identify various types of outliers in the regression. This study improves the significance of regression and increases the accuracy of prediction; thus, it has good applicability in anomaly detection of dam monitoring data and quantitative analysis of dam safety behavior.</p>","PeriodicalId":48582,"journal":{"name":"Journal of Civil Structural Health Monitoring","volume":"6 1","pages":""},"PeriodicalIF":3.6000,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Civil Structural Health Monitoring","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s13349-023-00752-y","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0
Abstract
An important technique for the quantitative analysis of dam deformation state is to establish safety monitoring models using deformation monitoring data. To address the shortcomings of conventional monitoring models, such as difficulty in selecting influencing factors and poor ability to resist the interference of outliers, this paper develops a structural safety monitoring model that can realize adaptive identification of various types of outliers in dam deformation monitoring data. The Bayesian model selection (BMS) method is first introduced to select the explanatory variables with a significant impact on the modeling process. On this basis, robust regression analysis of dam deformation monitoring data is performed by using the least trimmed squares (LTS) estimation. In particular, the recovery of clean data and the regression learning are conducted jointly. Furthermore, the double wedge plot is proposed, a graphical display which indicates outliers and potential level shifts. The engineering example demonstrates that, compared with the widely used multiple linear regression (MLR) model based on least squares (LS) fitting, the robust regression model based on BMS-LTS can not only effectively determine the key influencing factors but also adaptively identify various types of outliers in the regression. This study improves the significance of regression and increases the accuracy of prediction; thus, it has good applicability in anomaly detection of dam monitoring data and quantitative analysis of dam safety behavior.
期刊介绍:
The Journal of Civil Structural Health Monitoring (JCSHM) publishes articles to advance the understanding and the application of health monitoring methods for the condition assessment and management of civil infrastructure systems.
JCSHM serves as a focal point for sharing knowledge and experience in technologies impacting the discipline of Civionics and Civil Structural Health Monitoring, especially in terms of load capacity ratings and service life estimation.