{"title":"利用贝叶斯神经网络和空间先验进行自我训练,实现裂缝分割中的无监督域适应","authors":"Pang-jo Chun, Toshiya Kikuta","doi":"10.1111/mice.13315","DOIUrl":null,"url":null,"abstract":"<p>This study proposes a novel self-training framework for unsupervised domain adaptation in the segmentation of concrete wall cracks using accumulated crack data. The proposed method incorporates Bayesian neural networks for uncertainty estimation of pseudo-labels, and spatial priors of cracks for screening noisy labels. Experiments demonstrate that the proposed approach achieves significant improvements in F1 score. Comparing the F1 scores, Bayesian DeepLabv3+ and Bayesian U-Net showed performance improvements of 0.0588 and 0.1501, respectively, after domain adaptation. Furthermore, the integration of Stable Diffusion for few-shot image generation enhances domain adaptation performance by 0.0332. The proposed framework enables high-precision crack segmentation with as few as 100 target images, which can be easily obtained at the site, reducing the cost of model deployment in infrastructure maintenance. The study also investigates the optimal number of iterations for domain adaptation based on the uncertainty score, providing insights for practical implementation. The proposed method contributes to the development of efficient and automated structural health monitoring using AI.</p>","PeriodicalId":156,"journal":{"name":"Computer-Aided Civil and Infrastructure Engineering","volume":"39 17","pages":"2642-2661"},"PeriodicalIF":8.5000,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/mice.13315","citationCount":"0","resultStr":"{\"title\":\"Self-training with Bayesian neural networks and spatial priors for unsupervised domain adaptation in crack segmentation\",\"authors\":\"Pang-jo Chun, Toshiya Kikuta\",\"doi\":\"10.1111/mice.13315\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>This study proposes a novel self-training framework for unsupervised domain adaptation in the segmentation of concrete wall cracks using accumulated crack data. The proposed method incorporates Bayesian neural networks for uncertainty estimation of pseudo-labels, and spatial priors of cracks for screening noisy labels. Experiments demonstrate that the proposed approach achieves significant improvements in F1 score. Comparing the F1 scores, Bayesian DeepLabv3+ and Bayesian U-Net showed performance improvements of 0.0588 and 0.1501, respectively, after domain adaptation. Furthermore, the integration of Stable Diffusion for few-shot image generation enhances domain adaptation performance by 0.0332. The proposed framework enables high-precision crack segmentation with as few as 100 target images, which can be easily obtained at the site, reducing the cost of model deployment in infrastructure maintenance. The study also investigates the optimal number of iterations for domain adaptation based on the uncertainty score, providing insights for practical implementation. The proposed method contributes to the development of efficient and automated structural health monitoring using AI.</p>\",\"PeriodicalId\":156,\"journal\":{\"name\":\"Computer-Aided Civil and Infrastructure Engineering\",\"volume\":\"39 17\",\"pages\":\"2642-2661\"},\"PeriodicalIF\":8.5000,\"publicationDate\":\"2024-07-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1111/mice.13315\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer-Aided Civil and Infrastructure Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/mice.13315\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer-Aided Civil and Infrastructure Engineering","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/mice.13315","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
摘要
本研究提出了一种新颖的自我训练框架,用于利用累积的裂缝数据对混凝土墙裂缝进行无监督领域适应性分割。所提出的方法结合了贝叶斯神经网络来估计伪标签的不确定性,并结合了裂缝的空间先验来筛选噪声标签。实验证明,所提出的方法显著提高了 F1 分数。比较 F1 分数,贝叶斯 DeepLabv3+ 和贝叶斯 U-Net 经过领域适应后,性能分别提高了 0.0588 和 0.1501。此外,将稳定扩散整合到少帧图像生成中,域适应性能提高了 0.0332。所提出的框架只需 100 张目标图像就能实现高精度的裂缝分割,这些图像可在现场轻松获取,从而降低了在基础设施维护中部署模型的成本。该研究还根据不确定性得分研究了领域适应的最佳迭代次数,为实际应用提供了启示。所提出的方法有助于利用人工智能开发高效、自动化的结构健康监测。
Self-training with Bayesian neural networks and spatial priors for unsupervised domain adaptation in crack segmentation
This study proposes a novel self-training framework for unsupervised domain adaptation in the segmentation of concrete wall cracks using accumulated crack data. The proposed method incorporates Bayesian neural networks for uncertainty estimation of pseudo-labels, and spatial priors of cracks for screening noisy labels. Experiments demonstrate that the proposed approach achieves significant improvements in F1 score. Comparing the F1 scores, Bayesian DeepLabv3+ and Bayesian U-Net showed performance improvements of 0.0588 and 0.1501, respectively, after domain adaptation. Furthermore, the integration of Stable Diffusion for few-shot image generation enhances domain adaptation performance by 0.0332. The proposed framework enables high-precision crack segmentation with as few as 100 target images, which can be easily obtained at the site, reducing the cost of model deployment in infrastructure maintenance. The study also investigates the optimal number of iterations for domain adaptation based on the uncertainty score, providing insights for practical implementation. The proposed method contributes to the development of efficient and automated structural health monitoring using AI.
期刊介绍:
Computer-Aided Civil and Infrastructure Engineering stands as a scholarly, peer-reviewed archival journal, serving as a vital link between advancements in computer technology and civil and infrastructure engineering. The journal serves as a distinctive platform for the publication of original articles, spotlighting novel computational techniques and inventive applications of computers. Specifically, it concentrates on recent progress in computer and information technologies, fostering the development and application of emerging computing paradigms.
Encompassing a broad scope, the journal addresses bridge, construction, environmental, highway, geotechnical, structural, transportation, and water resources engineering. It extends its reach to the management of infrastructure systems, covering domains such as highways, bridges, pavements, airports, and utilities. The journal delves into areas like artificial intelligence, cognitive modeling, concurrent engineering, database management, distributed computing, evolutionary computing, fuzzy logic, genetic algorithms, geometric modeling, internet-based technologies, knowledge discovery and engineering, machine learning, mobile computing, multimedia technologies, networking, neural network computing, optimization and search, parallel processing, robotics, smart structures, software engineering, virtual reality, and visualization techniques.