在路面裂缝自动检测中消除运动模糊的生成式对抗网络方法

IF 8.5 1区 工程技术 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Computer-Aided Civil and Infrastructure Engineering Pub Date : 2024-05-20 DOI:10.1111/mice.13231
Yu Zhang, Lin Zhang
{"title":"在路面裂缝自动检测中消除运动模糊的生成式对抗网络方法","authors":"Yu Zhang, Lin Zhang","doi":"10.1111/mice.13231","DOIUrl":null,"url":null,"abstract":"Advancements in infrastructure management have significantly benefited from automatic pavement crack detection systems, relying on image processing enhanced by high‐resolution imaging and machine learning. However, image and motion blur substantially challenge the accuracy of crack detection and analysis. Nevertheless, research on mitigating motion blur remains sparse. This study introduces an effective image processing system adept at deblurring and segmentation, employing a generative adversarial network (GAN) with UNet as the generator and Wasserstein GAN with Gradient Penalty (WGAN‐gp) as the loss function. This approach performs exceptionally in deblurring pavement crack images and improves segmentation accuracy. Models were trained with sharp and artificially blurred images, with WGAN‐gp surpassing other loss functions in effectiveness. This research innovatively suggests assessing deblurring quality through segmentation accuracy in addition to peak signal‐to‐noise ratio (PSNR) and structural similarity (SSIM), revealing that PSNR and SSIM may not fully capture deblurring effectiveness for pavement crack images. An extensive evaluation of various generators, including UNet, lightweight UNet, TransUNet, DeblurGAN, DeblurGAN‐v2, and MIMO‐UNet, identifies the superior performance of UNet on simulated motion blur. Validation with actual motion‐blurred images confirms the effectiveness of the proposed model. These findings demonstrate that GAN‐based models have great potential in overcoming motion blur challenges in pavement crack detection systems, marking a notable advancement in the field.","PeriodicalId":156,"journal":{"name":"Computer-Aided Civil and Infrastructure Engineering","volume":null,"pages":null},"PeriodicalIF":8.5000,"publicationDate":"2024-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A generative adversarial network approach for removing motion blur in the automatic detection of pavement cracks\",\"authors\":\"Yu Zhang, Lin Zhang\",\"doi\":\"10.1111/mice.13231\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Advancements in infrastructure management have significantly benefited from automatic pavement crack detection systems, relying on image processing enhanced by high‐resolution imaging and machine learning. However, image and motion blur substantially challenge the accuracy of crack detection and analysis. Nevertheless, research on mitigating motion blur remains sparse. This study introduces an effective image processing system adept at deblurring and segmentation, employing a generative adversarial network (GAN) with UNet as the generator and Wasserstein GAN with Gradient Penalty (WGAN‐gp) as the loss function. This approach performs exceptionally in deblurring pavement crack images and improves segmentation accuracy. Models were trained with sharp and artificially blurred images, with WGAN‐gp surpassing other loss functions in effectiveness. This research innovatively suggests assessing deblurring quality through segmentation accuracy in addition to peak signal‐to‐noise ratio (PSNR) and structural similarity (SSIM), revealing that PSNR and SSIM may not fully capture deblurring effectiveness for pavement crack images. An extensive evaluation of various generators, including UNet, lightweight UNet, TransUNet, DeblurGAN, DeblurGAN‐v2, and MIMO‐UNet, identifies the superior performance of UNet on simulated motion blur. Validation with actual motion‐blurred images confirms the effectiveness of the proposed model. These findings demonstrate that GAN‐based models have great potential in overcoming motion blur challenges in pavement crack detection systems, marking a notable advancement in the field.\",\"PeriodicalId\":156,\"journal\":{\"name\":\"Computer-Aided Civil and Infrastructure Engineering\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":8.5000,\"publicationDate\":\"2024-05-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer-Aided Civil and Infrastructure Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1111/mice.13231\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer-Aided Civil and Infrastructure Engineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1111/mice.13231","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

路面裂缝自动检测系统依靠高分辨率成像和机器学习增强的图像处理能力,极大地促进了基础设施管理的发展。然而,图像和运动模糊对裂缝检测和分析的准确性提出了巨大挑战。然而,有关减轻运动模糊的研究仍然很少。本研究介绍了一种擅长去模糊和分割的有效图像处理系统,该系统采用了以 UNet 为生成器的生成对抗网络(GAN)和以 Wasserstein GAN with Gradient Penalty (WGAN-gp) 为损失函数。这种方法在路面裂缝图像去模糊方面表现出色,并提高了分割精度。使用清晰图像和人工模糊图像对模型进行了训练,WGAN-gp 的有效性超过了其他损失函数。这项研究创新性地提出,除了峰值信噪比(PSNR)和结构相似性(SSIM)之外,还可以通过分割准确性来评估去模糊质量,从而揭示出 PSNR 和 SSIM 可能无法完全反映路面裂缝图像的去模糊效果。对各种生成器(包括 UNet、轻量级 UNet、TransUNet、DeblurGAN、DeblurGAN-v2 和 MIMO-UNet)进行了广泛评估,确定了 UNet 在模拟运动模糊方面的卓越性能。利用实际运动模糊图像进行的验证证实了所建议模型的有效性。这些研究结果表明,基于 GAN 的模型在克服路面裂缝检测系统中的运动模糊难题方面具有巨大潜力,标志着该领域的显著进步。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A generative adversarial network approach for removing motion blur in the automatic detection of pavement cracks
Advancements in infrastructure management have significantly benefited from automatic pavement crack detection systems, relying on image processing enhanced by high‐resolution imaging and machine learning. However, image and motion blur substantially challenge the accuracy of crack detection and analysis. Nevertheless, research on mitigating motion blur remains sparse. This study introduces an effective image processing system adept at deblurring and segmentation, employing a generative adversarial network (GAN) with UNet as the generator and Wasserstein GAN with Gradient Penalty (WGAN‐gp) as the loss function. This approach performs exceptionally in deblurring pavement crack images and improves segmentation accuracy. Models were trained with sharp and artificially blurred images, with WGAN‐gp surpassing other loss functions in effectiveness. This research innovatively suggests assessing deblurring quality through segmentation accuracy in addition to peak signal‐to‐noise ratio (PSNR) and structural similarity (SSIM), revealing that PSNR and SSIM may not fully capture deblurring effectiveness for pavement crack images. An extensive evaluation of various generators, including UNet, lightweight UNet, TransUNet, DeblurGAN, DeblurGAN‐v2, and MIMO‐UNet, identifies the superior performance of UNet on simulated motion blur. Validation with actual motion‐blurred images confirms the effectiveness of the proposed model. These findings demonstrate that GAN‐based models have great potential in overcoming motion blur challenges in pavement crack detection systems, marking a notable advancement in the field.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
17.60
自引率
19.80%
发文量
146
审稿时长
1 months
期刊介绍: Computer-Aided Civil and Infrastructure Engineering stands as a scholarly, peer-reviewed archival journal, serving as a vital link between advancements in computer technology and civil and infrastructure engineering. The journal serves as a distinctive platform for the publication of original articles, spotlighting novel computational techniques and inventive applications of computers. Specifically, it concentrates on recent progress in computer and information technologies, fostering the development and application of emerging computing paradigms. Encompassing a broad scope, the journal addresses bridge, construction, environmental, highway, geotechnical, structural, transportation, and water resources engineering. It extends its reach to the management of infrastructure systems, covering domains such as highways, bridges, pavements, airports, and utilities. The journal delves into areas like artificial intelligence, cognitive modeling, concurrent engineering, database management, distributed computing, evolutionary computing, fuzzy logic, genetic algorithms, geometric modeling, internet-based technologies, knowledge discovery and engineering, machine learning, mobile computing, multimedia technologies, networking, neural network computing, optimization and search, parallel processing, robotics, smart structures, software engineering, virtual reality, and visualization techniques.
期刊最新文献
Self‐training with Bayesian neural networks and spatial priors for unsupervised domain adaptation in crack segmentation Multifidelity graph neural networks for efficient and accurate mesh‐based partial differential equations surrogate modeling A domain adaptation methodology for enhancing the classification of structural condition states in continuously monitored historical domes Integrated vision language and foundation model for automated estimation of building lowest floor elevation Bridge damage identification based on synchronous statistical moment theory of vehicle–bridge interaction
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1