{"title":"利用无人机摄影和深度学习识别桥梁混凝土结构的像素级裂缝","authors":"Fei Song, Bo Liu, Guixia Yuan","doi":"10.1155/2024/1299095","DOIUrl":null,"url":null,"abstract":"<div>\n <p>Traditional manual inspection technology has the problems of high risk, low efficiency, and being time-consuming in bridge safety management. The unmanned aerial vehicle (UAV)-based detection technology is widely used in bridge structure safety monitoring. However, the existing deep learning-based concrete crack identification method has great limitations in dealing with complex background and tiny cracks in bridge structures. To address these problems, this study designs a crack pixel-level high-performance segmentation model for bridge concrete cracks that is suitable for UAV detection scenarios using machine vision (MV) and deep learning (DL) algorithms. First, considering the high requirements for the computing performance of the MV-based model for UAV-based detection, the ResNet-18-based lightweight convolutional neural network is used to represent the traditional large-scale backbone network of the pyramid scene parsing network (PSPNet) to develop a high-performance crack automatic identification model. Then, considering that bridge concrete cracks have the characteristics of subtle shapes and complex backgrounds, the spatial position self-attention module is inserted into the PSPNet to improve its detection accuracy. A concrete bridge is used for the case study, and a dataset of cracks in bridge concrete structures collected by UAVs is constructed and used for model training. The experimental results show that the loss function of the developed method in the training process results in a smooth decline, and the developed algorithm achieves the evaluation indicators of 0.9008 precision, 0.8750 recall, 0.8820 accuracy, and 0.9012 IOU on the bridge concrete crack dataset, which are significantly higher than other state-of-the-art baseline methods. In addition, four common UAV bridge detection scenarios, including low light, complex crack forms, high background roughness, and complex background scenes, are used to further test the crack detection ability of the developed crack identification model. The experimental results show that the proposed crack identification method can effectively overcome interference and real-size pixel-level segmentation of crack morphology. In addition, it also achieved a detection efficiency of 35.04 FPS, which shows that the real-time detection ability of the method has good applicability in the UAV detection scene.</p>\n </div>","PeriodicalId":49471,"journal":{"name":"Structural Control & Health Monitoring","volume":"2024 1","pages":""},"PeriodicalIF":4.6000,"publicationDate":"2024-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1155/2024/1299095","citationCount":"0","resultStr":"{\"title\":\"Pixel-Level Crack Identification for Bridge Concrete Structures Using Unmanned Aerial Vehicle Photography and Deep Learning\",\"authors\":\"Fei Song, Bo Liu, Guixia Yuan\",\"doi\":\"10.1155/2024/1299095\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n <p>Traditional manual inspection technology has the problems of high risk, low efficiency, and being time-consuming in bridge safety management. The unmanned aerial vehicle (UAV)-based detection technology is widely used in bridge structure safety monitoring. However, the existing deep learning-based concrete crack identification method has great limitations in dealing with complex background and tiny cracks in bridge structures. To address these problems, this study designs a crack pixel-level high-performance segmentation model for bridge concrete cracks that is suitable for UAV detection scenarios using machine vision (MV) and deep learning (DL) algorithms. First, considering the high requirements for the computing performance of the MV-based model for UAV-based detection, the ResNet-18-based lightweight convolutional neural network is used to represent the traditional large-scale backbone network of the pyramid scene parsing network (PSPNet) to develop a high-performance crack automatic identification model. Then, considering that bridge concrete cracks have the characteristics of subtle shapes and complex backgrounds, the spatial position self-attention module is inserted into the PSPNet to improve its detection accuracy. A concrete bridge is used for the case study, and a dataset of cracks in bridge concrete structures collected by UAVs is constructed and used for model training. The experimental results show that the loss function of the developed method in the training process results in a smooth decline, and the developed algorithm achieves the evaluation indicators of 0.9008 precision, 0.8750 recall, 0.8820 accuracy, and 0.9012 IOU on the bridge concrete crack dataset, which are significantly higher than other state-of-the-art baseline methods. In addition, four common UAV bridge detection scenarios, including low light, complex crack forms, high background roughness, and complex background scenes, are used to further test the crack detection ability of the developed crack identification model. The experimental results show that the proposed crack identification method can effectively overcome interference and real-size pixel-level segmentation of crack morphology. In addition, it also achieved a detection efficiency of 35.04 FPS, which shows that the real-time detection ability of the method has good applicability in the UAV detection scene.</p>\\n </div>\",\"PeriodicalId\":49471,\"journal\":{\"name\":\"Structural Control & Health Monitoring\",\"volume\":\"2024 1\",\"pages\":\"\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2024-05-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1155/2024/1299095\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Structural Control & Health Monitoring\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1155/2024/1299095\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Structural Control & Health Monitoring","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1155/2024/1299095","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
Pixel-Level Crack Identification for Bridge Concrete Structures Using Unmanned Aerial Vehicle Photography and Deep Learning
Traditional manual inspection technology has the problems of high risk, low efficiency, and being time-consuming in bridge safety management. The unmanned aerial vehicle (UAV)-based detection technology is widely used in bridge structure safety monitoring. However, the existing deep learning-based concrete crack identification method has great limitations in dealing with complex background and tiny cracks in bridge structures. To address these problems, this study designs a crack pixel-level high-performance segmentation model for bridge concrete cracks that is suitable for UAV detection scenarios using machine vision (MV) and deep learning (DL) algorithms. First, considering the high requirements for the computing performance of the MV-based model for UAV-based detection, the ResNet-18-based lightweight convolutional neural network is used to represent the traditional large-scale backbone network of the pyramid scene parsing network (PSPNet) to develop a high-performance crack automatic identification model. Then, considering that bridge concrete cracks have the characteristics of subtle shapes and complex backgrounds, the spatial position self-attention module is inserted into the PSPNet to improve its detection accuracy. A concrete bridge is used for the case study, and a dataset of cracks in bridge concrete structures collected by UAVs is constructed and used for model training. The experimental results show that the loss function of the developed method in the training process results in a smooth decline, and the developed algorithm achieves the evaluation indicators of 0.9008 precision, 0.8750 recall, 0.8820 accuracy, and 0.9012 IOU on the bridge concrete crack dataset, which are significantly higher than other state-of-the-art baseline methods. In addition, four common UAV bridge detection scenarios, including low light, complex crack forms, high background roughness, and complex background scenes, are used to further test the crack detection ability of the developed crack identification model. The experimental results show that the proposed crack identification method can effectively overcome interference and real-size pixel-level segmentation of crack morphology. In addition, it also achieved a detection efficiency of 35.04 FPS, which shows that the real-time detection ability of the method has good applicability in the UAV detection scene.
期刊介绍:
The Journal Structural Control and Health Monitoring encompasses all theoretical and technological aspects of structural control, structural health monitoring theory and smart materials and structures. The journal focuses on aerospace, civil, infrastructure and mechanical engineering applications.
Original contributions based on analytical, computational and experimental methods are solicited in three main areas: monitoring, control, and smart materials and structures, covering subjects such as system identification, health monitoring, health diagnostics, multi-functional materials, signal processing, sensor technology, passive, active and semi active control schemes and implementations, shape memory alloys, piezoelectrics and mechatronics.
Also of interest are actuator design, dynamic systems, dynamic stability, artificial intelligence tools, data acquisition, wireless communications, measurements, MEMS/NEMS sensors for local damage detection, optical fibre sensors for health monitoring, remote control of monitoring systems, sensor-logger combinations for mobile applications, corrosion sensors, scour indicators and experimental techniques.