{"title":"基于移动图像采集系统和深度学习集合模型的隧道衬砌裂缝自动检测","authors":"","doi":"10.1016/j.tust.2024.106124","DOIUrl":null,"url":null,"abstract":"<div><div>Tunnel cracks are a crucial indicator of tunnel detection and performance evaluation. However, traditional manual inspection methods are time-consuming and dangerous. To address these problems, an automatic tunnel crack detection method based on a mobile image acquisition system and deep learning ensemble model is proposed. A novel mobile image acquisition system is proposed for tunnel data acquisition. A deep learning-based model, named You Only Look Once v8 enhanced by large separable kernel attention (LSKA) and dynamic snake convolution (DSC; YOLO-LD), is proposed to improve the crack detection performance. Collaborative learning is used to combine the YOLO-LD object detection and semantic segmentation models into an ensemble model to enhance the model’s engineering adaptability. Edge computing technologies are used for ensemble model deployment and inference acceleration. The method is tested on the custom tunnel lining crack (TL-Crack), the open-access dataset LinkCrack, and highway tunnel field data. The results show that the mobile image acquisition system can rapidly acquire high-resolution images and form panoramic images. The YOLO-LD model outperforms other state-of-the-art models in terms of precision, recall, and <em>F</em>1-score on both TL-Crack and LinkCrack. The ensemble model fully exploits the YOLO-LD object detection model’s crack localization capability and the YOLO-LD semantic segmentation model’s crack extraction performance, improving the model’s engineering adaptability. Edge computing techniques increase the inference speed of the ensemble model to 84 images/second. Parameters such as stake number, distribution, length, width, and type of cracks are calculated, and the crack distribution maps are prepared to assist inspectors in field verification.</div></div>","PeriodicalId":49414,"journal":{"name":"Tunnelling and Underground Space Technology","volume":null,"pages":null},"PeriodicalIF":6.7000,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automatic detection of tunnel lining crack based on mobile image acquisition system and deep learning ensemble model\",\"authors\":\"\",\"doi\":\"10.1016/j.tust.2024.106124\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Tunnel cracks are a crucial indicator of tunnel detection and performance evaluation. However, traditional manual inspection methods are time-consuming and dangerous. To address these problems, an automatic tunnel crack detection method based on a mobile image acquisition system and deep learning ensemble model is proposed. A novel mobile image acquisition system is proposed for tunnel data acquisition. A deep learning-based model, named You Only Look Once v8 enhanced by large separable kernel attention (LSKA) and dynamic snake convolution (DSC; YOLO-LD), is proposed to improve the crack detection performance. Collaborative learning is used to combine the YOLO-LD object detection and semantic segmentation models into an ensemble model to enhance the model’s engineering adaptability. Edge computing technologies are used for ensemble model deployment and inference acceleration. The method is tested on the custom tunnel lining crack (TL-Crack), the open-access dataset LinkCrack, and highway tunnel field data. The results show that the mobile image acquisition system can rapidly acquire high-resolution images and form panoramic images. The YOLO-LD model outperforms other state-of-the-art models in terms of precision, recall, and <em>F</em>1-score on both TL-Crack and LinkCrack. The ensemble model fully exploits the YOLO-LD object detection model’s crack localization capability and the YOLO-LD semantic segmentation model’s crack extraction performance, improving the model’s engineering adaptability. Edge computing techniques increase the inference speed of the ensemble model to 84 images/second. Parameters such as stake number, distribution, length, width, and type of cracks are calculated, and the crack distribution maps are prepared to assist inspectors in field verification.</div></div>\",\"PeriodicalId\":49414,\"journal\":{\"name\":\"Tunnelling and Underground Space Technology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":6.7000,\"publicationDate\":\"2024-10-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Tunnelling and Underground Space Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S088677982400542X\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Tunnelling and Underground Space Technology","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S088677982400542X","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
Automatic detection of tunnel lining crack based on mobile image acquisition system and deep learning ensemble model
Tunnel cracks are a crucial indicator of tunnel detection and performance evaluation. However, traditional manual inspection methods are time-consuming and dangerous. To address these problems, an automatic tunnel crack detection method based on a mobile image acquisition system and deep learning ensemble model is proposed. A novel mobile image acquisition system is proposed for tunnel data acquisition. A deep learning-based model, named You Only Look Once v8 enhanced by large separable kernel attention (LSKA) and dynamic snake convolution (DSC; YOLO-LD), is proposed to improve the crack detection performance. Collaborative learning is used to combine the YOLO-LD object detection and semantic segmentation models into an ensemble model to enhance the model’s engineering adaptability. Edge computing technologies are used for ensemble model deployment and inference acceleration. The method is tested on the custom tunnel lining crack (TL-Crack), the open-access dataset LinkCrack, and highway tunnel field data. The results show that the mobile image acquisition system can rapidly acquire high-resolution images and form panoramic images. The YOLO-LD model outperforms other state-of-the-art models in terms of precision, recall, and F1-score on both TL-Crack and LinkCrack. The ensemble model fully exploits the YOLO-LD object detection model’s crack localization capability and the YOLO-LD semantic segmentation model’s crack extraction performance, improving the model’s engineering adaptability. Edge computing techniques increase the inference speed of the ensemble model to 84 images/second. Parameters such as stake number, distribution, length, width, and type of cracks are calculated, and the crack distribution maps are prepared to assist inspectors in field verification.
期刊介绍:
Tunnelling and Underground Space Technology is an international journal which publishes authoritative articles encompassing the development of innovative uses of underground space and the results of high quality research into improved, more cost-effective techniques for the planning, geo-investigation, design, construction, operation and maintenance of underground and earth-sheltered structures. The journal provides an effective vehicle for the improved worldwide exchange of information on developments in underground technology - and the experience gained from its use - and is strongly committed to publishing papers on the interdisciplinary aspects of creating, planning, and regulating underground space.