Post‐earthquake damage recognition and condition assessment of bridges using UAV integrated with deep learning approach

X. Ye, Si-Yuan Ma, Zhi‐Xiong Liu, Yang Ding, Zhe‐Xun Li, T. Jin
{"title":"Post‐earthquake damage recognition and condition assessment of bridges using UAV integrated with deep learning approach","authors":"X. Ye, Si-Yuan Ma, Zhi‐Xiong Liu, Yang Ding, Zhe‐Xun Li, T. Jin","doi":"10.1002/stc.3128","DOIUrl":null,"url":null,"abstract":"Rapid and accurate assessment of the damage to bridge structures after an earthquake can provide a basis for decision‐making regarding post‐earthquake emergency work. However, the traditional structural damage inspection techniques are subjective, time‐consuming, and inefficient. This paper proposed a framework for rapid post‐earthquake structural damage inspection and condition assessment by integrating the technologies of satellite, unmanned aerial vehicle (UAV), and smartphone with the deep learning approach. The images of structural components of post‐earthquake bridges can be obtained by UAVs and smartphones. Furthermore, the multi‐task high‐resolution net (MT‐HRNet) model was adopted to recognize the structural components and damage conditions by weighting and combining the loss functions of a single‐task HRNet model. The performance of the proposed MT‐HRNet model and the single‐task HRNet model was verified based on the Tokaido dataset, which includes 2000 images of post‐earthquake bridges. The results showed that the MT‐HRNet model and the HRNet model exhibited equivalent recognition accuracy, while the number of floating‐point‐operations (FLOPs) and the parameters of the MT‐HRNet model were reduced by 46.48% and 49.58% compared with the HRNet model. In addition, a method for the determination of the safety risk level of the post‐earthquake bridge structures was developed, and the evaluation indices were established by considering the damage type, the spalling area, and the width of cracks as well as the recognition statistics of all images in Tokaido dataset. This study will provide a valuable reference for the rapid determination of structural safety level and the corresponding treatment measures of post‐earthquake bridges.","PeriodicalId":22049,"journal":{"name":"Structural Control and Health Monitoring","volume":"75 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2022-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Structural Control and Health Monitoring","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1002/stc.3128","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 8

Abstract

Rapid and accurate assessment of the damage to bridge structures after an earthquake can provide a basis for decision‐making regarding post‐earthquake emergency work. However, the traditional structural damage inspection techniques are subjective, time‐consuming, and inefficient. This paper proposed a framework for rapid post‐earthquake structural damage inspection and condition assessment by integrating the technologies of satellite, unmanned aerial vehicle (UAV), and smartphone with the deep learning approach. The images of structural components of post‐earthquake bridges can be obtained by UAVs and smartphones. Furthermore, the multi‐task high‐resolution net (MT‐HRNet) model was adopted to recognize the structural components and damage conditions by weighting and combining the loss functions of a single‐task HRNet model. The performance of the proposed MT‐HRNet model and the single‐task HRNet model was verified based on the Tokaido dataset, which includes 2000 images of post‐earthquake bridges. The results showed that the MT‐HRNet model and the HRNet model exhibited equivalent recognition accuracy, while the number of floating‐point‐operations (FLOPs) and the parameters of the MT‐HRNet model were reduced by 46.48% and 49.58% compared with the HRNet model. In addition, a method for the determination of the safety risk level of the post‐earthquake bridge structures was developed, and the evaluation indices were established by considering the damage type, the spalling area, and the width of cracks as well as the recognition statistics of all images in Tokaido dataset. This study will provide a valuable reference for the rapid determination of structural safety level and the corresponding treatment measures of post‐earthquake bridges.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于深度学习的无人机桥梁震后损伤识别与状态评估
快速准确地评估地震后桥梁结构的损伤,可以为震后应急工作的决策提供依据。然而,传统的结构损伤检测技术具有主观性强、耗时长、效率低等特点。结合卫星、无人机、智能手机等技术和深度学习方法,提出了一种快速地震灾后结构损伤检测与状态评估框架。地震后桥梁结构构件的图像可以通过无人机和智能手机获得。此外,采用多任务高分辨率网络(MT - HRNet)模型,通过加权和组合单任务HRNet模型的损失函数来识别结构部件和损伤情况。基于包含2000幅震后桥梁图像的Tokaido数据集,验证了所提出的MT - HRNet模型和单任务HRNet模型的性能。结果表明,MT‐HRNet模型与HRNet模型具有相当的识别精度,但与HRNet模型相比,MT‐HRNet模型的浮点运算次数(FLOPs)和参数分别减少了46.48%和49.58%。此外,建立了地震后桥梁结构安全风险等级的确定方法,并结合东海道数据集的损伤类型、剥落面积和裂缝宽度,以及所有图像的识别统计,建立了评价指标。该研究将为震后桥梁结构安全等级的快速确定和相应的处理措施提供有价值的参考。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Gross outlier removal and fault data recovery for SHM data of dynamic responses by an annihilating filter‐based Hankel‐structured robust PCA method Numerical and experimental analysis of the reliability of strain measured by surface‐mounted fiber‐optic sensors based on Bragg gratings Robust optimal sensor configuration using the value of information SCHM to publish open access from 2023 Full‐scaled experimental and numerical investigation on the contribution of masonry infill walls into dynamic behavior of RC buildings
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1