通过混合信息提取和大型语言模型自动构建桥梁检测数据库

IF 6.2 2区 工程技术 Q1 CONSTRUCTION & BUILDING TECHNOLOGY Developments in the Built Environment Pub Date : 2024-10-01 DOI:10.1016/j.dibe.2024.100549
Chenhong Zhang , Xiaoming Lei , Ye Xia , Limin Sun
{"title":"通过混合信息提取和大型语言模型自动构建桥梁检测数据库","authors":"Chenhong Zhang ,&nbsp;Xiaoming Lei ,&nbsp;Ye Xia ,&nbsp;Limin Sun","doi":"10.1016/j.dibe.2024.100549","DOIUrl":null,"url":null,"abstract":"<div><div>Regular bridge inspections generate extensive reports that, while critical for maintenance, often remain underutilized due to their unstructured format. Traditional information extraction methods depend on intricate labeling systems that commonly require time-consuming and labor-intensive labeling. This paper presents a novel bridge inspection database construction method leveraging LLM-assisted information extraction. First, we introduce the pseudo-labelling method using a closed-source LLM to generate high-quality data. Then we propose the hybrid extraction pipeline to extract relevant information segments and process them by a generation-based IE model, fine-tuned on pseudo-labeled data. Finally, the extracted data is used to construct the bridge inspection database. The proposed method, validated with real-world data, not only demonstrates higher extraction precision than the closed-source LLM used for pseudo-labeling but also outperforms traditional methods in both data preparation time and extraction accuracy. This approach provides a scalable solution for more proactive and data-driven bridge maintenance strategies.</div></div>","PeriodicalId":34137,"journal":{"name":"Developments in the Built Environment","volume":"20 ","pages":"Article 100549"},"PeriodicalIF":6.2000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automatic bridge inspection database construction through hybrid information extraction and large language models\",\"authors\":\"Chenhong Zhang ,&nbsp;Xiaoming Lei ,&nbsp;Ye Xia ,&nbsp;Limin Sun\",\"doi\":\"10.1016/j.dibe.2024.100549\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Regular bridge inspections generate extensive reports that, while critical for maintenance, often remain underutilized due to their unstructured format. Traditional information extraction methods depend on intricate labeling systems that commonly require time-consuming and labor-intensive labeling. This paper presents a novel bridge inspection database construction method leveraging LLM-assisted information extraction. First, we introduce the pseudo-labelling method using a closed-source LLM to generate high-quality data. Then we propose the hybrid extraction pipeline to extract relevant information segments and process them by a generation-based IE model, fine-tuned on pseudo-labeled data. Finally, the extracted data is used to construct the bridge inspection database. The proposed method, validated with real-world data, not only demonstrates higher extraction precision than the closed-source LLM used for pseudo-labeling but also outperforms traditional methods in both data preparation time and extraction accuracy. This approach provides a scalable solution for more proactive and data-driven bridge maintenance strategies.</div></div>\",\"PeriodicalId\":34137,\"journal\":{\"name\":\"Developments in the Built Environment\",\"volume\":\"20 \",\"pages\":\"Article 100549\"},\"PeriodicalIF\":6.2000,\"publicationDate\":\"2024-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Developments in the Built Environment\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666165924002308\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Developments in the Built Environment","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666165924002308","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

定期桥梁检测会产生大量报告,这些报告虽然对维护工作至关重要,但由于格式不规范,往往得不到充分利用。传统的信息提取方法依赖于复杂的标注系统,通常需要耗时耗力的标注工作。本文提出了一种利用 LLM 辅助信息提取的新型桥梁检测数据库构建方法。首先,我们介绍了使用闭源 LLM 生成高质量数据的伪标注方法。然后,我们提出了混合提取管道,以提取相关信息片段,并通过基于生成的 IE 模型对其进行处理,该模型在伪标记数据上进行了微调。最后,提取的数据被用于构建桥梁检测数据库。所提出的方法经过实际数据验证,不仅比用于伪标记的闭源 LLM 具有更高的提取精度,而且在数据准备时间和提取精度方面都优于传统方法。这种方法为更加积极主动和数据驱动的桥梁维护战略提供了可扩展的解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Automatic bridge inspection database construction through hybrid information extraction and large language models
Regular bridge inspections generate extensive reports that, while critical for maintenance, often remain underutilized due to their unstructured format. Traditional information extraction methods depend on intricate labeling systems that commonly require time-consuming and labor-intensive labeling. This paper presents a novel bridge inspection database construction method leveraging LLM-assisted information extraction. First, we introduce the pseudo-labelling method using a closed-source LLM to generate high-quality data. Then we propose the hybrid extraction pipeline to extract relevant information segments and process them by a generation-based IE model, fine-tuned on pseudo-labeled data. Finally, the extracted data is used to construct the bridge inspection database. The proposed method, validated with real-world data, not only demonstrates higher extraction precision than the closed-source LLM used for pseudo-labeling but also outperforms traditional methods in both data preparation time and extraction accuracy. This approach provides a scalable solution for more proactive and data-driven bridge maintenance strategies.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.40
自引率
1.20%
发文量
31
审稿时长
22 days
期刊介绍: Developments in the Built Environment (DIBE) is a recently established peer-reviewed gold open access journal, ensuring that all accepted articles are permanently and freely accessible. Focused on civil engineering and the built environment, DIBE publishes original papers and short communications. Encompassing topics such as construction materials and building sustainability, the journal adopts a holistic approach with the aim of benefiting the community.
期刊最新文献
Study on the pore structure of eco-regenerated mortar using corn cob based on nuclear magnetic resonance Innovative design and sensing performance of a novel large-strain sensor for prestressed FRP plates Effects of superabsorbent polymer and natural zeolite on shrinkage, mechanical properties, and porosity in ultra-high performance concretes Explainable machine learning model for load-deformation correlation in long-span suspension bridges using XGBoost-SHAP Extending Information Delivery Specifications for digital building permit requirements
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1