Online detection and evaluation of weld surface defects based on lightweight network VGG16-UNet and laser scanning

IF 6.1 1区 工程技术 Q1 ENGINEERING, MANUFACTURING Journal of Manufacturing Processes Pub Date : 2024-09-05 DOI:10.1016/j.jmapro.2024.08.037
{"title":"Online detection and evaluation of weld surface defects based on lightweight network VGG16-UNet and laser scanning","authors":"","doi":"10.1016/j.jmapro.2024.08.037","DOIUrl":null,"url":null,"abstract":"<div><p>Online inspection of welding defects is of great help for welding quality assessment, rapid process optimization, and production efficiency improvement. However, in-situ detection is difficult due to the noisy environments, real-time changes in light, diverse weld forms, and requirements for rapid detection. Traditional defect detection methods face many challenges, such as complex processes, slow speed, insufficient information, and weak adaptability. In this study, an online fast detection method based on laser scanning and a lightweight network is proposed. Firstly, high-precision point clouds of weld surfaces are acquired using a laser displacement sensor. Secondly, equal-interval splitting divides the point cloud of a long-seam weld into equal-resolution subframes for online detection. An image processing algorithm combining radius filtering, Sobel convolution, normalization, and Gaussian enhancement is proposed to convert the split point clouds into high-contrast gray-scale images. With the gray-scale images as input and pixel-level classification of the background and three types of defects as output, a semantic segmentation model, VGG16-UNet, is trained through transfer learning, achieving 88.77 % precision and 92.03 % recall. Based on the prediction result and its mapping point cloud, 3D reconstruction and visualization of defects are realized using Delaunay triangulation. 3D location and geometry dimensions of defects are calculated for defect assessment. Compared with the alternative segmentation models, VGG16-UNet performs better while having a smaller weight (94.95 MB) and a faster inference speed (26.8fps), making it suitable for online industrial applications. The work provides strong support for achieving online automated evaluation of weld surface quality.</p></div>","PeriodicalId":16148,"journal":{"name":"Journal of Manufacturing Processes","volume":null,"pages":null},"PeriodicalIF":6.1000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Processes","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1526612524008685","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0

Abstract

Online inspection of welding defects is of great help for welding quality assessment, rapid process optimization, and production efficiency improvement. However, in-situ detection is difficult due to the noisy environments, real-time changes in light, diverse weld forms, and requirements for rapid detection. Traditional defect detection methods face many challenges, such as complex processes, slow speed, insufficient information, and weak adaptability. In this study, an online fast detection method based on laser scanning and a lightweight network is proposed. Firstly, high-precision point clouds of weld surfaces are acquired using a laser displacement sensor. Secondly, equal-interval splitting divides the point cloud of a long-seam weld into equal-resolution subframes for online detection. An image processing algorithm combining radius filtering, Sobel convolution, normalization, and Gaussian enhancement is proposed to convert the split point clouds into high-contrast gray-scale images. With the gray-scale images as input and pixel-level classification of the background and three types of defects as output, a semantic segmentation model, VGG16-UNet, is trained through transfer learning, achieving 88.77 % precision and 92.03 % recall. Based on the prediction result and its mapping point cloud, 3D reconstruction and visualization of defects are realized using Delaunay triangulation. 3D location and geometry dimensions of defects are calculated for defect assessment. Compared with the alternative segmentation models, VGG16-UNet performs better while having a smaller weight (94.95 MB) and a faster inference speed (26.8fps), making it suitable for online industrial applications. The work provides strong support for achieving online automated evaluation of weld surface quality.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于轻量级网络 VGG16-UNet 和激光扫描的焊接表面缺陷在线检测与评估
焊接缺陷在线检测对焊接质量评估、快速工艺优化和提高生产效率有很大帮助。然而,由于嘈杂的环境、光线的实时变化、焊接形式的多样性以及快速检测的要求,现场检测存在一定难度。传统的缺陷检测方法面临着工艺复杂、速度慢、信息不足、适应性弱等诸多挑战。本研究提出了一种基于激光扫描和轻量级网络的在线快速检测方法。首先,利用激光位移传感器获取焊接表面的高精度点云。其次,等间隔分割法将长焊缝点云划分为等分辨率子帧,用于在线检测。结合半径滤波、Sobel 卷积、归一化和高斯增强的图像处理算法可将分割点云转换为高对比度的灰度图像。以灰度图像为输入,以背景和三种缺陷的像素级分类为输出,通过迁移学习训练了一个语义分割模型 VGG16-UNet,实现了 88.77 % 的精确度和 92.03 % 的召回率。根据预测结果及其映射点云,使用 Delaunay 三角测量法实现了缺陷的三维重建和可视化。计算出缺陷的三维位置和几何尺寸,用于缺陷评估。与其他分割模型相比,VGG16-UNet 性能更好,权重更小(94.95 MB),推理速度更快(26.8fps),适合在线工业应用。这项工作为实现焊接表面质量的在线自动评估提供了强有力的支持。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Manufacturing Processes
Journal of Manufacturing Processes ENGINEERING, MANUFACTURING-
CiteScore
10.20
自引率
11.30%
发文量
833
审稿时长
50 days
期刊介绍: The aim of the Journal of Manufacturing Processes (JMP) is to exchange current and future directions of manufacturing processes research, development and implementation, and to publish archival scholarly literature with a view to advancing state-of-the-art manufacturing processes and encouraging innovation for developing new and efficient processes. The journal will also publish from other research communities for rapid communication of innovative new concepts. Special-topic issues on emerging technologies and invited papers will also be published.
期刊最新文献
Achieving high thermal conductivity joining of Cf/C and Haynes 230 by using Cu-Mo30Cu-Ti composite foil as thermal interface material Examining the impact of tool taper angle in Al-Si tube manufacturing by friction stir extrusion A theoretical calculation method for asymmetric active counter-roller spinning force by combining strain electrical measurement and simulation Laser powder bed fusion processing of plasma atomized AlSi10Mg powder: Surface roughness and mechanical properties modification Control of hole rolling on 3D Servo Presses
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1