基于轻量级网络 VGG16-UNet 和激光扫描的焊接表面缺陷在线检测与评估

IF 6.1 1区 工程技术 Q1 ENGINEERING, MANUFACTURING Journal of Manufacturing Processes Pub Date : 2024-09-05 DOI:10.1016/j.jmapro.2024.08.037
{"title":"基于轻量级网络 VGG16-UNet 和激光扫描的焊接表面缺陷在线检测与评估","authors":"","doi":"10.1016/j.jmapro.2024.08.037","DOIUrl":null,"url":null,"abstract":"<div><p>Online inspection of welding defects is of great help for welding quality assessment, rapid process optimization, and production efficiency improvement. However, in-situ detection is difficult due to the noisy environments, real-time changes in light, diverse weld forms, and requirements for rapid detection. Traditional defect detection methods face many challenges, such as complex processes, slow speed, insufficient information, and weak adaptability. In this study, an online fast detection method based on laser scanning and a lightweight network is proposed. Firstly, high-precision point clouds of weld surfaces are acquired using a laser displacement sensor. Secondly, equal-interval splitting divides the point cloud of a long-seam weld into equal-resolution subframes for online detection. An image processing algorithm combining radius filtering, Sobel convolution, normalization, and Gaussian enhancement is proposed to convert the split point clouds into high-contrast gray-scale images. With the gray-scale images as input and pixel-level classification of the background and three types of defects as output, a semantic segmentation model, VGG16-UNet, is trained through transfer learning, achieving 88.77 % precision and 92.03 % recall. Based on the prediction result and its mapping point cloud, 3D reconstruction and visualization of defects are realized using Delaunay triangulation. 3D location and geometry dimensions of defects are calculated for defect assessment. Compared with the alternative segmentation models, VGG16-UNet performs better while having a smaller weight (94.95 MB) and a faster inference speed (26.8fps), making it suitable for online industrial applications. The work provides strong support for achieving online automated evaluation of weld surface quality.</p></div>","PeriodicalId":16148,"journal":{"name":"Journal of Manufacturing Processes","volume":null,"pages":null},"PeriodicalIF":6.1000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Online detection and evaluation of weld surface defects based on lightweight network VGG16-UNet and laser scanning\",\"authors\":\"\",\"doi\":\"10.1016/j.jmapro.2024.08.037\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Online inspection of welding defects is of great help for welding quality assessment, rapid process optimization, and production efficiency improvement. However, in-situ detection is difficult due to the noisy environments, real-time changes in light, diverse weld forms, and requirements for rapid detection. Traditional defect detection methods face many challenges, such as complex processes, slow speed, insufficient information, and weak adaptability. In this study, an online fast detection method based on laser scanning and a lightweight network is proposed. Firstly, high-precision point clouds of weld surfaces are acquired using a laser displacement sensor. Secondly, equal-interval splitting divides the point cloud of a long-seam weld into equal-resolution subframes for online detection. An image processing algorithm combining radius filtering, Sobel convolution, normalization, and Gaussian enhancement is proposed to convert the split point clouds into high-contrast gray-scale images. With the gray-scale images as input and pixel-level classification of the background and three types of defects as output, a semantic segmentation model, VGG16-UNet, is trained through transfer learning, achieving 88.77 % precision and 92.03 % recall. Based on the prediction result and its mapping point cloud, 3D reconstruction and visualization of defects are realized using Delaunay triangulation. 3D location and geometry dimensions of defects are calculated for defect assessment. Compared with the alternative segmentation models, VGG16-UNet performs better while having a smaller weight (94.95 MB) and a faster inference speed (26.8fps), making it suitable for online industrial applications. The work provides strong support for achieving online automated evaluation of weld surface quality.</p></div>\",\"PeriodicalId\":16148,\"journal\":{\"name\":\"Journal of Manufacturing Processes\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":6.1000,\"publicationDate\":\"2024-09-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Manufacturing Processes\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1526612524008685\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Processes","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1526612524008685","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0

摘要

焊接缺陷在线检测对焊接质量评估、快速工艺优化和提高生产效率有很大帮助。然而,由于嘈杂的环境、光线的实时变化、焊接形式的多样性以及快速检测的要求,现场检测存在一定难度。传统的缺陷检测方法面临着工艺复杂、速度慢、信息不足、适应性弱等诸多挑战。本研究提出了一种基于激光扫描和轻量级网络的在线快速检测方法。首先,利用激光位移传感器获取焊接表面的高精度点云。其次,等间隔分割法将长焊缝点云划分为等分辨率子帧,用于在线检测。结合半径滤波、Sobel 卷积、归一化和高斯增强的图像处理算法可将分割点云转换为高对比度的灰度图像。以灰度图像为输入,以背景和三种缺陷的像素级分类为输出,通过迁移学习训练了一个语义分割模型 VGG16-UNet,实现了 88.77 % 的精确度和 92.03 % 的召回率。根据预测结果及其映射点云,使用 Delaunay 三角测量法实现了缺陷的三维重建和可视化。计算出缺陷的三维位置和几何尺寸,用于缺陷评估。与其他分割模型相比,VGG16-UNet 性能更好,权重更小(94.95 MB),推理速度更快(26.8fps),适合在线工业应用。这项工作为实现焊接表面质量的在线自动评估提供了强有力的支持。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Online detection and evaluation of weld surface defects based on lightweight network VGG16-UNet and laser scanning

Online inspection of welding defects is of great help for welding quality assessment, rapid process optimization, and production efficiency improvement. However, in-situ detection is difficult due to the noisy environments, real-time changes in light, diverse weld forms, and requirements for rapid detection. Traditional defect detection methods face many challenges, such as complex processes, slow speed, insufficient information, and weak adaptability. In this study, an online fast detection method based on laser scanning and a lightweight network is proposed. Firstly, high-precision point clouds of weld surfaces are acquired using a laser displacement sensor. Secondly, equal-interval splitting divides the point cloud of a long-seam weld into equal-resolution subframes for online detection. An image processing algorithm combining radius filtering, Sobel convolution, normalization, and Gaussian enhancement is proposed to convert the split point clouds into high-contrast gray-scale images. With the gray-scale images as input and pixel-level classification of the background and three types of defects as output, a semantic segmentation model, VGG16-UNet, is trained through transfer learning, achieving 88.77 % precision and 92.03 % recall. Based on the prediction result and its mapping point cloud, 3D reconstruction and visualization of defects are realized using Delaunay triangulation. 3D location and geometry dimensions of defects are calculated for defect assessment. Compared with the alternative segmentation models, VGG16-UNet performs better while having a smaller weight (94.95 MB) and a faster inference speed (26.8fps), making it suitable for online industrial applications. The work provides strong support for achieving online automated evaluation of weld surface quality.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Manufacturing Processes
Journal of Manufacturing Processes ENGINEERING, MANUFACTURING-
CiteScore
10.20
自引率
11.30%
发文量
833
审稿时长
50 days
期刊介绍: The aim of the Journal of Manufacturing Processes (JMP) is to exchange current and future directions of manufacturing processes research, development and implementation, and to publish archival scholarly literature with a view to advancing state-of-the-art manufacturing processes and encouraging innovation for developing new and efficient processes. The journal will also publish from other research communities for rapid communication of innovative new concepts. Special-topic issues on emerging technologies and invited papers will also be published.
期刊最新文献
Surface evolution mechanism for atomic-scale smoothing of Si via atmospheric pressure plasma etching Developing the optimized control scheme for digital light processing 3D printing by combining numerical simulation and machine learning-guided temperature prediction Atomic-scale insights into the material removal mechanism of cerium oxide polished fused silica based on ReaxFF-MD A review on the grinding of SiC-based ceramic matrix composites reinforced by continuous fibre: Damage mechanisms and evaluations Microstructure analysis and interfacial wave formation mechanism research of Mg/Al dissimilar metal laser impact welding in a vacuum environment
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1