{"title":"基于轻量级网络 VGG16-UNet 和激光扫描的焊接表面缺陷在线检测与评估","authors":"","doi":"10.1016/j.jmapro.2024.08.037","DOIUrl":null,"url":null,"abstract":"<div><p>Online inspection of welding defects is of great help for welding quality assessment, rapid process optimization, and production efficiency improvement. However, in-situ detection is difficult due to the noisy environments, real-time changes in light, diverse weld forms, and requirements for rapid detection. Traditional defect detection methods face many challenges, such as complex processes, slow speed, insufficient information, and weak adaptability. In this study, an online fast detection method based on laser scanning and a lightweight network is proposed. Firstly, high-precision point clouds of weld surfaces are acquired using a laser displacement sensor. Secondly, equal-interval splitting divides the point cloud of a long-seam weld into equal-resolution subframes for online detection. An image processing algorithm combining radius filtering, Sobel convolution, normalization, and Gaussian enhancement is proposed to convert the split point clouds into high-contrast gray-scale images. With the gray-scale images as input and pixel-level classification of the background and three types of defects as output, a semantic segmentation model, VGG16-UNet, is trained through transfer learning, achieving 88.77 % precision and 92.03 % recall. Based on the prediction result and its mapping point cloud, 3D reconstruction and visualization of defects are realized using Delaunay triangulation. 3D location and geometry dimensions of defects are calculated for defect assessment. Compared with the alternative segmentation models, VGG16-UNet performs better while having a smaller weight (94.95 MB) and a faster inference speed (26.8fps), making it suitable for online industrial applications. The work provides strong support for achieving online automated evaluation of weld surface quality.</p></div>","PeriodicalId":16148,"journal":{"name":"Journal of Manufacturing Processes","volume":null,"pages":null},"PeriodicalIF":6.1000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Online detection and evaluation of weld surface defects based on lightweight network VGG16-UNet and laser scanning\",\"authors\":\"\",\"doi\":\"10.1016/j.jmapro.2024.08.037\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Online inspection of welding defects is of great help for welding quality assessment, rapid process optimization, and production efficiency improvement. However, in-situ detection is difficult due to the noisy environments, real-time changes in light, diverse weld forms, and requirements for rapid detection. Traditional defect detection methods face many challenges, such as complex processes, slow speed, insufficient information, and weak adaptability. In this study, an online fast detection method based on laser scanning and a lightweight network is proposed. Firstly, high-precision point clouds of weld surfaces are acquired using a laser displacement sensor. Secondly, equal-interval splitting divides the point cloud of a long-seam weld into equal-resolution subframes for online detection. An image processing algorithm combining radius filtering, Sobel convolution, normalization, and Gaussian enhancement is proposed to convert the split point clouds into high-contrast gray-scale images. With the gray-scale images as input and pixel-level classification of the background and three types of defects as output, a semantic segmentation model, VGG16-UNet, is trained through transfer learning, achieving 88.77 % precision and 92.03 % recall. Based on the prediction result and its mapping point cloud, 3D reconstruction and visualization of defects are realized using Delaunay triangulation. 3D location and geometry dimensions of defects are calculated for defect assessment. Compared with the alternative segmentation models, VGG16-UNet performs better while having a smaller weight (94.95 MB) and a faster inference speed (26.8fps), making it suitable for online industrial applications. The work provides strong support for achieving online automated evaluation of weld surface quality.</p></div>\",\"PeriodicalId\":16148,\"journal\":{\"name\":\"Journal of Manufacturing Processes\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":6.1000,\"publicationDate\":\"2024-09-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Manufacturing Processes\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1526612524008685\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Processes","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1526612524008685","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
Online detection and evaluation of weld surface defects based on lightweight network VGG16-UNet and laser scanning
Online inspection of welding defects is of great help for welding quality assessment, rapid process optimization, and production efficiency improvement. However, in-situ detection is difficult due to the noisy environments, real-time changes in light, diverse weld forms, and requirements for rapid detection. Traditional defect detection methods face many challenges, such as complex processes, slow speed, insufficient information, and weak adaptability. In this study, an online fast detection method based on laser scanning and a lightweight network is proposed. Firstly, high-precision point clouds of weld surfaces are acquired using a laser displacement sensor. Secondly, equal-interval splitting divides the point cloud of a long-seam weld into equal-resolution subframes for online detection. An image processing algorithm combining radius filtering, Sobel convolution, normalization, and Gaussian enhancement is proposed to convert the split point clouds into high-contrast gray-scale images. With the gray-scale images as input and pixel-level classification of the background and three types of defects as output, a semantic segmentation model, VGG16-UNet, is trained through transfer learning, achieving 88.77 % precision and 92.03 % recall. Based on the prediction result and its mapping point cloud, 3D reconstruction and visualization of defects are realized using Delaunay triangulation. 3D location and geometry dimensions of defects are calculated for defect assessment. Compared with the alternative segmentation models, VGG16-UNet performs better while having a smaller weight (94.95 MB) and a faster inference speed (26.8fps), making it suitable for online industrial applications. The work provides strong support for achieving online automated evaluation of weld surface quality.
期刊介绍:
The aim of the Journal of Manufacturing Processes (JMP) is to exchange current and future directions of manufacturing processes research, development and implementation, and to publish archival scholarly literature with a view to advancing state-of-the-art manufacturing processes and encouraging innovation for developing new and efficient processes. The journal will also publish from other research communities for rapid communication of innovative new concepts. Special-topic issues on emerging technologies and invited papers will also be published.