Yunfeng Wang , Wonjoo Lee , Seungbeom Jang , Van Doi Truong , Yuhyeong Jeong , Chanhee Won , Jangwook Lee , Jonghun Yoon
{"title":"在机器人自动焊接过程中,基于机器视觉和 ANN 模型支持下的红外热图像预测内部焊接熔深","authors":"Yunfeng Wang , Wonjoo Lee , Seungbeom Jang , Van Doi Truong , Yuhyeong Jeong , Chanhee Won , Jangwook Lee , Jonghun Yoon","doi":"10.1016/j.jajp.2024.100199","DOIUrl":null,"url":null,"abstract":"<div><p>Welding quality is a critical criterion for evaluating welding operations. Traditional evaluation methods suffer from drawbacks such as lack of objectivity, untimeliness, and high costs. Therefore, real-time monitoring and assessment of the weld pool have become the mainstream trend in welding technology. This study introduces a novel method for defining weld pool width boundaries. It utilizes an infrared (IR) camera to capture the weld pool temperature clusters and employs the Sobel operator for convolution to generate the gradient map of the weld pool temperature clusters. Through enhanced processing in the gradient map, the width boundaries of the weld pool are more effectively detected compared to previous methods. Previous studies defined weld pool width boundaries by identifying characteristic points with the most distinct temperature fluctuations, caused by the different radiative properties of the same material in different states. However, practical tests revealed susceptibility to interference from reflected arc light. The proposed method mitigates the impact of reflected arc light and is applicable to complex multilayer welding scenarios. To address the lag in quality monitoring, reduce welding costs, and achieve real-time monitoring of the weld pool process, we employed machine vision and an artificial neural network (ANN) model. This led to the development of a weld penetration assessment system based on infrared thermal images. The system successfully predicted the penetration depth for 4 mm carbon steel with an accuracy of 86.6 %. This validates the feasibility of estimating and predicting weld performance using the surface temperature characteristics of the weld pool. The newly proposed weld pool boundary definition method holds promise for real-time monitoring in more complex multilayer pipe welding scenarios. It lays the groundwork for predicting and fusing the weld depth in intricate multi-pass pipe welding.</p></div>","PeriodicalId":34313,"journal":{"name":"Journal of Advanced Joining Processes","volume":"9 ","pages":"Article 100199"},"PeriodicalIF":3.8000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666330924000165/pdfft?md5=a82fa9e12eadfb4154a6a5b593d56fbf&pid=1-s2.0-S2666330924000165-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Prediction of internal welding penetration based on IR thermal image supported by machine vision and ANN-model during automatic robot welding process\",\"authors\":\"Yunfeng Wang , Wonjoo Lee , Seungbeom Jang , Van Doi Truong , Yuhyeong Jeong , Chanhee Won , Jangwook Lee , Jonghun Yoon\",\"doi\":\"10.1016/j.jajp.2024.100199\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Welding quality is a critical criterion for evaluating welding operations. Traditional evaluation methods suffer from drawbacks such as lack of objectivity, untimeliness, and high costs. Therefore, real-time monitoring and assessment of the weld pool have become the mainstream trend in welding technology. This study introduces a novel method for defining weld pool width boundaries. It utilizes an infrared (IR) camera to capture the weld pool temperature clusters and employs the Sobel operator for convolution to generate the gradient map of the weld pool temperature clusters. Through enhanced processing in the gradient map, the width boundaries of the weld pool are more effectively detected compared to previous methods. Previous studies defined weld pool width boundaries by identifying characteristic points with the most distinct temperature fluctuations, caused by the different radiative properties of the same material in different states. However, practical tests revealed susceptibility to interference from reflected arc light. The proposed method mitigates the impact of reflected arc light and is applicable to complex multilayer welding scenarios. To address the lag in quality monitoring, reduce welding costs, and achieve real-time monitoring of the weld pool process, we employed machine vision and an artificial neural network (ANN) model. This led to the development of a weld penetration assessment system based on infrared thermal images. The system successfully predicted the penetration depth for 4 mm carbon steel with an accuracy of 86.6 %. This validates the feasibility of estimating and predicting weld performance using the surface temperature characteristics of the weld pool. The newly proposed weld pool boundary definition method holds promise for real-time monitoring in more complex multilayer pipe welding scenarios. It lays the groundwork for predicting and fusing the weld depth in intricate multi-pass pipe welding.</p></div>\",\"PeriodicalId\":34313,\"journal\":{\"name\":\"Journal of Advanced Joining Processes\",\"volume\":\"9 \",\"pages\":\"Article 100199\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2024-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2666330924000165/pdfft?md5=a82fa9e12eadfb4154a6a5b593d56fbf&pid=1-s2.0-S2666330924000165-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Advanced Joining Processes\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666330924000165\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATERIALS SCIENCE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Advanced Joining Processes","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666330924000165","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
Prediction of internal welding penetration based on IR thermal image supported by machine vision and ANN-model during automatic robot welding process
Welding quality is a critical criterion for evaluating welding operations. Traditional evaluation methods suffer from drawbacks such as lack of objectivity, untimeliness, and high costs. Therefore, real-time monitoring and assessment of the weld pool have become the mainstream trend in welding technology. This study introduces a novel method for defining weld pool width boundaries. It utilizes an infrared (IR) camera to capture the weld pool temperature clusters and employs the Sobel operator for convolution to generate the gradient map of the weld pool temperature clusters. Through enhanced processing in the gradient map, the width boundaries of the weld pool are more effectively detected compared to previous methods. Previous studies defined weld pool width boundaries by identifying characteristic points with the most distinct temperature fluctuations, caused by the different radiative properties of the same material in different states. However, practical tests revealed susceptibility to interference from reflected arc light. The proposed method mitigates the impact of reflected arc light and is applicable to complex multilayer welding scenarios. To address the lag in quality monitoring, reduce welding costs, and achieve real-time monitoring of the weld pool process, we employed machine vision and an artificial neural network (ANN) model. This led to the development of a weld penetration assessment system based on infrared thermal images. The system successfully predicted the penetration depth for 4 mm carbon steel with an accuracy of 86.6 %. This validates the feasibility of estimating and predicting weld performance using the surface temperature characteristics of the weld pool. The newly proposed weld pool boundary definition method holds promise for real-time monitoring in more complex multilayer pipe welding scenarios. It lays the groundwork for predicting and fusing the weld depth in intricate multi-pass pipe welding.