Chuyi Dai , Congcong Wang , Zhixuan Zhou , Zhen Wang , Ding Liu
{"title":"WeldNet:一种用于机器人焊接中精确激光条纹提取的超快速测量算法","authors":"Chuyi Dai , Congcong Wang , Zhixuan Zhou , Zhen Wang , Ding Liu","doi":"10.1016/j.measurement.2024.116219","DOIUrl":null,"url":null,"abstract":"<div><div>The integration of laser vision sensors in robotic welding improves seam tracking accuracy, but welding noise poses significant challenges. Our research introduces WeldNet, enhances laser stripe extraction, significantly outperforming traditional and deep neural network (DNN) solutions in efficiency and measurement precision. WeldNet comprises lightweight modules for optimal feature extraction, including Multi-Part Channel Convolution (MPC) blocks, Parallel Shift Multilayer Perceptrons (PS-MLP), and Serial Shift MLP (SS-MLP). A specially designed data augmentation strategy is also integrated to address the complex noise encountered in robotic welding. Experimental results demonstrate WeldNet’s effectiveness in reducing welding noise interference, achieving a real-time processing speed of 145 FPS on RTX 2080 Ti GPU, approximately 5x faster than existing state-of-the-art methods. With a Dice coefficient of 87.52% and an IoU value of 77.82%, WeldNet not only enhances operational efficiency but also markedly improves precision in industrial robotic welding.</div></div>","PeriodicalId":18349,"journal":{"name":"Measurement","volume":"242 ","pages":"Article 116219"},"PeriodicalIF":5.2000,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"WeldNet: An ultra fast measurement algorithm for precision laser stripe extraction in robotic welding\",\"authors\":\"Chuyi Dai , Congcong Wang , Zhixuan Zhou , Zhen Wang , Ding Liu\",\"doi\":\"10.1016/j.measurement.2024.116219\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The integration of laser vision sensors in robotic welding improves seam tracking accuracy, but welding noise poses significant challenges. Our research introduces WeldNet, enhances laser stripe extraction, significantly outperforming traditional and deep neural network (DNN) solutions in efficiency and measurement precision. WeldNet comprises lightweight modules for optimal feature extraction, including Multi-Part Channel Convolution (MPC) blocks, Parallel Shift Multilayer Perceptrons (PS-MLP), and Serial Shift MLP (SS-MLP). A specially designed data augmentation strategy is also integrated to address the complex noise encountered in robotic welding. Experimental results demonstrate WeldNet’s effectiveness in reducing welding noise interference, achieving a real-time processing speed of 145 FPS on RTX 2080 Ti GPU, approximately 5x faster than existing state-of-the-art methods. With a Dice coefficient of 87.52% and an IoU value of 77.82%, WeldNet not only enhances operational efficiency but also markedly improves precision in industrial robotic welding.</div></div>\",\"PeriodicalId\":18349,\"journal\":{\"name\":\"Measurement\",\"volume\":\"242 \",\"pages\":\"Article 116219\"},\"PeriodicalIF\":5.2000,\"publicationDate\":\"2024-11-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Measurement\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0263224124021043\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Measurement","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0263224124021043","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
摘要
激光视觉传感器在机器人焊接中的集成提高了焊缝跟踪精度,但焊接噪声带来了重大挑战。我们的研究引入了WeldNet,增强了激光条纹提取,在效率和测量精度方面显着优于传统和深度神经网络(DNN)解决方案。WeldNet包括用于优化特征提取的轻量级模块,包括多部分通道卷积(MPC)模块、并行移位多层感知器(PS-MLP)和串行移位MLP (SS-MLP)。为了解决机器人焊接过程中遇到的复杂噪声问题,采用了一种特殊设计的数据增强策略。实验结果证明了WeldNet在降低焊接噪声干扰方面的有效性,在RTX 2080 Ti GPU上实现了145 FPS的实时处理速度,比现有最先进的方法快了大约5倍。WeldNet的Dice系数为87.52%,IoU值为77.82%,不仅提高了操作效率,而且显著提高了工业机器人焊接的精度。
WeldNet: An ultra fast measurement algorithm for precision laser stripe extraction in robotic welding
The integration of laser vision sensors in robotic welding improves seam tracking accuracy, but welding noise poses significant challenges. Our research introduces WeldNet, enhances laser stripe extraction, significantly outperforming traditional and deep neural network (DNN) solutions in efficiency and measurement precision. WeldNet comprises lightweight modules for optimal feature extraction, including Multi-Part Channel Convolution (MPC) blocks, Parallel Shift Multilayer Perceptrons (PS-MLP), and Serial Shift MLP (SS-MLP). A specially designed data augmentation strategy is also integrated to address the complex noise encountered in robotic welding. Experimental results demonstrate WeldNet’s effectiveness in reducing welding noise interference, achieving a real-time processing speed of 145 FPS on RTX 2080 Ti GPU, approximately 5x faster than existing state-of-the-art methods. With a Dice coefficient of 87.52% and an IoU value of 77.82%, WeldNet not only enhances operational efficiency but also markedly improves precision in industrial robotic welding.
期刊介绍:
Contributions are invited on novel achievements in all fields of measurement and instrumentation science and technology. Authors are encouraged to submit novel material, whose ultimate goal is an advancement in the state of the art of: measurement and metrology fundamentals, sensors, measurement instruments, measurement and estimation techniques, measurement data processing and fusion algorithms, evaluation procedures and methodologies for plants and industrial processes, performance analysis of systems, processes and algorithms, mathematical models for measurement-oriented purposes, distributed measurement systems in a connected world.