A novel laser stripe key point tracker based on self-supervised learning and improved KCF for robotic welding seam tracking

IF 6.1 1区 工程技术 Q1 ENGINEERING, MANUFACTURING Journal of Manufacturing Processes Pub Date : 2024-08-14 DOI:10.1016/j.jmapro.2024.07.140
{"title":"A novel laser stripe key point tracker based on self-supervised learning and improved KCF for robotic welding seam tracking","authors":"","doi":"10.1016/j.jmapro.2024.07.140","DOIUrl":null,"url":null,"abstract":"<div><p>Laser vision based real-time welding seam tracking has emerged as a potent strategy for enabling intelligent robotic welding. And trackers based seam key point tracking algorithms demonstrate remarkable adaptability to complex welding environments. This paper proposed a self-supervised robust KCF (Kernelized Correlation Filter) tracker for seam key point tracking, which could be a novel approach to achieve autonomous seam tracking. Firstly, a self-supervised global-local feature extraction network is constructed, which can guide the model to focus on both global semantic and local texture features of laser stripes, thereby establishing a solid groundwork for stable key point tracking. Subsequently, a robust KCF tracking algorithm is presented. A multi-template enhanced tracker generation strategy is designed, and the corresponding analytical solution is derived, which can improve the tracker's representation capability of stripe features without significantly increasing computational complexity. Experimental results demonstrate that compared to traditional algorithms, the proposed algorithm exhibits advantages in tracking accuracy, stability, and real-time performance. Moreover, since the algorithm minimally relies on manually labeled data, it holds promise as a technological means to achieve fully autonomous seam tracking in actual welding production.</p></div>","PeriodicalId":16148,"journal":{"name":"Journal of Manufacturing Processes","volume":null,"pages":null},"PeriodicalIF":6.1000,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Processes","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1526612524008028","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0

Abstract

Laser vision based real-time welding seam tracking has emerged as a potent strategy for enabling intelligent robotic welding. And trackers based seam key point tracking algorithms demonstrate remarkable adaptability to complex welding environments. This paper proposed a self-supervised robust KCF (Kernelized Correlation Filter) tracker for seam key point tracking, which could be a novel approach to achieve autonomous seam tracking. Firstly, a self-supervised global-local feature extraction network is constructed, which can guide the model to focus on both global semantic and local texture features of laser stripes, thereby establishing a solid groundwork for stable key point tracking. Subsequently, a robust KCF tracking algorithm is presented. A multi-template enhanced tracker generation strategy is designed, and the corresponding analytical solution is derived, which can improve the tracker's representation capability of stripe features without significantly increasing computational complexity. Experimental results demonstrate that compared to traditional algorithms, the proposed algorithm exhibits advantages in tracking accuracy, stability, and real-time performance. Moreover, since the algorithm minimally relies on manually labeled data, it holds promise as a technological means to achieve fully autonomous seam tracking in actual welding production.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于自监督学习和改进型 KCF 的新型激光条纹关键点跟踪器,用于机器人焊缝跟踪
基于激光视觉的实时焊缝跟踪已成为实现智能机器人焊接的有效策略。基于焊缝关键点跟踪算法的跟踪器在复杂的焊接环境中表现出卓越的适应性。本文提出了一种用于焊缝关键点跟踪的自监督鲁棒 KCF(核化相关滤波)跟踪器,这可能是实现自主焊缝跟踪的一种新方法。首先,构建了一个自监督的全局-局部特征提取网络,该网络可以引导模型关注激光条纹的全局语义特征和局部纹理特征,从而为稳定的关键点跟踪奠定坚实的基础。随后,提出了一种稳健的 KCF 跟踪算法。设计了一种多模板增强型跟踪器生成策略,并推导出相应的解析解,在不显著增加计算复杂度的情况下,提高了跟踪器对条纹特征的表示能力。实验结果表明,与传统算法相比,所提出的算法在跟踪精度、稳定性和实时性方面都具有优势。此外,由于该算法对人工标注数据的依赖最小,因此有望成为在实际焊接生产中实现完全自主焊缝跟踪的技术手段。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Manufacturing Processes
Journal of Manufacturing Processes ENGINEERING, MANUFACTURING-
CiteScore
10.20
自引率
11.30%
发文量
833
审稿时长
50 days
期刊介绍: The aim of the Journal of Manufacturing Processes (JMP) is to exchange current and future directions of manufacturing processes research, development and implementation, and to publish archival scholarly literature with a view to advancing state-of-the-art manufacturing processes and encouraging innovation for developing new and efficient processes. The journal will also publish from other research communities for rapid communication of innovative new concepts. Special-topic issues on emerging technologies and invited papers will also be published.
期刊最新文献
Achieving high thermal conductivity joining of Cf/C and Haynes 230 by using Cu-Mo30Cu-Ti composite foil as thermal interface material Examining the impact of tool taper angle in Al-Si tube manufacturing by friction stir extrusion A theoretical calculation method for asymmetric active counter-roller spinning force by combining strain electrical measurement and simulation Laser powder bed fusion processing of plasma atomized AlSi10Mg powder: Surface roughness and mechanical properties modification Control of hole rolling on 3D Servo Presses
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1