一种基于双目视觉的机器人螺纹装配预对准姿态估计方法

IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Robotics and Computer-integrated Manufacturing Pub Date : 2024-12-25 DOI:10.1016/j.rcim.2024.102939
Yi Zhang , Zhonghai Song , Jiuwei Yu , Bingzhang Cao , Lei Wang
{"title":"一种基于双目视觉的机器人螺纹装配预对准姿态估计方法","authors":"Yi Zhang ,&nbsp;Zhonghai Song ,&nbsp;Jiuwei Yu ,&nbsp;Bingzhang Cao ,&nbsp;Lei Wang","doi":"10.1016/j.rcim.2024.102939","DOIUrl":null,"url":null,"abstract":"<div><div>Threaded assembly plays a critical role in industrial manufacturing; however, achieving a fully automated threaded assembly remains challenging. In this study, an automatic robot thread assembly system based on binocular vision was developed, along with a novel approach for spatial circle pose estimation. Notably, this method utilises the chamfering circle of the threaded hole as the recognition target and achieves precise pose estimation without requiring any prior knowledge, from a geometric perspective. Utilising only a chord of the ellipse projected from the circular feature of the threaded hole, the method effectively addresses the traditional reliance on complete target features. Additionally, it avoids the need for point cloud fitting, which is commonly used in conventional 3D pose estimation, thereby significantly reducing computational complexity and improving both efficiency and accuracy. An innovative method for verifying the spatial circle positioning accuracy is proposed based on the calibration plate coordinate system. The proposed method achieved position error ranges of [0.0419, 0.0837], [-0.0864, 0.0148], and [-0.0434, 0.0286] in mm along the x, y, and z axes, respectively. Furthermore, the orientation error ranged from 0.649° - 1.752° To comprehensively consider the origin of the various errors, a workpiece was designed to conduct robot alignment experiments. The average errors along the x, y, and z axes were -0.23, -0.57, and -0.45 mm, respectively. Overall, the proposed vision measurement method demonstrated excellent pose estimation accuracy and significantly enhanced the automation of robotic threaded assembly processes. This advancement holds great potential for widespread applications in industrial manufacturing environments.</div></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"93 ","pages":"Article 102939"},"PeriodicalIF":9.1000,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel pose estimation method for robot threaded assembly pre-alignment based on binocular vision\",\"authors\":\"Yi Zhang ,&nbsp;Zhonghai Song ,&nbsp;Jiuwei Yu ,&nbsp;Bingzhang Cao ,&nbsp;Lei Wang\",\"doi\":\"10.1016/j.rcim.2024.102939\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Threaded assembly plays a critical role in industrial manufacturing; however, achieving a fully automated threaded assembly remains challenging. In this study, an automatic robot thread assembly system based on binocular vision was developed, along with a novel approach for spatial circle pose estimation. Notably, this method utilises the chamfering circle of the threaded hole as the recognition target and achieves precise pose estimation without requiring any prior knowledge, from a geometric perspective. Utilising only a chord of the ellipse projected from the circular feature of the threaded hole, the method effectively addresses the traditional reliance on complete target features. Additionally, it avoids the need for point cloud fitting, which is commonly used in conventional 3D pose estimation, thereby significantly reducing computational complexity and improving both efficiency and accuracy. An innovative method for verifying the spatial circle positioning accuracy is proposed based on the calibration plate coordinate system. The proposed method achieved position error ranges of [0.0419, 0.0837], [-0.0864, 0.0148], and [-0.0434, 0.0286] in mm along the x, y, and z axes, respectively. Furthermore, the orientation error ranged from 0.649° - 1.752° To comprehensively consider the origin of the various errors, a workpiece was designed to conduct robot alignment experiments. The average errors along the x, y, and z axes were -0.23, -0.57, and -0.45 mm, respectively. Overall, the proposed vision measurement method demonstrated excellent pose estimation accuracy and significantly enhanced the automation of robotic threaded assembly processes. This advancement holds great potential for widespread applications in industrial manufacturing environments.</div></div>\",\"PeriodicalId\":21452,\"journal\":{\"name\":\"Robotics and Computer-integrated Manufacturing\",\"volume\":\"93 \",\"pages\":\"Article 102939\"},\"PeriodicalIF\":9.1000,\"publicationDate\":\"2024-12-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Robotics and Computer-integrated Manufacturing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0736584524002266\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Computer-integrated Manufacturing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0736584524002266","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

螺纹装配在工业制造中起着至关重要的作用;然而,实现全自动螺纹装配仍然具有挑战性。本研究开发了一种基于双目视觉的机器人螺纹自动装配系统,并提出了一种新的空间圆位姿估计方法。值得注意的是,该方法从几何角度利用螺纹孔的倒角圆作为识别目标,无需任何先验知识即可实现精确的姿态估计。该方法仅利用螺纹孔圆形特征投射的椭圆弦,有效地解决了传统上对完整目标特征的依赖。此外,它避免了传统3D姿态估计中常用的点云拟合的需要,从而大大降低了计算复杂度,提高了效率和精度。提出了一种基于标定板坐标系的空间圆定位精度验证方法。该方法在x、y和z轴上的位置误差范围分别为[0.0419、0.0837]、[-0.0864、0.0148]和[-0.0434、0.0286]mm。为了综合考虑各种误差的来源,设计了一个工件进行机器人对中实验。沿x、y、z轴的平均误差分别为-0.23、-0.57、-0.45 mm。总体而言,所提出的视觉测量方法具有良好的姿态估计精度,显著提高了机器人螺纹装配过程的自动化程度。这一进步在工业制造环境中具有广泛应用的巨大潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A novel pose estimation method for robot threaded assembly pre-alignment based on binocular vision
Threaded assembly plays a critical role in industrial manufacturing; however, achieving a fully automated threaded assembly remains challenging. In this study, an automatic robot thread assembly system based on binocular vision was developed, along with a novel approach for spatial circle pose estimation. Notably, this method utilises the chamfering circle of the threaded hole as the recognition target and achieves precise pose estimation without requiring any prior knowledge, from a geometric perspective. Utilising only a chord of the ellipse projected from the circular feature of the threaded hole, the method effectively addresses the traditional reliance on complete target features. Additionally, it avoids the need for point cloud fitting, which is commonly used in conventional 3D pose estimation, thereby significantly reducing computational complexity and improving both efficiency and accuracy. An innovative method for verifying the spatial circle positioning accuracy is proposed based on the calibration plate coordinate system. The proposed method achieved position error ranges of [0.0419, 0.0837], [-0.0864, 0.0148], and [-0.0434, 0.0286] in mm along the x, y, and z axes, respectively. Furthermore, the orientation error ranged from 0.649° - 1.752° To comprehensively consider the origin of the various errors, a workpiece was designed to conduct robot alignment experiments. The average errors along the x, y, and z axes were -0.23, -0.57, and -0.45 mm, respectively. Overall, the proposed vision measurement method demonstrated excellent pose estimation accuracy and significantly enhanced the automation of robotic threaded assembly processes. This advancement holds great potential for widespread applications in industrial manufacturing environments.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Robotics and Computer-integrated Manufacturing
Robotics and Computer-integrated Manufacturing 工程技术-工程:制造
CiteScore
24.10
自引率
13.50%
发文量
160
审稿时长
50 days
期刊介绍: The journal, Robotics and Computer-Integrated Manufacturing, focuses on sharing research applications that contribute to the development of new or enhanced robotics, manufacturing technologies, and innovative manufacturing strategies that are relevant to industry. Papers that combine theory and experimental validation are preferred, while review papers on current robotics and manufacturing issues are also considered. However, papers on traditional machining processes, modeling and simulation, supply chain management, and resource optimization are generally not within the scope of the journal, as there are more appropriate journals for these topics. Similarly, papers that are overly theoretical or mathematical will be directed to other suitable journals. The journal welcomes original papers in areas such as industrial robotics, human-robot collaboration in manufacturing, cloud-based manufacturing, cyber-physical production systems, big data analytics in manufacturing, smart mechatronics, machine learning, adaptive and sustainable manufacturing, and other fields involving unique manufacturing technologies.
期刊最新文献
Proposing a model based on deep reinforcement learning for real-time scheduling of collaborative customization remanufacturing Generalizing kinematic skill learning to energy efficient dynamic motion planning using optimized Dynamic Movement Primitives A step-driven framework of digital twin model for product assembly precision based on polychromatic sets Reinforcement Learning-based five-axis continuous inspection method for complex freeform surface VLM-MSGraph: Vision Language Model-enabled Multi-hierarchical Scene Graph for robotic assembly
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1