Yi Zhang , Zhonghai Song , Jiuwei Yu , Bingzhang Cao , Lei Wang
{"title":"一种基于双目视觉的机器人螺纹装配预对准姿态估计方法","authors":"Yi Zhang , Zhonghai Song , Jiuwei Yu , Bingzhang Cao , Lei Wang","doi":"10.1016/j.rcim.2024.102939","DOIUrl":null,"url":null,"abstract":"<div><div>Threaded assembly plays a critical role in industrial manufacturing; however, achieving a fully automated threaded assembly remains challenging. In this study, an automatic robot thread assembly system based on binocular vision was developed, along with a novel approach for spatial circle pose estimation. Notably, this method utilises the chamfering circle of the threaded hole as the recognition target and achieves precise pose estimation without requiring any prior knowledge, from a geometric perspective. Utilising only a chord of the ellipse projected from the circular feature of the threaded hole, the method effectively addresses the traditional reliance on complete target features. Additionally, it avoids the need for point cloud fitting, which is commonly used in conventional 3D pose estimation, thereby significantly reducing computational complexity and improving both efficiency and accuracy. An innovative method for verifying the spatial circle positioning accuracy is proposed based on the calibration plate coordinate system. The proposed method achieved position error ranges of [0.0419, 0.0837], [-0.0864, 0.0148], and [-0.0434, 0.0286] in mm along the x, y, and z axes, respectively. Furthermore, the orientation error ranged from 0.649° - 1.752° To comprehensively consider the origin of the various errors, a workpiece was designed to conduct robot alignment experiments. The average errors along the x, y, and z axes were -0.23, -0.57, and -0.45 mm, respectively. Overall, the proposed vision measurement method demonstrated excellent pose estimation accuracy and significantly enhanced the automation of robotic threaded assembly processes. This advancement holds great potential for widespread applications in industrial manufacturing environments.</div></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"93 ","pages":"Article 102939"},"PeriodicalIF":9.1000,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel pose estimation method for robot threaded assembly pre-alignment based on binocular vision\",\"authors\":\"Yi Zhang , Zhonghai Song , Jiuwei Yu , Bingzhang Cao , Lei Wang\",\"doi\":\"10.1016/j.rcim.2024.102939\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Threaded assembly plays a critical role in industrial manufacturing; however, achieving a fully automated threaded assembly remains challenging. In this study, an automatic robot thread assembly system based on binocular vision was developed, along with a novel approach for spatial circle pose estimation. Notably, this method utilises the chamfering circle of the threaded hole as the recognition target and achieves precise pose estimation without requiring any prior knowledge, from a geometric perspective. Utilising only a chord of the ellipse projected from the circular feature of the threaded hole, the method effectively addresses the traditional reliance on complete target features. Additionally, it avoids the need for point cloud fitting, which is commonly used in conventional 3D pose estimation, thereby significantly reducing computational complexity and improving both efficiency and accuracy. An innovative method for verifying the spatial circle positioning accuracy is proposed based on the calibration plate coordinate system. The proposed method achieved position error ranges of [0.0419, 0.0837], [-0.0864, 0.0148], and [-0.0434, 0.0286] in mm along the x, y, and z axes, respectively. Furthermore, the orientation error ranged from 0.649° - 1.752° To comprehensively consider the origin of the various errors, a workpiece was designed to conduct robot alignment experiments. The average errors along the x, y, and z axes were -0.23, -0.57, and -0.45 mm, respectively. Overall, the proposed vision measurement method demonstrated excellent pose estimation accuracy and significantly enhanced the automation of robotic threaded assembly processes. This advancement holds great potential for widespread applications in industrial manufacturing environments.</div></div>\",\"PeriodicalId\":21452,\"journal\":{\"name\":\"Robotics and Computer-integrated Manufacturing\",\"volume\":\"93 \",\"pages\":\"Article 102939\"},\"PeriodicalIF\":9.1000,\"publicationDate\":\"2024-12-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Robotics and Computer-integrated Manufacturing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0736584524002266\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Computer-integrated Manufacturing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0736584524002266","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
A novel pose estimation method for robot threaded assembly pre-alignment based on binocular vision
Threaded assembly plays a critical role in industrial manufacturing; however, achieving a fully automated threaded assembly remains challenging. In this study, an automatic robot thread assembly system based on binocular vision was developed, along with a novel approach for spatial circle pose estimation. Notably, this method utilises the chamfering circle of the threaded hole as the recognition target and achieves precise pose estimation without requiring any prior knowledge, from a geometric perspective. Utilising only a chord of the ellipse projected from the circular feature of the threaded hole, the method effectively addresses the traditional reliance on complete target features. Additionally, it avoids the need for point cloud fitting, which is commonly used in conventional 3D pose estimation, thereby significantly reducing computational complexity and improving both efficiency and accuracy. An innovative method for verifying the spatial circle positioning accuracy is proposed based on the calibration plate coordinate system. The proposed method achieved position error ranges of [0.0419, 0.0837], [-0.0864, 0.0148], and [-0.0434, 0.0286] in mm along the x, y, and z axes, respectively. Furthermore, the orientation error ranged from 0.649° - 1.752° To comprehensively consider the origin of the various errors, a workpiece was designed to conduct robot alignment experiments. The average errors along the x, y, and z axes were -0.23, -0.57, and -0.45 mm, respectively. Overall, the proposed vision measurement method demonstrated excellent pose estimation accuracy and significantly enhanced the automation of robotic threaded assembly processes. This advancement holds great potential for widespread applications in industrial manufacturing environments.
期刊介绍:
The journal, Robotics and Computer-Integrated Manufacturing, focuses on sharing research applications that contribute to the development of new or enhanced robotics, manufacturing technologies, and innovative manufacturing strategies that are relevant to industry. Papers that combine theory and experimental validation are preferred, while review papers on current robotics and manufacturing issues are also considered. However, papers on traditional machining processes, modeling and simulation, supply chain management, and resource optimization are generally not within the scope of the journal, as there are more appropriate journals for these topics. Similarly, papers that are overly theoretical or mathematical will be directed to other suitable journals. The journal welcomes original papers in areas such as industrial robotics, human-robot collaboration in manufacturing, cloud-based manufacturing, cyber-physical production systems, big data analytics in manufacturing, smart mechatronics, machine learning, adaptive and sustainable manufacturing, and other fields involving unique manufacturing technologies.