首页 > 最新文献

Robotics and Computer-integrated Manufacturing最新文献

英文 中文
Design of a mixed robotic machining system and its application in support removal from metal additive manufactured thin-wall parts 混合机器人加工系统的设计及其在金属增材制造薄壁部件支撑去除中的应用
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-21 DOI: 10.1016/j.rcim.2024.102878
Pengfei Su , Wei Wang , Kaiyuan Liu , Jin Zhang , Yantao He , Zhimin Wang , Lianyu Zheng

Robotic machining could provide a solution for removing supports from metal additive manufactured workpieces, replacing labor-intensive work. However, the robot’s intrinsic weaknesses of low positioning accuracy and structural rigidity primarily restrict its applications. Improving the accuracy of robotic machining remains an unresolved issue. A mixed solution is proposed, in which a portable CNC machine with the capability of visual feature recognition is equipped with a universal industrial robot. The robot implements positioning motions in a large space, while the portable CNC fulfills accurate machining motions on a local feature of the workpiece. A sizeable weight of the portable CNC exerts a moderate load on the industrial robot’s joints, increasing joint stiffness. The mixed machining system exhibits high accuracy and stiffness when milling a steel/titanium alloy workpiece, achieving tolerances up to ±0.04 mm on a 60×80 mm U-shaped path without exciting any structural vibration modes. When the dimension of the workpiece exceeds the machining range of the portable CNC, a combined algorithm of coarse-fine registration based visual identification and robot error compensation is designed to align the spatial coordinates of the machining motion with that of the positioning motion, thereby extending the machining range with high accuracy. Through the proposed mixed robot machining method, experiments of doubling the machining range have been done to verify that the mixed machining robotic system is able to slot a 550 mm-long path with accuracy of ±0.1 mm. Furthermore, the mixed robotic machining system is applied to recognize and remove multiple supports of lattices, grids and ribs from a titanium-alloy additive manufactured thin-wall workpiece with high accuracy and high efficiency.

机器人加工可为金属添加剂制造的工件去除支撑物提供解决方案,从而取代劳动密集型工作。然而,机器人定位精度低和结构刚性差的固有弱点主要限制了其应用。提高机器人加工的精度仍是一个悬而未决的问题。本文提出了一种混合解决方案,即在具有视觉特征识别功能的便携式数控机床上配备一个通用工业机器人。机器人在大空间内执行定位动作,而便携式数控机床则对工件的局部特征执行精确的加工动作。便携式数控系统的重量较大,会对工业机器人的关节造成一定的负荷,从而增加关节的刚度。在铣削钢/钛合金工件时,混合加工系统表现出很高的精度和刚度,在 60×80 mm 的 U 形路径上实现了高达 ±0.04 mm 的公差,且不会产生任何结构振动模式。当工件尺寸超出便携式数控系统的加工范围时,设计了一种基于视觉识别和机器人误差补偿的粗-细注册组合算法,使加工运动的空间坐标与定位运动的空间坐标保持一致,从而高精度地扩展了加工范围。通过所提出的混合机器人加工方法,进行了加工范围扩大一倍的实验,验证了混合加工机器人系统能够在 550 毫米长的路径上开槽,精度为 ±0.1 毫米。此外,混合机器人加工系统还能高精度、高效率地识别和去除钛合金增材制造薄壁工件上的多个支撑网格、栅格和肋条。
{"title":"Design of a mixed robotic machining system and its application in support removal from metal additive manufactured thin-wall parts","authors":"Pengfei Su ,&nbsp;Wei Wang ,&nbsp;Kaiyuan Liu ,&nbsp;Jin Zhang ,&nbsp;Yantao He ,&nbsp;Zhimin Wang ,&nbsp;Lianyu Zheng","doi":"10.1016/j.rcim.2024.102878","DOIUrl":"10.1016/j.rcim.2024.102878","url":null,"abstract":"<div><p>Robotic machining could provide a solution for removing supports from metal additive manufactured workpieces, replacing labor-intensive work. However, the robot’s intrinsic weaknesses of low positioning accuracy and structural rigidity primarily restrict its applications. Improving the accuracy of robotic machining remains an unresolved issue. A mixed solution is proposed, in which a portable CNC machine with the capability of visual feature recognition is equipped with a universal industrial robot. The robot implements positioning motions in a large space, while the portable CNC fulfills accurate machining motions on a local feature of the workpiece. A sizeable weight of the portable CNC exerts a moderate load on the industrial robot’s joints, increasing joint stiffness. The mixed machining system exhibits high accuracy and stiffness when milling a steel/titanium alloy workpiece, achieving tolerances up to ±0.04 mm on a 60×80 mm U-shaped path without exciting any structural vibration modes. When the dimension of the workpiece exceeds the machining range of the portable CNC, a combined algorithm of coarse-fine registration based visual identification and robot error compensation is designed to align the spatial coordinates of the machining motion with that of the positioning motion, thereby extending the machining range with high accuracy. Through the proposed mixed robot machining method, experiments of doubling the machining range have been done to verify that the mixed machining robotic system is able to slot a 550 mm-long path with accuracy of ±0.1 mm. Furthermore, the mixed robotic machining system is applied to recognize and remove multiple supports of lattices, grids and ribs from a titanium-alloy additive manufactured thin-wall workpiece with high accuracy and high efficiency.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102878"},"PeriodicalIF":9.1,"publicationDate":"2024-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142274888","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Accurate backside boundary recognition of girth weld beads 准确识别环缝焊珠背面边界
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-20 DOI: 10.1016/j.rcim.2024.102880
Haibo Liu , Tian Lan , Te Li , Jingchao Ai , Yongqing Wang , Yu Sun

Visual recognition of weld beads is essential for post-weld robotic grinding. The recognition of thin-walled weld bead boundary, especially the backside boundary, remains challenging due to the diverse features such as debris, misalignment, and deformation. Based on point cloud from a laser scanner, we present a robust and accurate backside boundary recognition method for girth weld beads of thin-walled pipes. A boundary point extraction method is designed based on an adaptive sliding window model. Without prior morphology features, the influence of misalignment and deformation on the accuracy of boundary point recognition is greatly reduced by the local model matching strategy. Leveraging the correlation among overall weld bead features, an anomalous boundary point recognition and correction method based on DBSCAN clustering is proposed to further enhance robustness. A series of validation experiments were conducted by the obtained backside point cloud data inside a girth weld pipe, and our proposed method showed a high accuracy and a high robustness to misalignment, deformation and debris features.

焊珠的视觉识别对于焊后机器人打磨至关重要。由于存在碎屑、错位和变形等多种特征,薄壁焊珠边界(尤其是背面边界)的识别仍具有挑战性。基于激光扫描仪的点云,我们提出了一种稳健、准确的薄壁管道环缝焊缝背面边界识别方法。我们设计了一种基于自适应滑动窗口模型的边界点提取方法。在没有先验形态特征的情况下,局部模型匹配策略大大降低了错位和变形对边界点识别准确性的影响。利用整体焊珠特征之间的相关性,提出了一种基于 DBSCAN 聚类的异常边界点识别和修正方法,以进一步提高鲁棒性。我们利用获得的环缝焊管内背面点云数据进行了一系列验证实验,结果表明我们提出的方法具有较高的准确性,并且对错位、变形和碎片特征具有较高的鲁棒性。
{"title":"Accurate backside boundary recognition of girth weld beads","authors":"Haibo Liu ,&nbsp;Tian Lan ,&nbsp;Te Li ,&nbsp;Jingchao Ai ,&nbsp;Yongqing Wang ,&nbsp;Yu Sun","doi":"10.1016/j.rcim.2024.102880","DOIUrl":"10.1016/j.rcim.2024.102880","url":null,"abstract":"<div><p>Visual recognition of weld beads is essential for post-weld robotic grinding. The recognition of thin-walled weld bead boundary, especially the backside boundary, remains challenging due to the diverse features such as debris, misalignment, and deformation. Based on point cloud from a laser scanner, we present a robust and accurate backside boundary recognition method for girth weld beads of thin-walled pipes. A boundary point extraction method is designed based on an adaptive sliding window model. Without prior morphology features, the influence of misalignment and deformation on the accuracy of boundary point recognition is greatly reduced by the local model matching strategy. Leveraging the correlation among overall weld bead features, an anomalous boundary point recognition and correction method based on DBSCAN clustering is proposed to further enhance robustness. A series of validation experiments were conducted by the obtained backside point cloud data inside a girth weld pipe, and our proposed method showed a high accuracy and a high robustness to misalignment, deformation and debris features.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102880"},"PeriodicalIF":9.1,"publicationDate":"2024-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142274889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A method for detecting process design intent in the process route based on heterogeneous graph convolutional networks 一种基于异构图卷积网络检测工艺路线中工艺设计意图的方法
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-19 DOI: 10.1016/j.rcim.2024.102872
Jiachen Liang , Shusheng Zhang , Changhong Xu , Yajun Zhang , Rui Huang , Hang Zhang , Zhen Wang

The process design intent is the concentration of the technologists’ design cognitive process which contains the experiential knowledge and skills. It can reproduce technologists’ design thinking process in process design and provides guidance and interpretability for the generation of process results. The machining process route, as a core component of a part's entire manufacturing process, contains substantial process design intent. If the process design intent embedded in the existing process route can be explicitly identified, subsequent technologists will be able to learn and understand the original designers’ thinking, methodologies, and intents. This understanding enables effective reuse of design thinking and logic in the process design of new parts, rather than merely reusing data. It can also promote the propagation of the expertise and skills inherent in the process design intent. However, existing research on process design intent lacks a detailed explanation of its formation and specific structure from the design cognition perspective, making it challenging to effectively predict the process design intent containing interpretable empirical knowledge in the process route. To address this issue, this paper provides a method for predicting process design intent in the process route using heterogeneous graph convolutional networks. First, the heterogeneous graph is used to represent the parts and their associated process routes in the dataset. The nodes in the graph are then labeled based on accumulated and summarized process design intent. The prediction of process design intent in the process route is then converted into a node classification issue with heterogeneous graphs. A node classification network model is constructed using a heterogeneous graph convolutional network where the input is the created heterogeneous graph, and the output is the design reason contained in the machining feature and the intent cognition embedded in the working step, both of which are part of the process design intent. After training, the proposed model accurately predicted design reasons for machining features and intent cognitions for working steps (95.13 % and 96.85 %, respectively). Finally, examples of actual process routes are analyzed to verify the method's feasibility and reliability. The method given in this article can help technologists gain a deeper understanding of process route generation, hence improving their process design capabilities.

工艺设计意图是技术人员设计认知过程的集中体现,其中包含经验知识和技能。它可以再现技术人员在工艺设计中的设计思维过程,并为工艺结果的生成提供指导和可解释性。加工工艺路线作为零件整个制造过程的核心组成部分,包含了大量的工艺设计意图。如果能明确识别现有工艺路线中蕴含的工艺设计意图,后续技术人员就能学习和理解原始设计者的思维、方法和意图。通过这种理解,可以在新部件的工艺设计中有效地重复使用设计思维和逻辑,而不仅仅是重复使用数据。它还能促进工艺设计意图中固有的专业知识和技能的传播。然而,现有关于工艺设计意图的研究缺乏从设计认知角度对其形成和具体结构的详细解释,这使得在工艺路线中有效预测包含可解释经验知识的工艺设计意图具有挑战性。针对这一问题,本文提供了一种利用异构图卷积网络预测工艺路线中工艺设计意图的方法。首先,使用异构图来表示数据集中的零件及其相关工艺路线。然后,根据积累和总结的工艺设计意图对图中的节点进行标注。然后将工艺路线中的工艺设计意图预测转化为异构图的节点分类问题。使用异构图卷积网络构建节点分类网络模型,输入是创建的异构图,输出是加工特征中包含的设计原因和工作步骤中蕴含的意图认知,两者都是工艺设计意图的一部分。经过训练后,所提出的模型能准确预测加工特征的设计原因和工作步骤的意图认知(分别为 95.13 % 和 96.85 %)。最后,对实际工艺路线的实例进行了分析,以验证该方法的可行性和可靠性。本文给出的方法可以帮助技术人员更深入地了解工艺路线的生成,从而提高他们的工艺设计能力。
{"title":"A method for detecting process design intent in the process route based on heterogeneous graph convolutional networks","authors":"Jiachen Liang ,&nbsp;Shusheng Zhang ,&nbsp;Changhong Xu ,&nbsp;Yajun Zhang ,&nbsp;Rui Huang ,&nbsp;Hang Zhang ,&nbsp;Zhen Wang","doi":"10.1016/j.rcim.2024.102872","DOIUrl":"10.1016/j.rcim.2024.102872","url":null,"abstract":"<div><p>The process design intent is the concentration of the technologists’ design cognitive process which contains the experiential knowledge and skills. It can reproduce technologists’ design thinking process in process design and provides guidance and interpretability for the generation of process results. The machining process route, as a core component of a part's entire manufacturing process, contains substantial process design intent. If the process design intent embedded in the existing process route can be explicitly identified, subsequent technologists will be able to learn and understand the original designers’ thinking, methodologies, and intents. This understanding enables effective reuse of design thinking and logic in the process design of new parts, rather than merely reusing data. It can also promote the propagation of the expertise and skills inherent in the process design intent. However, existing research on process design intent lacks a detailed explanation of its formation and specific structure from the design cognition perspective, making it challenging to effectively predict the process design intent containing interpretable empirical knowledge in the process route. To address this issue, this paper provides a method for predicting process design intent in the process route using heterogeneous graph convolutional networks. First, the heterogeneous graph is used to represent the parts and their associated process routes in the dataset. The nodes in the graph are then labeled based on accumulated and summarized process design intent. The prediction of process design intent in the process route is then converted into a node classification issue with heterogeneous graphs. A node classification network model is constructed using a heterogeneous graph convolutional network where the input is the created heterogeneous graph, and the output is the design reason contained in the machining feature and the intent cognition embedded in the working step, both of which are part of the process design intent. After training, the proposed model accurately predicted design reasons for machining features and intent cognitions for working steps (95.13 % and 96.85 %, respectively). Finally, examples of actual process routes are analyzed to verify the method's feasibility and reliability. The method given in this article can help technologists gain a deeper understanding of process route generation, hence improving their process design capabilities.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102872"},"PeriodicalIF":9.1,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142240697","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A corrective shared control architecture for human–robot collaborative polishing tasks 用于人机协作抛光任务的纠正共享控制架构
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-18 DOI: 10.1016/j.rcim.2024.102876
Hao Zhou , Xin Zhang , Jinguo Liu

Human–robot collaborative polishing can integrate the capabilities of humans and automation to deal with complex polishing tasks. Traditional impedance-control-based human–robot collaboration (HRC) requires operators to physically interact with robots for a good polishing performance, which brings unsafety to operators. To address this issue, a corrective shared control architecture using haptic feedback is proposed in this paper, where the direct force-reflection is used to guarantee the exact human-intention intervention. The proposed control architecture is designed with two layers: (i) the transparency layer in which the direct force-reflection and the human–robot collaborative polishing strategy are implemented; (ii) the passivity layer in which two energy tanks are designed and endowed with master and slave sides and a coupling energy scaling policy is employed to guarantee the passivity of the whole system. Under the proposed architecture, the constant force is adopted to polish normal areas of workpieces, and corrective force based on human intention is applied to deal with unexpected issues. Finally, two groups of experiments are conducted to evaluate the proposed architecture from two aspects: polishing effect and user experience.

人机协作抛光可以整合人类和自动化的能力,以处理复杂的抛光任务。传统的基于阻抗控制的人机协作(HRC)需要操作员与机器人进行物理交互才能获得良好的抛光性能,这给操作员带来了不安全性。为解决这一问题,本文提出了一种使用触觉反馈的矫正共享控制架构,其中使用直接力反射来保证准确的人类意图干预。所提出的控制架构设计了两层:(i) 透明层,在此层中实现了直接力反馈和人机协作抛光策略;(ii) 被动层,在此层中设计了两个能量槽,并分别赋予主从两侧,同时采用耦合能量缩放策略来保证整个系统的被动性。在提出的架构下,采用恒定力打磨工件的正常区域,并根据人的意图施加修正力以处理突发问题。最后,我们进行了两组实验,从抛光效果和用户体验两个方面对所提出的架构进行了评估。
{"title":"A corrective shared control architecture for human–robot collaborative polishing tasks","authors":"Hao Zhou ,&nbsp;Xin Zhang ,&nbsp;Jinguo Liu","doi":"10.1016/j.rcim.2024.102876","DOIUrl":"10.1016/j.rcim.2024.102876","url":null,"abstract":"<div><p>Human–robot collaborative polishing can integrate the capabilities of humans and automation to deal with complex polishing tasks. Traditional impedance-control-based human–robot collaboration (HRC) requires operators to physically interact with robots for a good polishing performance, which brings unsafety to operators. To address this issue, a corrective shared control architecture using haptic feedback is proposed in this paper, where the direct force-reflection is used to guarantee the exact human-intention intervention. The proposed control architecture is designed with two layers: (i) the transparency layer in which the direct force-reflection and the human–robot collaborative polishing strategy are implemented; (ii) the passivity layer in which two energy tanks are designed and endowed with master and slave sides and a coupling energy scaling policy is employed to guarantee the passivity of the whole system. Under the proposed architecture, the constant force is adopted to polish normal areas of workpieces, and corrective force based on human intention is applied to deal with unexpected issues. Finally, two groups of experiments are conducted to evaluate the proposed architecture from two aspects: polishing effect and user experience.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102876"},"PeriodicalIF":9.1,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142240696","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A parallel graph network for generating 7-DoF model-free grasps in unstructured scenes using point cloud 利用点云在非结构化场景中生成 7-DoF 无模型抓手的并行图网络
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-17 DOI: 10.1016/j.rcim.2024.102879
Chungang Zhuang, Haowen Wang, Wanhao Niu, Han Ding

Generating model-free grasps in complex scattered scenes remains a challenging task. Most current methods adopt PointNet++ as the backbone to extract structural features, while the relative associations of geometry are underexplored, leading to non-optimal grasp prediction results. In this work, a parallelized graph-based pipeline is developed to solve the 7-DoF grasp pose generation problem with point cloud as input. Using the non-textured information of the grasping scene, the proposed pipeline simultaneously performs feature embedding and grasping location focusing in two branches, avoiding the mutual influence of the two learning processes. In the feature learning branch, the geometric features of the whole scene will be fully learned. In the location focusing branch, the high-value grasping locations on the surface of objects will be strategically selected. Using the learned graph features at these locations, the pipeline will eventually output refined grasping directions and widths in conjunction with local spatial features. To strengthen the positional features in the grasping problem, a graph convolution operator based on the positional attention mechanism is designed, and a graph residual network based on this operator is applied in two branches. The above pipeline abstracts the grasping location selection task from the main process of grasp generation, which lowers the learning difficulty while avoiding the performance degradation problem of deep graph networks. The established pipeline is evaluated on the GraspNet-1Billion dataset, demonstrating much better performance and stronger generalization capabilities than the benchmark approach. In robotic bin-picking experiments, the proposed method can effectively understand scattered grasping scenarios and grasp multiple types of unknown objects with a high success rate.

在复杂的零散场景中生成无模型抓取仍然是一项具有挑战性的任务。目前的大多数方法都采用 PointNet++ 作为提取结构特征的骨干,而对几何图形的相对关联探索不足,导致抓取预测结果不理想。在这项工作中,开发了一种基于图的并行化流水线,用于解决以点云为输入的 7-DoF 抓姿生成问题。利用抓取场景的非纹理信息,所提出的流水线在两个分支中同时执行特征嵌入和抓取位置聚焦,避免了两个学习过程的相互影响。在特征学习分支中,整个场景的几何特征将被完全学习。在位置聚焦分支中,将战略性地选择物体表面的高价值抓取位置。利用在这些位置学习到的图形特征,管道将结合局部空间特征,最终输出细化的抓取方向和宽度。为了强化抓取问题中的位置特征,我们设计了基于位置注意力机制的图卷积算子,并在两个分支中应用了基于该算子的图残差网络。上述管道将抓取位置选择任务从抓取生成的主要过程中抽象出来,降低了学习难度,同时避免了深度图网络的性能下降问题。在 GraspNet-1Billion 数据集上对所建立的管道进行了评估,结果表明其性能和泛化能力远远优于基准方法。在机器人分拣实验中,所提出的方法能有效地理解分散的抓取场景,并以较高的成功率抓取多种类型的未知物体。
{"title":"A parallel graph network for generating 7-DoF model-free grasps in unstructured scenes using point cloud","authors":"Chungang Zhuang,&nbsp;Haowen Wang,&nbsp;Wanhao Niu,&nbsp;Han Ding","doi":"10.1016/j.rcim.2024.102879","DOIUrl":"10.1016/j.rcim.2024.102879","url":null,"abstract":"<div><p>Generating model-free grasps in complex scattered scenes remains a challenging task. Most current methods adopt PointNet++ as the backbone to extract structural features, while the relative associations of geometry are underexplored, leading to non-optimal grasp prediction results. In this work, a parallelized graph-based pipeline is developed to solve the 7-DoF grasp pose generation problem with point cloud as input. Using the non-textured information of the grasping scene, the proposed pipeline simultaneously performs feature embedding and grasping location focusing in two branches, avoiding the mutual influence of the two learning processes. In the feature learning branch, the geometric features of the whole scene will be fully learned. In the location focusing branch, the high-value grasping locations on the surface of objects will be strategically selected. Using the learned graph features at these locations, the pipeline will eventually output refined grasping directions and widths in conjunction with local spatial features. To strengthen the positional features in the grasping problem, a graph convolution operator based on the positional attention mechanism is designed, and a graph residual network based on this operator is applied in two branches. The above pipeline abstracts the grasping location selection task from the main process of grasp generation, which lowers the learning difficulty while avoiding the performance degradation problem of deep graph networks. The established pipeline is evaluated on the GraspNet-1Billion dataset, demonstrating much better performance and stronger generalization capabilities than the benchmark approach. In robotic bin-picking experiments, the proposed method can effectively understand scattered grasping scenarios and grasp multiple types of unknown objects with a high success rate.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102879"},"PeriodicalIF":9.1,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142240695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A vision-guided adaptive and optimized robotic fabric gripping system for garment manufacturing automation 用于服装制造自动化的视觉引导自适应优化机器人织物抓取系统
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-16 DOI: 10.1016/j.rcim.2024.102874
Young Woon Choi , Jiho Lee , Yongho Lee , Suhyun Lee , Wonyoung Jeong , Dae Young Lim , Sang Won Lee

Automating fabric manipulation in garment manufacturing remains a challenging task due to the characteristics of limp sheet materials and the diversity of fabrics used. This paper introduces an adaptive and optimized robotic fabric handling system, designed to address these challenges. The system comprises an industrial robot, four needle grippers, and a novel adaptive gripper jig system capable of adjusting the positions of the grippers adaptively to accommodate the shape and material properties of the garment fabric parts. To do this, an in-depth analysis of fabric gripping characteristics—accounting for material properties, gripping position, and fabric deformation—is conducted. A two-stage machine learning model predicting fabric deflection and folding is established from the analyzed data. This model is then incorporated into a vision-guided algorithm that determines the optimal gripping points on garment parts using corresponding CAD data. In addition, the exact position of the target fabric part is swiftly recognized via an algorithm that maps the real-time captured images to the CAD-based shape information. The decision-making information—namely optimal gripping points and garment part position—are subsequently transmitted to the robotic system for automated fabric handling process. The performance of the developed algorithms was quantitatively evaluated, and the integrated robotic system verified to be capable of completing garment manufacturing automation by connecting the processes of automatic fabric cutting and sewing.

由于软片材料的特性和所使用面料的多样性,服装制造中的面料自动操作仍是一项具有挑战性的任务。本文介绍了一种自适应优化机器人织物处理系统,旨在应对这些挑战。该系统由一个工业机器人、四个针式夹具和一个新颖的自适应夹具夹具系统组成,能够根据服装织物部件的形状和材料特性自适应地调整夹具的位置。为此,我们对织物抓取特性进行了深入分析,包括材料特性、抓取位置和织物变形。根据分析数据建立了一个预测织物变形和折叠的两阶段机器学习模型。然后将该模型纳入视觉引导算法,利用相应的 CAD 数据确定服装部件上的最佳抓取点。此外,通过将实时捕获的图像映射到基于 CAD 的形状信息的算法,可以迅速识别目标织物部件的准确位置。随后,将决策信息(即最佳抓取点和服装部件位置)传输给机器人系统,以实现自动织物处理过程。对所开发算法的性能进行了定量评估,并验证了集成机器人系统能够通过连接自动织物裁剪和缝纫流程来完成服装制造自动化。
{"title":"A vision-guided adaptive and optimized robotic fabric gripping system for garment manufacturing automation","authors":"Young Woon Choi ,&nbsp;Jiho Lee ,&nbsp;Yongho Lee ,&nbsp;Suhyun Lee ,&nbsp;Wonyoung Jeong ,&nbsp;Dae Young Lim ,&nbsp;Sang Won Lee","doi":"10.1016/j.rcim.2024.102874","DOIUrl":"10.1016/j.rcim.2024.102874","url":null,"abstract":"<div><p>Automating fabric manipulation in garment manufacturing remains a challenging task due to the characteristics of limp sheet materials and the diversity of fabrics used. This paper introduces an adaptive and optimized robotic fabric handling system, designed to address these challenges. The system comprises an industrial robot, four needle grippers, and a novel adaptive gripper jig system capable of adjusting the positions of the grippers adaptively to accommodate the shape and material properties of the garment fabric parts. To do this, an in-depth analysis of fabric gripping characteristics—accounting for material properties, gripping position, and fabric deformation—is conducted. A two-stage machine learning model predicting fabric deflection and folding is established from the analyzed data. This model is then incorporated into a vision-guided algorithm that determines the optimal gripping points on garment parts using corresponding CAD data. In addition, the exact position of the target fabric part is swiftly recognized via an algorithm that maps the real-time captured images to the CAD-based shape information. The decision-making information—namely optimal gripping points and garment part position—are subsequently transmitted to the robotic system for automated fabric handling process. The performance of the developed algorithms was quantitatively evaluated, and the integrated robotic system verified to be capable of completing garment manufacturing automation by connecting the processes of automatic fabric cutting and sewing.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102874"},"PeriodicalIF":9.1,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142240698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robotic grinding and polishing of complex aeroengine blades based on new device design and variable impedance control 基于新设备设计和可变阻抗控制的复杂航空发动机叶片机器人打磨和抛光技术
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-13 DOI: 10.1016/j.rcim.2024.102875
Xiangfei Li, Huan Zhao, Haoyuan Zhou, Yuanhao Cai, Yecan Yin, Han Ding

Owing to the advantages of good flexibility and low cost, robots are gradually replacing manual labor as an effective carrier for the grinding and polishing of aeroengine blades. However, the geometric features of blades are complex and diverse, and the contour accuracy and surface quality requirements are high, making the robotic grinding and polishing of blades still a challenging task. For this reason, this article first designs a new device by integrating different tools, which can achieve full-feature grinding and polishing of blades. Then, in order to improve the accuracy and stability of force tracking during the robotic grinding and polishing processes, a variable impedance control approach with simultaneous changes in stiffness and damping and parameter boundaries is proposed. Finally, the superiority of the proposed variable impedance control method is verified by comparative experiments on surface tracking. In addition, by combining the device with the variable impedance control method in the robotic grinding and polishing experiments of an aeroengine blade, their effectiveness in practical situations is confirmed.

由于具有灵活性好、成本低等优点,机器人正逐渐取代人工,成为航空发动机叶片打磨和抛光的有效载体。然而,叶片的几何特征复杂多样,轮廓精度和表面质量要求高,使得叶片的机器人打磨和抛光仍是一项具有挑战性的任务。为此,本文首先通过整合不同工具设计了一种新装置,可实现叶片的全功能打磨和抛光。然后,为了提高机器人打磨和抛光过程中力跟踪的准确性和稳定性,提出了一种同时改变刚度和阻尼以及参数边界的可变阻抗控制方法。最后,通过表面跟踪对比实验验证了所提出的可变阻抗控制方法的优越性。此外,通过在航空发动机叶片的机器人打磨和抛光实验中将该装置与可变阻抗控制方法相结合,证实了它们在实际应用中的有效性。
{"title":"Robotic grinding and polishing of complex aeroengine blades based on new device design and variable impedance control","authors":"Xiangfei Li,&nbsp;Huan Zhao,&nbsp;Haoyuan Zhou,&nbsp;Yuanhao Cai,&nbsp;Yecan Yin,&nbsp;Han Ding","doi":"10.1016/j.rcim.2024.102875","DOIUrl":"10.1016/j.rcim.2024.102875","url":null,"abstract":"<div><p>Owing to the advantages of good flexibility and low cost, robots are gradually replacing manual labor as an effective carrier for the grinding and polishing of aeroengine blades. However, the geometric features of blades are complex and diverse, and the contour accuracy and surface quality requirements are high, making the robotic grinding and polishing of blades still a challenging task. For this reason, this article first designs a new device by integrating different tools, which can achieve full-feature grinding and polishing of blades. Then, in order to improve the accuracy and stability of force tracking during the robotic grinding and polishing processes, a variable impedance control approach with simultaneous changes in stiffness and damping and parameter boundaries is proposed. Finally, the superiority of the proposed variable impedance control method is verified by comparative experiments on surface tracking. In addition, by combining the device with the variable impedance control method in the robotic grinding and polishing experiments of an aeroengine blade, their effectiveness in practical situations is confirmed.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102875"},"PeriodicalIF":9.1,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142230362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Force–vision fusion fuzzy control for robotic batch precision assembly of flexibly absorbed pegs 用于机器人批量精密装配弹性吸附钉的力视融合模糊控制
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-06 DOI: 10.1016/j.rcim.2024.102861
Bin Wang, Jiwen Zhang, Dan Wu

This article focuses on improving the compliance, efficiency, and robustness of batch precision assembly of small-scale pegs flexibly absorbed by a suction cup. The main contribution is that a force–vision fusion fuzzy control method (FVFFC) is proposed to achieve precision assembly with unknown clearance or interference fit. Both visual and force features are designed to describe the state of the peg and hole with the deformation of the suction cup. Then, a force–vision fusion control framework is proposed, where the visual features dynamically modify the reference position of admittance control and guide compliant adjustment of the peg angles. Furthermore, based on theoretical analysis, two fuzzy logic inference modules are developed to estimate the contact state as well as either the clearance or interference amount between the peg and hole in order to adaptively tune the control parameters. Finally, sufficient experiments are conducted to demonstrate the superiority and robustness of the FVFFC method.

本文的重点是提高由吸盘灵活吸附的小型挂件批量精密装配的顺应性、效率和稳健性。其主要贡献在于提出了一种力-视觉融合模糊控制方法(FVFFC),以实现未知间隙或过盈配合的精密装配。设计了视觉特征和力特征来描述吸盘变形时钉和孔的状态。然后,提出了力-视觉融合控制框架,其中视觉特征动态地修改了导纳控制的参考位置,并指导对钉角度进行顺应性调整。此外,在理论分析的基础上,还开发了两个模糊逻辑推理模块,用于估计接触状态以及挂件和孔之间的间隙或干涉量,从而自适应地调整控制参数。最后,通过充分的实验证明了 FVFFC 方法的优越性和鲁棒性。
{"title":"Force–vision fusion fuzzy control for robotic batch precision assembly of flexibly absorbed pegs","authors":"Bin Wang,&nbsp;Jiwen Zhang,&nbsp;Dan Wu","doi":"10.1016/j.rcim.2024.102861","DOIUrl":"10.1016/j.rcim.2024.102861","url":null,"abstract":"<div><p>This article focuses on improving the compliance, efficiency, and robustness of batch precision assembly of small-scale pegs flexibly absorbed by a suction cup. The main contribution is that a force–vision fusion fuzzy control method (FVFFC) is proposed to achieve precision assembly with unknown clearance or interference fit. Both visual and force features are designed to describe the state of the peg and hole with the deformation of the suction cup. Then, a force–vision fusion control framework is proposed, where the visual features dynamically modify the reference position of admittance control and guide compliant adjustment of the peg angles. Furthermore, based on theoretical analysis, two fuzzy logic inference modules are developed to estimate the contact state as well as either the clearance or interference amount between the peg and hole in order to adaptively tune the control parameters. Finally, sufficient experiments are conducted to demonstrate the superiority and robustness of the FVFFC method.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102861"},"PeriodicalIF":9.1,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142144046","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Rapid and automated configuration of robot manufacturing cells 快速自动配置机器人制造单元
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-05 DOI: 10.1016/j.rcim.2024.102862
Seemal Asif , Mikel Bueno , Pedro Ferreira , Paul Anandan , Ze Zhang , Yue Yao , Gautham Ragunathan , Lloyd Tinkler , Masoud Sotoodeh-Bahraini , Niels Lohse , Phil Webb , Windo Hutabarat , Ashutosh Tiwari

This study presents the Reconfigurable and Responsive Robot Manufacturing (R3M) architecture, a novel framework engineered to autonomously adapt to fluctuating product variants and demands within manufacturing environments. At the heart of R3M lies an integrated architecture that ensures a seamless data flow between critical modules, facilitated by an advanced communication platform. These modules are central to delivering a range of services crucial for operational efficiency. Key to the architecture is the incorporation of Automated Risk Assessment aligned with ISO-12100 standards, utilizing ROS2 Gazebo for the dynamic modification of robot skills in a plug-and-produce manner. The architecture's unique approach to requirements definition employs AutomationML (AML), enabling effective system integration and the consolidation of varied information sources. This is achieved through the innovative use of skill-based concepts and AML Class Libraries, enhancing the system's adaptability and integration within manufacturing settings. The narrative delves into the intricate descriptions of products, equipment, and processes within the AML framework, highlighting the strategic consideration of profitability in the product domain and distinguishing between atomic and composite skills in equipment characterization. The process domain serves as an invaluable knowledge repository, bridging the gap between high-level product demands and specific equipment capabilities via process patterns. The culmination of these elements within the R3M framework provides a versatile and scalable solution poised to revolutionize manufacturing processes. Empirical results underscore the architecture's robust perception abilities, with a particular focus on a real-world application in robotic lamination stacking, elucidating both the inherent challenges and the tangible outcomes of the R3M deployment.

本研究介绍了可重构和响应式机器人制造(R3M)架构,这是一个新颖的框架,旨在自主适应制造环境中不断变化的产品类型和需求。R3M 的核心是一个集成架构,通过先进的通信平台,确保关键模块之间的无缝数据流。这些模块是提供一系列对运营效率至关重要的服务的核心。该架构的关键是根据 ISO-12100 标准纳入自动风险评估,利用 ROS2 Gazebo 以即插即用的方式动态修改机器人技能。该架构的独特需求定义方法采用了 AutomationML (AML),实现了有效的系统集成和各种信息源的整合。这是通过创新性地使用基于技能的概念和 AML 类库来实现的,从而增强了系统在制造环境中的适应性和集成性。报告深入探讨了 AML 框架内对产品、设备和流程的复杂描述,强调了产品领域对盈利能力的战略考量,并区分了设备特征描述中的原子技能和复合技能。工艺领域是一个宝贵的知识库,通过工艺模式在高层次产品需求和具体设备能力之间架起了桥梁。这些元素在 R3M 框架内汇聚成一个多功能、可扩展的解决方案,有望彻底改变制造流程。实证结果凸显了该架构强大的感知能力,尤其侧重于机器人层压堆叠的实际应用,阐明了 R3M 部署所面临的固有挑战和实际成果。
{"title":"Rapid and automated configuration of robot manufacturing cells","authors":"Seemal Asif ,&nbsp;Mikel Bueno ,&nbsp;Pedro Ferreira ,&nbsp;Paul Anandan ,&nbsp;Ze Zhang ,&nbsp;Yue Yao ,&nbsp;Gautham Ragunathan ,&nbsp;Lloyd Tinkler ,&nbsp;Masoud Sotoodeh-Bahraini ,&nbsp;Niels Lohse ,&nbsp;Phil Webb ,&nbsp;Windo Hutabarat ,&nbsp;Ashutosh Tiwari","doi":"10.1016/j.rcim.2024.102862","DOIUrl":"10.1016/j.rcim.2024.102862","url":null,"abstract":"<div><p>This study presents the Reconfigurable and Responsive Robot Manufacturing (R3M) architecture, a novel framework engineered to autonomously adapt to fluctuating product variants and demands within manufacturing environments. At the heart of R3M lies an integrated architecture that ensures a seamless data flow between critical modules, facilitated by an advanced communication platform. These modules are central to delivering a range of services crucial for operational efficiency. Key to the architecture is the incorporation of Automated Risk Assessment aligned with ISO-12100 standards, utilizing ROS2 Gazebo for the dynamic modification of robot skills in a plug-and-produce manner. The architecture's unique approach to requirements definition employs AutomationML (AML), enabling effective system integration and the consolidation of varied information sources. This is achieved through the innovative use of skill-based concepts and AML Class Libraries, enhancing the system's adaptability and integration within manufacturing settings. The narrative delves into the intricate descriptions of products, equipment, and processes within the AML framework, highlighting the strategic consideration of profitability in the product domain and distinguishing between atomic and composite skills in equipment characterization. The process domain serves as an invaluable knowledge repository, bridging the gap between high-level product demands and specific equipment capabilities via process patterns. The culmination of these elements within the R3M framework provides a versatile and scalable solution poised to revolutionize manufacturing processes. Empirical results underscore the architecture's robust perception abilities, with a particular focus on a real-world application in robotic lamination stacking, elucidating both the inherent challenges and the tangible outcomes of the R3M deployment.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102862"},"PeriodicalIF":9.1,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0736584524001492/pdfft?md5=e3690479a2a80ae151f70d8a450b9bb7&pid=1-s2.0-S0736584524001492-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142144066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A digital twin dynamic migration method for industrial mobile robots 工业移动机器人的数字孪生动态迁移方法
IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-09-05 DOI: 10.1016/j.rcim.2024.102864
Yue Wang , Xiaohu Zhao

In recent years, with the deepening integration of digital twins (DT) and the Industrial Internet of Things (IIoT), solutions based on digital twins have been widely applied in IIoT scenarios. However, most existing solutions tend to overlook the latency issue during the interaction between mobile devices, such as industrial mobile robots (IMR), and their DTs while in motion. Excessive interaction latency can directly impair the real-time response capability and decision accuracy of industrial mobile robots, and in severe cases, it may lead to the failure of intricate industrial tasks. In order to solve the above problems, we propose a digital twin dynamic migration method for industrial mobile robots. Firstly, we design and implement a STGCN-Transformer-based movement trajectory prediction method for IMR to predict the future movement trajectory of IMR and pre-migrate the DT of IMR to all intelligent gateways (IG) within the prediction range. Then, we design and implement a Proximal Policy Optimization-based DT migration time determination method for IMR and obtain the migration timing of DT under the premise of balancing the DT migration overhead, the load of the IG where the DT is deployed, the load of the IG where the DT is connected, and the communication delay between the IMR and the IG where the DT is deployed. Next, the DT of the IMR is migrated based on the IMR’s anticipated trajectory and optimal times for migration, with the objective of minimizing the interaction latency between the IMR and its DT. Finally, we conduct simulation experiments on the proposed method. Through theoretical and simulation experiments, it has been proven that the proposed method can effectively ensure the dynamic interaction delay between the IMR and its DT during the moving process, thereby enhancing the real-time responsiveness and decision precision of the IMR.

近年来,随着数字孪生(DT)与工业物联网(IIoT)的深度融合,基于数字孪生的解决方案已被广泛应用于 IIoT 场景。然而,大多数现有解决方案往往忽视了移动设备(如工业移动机器人(IMR))在运动过程中与数字孪生系统交互时的延迟问题。过长的交互延迟会直接影响工业移动机器人的实时响应能力和决策准确性,严重时可能导致复杂的工业任务失败。为了解决上述问题,我们提出了一种工业移动机器人数字孪生动态迁移方法。首先,我们设计并实现了一种基于 STGCN 变换器的 IMR 运动轨迹预测方法,用于预测 IMR 未来的运动轨迹,并将 IMR 的 DT 预迁移到预测范围内的所有智能网关(IG)。然后,设计并实现基于近端策略优化的 IMR DT 迁移时间确定方法,在平衡 DT 迁移开销、DT 部署地 IG 负载、DT 连接地 IG 负载以及 IMR 与 DT 部署地 IG 通信时延的前提下,得到 DT 的迁移时序。接下来,根据 IMR 的预期轨迹和最佳迁移时间迁移 IMR 的 DT,目标是最大限度地减少 IMR 与其 DT 之间的交互延迟。最后,我们对所提出的方法进行了仿真实验。通过理论和仿真实验证明,所提出的方法能有效保证 IMR 与其 DT 在移动过程中的动态交互延迟,从而提高 IMR 的实时响应能力和决策精度。
{"title":"A digital twin dynamic migration method for industrial mobile robots","authors":"Yue Wang ,&nbsp;Xiaohu Zhao","doi":"10.1016/j.rcim.2024.102864","DOIUrl":"10.1016/j.rcim.2024.102864","url":null,"abstract":"<div><p>In recent years, with the deepening integration of digital twins (DT) and the Industrial Internet of Things (IIoT), solutions based on digital twins have been widely applied in IIoT scenarios. However, most existing solutions tend to overlook the latency issue during the interaction between mobile devices, such as industrial mobile robots (IMR), and their DTs while in motion. Excessive interaction latency can directly impair the real-time response capability and decision accuracy of industrial mobile robots, and in severe cases, it may lead to the failure of intricate industrial tasks. In order to solve the above problems, we propose a digital twin dynamic migration method for industrial mobile robots. Firstly, we design and implement a STGCN-Transformer-based movement trajectory prediction method for IMR to predict the future movement trajectory of IMR and pre-migrate the DT of IMR to all intelligent gateways (IG) within the prediction range. Then, we design and implement a Proximal Policy Optimization-based DT migration time determination method for IMR and obtain the migration timing of DT under the premise of balancing the DT migration overhead, the load of the IG where the DT is deployed, the load of the IG where the DT is connected, and the communication delay between the IMR and the IG where the DT is deployed. Next, the DT of the IMR is migrated based on the IMR’s anticipated trajectory and optimal times for migration, with the objective of minimizing the interaction latency between the IMR and its DT. Finally, we conduct simulation experiments on the proposed method. Through theoretical and simulation experiments, it has been proven that the proposed method can effectively ensure the dynamic interaction delay between the IMR and its DT during the moving process, thereby enhancing the real-time responsiveness and decision precision of the IMR.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102864"},"PeriodicalIF":9.1,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142144035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Robotics and Computer-integrated Manufacturing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1