Wenjun Xu, Siqi Feng, Bitao Yao, Zhenrui Ji, Zhihao Liu
{"title":"Turn-taking prediction for human-robot collaborative assembly considering human uncertainty","authors":"Wenjun Xu, Siqi Feng, Bitao Yao, Zhenrui Ji, Zhihao Liu","doi":"10.1115/1.4063231","DOIUrl":null,"url":null,"abstract":"\n Human-robot collaboration (HRC) combines the repeatability and strength of robots and human's ability of cognition and planning to enable a flexible and efficient production mode. The ideal HRC process is that robots can smoothly assist workers in complex environments. This means that robots need to know the process's turn-taking earlier, adapt to the operating habits of different workers, and make reasonable plans in advance to improve the fluency of HRC. However, many of the current HRC systems ignore the fluent turn-taking between robots and humans, which results in unsatisfactory HRC and affects productivity. Moreover, there are uncertainties in humans as different humans have different operating proficiency, resulting in different operating speeds. This requires the robots to be able to make early predictions of turn-taking even when human is uncertain. Therefore, in this paper, an early turn-taking prediction method in HRC assembly tasks with Izhi neuron model-based spiking neuron network (SNN) is proposed. On this basis, dynamic motion primitives (DMP) are used to establish trajectory templates at different operating speeds. The length of the sequence sent to the SNN network is judged by the matching degree between the observed data and the template, so as to adjust to human uncertainty. The proposed method is verified by the gear assembly case. The results show that our method can shorten the human-robot turn-taking recognition time under human uncertainty.","PeriodicalId":16299,"journal":{"name":"Journal of Manufacturing Science and Engineering-transactions of The Asme","volume":null,"pages":null},"PeriodicalIF":2.4000,"publicationDate":"2023-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Science and Engineering-transactions of The Asme","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1115/1.4063231","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0
Abstract
Human-robot collaboration (HRC) combines the repeatability and strength of robots and human's ability of cognition and planning to enable a flexible and efficient production mode. The ideal HRC process is that robots can smoothly assist workers in complex environments. This means that robots need to know the process's turn-taking earlier, adapt to the operating habits of different workers, and make reasonable plans in advance to improve the fluency of HRC. However, many of the current HRC systems ignore the fluent turn-taking between robots and humans, which results in unsatisfactory HRC and affects productivity. Moreover, there are uncertainties in humans as different humans have different operating proficiency, resulting in different operating speeds. This requires the robots to be able to make early predictions of turn-taking even when human is uncertain. Therefore, in this paper, an early turn-taking prediction method in HRC assembly tasks with Izhi neuron model-based spiking neuron network (SNN) is proposed. On this basis, dynamic motion primitives (DMP) are used to establish trajectory templates at different operating speeds. The length of the sequence sent to the SNN network is judged by the matching degree between the observed data and the template, so as to adjust to human uncertainty. The proposed method is verified by the gear assembly case. The results show that our method can shorten the human-robot turn-taking recognition time under human uncertainty.
期刊介绍:
Areas of interest including, but not limited to: Additive manufacturing; Advanced materials and processing; Assembly; Biomedical manufacturing; Bulk deformation processes (e.g., extrusion, forging, wire drawing, etc.); CAD/CAM/CAE; Computer-integrated manufacturing; Control and automation; Cyber-physical systems in manufacturing; Data science-enhanced manufacturing; Design for manufacturing; Electrical and electrochemical machining; Grinding and abrasive processes; Injection molding and other polymer fabrication processes; Inspection and quality control; Laser processes; Machine tool dynamics; Machining processes; Materials handling; Metrology; Micro- and nano-machining and processing; Modeling and simulation; Nontraditional manufacturing processes; Plant engineering and maintenance; Powder processing; Precision and ultra-precision machining; Process engineering; Process planning; Production systems optimization; Rapid prototyping and solid freeform fabrication; Robotics and flexible tooling; Sensing, monitoring, and diagnostics; Sheet and tube metal forming; Sustainable manufacturing; Tribology in manufacturing; Welding and joining