Research on human-robot interaction for robotic spatial 3D printing based on real-time hand gesture control

Abstract

With the rapid advancements in three-dimensional (3D) printing, researchers have shifted their focus towards the mechanical systems and methods used in this field. While Fused Deposition Modelling (FDM) remains the dominant method, alternative printing methods such as Spatial 3DP (S-3DP) have emerged. However, the majority of existing research on 3D printing technology has been emphasizing offline control, which lacks the capability to dynamically adjust the printing path in real time. Such an limitation has resulted in a decrease in printing efficiency. Therefore, this paper proposes a human-robot interaction (HRI) method based on real-time gesture control for Robotic Spatial 3DP (RS-3DP). This method incorporates utilization of YOLOv5 and Mediapipe algorithms to recognize gestures and convert the gesture information into real-time robot operations. Results show that this approach offers a feasible solution to address the issue of discontinuous S-3DP nodes because it achieves a gesture-controlled robot movement accuracy of 91 % and an average system response time of approximately 0.54 s. The proposed HRI method represents a pioneering advancement in real-time control for RS-3DP, thereby paving the way for further exploration and development in this field.