How to improve human-robot collaborative applications through operation recognition based on human 2D motion

Abstract

Human-robot collaborative applications are generally based on some kind of co-working of the human operator and the robot in the execution of a given task. A disruptive change in the collaborative modalities would be given by the capability of the robot to anticipate how it could be of help for the operator. In case of an Autonomous Mobile Robot (AMR), this would imply not only a safe navigation in presence of a human operator, but the automatic adaptation of its motion to the specific operation carried out by the operator. This paper investigates the possibility of achieving operation recognition by monitoring the human motion on a 2D map and classifying his/her path on the map, taken as an image data sample. Deep learning state-of-the-art libraries and architectures are exploited with the aim of making the robotic system aware of the ongoing process. The reported results, relative to a small training dataset, are nonetheless promising.