A hand-interaction model for augmented reality enhanced human-robot collaboration

Flexible and rapidly adaptable automated production processes, e.g. with collaborative lightweight robots, are key aspects for the competitiveness of companies in globalised markets. However, software adaptation of the robot still requires specific programming skills. We have developed a human-centred programming by demonstration approach based on augmented reality to enable operators to intuitively adapt the robot programme. The developed hand-interaction model overcomes the challenge of object tracking during the assembly demonstration phase. This allows quick programme modifications by the operator using the head-mounted augmented reality device. The human-in-the-loop concept ensures a highly reliable and robust programming process.