Development of Automatic Virtual Guidance Visualization System for Teleoperation Using Object Detection

Abstract

This paper proposes automatically generate a virtual guidance for teleoperation system using object detection. A virtual guidance that gives force feedback when performing a mission like a peg-in-hole using a slave robot with a haptic device is very helpful for the operator. The key point of our study is to automatically generate this virtual guidance using deep learning architecture. If the operator uses this information, there is no need to generate a virtual guidance one by one. In addition, our system can automatically and continuously generate virtual guidance in moving situations as well as stationary situations. The position of the target object is recognized using deep learning architecture and depth information. And visual information of the virtual guidance is visualized using the virtual environment visualization system. Our system helps the operator to recognize spatial information.