Mixed Reality Application: A Framework of Markerless Assembly Guidance System with Hololens Glass

Abstract

We proposed a markerless MR guidance system for the manufactory assembly, which utilizes augmented reality device and camera sensor to display virtual model in designated position in the real world. By taking advantage of image processing methods. The system can automatically detect the location of device and target. The application result in real manufactory scene shows that the guidance system performs well and can track the changing of the posture of target products in less than 200ms, and then adjust the virtual models into right position coordinately.