ARinVR: Bringing Mobile AR into VR

Abstract

Augmented Reality (AR) and Virtual Reality (VR) techniques are widely used for people to experience and interact with 3D digital content. However, the user has to choose either AR or VR separately with different devices for different interaction modalities. This work presents ARinVR, a novel concept that seamlessly and synchronously integrates handheld mobile AR and head-worn VR to allow users to see an augmented scenario on a phone screen and in a VR space at the same time. We developed a prototype system that enabled users to operate a smartphone and observe mobile AR scenarios in VR environment as naturally as in the real world. The system extends the AR space and occludes the physical surroundings, enabling users to stay focused on task performance and enhancing spatial perception.