A Real-Time Background Replacement Method Based on Estimated Depth for AR Applications

Abstract

Recent technological advances in Virtual Reality (VR) and Augmented Reality (AR) enable users to experience a high-quality virtual world. In VR applications, the user's physical movement is generally restricted because the situation around the real world cannot be seen. AR allows users to experience virtual worlds without restrictions on physical movement, but the extent to which they are replaced as virtual worlds is limited. In this research, assuming the use of smartphones and tablet devices, a partial virtual world system is implemented by removing only the background part from the real-time real-world image taken by the camera and replacing it with a virtual background.