A real-time x-ray mobile application using augmented reality and google street view

Abstract

X-ray view can be defined as the ability one has to see through real surfaces. Although this skill is often associated with superheroes and medical examination, there are several researches conducted to employ X-ray view in numerous applications. However, the generation of X-ray visualization includes numerous challenges regarding occlusion, realistic appearance, and depth perception. In this paper, we present a mobile application that uses Augmented Reality and Google Street View to allow users experience real-time X-ray vision. The proposed application was designed to enhance previous Augmented Reality X-ray systems, by introducing a silhouette computation method to provide visual context from the occluder and a perspective estimation system that improves the projection of occluded images into the real scene. Additionally, we implemented two usability studies to assess qualitative aspects of both silhouettes and perspective estimation to generate better X-ray effects. Results indicate good acceptance of the novel X-ray visualization method and a great usability score on the SUS scale for the mobile application.