Using deep-neural-network to extend videos for head-mounted display experiences

Abstract

Immersion is an important factor in video experiences. Therefore, various methods and video viewing systems have been proposed so far. Although head-mounted displays (HMDs) are home-friendly and more available among these devices, they can provide an immersive video experience owing to their wide field-of-view (FoV) and separation of users from the outside environment. They are often used for panoramic and stereoscopic VR videos, but the demand for viewing standard plane videos has increased in recent years. However, the theater mode, which restricts the FoV, is basically used for viewing plane videos. Thus, the advantages of HMDs are not fully utilized. Therefore, we explored an effective method for viewing plane videos by an HMD, in combination with view augmentation by LED implants to the HMD. We used deep neural network (DNN) to generate images for peripheral vision and wide FoV customization.