Enhancing Health Training Education Experience with Volumetric Video and Wearable Mixed Reality

Abstract

Physical exercise is essential for maintaining a healthy life, and regular health training is critical for patients with chronic diseases. Although the patient has access to a wide range of exercise prescriptions that combine aerobic, muscle-strengthening, stretching, and neuromuscular activities, exercising effectively and regularly is difficult without motivation and guidance at home. Therefore, we suggest a system design to enhance the health training education experience at home with volumetric video and wearable mixed reality. We track the cycling data on an indoor cycle trainer equipped with sensors, and then we employ IoT protocols to deliver the riding data to an application server. The server evaluates the training scenario and provides the HMD with the information for correction suggestions. The HMD, then, displays the instructions as a volumetric movie in the right place to facilitate the training. We discuss the design of volumetric video recording and replaying as well as early user responses.