Impact of Morphing-Based Frame Synthesis on Bandwidth Optimization for 3DTI Video

Abstract

In view of the resource demanding nature of 3D Tele-immersion (3DTI), we apply Morphing-based Frame Synthesis (MBFS) on delivery of both online and offline 3DTI visual content to decrease the resource consumption without degrading the perceptual quality. We further investigate the relationship between the level-of-motion of the content and the effectiveness of MBFS. In light of the results, we propose an on-the-fly resource adaptor for 3DTI video transmission which utilizes a perceptual model built from data compiled by a series of subjective experiments. Results show that our adaptor achieves 43% to 87% compression ratio for offline compression on 3DTI videos of different baseline user activities, and a 10% on-the-fly bandwidth saving on complex user activity without perceptible degradation.