Mobile collaborative walkthrough using 3D image warping and streaming

Abstract

A mobile walkthrough environment based on 3D superview warping and view compensation streaming is presented. In the environment, 3D views are rendered on the remote clients using 3D oversized reference views and compensated on a view-on-demand basis by the graphically rendered views from the server. The view compensations (hole residuals and the depth map) are coded using a layered joint source-channel coding with unequal error corrections to protect the significant packets on noisy and erasure mobile channels. The new compensated view will then serve as a reference view for the subsequent rendering on the clients