Simulated Local Deformation & Focal Length Optimisation For Improved Template-Based 3D Reconstruction of Non-Rigid Objects

Abstract

Non-rigid objects 3D reconstruction is a complex problem, which solution has many practical implications for graphics, robotics or augmented reality. One of the approaches to the problem is template-based, where the reference mesh, deformed over time, is used. To achieve improvement in the quality of reconstruction of the non-rigid object, we implemented two novel concepts - Simulated Local Deformation (SLD) and focal length optimisation. In this paper, we combine them together. SLD successfully enlarges the number of correspondences, hence improving the reconstruction process. Additionally, 3D reconstruction also depends on reprojection error. To minimise this measure, we propose to optimise focal length simultaneously with the reconstruction process. As a result, we achieved improved reconstruction when compared to the state-of-the-art solution.