Multiview from micro-lens image of multi-focused plenoptic camera

Abstract

Multi-focused Plenoptic cameras (Plenoptic 2.0) allow the acquisition of the Light-Field of a scene. However, extracting a novel view from the resulting Micro-Lens Array (MLA) image poses several challenges: micro-lenses calibration, noise reduction, patch size (depth) estimation to convert micro-lens image to multi-view images. We propose a novel method to easily find important micro-lenses parameters, avoid the unreliable luminance area, estimate the depth map, and extract sub-aperture images (multiview) for the single- and multi-focused Plenoptic 2.0 camera. Our results demonstrate significant improvement in quality and reduction in computational time compared to the state-of-the-art conversion tool Reference Lenslet content Convertor from MLA image to multiview images.