Shape-from-texture by wavelet-based measurement of local spectral moments

Abstract

A closed-form solution to the problem of computing 3D curved-surface shape from texture cues is presented. An expression showing the dependence of localized image spectral moments on localized surface spectral moments and on local surface orientation is derived. The local image spectra are measured with wavelets, and the expression is solved for the surface orientation at each point. Because the method uses localized spectral information, it operates at a very low level in the visual hierarchy. No extraction of texture or edge elements is required. The wavelet-based computation used is biologically plausible, easily parallelized for rapid computation, and has been shown to be the basis for effective solutions to a variety of other vision tasks. The method is demonstrated on a number of real-world examples.<>