Part-Based 3D Face Morphable Model with Anthropometric Local Control

We propose an approach to construct realistic 3D facial morphable models (3DMM) that allows an intuitive facial attribute editing workflow. Current face modeling methods using 3DMM suffer from a lack of local control. We thus create a 3DMM by combining local part-based 3DMM for the eyes, nose, mouth, ears, and facial mask regions. Our local PCA-based approach uses a novel method to select the best eigenvectors from the local 3DMM to ensure that the combined 3DMM is expressive, while allowing accurate reconstruction. The editing controls we provide to the user are intuitive as they are extracted from anthropometric measurements found in the literature. Out of a large set of possible anthropometric measurements, we filter those that have meaningful generative power given the face data set. We bind the measurements to the part-based 3DMM through mapping matrices derived from our data set of facial scans. Our part-based 3DMM is compact, yet accurate, and compared to other 3DMM methods, it provides a new trade-off between local and global control. We tested our approach on a data set of 135 scans used to derive the 3DMM, plus 19 scans that served for validation. The results show that our part-based 3DMM approach has excellent generative properties and allows the user intuitive local control. *e-mail: donya.ghafourzadeh@ubisoft.com †e-mail: cyrus.rahgoshay@ubisoft.com ‡e-mail: sahel.fallahdoust@ubisoft.com §e-mail: andre.beauchamp@ubisoft.com ¶e-mail: adeline.aubame@ubisoft.com ||e-mail: tiberiu.popa@concordia.ca **e-mail: eric.paquette@etsmtl.ca