Dynamic facial caricaturing system based on the gaze direction of gallery

Abstract

Facial caricaturing is a representation process of human visual impression onto paper or other media. Facial caricaturing should be discussed from multiple viewpoints of three relations among the model, the caricaturist and the gallery. Furthermore, some kinds of interactive mechanism should be required between the caricaturist and the gallery. We propose a dynamic caricaturing system. In our system the utilization of an in-betweening method realizes the generation mechanism from the caricaturist to the gallery, and on the contrary, the utilization of eye-camera vision realizes the feedback mechanism from the gallery to the caricaturist. This is an original and unique point of our system. The gallery mounts an eye-camera on the head, and the system reflects visual characteristics of the gallery directly onto the works of facial caricature. After observing the image of the model and analyzing the gaze direction and distribution, the system deforms some characteristic and impressive facial parts more strongly than other non-impressive facial parts, and generates the caricature which is suited especially for the gallery. We demonstrate experimentally the effectivity of this method to integrate these kinds of viewpoints.