Multiple faces tracking based on joint kernel density estimation and robust feature descriptors

Abstract

In this paper, we present a robust implementation of multi-face tracker using Joint Feature Model, Kalman filter-based Mean-shift and Speeded-Up Robust Features (SURF), which can tolerate interference caused by objects of similar color, partial occlusion, total occlusion, rotation and scale change. The Joint Feature Model for each person combines the non-parametric distribution of colors in the face region and gradient information of face, Mean-shift based on Kalman filter is adopted to update the position and velocity of the object in real-time and predict the locations in the subsequent frame, and SURF solves the object-recovery problem in occlusion. Experimental results demonstrate the efficiency of the tracking algorithm and the recovery capability even in case of total occlusion.