Pose tracking by efficiently exploiting global features

Abstract

Typical pose tracking algorithms first obtain a set of plausible pose hypotheses in all image frames of a video and subsequently stitch compatible detections across time to form a pose-track. This approach to tracking is commonly termed tracking-by-detections, and has been very successful in other areas such as multiple object tracking, video segmentation using object proposals. Often models in this category can only incorporate local spatio-temporal evidence due to exponentially increased cost when using global information. Local spatio-temporal evidence can be ambiguous, thus leading to an inferior objective modeling. To deal with ambiguities in local information it is necessary to incorporate global information over multiple frames into a model. Based on the recent advances in generating multiple solutions from a probabilistic model, we first generate multiple plausible pose-track hypotheses, and subsequently employ a mixture of local and global features to express the quality of these solutions with high fidelity. We perform extensive experiments and competitive results across varied datasets demonstrate the robustness of our approach.