Human Activity Recognition Based on 3D Mesh MoSIFT Feature Descriptor

Abstract

The times of Big Data promotes increasingly higher demands for information processing. The rapid development of 3D digital capturing devices prompts the traditional behavior analysis towards fine motion recognition, such as hands and gesture. In this paper, a complete framework of 3D human activity recognition is presented for the behavior analysis of hands and gesture. First, the improved graph cuts method is introduced to hand segmentation and tracking. Then, combined with 3D geometric characteristics and human behavior prior information, 3D Mesh MoSIFT feature descriptor is proposed to represent the discriminant property of human activity. Simulation orthogonal matching pursuit (SOMP) is used to encode the visual code words. Experiments, based on a RGB-D video dataset and ChaLearn gesture dataset, show the improved accuracy of human activity recognition.