A Hybrid CNN-CRF Inference Models for 3D Mesh Segmentation

Abstract

Owing to the wide spread of the 3D objects technologies, learning 3D objects labeling and segmentation is becoming one of the most provocative tasks in computer vision and digital multimedia. Recently, convolutional neural network (CNN) has proved itself as a powerful model in segmentation and classification by giving excellent performances. The use of a graphical model such as conditional random field (CRF) contributes further in capturing contextual information and thus improving the segmentation performance. In this paper, we implement a deep architecture in order to segment and label 3D shape parts by considering both spectral and geometric features via a combined framework consisting of a CNN and CRF models. First, low-level features are used to learn deep features using a CNN model, and then formulate the deep CRF model with a CNN-based unary and pairwise potential functions to effectively extract the semantic correlations between adjacent triangles on the mesh. By comparing our results with those from several state-of-the-art, our method shows promising potentials.