What Happens in Face During a Facial Expression? Using Data Mining Techniques to Analyze Facial Expression Motion Vectors

Abstract

Automatic facial expression recognition is a big challenge in human–computer interaction. Analyzing the changes in the face during a facial expression can be used for this purpose. In this paper, these changes are extracted as a number of motion vectors. These motion vectors are extracted using an optical flow algorithm. Then, they are used to analyze facial expressions by some of the data mining algorithms. This analysis has not only determined what changes occur in the face during facial expression but has also been used to recognize facial expressions. Cohen-Kanade facial expression dataset was used in this research. Based on our findings, the vertical lengths of motion vectors created in the lower part of the face have the greatest impact on the classification of facial expressions. Among the investigated classification algorithms, deep learning, support vector machine, and C5.0 had better performance, yielding an accuracy of 95.3%, 92.8%, and 90.2% respectively.