Multiple Models Using Temporal Feature Learning for Emotion Recognition

Abstract

Emotion recognition has a broad variety of applications in the area of affective computing, such as education, robotics, human-computer interaction. Because of that, the emotion recognition has been a significant concern in the area of computer vision in recent years, and has allowed a great deal of effort on the part of researchers to address the complexities involved in this task. Many techniques and approaches have been studied for different problems in this area including traditional machine learning techniques and deep learning approaches. The purpose of this paper is to incorporate models together to obtain benefit from different approaches for emotion recognition based on facial expression from images and videos. At the first stage, we use MTCNN to detect the faces of the objects contained in the video, then they are extracted as feature representations through ResNet50. In the next stage, the features will be learned through multi models that is LSTM, WaveNet, and SVM then we use late fusion to get the final decision. Our method is evaluated on MuSe-CaR dataset and the experimental results can compete with the baseline.