Proxy-based Metric Learning for Emotion Recognition

Abstract

Emotion Recognition (ER) is an essential research area of natural language processing that can be applied to various fields. Texts in the fields of health care, marketing, and psychological counseling take various forms, and it is very important from a business point of view to find the emotions inherent in these texts. Recently, ER using text embeddings generated through a pre-trained language model with a large corpus was performed. However, since the embeddings are generalized to various domains, there is a limitation to directly using them for ER. In this study, to overcome the limitation, we propose a method that modifies generalized embeddings to emotional embeddings by performing proxy-based metric learning. In the proposed method, we fine-tuned the pre-trained language model by using proxy-anchor loss so that embeddings represent emotion appropriately. Previous studies only added linear classifiers. But, it is possible to capture emotional relationships between data by using proxy-based metric learning. In this study, we conducted ER experiments with benchmark datasets. The experimental result shows that the proposed method achieves better performance than the baseline and creates emotion-specific embeddings.