Recognition of and reasoning about facial expressions using fuzzy logic

Abstract

In the study of the linguistic modeling of facial images we have been previously concerned with deriving qualitative descriptions such as "big eyes, long hair" of face components. To enhance this system we extend our approach at deriving higher level, qualitative descriptions. In particular, we focus on describing facial expressions. Our approach is that of qualitative modeling based on fuzzy number modeling. The result of this modeling method is a collection of fuzzy if-then rules obtained from input-output data. The input data consists of measurements of the movement of facial parts associated to different facial expressions. The output data consists of scores for face images collected using a questionnaire. In this paper, we show the modeling result obtained from this method for the facial expression "happy". While the modeling results are satisfactory the initial recognition results are limited, due in part to the absence of the models for the remaining facial expressions.<>