Sophie Wohltjen, Yolanda Ivette Colón, Zihao Zhu, Karina Miller, Wei-Chun Huang, Bilge Mutlu, Yin Li, Paula M Niedenthal
{"title":"结合理论和数据:创造一个诚实的面部表情模型的希望和挑战。","authors":"Sophie Wohltjen, Yolanda Ivette Colón, Zihao Zhu, Karina Miller, Wei-Chun Huang, Bilge Mutlu, Yin Li, Paula M Niedenthal","doi":"10.1080/02699931.2024.2446945","DOIUrl":null,"url":null,"abstract":"<p><p>People routinely use facial expressions to communicate successfully and to regulate other's behaviour, yet modelling the form and meaning of these facial behaviours has proven surprisingly complex. One reason for this difficulty may lie in an over-reliance on the assumptions inherent in existing theories of facial expression - specifically that (1) there is a putative set of facial expressions that signal an internal state of emotion, (2) patterns of facial movement have been empirically linked to the prototypical emotions in this set, and (3) static, non-social, posed images from convenience samples are adequate to validate the first two assumptions. These assumptions have guided the creation of datasets, which are then used to train unrepresentative computational models of facial expression. In this article, we discuss existing theories of facial expression and review how they have shaped current facial expression recognition tools. We then discuss the resources that are available to help researchers build a more ecologically valid model of facial expressions.</p>","PeriodicalId":48412,"journal":{"name":"Cognition & Emotion","volume":" ","pages":"1-15"},"PeriodicalIF":2.6000,"publicationDate":"2025-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Uniting theory and data: the promise and challenge of creating an honest model of facial expression.\",\"authors\":\"Sophie Wohltjen, Yolanda Ivette Colón, Zihao Zhu, Karina Miller, Wei-Chun Huang, Bilge Mutlu, Yin Li, Paula M Niedenthal\",\"doi\":\"10.1080/02699931.2024.2446945\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>People routinely use facial expressions to communicate successfully and to regulate other's behaviour, yet modelling the form and meaning of these facial behaviours has proven surprisingly complex. One reason for this difficulty may lie in an over-reliance on the assumptions inherent in existing theories of facial expression - specifically that (1) there is a putative set of facial expressions that signal an internal state of emotion, (2) patterns of facial movement have been empirically linked to the prototypical emotions in this set, and (3) static, non-social, posed images from convenience samples are adequate to validate the first two assumptions. These assumptions have guided the creation of datasets, which are then used to train unrepresentative computational models of facial expression. In this article, we discuss existing theories of facial expression and review how they have shaped current facial expression recognition tools. We then discuss the resources that are available to help researchers build a more ecologically valid model of facial expressions.</p>\",\"PeriodicalId\":48412,\"journal\":{\"name\":\"Cognition & Emotion\",\"volume\":\" \",\"pages\":\"1-15\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2025-01-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cognition & Emotion\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1080/02699931.2024.2446945\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PSYCHOLOGY, EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cognition & Emotion","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/02699931.2024.2446945","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
Uniting theory and data: the promise and challenge of creating an honest model of facial expression.
People routinely use facial expressions to communicate successfully and to regulate other's behaviour, yet modelling the form and meaning of these facial behaviours has proven surprisingly complex. One reason for this difficulty may lie in an over-reliance on the assumptions inherent in existing theories of facial expression - specifically that (1) there is a putative set of facial expressions that signal an internal state of emotion, (2) patterns of facial movement have been empirically linked to the prototypical emotions in this set, and (3) static, non-social, posed images from convenience samples are adequate to validate the first two assumptions. These assumptions have guided the creation of datasets, which are then used to train unrepresentative computational models of facial expression. In this article, we discuss existing theories of facial expression and review how they have shaped current facial expression recognition tools. We then discuss the resources that are available to help researchers build a more ecologically valid model of facial expressions.
期刊介绍:
Cognition & Emotion is devoted to the study of emotion, especially to those aspects of emotion related to cognitive processes. The journal aims to bring together work on emotion undertaken by researchers in cognitive, social, clinical, and developmental psychology, neuropsychology, and cognitive science. Examples of topics appropriate for the journal include the role of cognitive processes in emotion elicitation, regulation, and expression; the impact of emotion on attention, memory, learning, motivation, judgements, and decisions.