Semantic differences in visually similar face emojis

IF 1.1 3区 心理学 0 LANGUAGE & LINGUISTICS Language and Cognition Pub Date : 2024-03-26 DOI:10.1017/langcog.2024.12
Lea Fricke, Patrick G. Grosz, Tatjana Scheffler
{"title":"Semantic differences in visually similar face emojis","authors":"Lea Fricke, Patrick G. Grosz, Tatjana Scheffler","doi":"10.1017/langcog.2024.12","DOIUrl":null,"url":null,"abstract":"<p>The literature on face emojis raises the central question whether they should be treated as pictures or conventionalized signals. Our experiment addresses this question by investigating semantic differences in visually similar face emojis. We test a prediction following from a pictorial approach: small visual features of emojis that do not correspond to human facial features should be semantically less relevant than features that represent aspects of facial expressions. We compare emoji pairs with a visual difference that either does or does not correspond to a difference in a human facial expression according to an adaptation of the Facial Action Coding System. We created two contexts per pair, each fitted to correspond to a prominent meaning of one or the other emoji. Participants had to choose a suitable emoji for each context. The rate at which the context-matching emoji was chosen was significantly above chance for both types of emoji pairs and it did not differ significantly between them. Our results show that the small differences are meaningful in all pairs whether or not they correspond to human facial differences. This supports a lexicalist approach to emoji semantics, which treats face emojis as conventionalized signals rather than mere pictures of faces.</p>","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2024-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Language and Cognition","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1017/langcog.2024.12","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"LANGUAGE & LINGUISTICS","Score":null,"Total":0}
引用次数: 0

Abstract

The literature on face emojis raises the central question whether they should be treated as pictures or conventionalized signals. Our experiment addresses this question by investigating semantic differences in visually similar face emojis. We test a prediction following from a pictorial approach: small visual features of emojis that do not correspond to human facial features should be semantically less relevant than features that represent aspects of facial expressions. We compare emoji pairs with a visual difference that either does or does not correspond to a difference in a human facial expression according to an adaptation of the Facial Action Coding System. We created two contexts per pair, each fitted to correspond to a prominent meaning of one or the other emoji. Participants had to choose a suitable emoji for each context. The rate at which the context-matching emoji was chosen was significantly above chance for both types of emoji pairs and it did not differ significantly between them. Our results show that the small differences are meaningful in all pairs whether or not they correspond to human facial differences. This supports a lexicalist approach to emoji semantics, which treats face emojis as conventionalized signals rather than mere pictures of faces.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
视觉上相似的人脸表情符号的语义差异
有关人脸表情符号的文献提出了一个核心问题,即这些表情符号应被视为图片还是传统化的信号。我们的实验通过研究视觉上相似的表情符号的语义差异来解决这个问题。我们测试了从图像方法得出的一个预测:表情符号中与人类面部特征不对应的小视觉特征在语义上的相关性应低于代表面部表情方面的特征。我们根据面部动作编码系统(Facial Action Coding System)的改编,对视觉差异与人类面部表情差异对应或不对应的表情符号对进行比较。我们为每对表情符号创建了两个情境,每个情境都与一个或另一个表情符号的突出含义相对应。参与者必须为每个情境选择一个合适的表情符号。在两种类型的表情符号配对中,选择与语境相匹配的表情符号的比率都明显高于偶然性,而且两者之间没有明显差异。我们的结果表明,无论是否与人类面部差异相对应,所有配对中的微小差异都是有意义的。这支持了对表情符号语义的词法主义方法,该方法将人脸表情符号视为常规化的信号,而不仅仅是人脸图片。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
4.20
自引率
0.00%
发文量
34
期刊最新文献
Multimodal training on L2 Japanese pitch accent: learning outcomes, neural correlates and subjective assessments Head metonymies and metaphors in Jordanian and Tunisian Arabic: an extended conceptual metaphor theory perspective Facial expressions in different communication settings: A case of whispering and speaking with a face mask in Farsi The effect of emotional prosody and referent characteristics on novel noun learning Inherent linguistic preference outcompetes incidental alignment in cooperative partner choice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1