PeTracker: Poincaré-Based Dual-Strategy Emotion Tracker for Emotion Recognition in Conversation

IF 9.8 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE IEEE Transactions on Affective Computing Pub Date : 2025-03-10 DOI:10.1109/TAFFC.2025.3549926
YuKun Cao;Luobin Huang;Yijia Tang
{"title":"PeTracker: Poincaré-Based Dual-Strategy Emotion Tracker for Emotion Recognition in Conversation","authors":"YuKun Cao;Luobin Huang;Yijia Tang","doi":"10.1109/TAFFC.2025.3549926","DOIUrl":null,"url":null,"abstract":"With the increasing use of interactive applications, the importance of Emotion recognition in conversation (ERC) is growing. Current research in the ERC domain mainly emphasizes the extraction of contextual information. However, challenges arise due to multi-turn conversation scenarios and the natural transformation of emotions, particularly in identifying subtle emotion transfers. Moreover, emotions exhibit nonlinear characteristics in semantic spaces, leading to potential confusion when discerning similar semantic emotions in the Euclidean semantic space. To address these issues, this study proposes a Poincaré-based dual-strategy emotion tracker for emotion recognition in conversation (PeTracker), which introduces the hyperbolic space representation in the ERC domain. Based on the spatial properties of the hyperbolic space representation to capture the nonlinear relationships among features, PeTracker encompasses two learning strategies. Poincaré emotional geometry curriculum learning (PGCL) and Poincaré emotional stratification contrastive learning (PSCL). In PGCL, the similarity of emotion labels is effectively discerned using the Poincaré distance, quantifying emotion transfer distances and facilitating the identification of subtle emotion transfers in utterance. In PSCL, PeTracker extracts and adapts multi-level features, mapping them to the Poincaré ball space to build emotion prototype-based contrastive learning. This process enhances the model’s ability to distinguish between similar emotion labels. while alleviating potential label confusion issues. Experimental results on three general datasets demonstrate that PeTracker achieves optimal or near-optimal performance. Furthermore, the study investigates the role and impact of the Poincaré ball in differentiating similar emotions.","PeriodicalId":13131,"journal":{"name":"IEEE Transactions on Affective Computing","volume":"16 3","pages":"2020-2032"},"PeriodicalIF":9.8000,"publicationDate":"2025-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Affective Computing","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10919037/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

With the increasing use of interactive applications, the importance of Emotion recognition in conversation (ERC) is growing. Current research in the ERC domain mainly emphasizes the extraction of contextual information. However, challenges arise due to multi-turn conversation scenarios and the natural transformation of emotions, particularly in identifying subtle emotion transfers. Moreover, emotions exhibit nonlinear characteristics in semantic spaces, leading to potential confusion when discerning similar semantic emotions in the Euclidean semantic space. To address these issues, this study proposes a Poincaré-based dual-strategy emotion tracker for emotion recognition in conversation (PeTracker), which introduces the hyperbolic space representation in the ERC domain. Based on the spatial properties of the hyperbolic space representation to capture the nonlinear relationships among features, PeTracker encompasses two learning strategies. Poincaré emotional geometry curriculum learning (PGCL) and Poincaré emotional stratification contrastive learning (PSCL). In PGCL, the similarity of emotion labels is effectively discerned using the Poincaré distance, quantifying emotion transfer distances and facilitating the identification of subtle emotion transfers in utterance. In PSCL, PeTracker extracts and adapts multi-level features, mapping them to the Poincaré ball space to build emotion prototype-based contrastive learning. This process enhances the model’s ability to distinguish between similar emotion labels. while alleviating potential label confusion issues. Experimental results on three general datasets demonstrate that PeTracker achieves optimal or near-optimal performance. Furthermore, the study investigates the role and impact of the Poincaré ball in differentiating similar emotions.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
会话中情绪识别的双策略跟踪
随着交互式应用的日益普及,情感识别在会话中的重要性日益凸显。当前ERC领域的研究主要侧重于上下文信息的提取。然而,由于多回合的对话场景和情绪的自然转换,特别是在识别微妙的情绪转移方面,出现了挑战。此外,情感在语义空间中表现出非线性特征,导致在欧几里得语义空间中识别相似的语义情感时可能出现混淆。为了解决这些问题,本研究提出了一种基于poincar的双策略情感跟踪器(PeTracker),用于会话中的情感识别,该跟踪器在ERC域中引入了双曲空间表示。PeTracker基于双曲空间表示的空间特性来捕捉特征之间的非线性关系,包含两种学习策略。情感几何课程学习(PGCL)和情感分层对比学习(PSCL)。在PGCL中,使用poincar距离有效地识别情感标签的相似性,量化情感迁移距离,便于识别话语中微妙的情感迁移。在PSCL中,PeTracker提取并适应多层次特征,并将其映射到poincarcarcars球空间,以构建基于情感原型的对比学习。这个过程增强了模型区分相似情绪标签的能力。同时减轻潜在的标签混淆问题。在三个通用数据集上的实验结果表明,PeTracker达到了最优或接近最优的性能。此外,该研究还调查了poincarcarcarle球在区分相似情绪方面的作用和影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Affective Computing
IEEE Transactions on Affective Computing COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-COMPUTER SCIENCE, CYBERNETICS
CiteScore
15.00
自引率
6.20%
发文量
174
期刊介绍: The IEEE Transactions on Affective Computing is an international and interdisciplinary journal. Its primary goal is to share research findings on the development of systems capable of recognizing, interpreting, and simulating human emotions and related affective phenomena. The journal publishes original research on the underlying principles and theories that explain how and why affective factors shape human-technology interactions. It also focuses on how techniques for sensing and simulating affect can enhance our understanding of human emotions and processes. Additionally, the journal explores the design, implementation, and evaluation of systems that prioritize the consideration of affect in their usability. We also welcome surveys of existing work that provide new perspectives on the historical and future directions of this field.
期刊最新文献
Incremental Micro-Expression Recognition: A Benchmark Charting 15 Years of Progress in Deep Learning for Speech Emotion Recognition: a Replication Study Video-Based Cross-Domain Emotion Recognition Via Sample-Graph Relations Self-Distillation EchoReason: a Two-stage Clinically Aligned Vision-Language Framework for Interpretable Diseases Diagnosis from Multi-Modal Ultrasound Advancing Micro-Expression Recognition: a Task-Specific Framework Integrating Frequency Analysis and Structural Embedding
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1