Learning chain for clause awareness: Triplex-contrastive learning for emotion recognition in conversations

IF 6.8 1区 计算机科学 0 COMPUTER SCIENCE, INFORMATION SYSTEMS Information Sciences Pub Date : 2025-07-01 Epub Date: 2025-02-17 DOI:10.1016/j.ins.2025.121969
Jiazhen Liang , Wai Li , Qingshan Zhong , Jun Huang , Dazhi Jiang , Erik Cambria
{"title":"Learning chain for clause awareness: Triplex-contrastive learning for emotion recognition in conversations","authors":"Jiazhen Liang ,&nbsp;Wai Li ,&nbsp;Qingshan Zhong ,&nbsp;Jun Huang ,&nbsp;Dazhi Jiang ,&nbsp;Erik Cambria","doi":"10.1016/j.ins.2025.121969","DOIUrl":null,"url":null,"abstract":"<div><div>Emotion recognition in conversation (ERC) is essential for enhancing human-computer interaction and improving intelligent systems' emotional intelligence. Despite advancements, ERC still struggles to capture the complexity and nuances of emotions in dialogues. Traditional approaches rely on context modeling to improve text representations but often fail to fully capture emotions' continuous and intricate nature. While contrastive learning has emerged as a promising technique to enhance the discriminative power of text features, many methods still rely on discrete emotion labels, limiting their ability to model emotions' inherent continuity and relational structure. To address these challenges, we introduce the Chain of Triplex Contrastive Learning (CoTCL) framework, which progressively refines utterance representations, strengthens emotional distinctions, and incorporates contextual information from dialogues. CoTCL employs instance contrastive learning using dropout-based positive samples to improve the richness and separation of utterance features. Additionally, it introduces the Pleasure-Arousal-Dominance (PAD) space as a continuous representation framework, embedding utterances in a way that reduces confusion between similar emotions. This allows for more nuanced, relation-aware emotion modeling. Furthermore, CoTCL enhances contextual understanding by constructing an utterance graph, where nodes represent utterances and edges denote relationships. By integrating external knowledge from the COMET model and applying graph-based contrastive learning with edge perturbation and node masking, CoTCL improves contextual transmission, making the model more robust and adaptable to real-world dialogues. Experimental results demonstrate that CoTCL achieves state-of-the-art performance across multiple ERC benchmarks, highlighting the importance of continuous emotion modeling and context integration. By refining text representation, introducing a continuous emotion space, and leveraging external knowledge, CoTCL provides a strong foundation for advancing ERC research and improving real-world dialogue systems.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"705 ","pages":"Article 121969"},"PeriodicalIF":6.8000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S002002552500101X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/17 0:00:00","PubModel":"Epub","JCR":"0","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Emotion recognition in conversation (ERC) is essential for enhancing human-computer interaction and improving intelligent systems' emotional intelligence. Despite advancements, ERC still struggles to capture the complexity and nuances of emotions in dialogues. Traditional approaches rely on context modeling to improve text representations but often fail to fully capture emotions' continuous and intricate nature. While contrastive learning has emerged as a promising technique to enhance the discriminative power of text features, many methods still rely on discrete emotion labels, limiting their ability to model emotions' inherent continuity and relational structure. To address these challenges, we introduce the Chain of Triplex Contrastive Learning (CoTCL) framework, which progressively refines utterance representations, strengthens emotional distinctions, and incorporates contextual information from dialogues. CoTCL employs instance contrastive learning using dropout-based positive samples to improve the richness and separation of utterance features. Additionally, it introduces the Pleasure-Arousal-Dominance (PAD) space as a continuous representation framework, embedding utterances in a way that reduces confusion between similar emotions. This allows for more nuanced, relation-aware emotion modeling. Furthermore, CoTCL enhances contextual understanding by constructing an utterance graph, where nodes represent utterances and edges denote relationships. By integrating external knowledge from the COMET model and applying graph-based contrastive learning with edge perturbation and node masking, CoTCL improves contextual transmission, making the model more robust and adaptable to real-world dialogues. Experimental results demonstrate that CoTCL achieves state-of-the-art performance across multiple ERC benchmarks, highlighting the importance of continuous emotion modeling and context integration. By refining text representation, introducing a continuous emotion space, and leveraging external knowledge, CoTCL provides a strong foundation for advancing ERC research and improving real-world dialogue systems.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
小句意识的学习链:对话中情绪识别的三重对比学习
对话中的情绪识别(ERC)对于增强人机交互和提高智能系统的情绪智力至关重要。尽管取得了进步,ERC仍在努力捕捉对话中情感的复杂性和细微差别。传统的方法依赖于上下文建模来改善文本表示,但往往不能完全捕捉情感的连续和复杂的性质。虽然对比学习已经成为一种很有前途的增强文本特征辨别能力的技术,但许多方法仍然依赖于离散的情感标签,限制了它们对情感内在连续性和关系结构建模的能力。为了应对这些挑战,我们引入了三元对比学习链(CoTCL)框架,该框架逐步完善话语表征,加强情感差异,并结合对话中的上下文信息。CoTCL采用基于辍学的正样本实例对比学习来提高话语特征的丰富度和分离度。此外,它引入了快乐-唤醒-支配(PAD)空间作为一个连续的表征框架,以一种减少相似情绪之间混淆的方式嵌入话语。这允许更细微的、关系感知的情感建模。此外,CoTCL通过构建一个话语图来增强上下文理解,其中节点表示话语,边表示关系。通过集成来自COMET模型的外部知识,并将基于图的对比学习与边缘扰动和节点掩蔽相结合,CoTCL改善了上下文传输,使模型更具鲁棒性并适应现实世界的对话。实验结果表明,CoTCL在多个ERC基准测试中达到了最先进的性能,突出了持续情绪建模和上下文集成的重要性。通过精炼文本表示,引入连续的情感空间,并利用外部知识,CoTCL为推进ERC研究和改进现实世界的对话系统提供了坚实的基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Information Sciences
Information Sciences 工程技术-计算机:信息系统
CiteScore
14.00
自引率
17.30%
发文量
1322
审稿时长
10.4 months
期刊介绍: Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions. Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.
期刊最新文献
Matrix-based incremental reduction in neighborhood covering decision information systems Cross-chain identity privacy protection scheme based on oblivious transfer protocol and key agreement The subgraph eigenvector centrality of graphs Collaborative neurodynamic approach on multi-objective optimization of wind power systems Research on pricing Asian carbon options for an uncertain exponential Ornstein-Uhlenbeck model
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1