EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation

IF 7.3 2区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Science China Information Sciences Pub Date : 2024-07-25 DOI:10.1007/s11432-023-3908-6
Yingjian Liu, Jiang Li, Xiaoping Wang, Zhigang Zeng
{"title":"EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation","authors":"Yingjian Liu, Jiang Li, Xiaoping Wang, Zhigang Zeng","doi":"10.1007/s11432-023-3908-6","DOIUrl":null,"url":null,"abstract":"<p>Emotion recognition in conversation (ERC) has attracted growing attention in recent years as a result of the advancement and implementation of human-computer interface technologies. In this paper, we propose an emotional inertia and contagion-driven dependency modeling approach (EmotionIC) for ERC tasks. Our EmotionIC consists of three main components, i.e., identity masked multi-head attention (IM-MHA), dialogue-based gated recurrent unit (DiaGRU), and skip-chain conditional random field (SkipCRF). Compared to previous ERC models, EmotionIC can model a conversation more thoroughly at both the feature-extraction and classification levels. The proposed model attempts to integrate the advantages of attention- and recurrence-based methods at the feature-extraction level. Specifically, IMMHA is applied to capture identity-based global contextual dependencies, while DiaGRU is utilized to extract speaker- and temporal-aware local contextual information. At the classification level, SkipCRF can explicitly mine complex emotional flows from higher-order neighboring utterances in the conversation. Experimental results show that our method can significantly outperform the state-of-the-art models on four benchmark datasets. The ablation studies confirm that our modules can effectively model emotional inertia and contagion.</p>","PeriodicalId":21618,"journal":{"name":"Science China Information Sciences","volume":null,"pages":null},"PeriodicalIF":7.3000,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Science China Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s11432-023-3908-6","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Emotion recognition in conversation (ERC) has attracted growing attention in recent years as a result of the advancement and implementation of human-computer interface technologies. In this paper, we propose an emotional inertia and contagion-driven dependency modeling approach (EmotionIC) for ERC tasks. Our EmotionIC consists of three main components, i.e., identity masked multi-head attention (IM-MHA), dialogue-based gated recurrent unit (DiaGRU), and skip-chain conditional random field (SkipCRF). Compared to previous ERC models, EmotionIC can model a conversation more thoroughly at both the feature-extraction and classification levels. The proposed model attempts to integrate the advantages of attention- and recurrence-based methods at the feature-extraction level. Specifically, IMMHA is applied to capture identity-based global contextual dependencies, while DiaGRU is utilized to extract speaker- and temporal-aware local contextual information. At the classification level, SkipCRF can explicitly mine complex emotional flows from higher-order neighboring utterances in the conversation. Experimental results show that our method can significantly outperform the state-of-the-art models on four benchmark datasets. The ablation studies confirm that our modules can effectively model emotional inertia and contagion.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
EmotionIC:用于对话中情绪识别的情绪惯性和传染驱动依赖建模
近年来,随着人机界面技术的发展和应用,对话中的情感识别(ERC)越来越受到人们的关注。在本文中,我们提出了一种针对 ERC 任务的情感惯性和传染驱动依赖建模方法(EmotionIC)。我们的 EmotionIC 由三个主要部分组成,即身份掩蔽多头注意力(IM-MHA)、基于对话的门控递归单元(DiaGRU)和跳链条件随机场(SkipCRF)。与以前的 ERC 模型相比,EmotionIC 可以在特征提取和分类两个层面对对话进行更全面的建模。所提出的模型试图在特征提取层面整合注意力方法和递归方法的优势。具体来说,IMMHA 用于捕捉基于身份的全局上下文相关性,而 DiaGRU 则用于提取说话人和时间感知的局部上下文信息。在分类层面,SkipCRF 可以明确地从对话中的高阶相邻语篇中挖掘复杂的情感流。实验结果表明,在四个基准数据集上,我们的方法明显优于最先进的模型。消融研究证实,我们的模块可以有效地模拟情感惯性和情感传染。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Science China Information Sciences
Science China Information Sciences COMPUTER SCIENCE, INFORMATION SYSTEMS-
CiteScore
12.60
自引率
5.70%
发文量
224
审稿时长
8.3 months
期刊介绍: Science China Information Sciences is a dedicated journal that showcases high-quality, original research across various domains of information sciences. It encompasses Computer Science & Technologies, Control Science & Engineering, Information & Communication Engineering, Microelectronics & Solid-State Electronics, and Quantum Information, providing a platform for the dissemination of significant contributions in these fields.
期刊最新文献
Weighted sum power maximization for STAR-RIS-aided SWIPT systems with nonlinear energy harvesting TSCompiler: efficient compilation framework for dynamic-shape models NeurDB: an AI-powered autonomous data system State and parameter identification of linearized water wave equation via adjoint method An STP look at logical blocking of finite state machines: formulation, detection, and search
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1