Multi-Level Causal Reasoning for Emotion Recognition in Conversations

Emotion recognition in conversation (ERC) has always been a research highlight in human-computer interaction (HCI). Existing models, including large-scale language models (LLMs), exhibit their advantages in capturing semantic correlations in utterance embeddings. However, they do not consider the causal relationship between utterances, which can be directly located to the cause and avoid unnecessary noise interference. Causal relationships are powerful in seizing the generation and evolution of emotions, and are also important for understanding the spread and changes of emotions in dialogue. To address this limitation, we propose a novel Multi-Level Causal Reasoning Model (MLCRM), which explores how to distinguish different causal relationships of a simulation embedding by independent conditioning. Specifically, we put forward a novel causal graph architecture to deal with unstructured conversation data, aiming to reveal causal links between sentences in a conversation. We not only focus on causal relations at the local level, but also on semantic embedding analysis at the global level. We commit to achieving comprehensive capture of causal relationships in conversation data by devising a coarse-grained semantic embedding module to assist the fine-grained causal inference. Furthermore, we raise a mix of experts module to enhance the exchange of information between the coarse-grained and fine-grained modules and to ensure the effective fusion of information for both. We conduct extensive experiments on four benchmarks, and the experimental results show that our model exhibits competitive results in the task of ERC.

Authors

Institutions

Publication Details

Published
2024-12-02
DOI
https://doi.org/10.1109/swc62898.2024.00179
Citations
1
Primary Topic
Speech and dialogue systems
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Level Causal Reasoning for Emotion Recognition in Conversations

Feifei Xu, Qiang Du, Jiahao Lu, Zhou Wang et al.
1 citations
Speech and dialogue systems
0.35
article

Multi-Level Causal Reasoning for Emotion Recognition in Conversations

Feifei Xu, Qiang Du, Jiahao Lu, Zhou Wang, Ziheng Yu, Tao Sun
article en
1 citations

Abstract

Emotion recognition in conversation (ERC) has always been a research highlight in human-computer interaction (HCI). Existing models, including large-scale language models (LLMs), exhibit their advantages in capturing semantic correlations in utterance embeddings. However, they do not consider the causal relationship between utterances, which can be directly located to the cause and avoid unnecessary noise interference. Causal relationships are powerful in seizing the generation and evolution of emotions, and are also important for understanding the spread and changes of emotions in dialogue. To address this limitation, we propose a novel Multi-Level Causal Reasoning Model (MLCRM), which explores how to distinguish different causal relationships of a simulation embedding by independent conditioning. Specifically, we put forward a novel causal graph architecture to deal with unstructured conversation data, aiming to reveal causal links between sentences in a conversation. We not only focus on causal relations at the local level, but also on semantic embedding analysis at the global level. We commit to achieving comprehensive capture of causal relationships in conversation data by devising a coarse-grained semantic embedding module to assist the fine-grained causal inference. Furthermore, we raise a mix of experts module to enhance the exchange of information between the coarse-grained and fine-grained modules and to ensure the effective fusion of information for both. We conduct extensive experiments on four benchmarks, and the experimental results show that our model exhibits competitive results in the task of ERC.

Shanghai University of Electric Power (CN)
Reduced inequalities
Openalex Percentile: Top 29%
Speech and dialogue systems
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.