Knowledge-Enhanced Prompt-Tuning With Contrastive Learning for Emotion Recognition in Conversations

Emotion Recognition in Conversation (ERC) is essential for a wide range of applications, but it faces challenges arising from contextual influences. Imbalanced emotion distributions further complicate the ERC task, resulting in constrained learning for minority emotions and biased predictions for common emotions. To address these issues, we propose the Knowledge-Enhanced Prompt-Tuning with Contrastive Learning (KEPTCL) framework. KEPTCL leverages prompt-tuning to align the ERC task with the pre-training objective of the Pre-trained Language Model (PLM), thereby effectively harnessing the rich linguistic knowledge accumulated by the PLM from large-scale corpora. This approach effectively mitigates the data scarcity issue for minority emotions. Furthermore, we introduce a context-aware mixed prompt template and a knowledge subgraph-based label mapping strategy to aid the prompt-tuning process. Moreover, Supervised Contrastive Learning (SCL) is integrated to improve the PLM's capability to distinguish utterances with different emotions, reducing biased predictions for common emotions. Experimental results demonstrate that KEPTCL outperforms the state-of-the-art methods on all three benchmark datasets and mitigates the challenges posed by the imbalanced emotion distributions.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Audio Speech and Language Processing
Published
2025-01-01
DOI
https://doi.org/10.1109/taslpro.2025.3592325
Citations
1
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
2.12
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Knowledge-Enhanced Prompt-Tuning With Contrastive Learning for Emotion Recognition in Conversations

Qingqing Gao, Biwei Cao, Bo Liu, Xin Guan et al.
1 citations
IEEE Transactions on Audio Speech and Language Processing
Emotion and Mood Recognition
2.12
article

Knowledge-Enhanced Prompt-Tuning With Contrastive Learning for Emotion Recognition in Conversations

Qingqing Gao, Biwei Cao, Bo Liu, Xin Guan, Jiuxin Cao
article en
1 citations

Abstract

Emotion Recognition in Conversation (ERC) is essential for a wide range of applications, but it faces challenges arising from contextual influences. Imbalanced emotion distributions further complicate the ERC task, resulting in constrained learning for minority emotions and biased predictions for common emotions. To address these issues, we propose the Knowledge-Enhanced Prompt-Tuning with Contrastive Learning (KEPTCL) framework. KEPTCL leverages prompt-tuning to align the ERC task with the pre-training objective of the Pre-trained Language Model (PLM), thereby effectively harnessing the rich linguistic knowledge accumulated by the PLM from large-scale corpora. This approach effectively mitigates the data scarcity issue for minority emotions. Furthermore, we introduce a context-aware mixed prompt template and a knowledge subgraph-based label mapping strategy to aid the prompt-tuning process. Moreover, Supervised Contrastive Learning (SCL) is integrated to improve the PLM's capability to distinguish utterances with different emotions, reducing biased predictions for common emotions. Experimental results demonstrate that KEPTCL outperforms the state-of-the-art methods on all three benchmark datasets and mitigates the challenges posed by the imbalanced emotion distributions.

IEEE Transactions on Audio Speech and Language ProcessingVol. 33
Southeast University (CN)
Openalex Percentile: Top 12%
Emotion and Mood Recognition
2.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Knowledge-Enhanced Prompt-Tuning With Contrastive Learning for Emotion Recognition in Conversations — Qingqing Gao, Biwei Cao, et al. · IEEE Transactions on Audio Speech and Language Processing (2025) | TGRS Research Map | TGRS