Knowledge-Enhanced Prompt-Tuning With Contrastive Learning for Emotion Recognition in Conversations
Emotion Recognition in Conversation (ERC) is essential for a wide range of applications, but it faces challenges arising from contextual influences. Imbalanced emotion distributions further complicate the ERC task, resulting in constrained learning for minority emotions and biased predictions for common emotions. To address these issues, we propose the Knowledge-Enhanced Prompt-Tuning with Contrastive Learning (KEPTCL) framework. KEPTCL leverages prompt-tuning to align the ERC task with the pre-training objective of the Pre-trained Language Model (PLM), thereby effectively harnessing the rich linguistic knowledge accumulated by the PLM from large-scale corpora. This approach effectively mitigates the data scarcity issue for minority emotions. Furthermore, we introduce a context-aware mixed prompt template and a knowledge subgraph-based label mapping strategy to aid the prompt-tuning process. Moreover, Supervised Contrastive Learning (SCL) is integrated to improve the PLM's capability to distinguish utterances with different emotions, reducing biased predictions for common emotions. Experimental results demonstrate that KEPTCL outperforms the state-of-the-art methods on all three benchmark datasets and mitigates the challenges posed by the imbalanced emotion distributions.
Authors
- Qingqing Gao
- Biwei Cao
- Bo Liu (ORCID: https://orcid.org/0000-0002-0894-1054)
- Xin Guan (ORCID: https://orcid.org/0000-0002-9129-327X)
- Jiuxin Cao
Institutions
- Southeast University (CN)
Publication Details
- Journal
- IEEE Transactions on Audio Speech and Language Processing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/taslpro.2025.3592325
- Citations
- 1
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 2.12