A Survey of Knowledge Graph-based Emotion Recognition: Technologies, Models, and Applications

​E​motion recognition (ER) aims to identify affective states from facial expressions, speech, text, and physiological signals. The context-dependent and multimodal nature of emotion presents challenges for systems that rely on statistical associations alone. Knowledge graphs (KGs) organize affective concepts and their relations, providing explicit knowledge for contextual modeling, multimodal integration, and reasoning. This survey reviews KG-based emotion recognition and related affective tasks, covering knowledge extraction and graph construction, unimodal and multimodal systems, representation learning, reasoning, and integration with large language models (LLMs). The synthesis draws on 49 core studies and uses additional literature for theoretical and methodological context. It distinguishes semantic KGs from computational graphs and characterizes graph construction along five dimensions: knowledge scope, semantic foundation, construction mechanism, human involvement, and multimodal representation. Selected within-study comparisons report gains from enabling knowledge-related components, while differences in tasks, protocols, and comparison designs limit conclusions across systems. The survey also examines evaluation datasets, knowledge quality, and the computational and grounding challenges of LLM and KG integration. It identifies research priorities in knowledge validation, cross-domain generalization, privacy, temporal modeling, and multimodal alignment, with evaluation procedures for assessing their contribution to reliable affective systems.

Authors

Institutions

Publication Details

Journal
Cognitive Computation
Published
2026-11-06
DOI
https://doi.org/10.1007/s12559-026-10669-5
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A Survey of Knowledge Graph-based Emotion Recognition: Technologies, Models, and Applications

Siti Hafizah Ab Hamid, Nur Nasuha Daud, Faisal Fahmi, Hasni Meon et al.
1 links
Cognitive Computation
Emotion and Mood Recognition
article

A Survey of Knowledge Graph-based Emotion Recognition: Technologies, Models, and Applications

Siti Hafizah Ab Hamid, Nur Nasuha Daud, Faisal Fahmi, Hasni Meon, Zhang xiang, Nik Daliana Binti Nik Fari
article en

Abstract

​E​motion recognition (ER) aims to identify affective states from facial expressions, speech, text, and physiological signals. The context-dependent and multimodal nature of emotion presents challenges for systems that rely on statistical associations alone. Knowledge graphs (KGs) organize affective concepts and their relations, providing explicit knowledge for contextual modeling, multimodal integration, and reasoning. This survey reviews KG-based emotion recognition and related affective tasks, covering knowledge extraction and graph construction, unimodal and multimodal systems, representation learning, reasoning, and integration with large language models (LLMs). The synthesis draws on 49 core studies and uses additional literature for theoretical and methodological context. It distinguishes semantic KGs from computational graphs and characterizes graph construction along five dimensions: knowledge scope, semantic foundation, construction mechanism, human involvement, and multimodal representation. Selected within-study comparisons report gains from enabling knowledge-related components, while differences in tasks, protocols, and comparison designs limit conclusions across systems. The survey also examines evaluation datasets, knowledge quality, and the computational and grounding challenges of LLM and KG integration. It identifies research priorities in knowledge validation, cross-domain generalization, privacy, temporal modeling, and multimodal alignment, with evaluation procedures for assessing their contribution to reliable affective systems.

Cognitive ComputationVol. 18(1)
University of Selangor (MY), Universitas Airlangga (ID), University of Malaya (MY)
Openalex Percentile: Top 19%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon