EmoSense: AFRN-RAG Framework for FER-Based Facial Emotion Analysis and Mental Health Support

Mental health monitoring is becoming increasingly important with the rising prevalence of psychological disorders, yet traditional assessment methods remain subjective and resource-intensive. This paper presents a hybrid framework that combines an Adaptive Feature Recalibration Network (AFRN) for facial emotion recognition with RetrievalAugmented Generation (RAG) for mental health–related feedback. The AFRN architecture incorporates two key components: adaptive spectral recalibration modules that enhance emotion-relevant features through learned attention mechanisms, and a progressive multi-scale fusion scheme that captures both fine-grained local patterns and global facial configurations. On top of the FER backbone, the RAG component leverages domain-specific psychological resources to generate contextually informed textual summaries and guidance based on detected emotion trajectories. Experimental validation on a standard facial emotion recognition dataset demonstrates that AFRN achieves improved classification performance compared to a baseline CNN, while maintaining computational efficiency suitable for real-time or near real-time applications. The overall EmoSense framework illustrates a feasible pathway from automated emotion detection to psychologically grounded, human-readable feedback, and is positioned as an exploratory tool for AI-assisted mental health monitoring and clinical decision support rather than a standalone diagnostic or therapeutic system.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-03-21
DOI
https://doi.org/10.5281/zenodo.19141745
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EmoSense: AFRN-RAG Framework for FER-Based Facial Emotion Analysis and Mental Health Support

Ifran Rahman Nijhum, Keru Cai, Soumyabrata Dev, S Li et al.
Zenodo (CERN European Organization for Nuclear Research)
Emotion and Mood Recognition
article

EmoSense: AFRN-RAG Framework for FER-Based Facial Emotion Analysis and Mental Health Support

Ifran Rahman Nijhum, Keru Cai, Soumyabrata Dev, S Li, Riju Das, Peiang Miao, Yuxin Tian
article en

Abstract

Mental health monitoring is becoming increasingly important with the rising prevalence of psychological disorders, yet traditional assessment methods remain subjective and resource-intensive. This paper presents a hybrid framework that combines an Adaptive Feature Recalibration Network (AFRN) for facial emotion recognition with RetrievalAugmented Generation (RAG) for mental health–related feedback. The AFRN architecture incorporates two key components: adaptive spectral recalibration modules that enhance emotion-relevant features through learned attention mechanisms, and a progressive multi-scale fusion scheme that captures both fine-grained local patterns and global facial configurations. On top of the FER backbone, the RAG component leverages domain-specific psychological resources to generate contextually informed textual summaries and guidance based on detected emotion trajectories. Experimental validation on a standard facial emotion recognition dataset demonstrates that AFRN achieves improved classification performance compared to a baseline CNN, while maintaining computational efficiency suitable for real-time or near real-time applications. The overall EmoSense framework illustrates a feasible pathway from automated emotion detection to psychologically grounded, human-readable feedback, and is positioned as an exploratory tool for AI-assisted mental health monitoring and clinical decision support rather than a standalone diagnostic or therapeutic system.

Zenodo (CERN European Organization for Nuclear Research)
University College Dublin (IE), Hong Kong Polytechnic University (HK), King's College London (GB), Beijing Jiaotong University (CN), New York University (US)
Openalex Percentile: Top 13%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.