EmoSense: AFRN-RAG Framework for FER-Based Facial Emotion Analysis and Mental Health Support
Mental health monitoring is becoming increasingly important with the rising prevalence of psychological disorders, yet traditional assessment methods remain subjective and resource-intensive. This paper presents a hybrid framework that combines an Adaptive Feature Recalibration Network (AFRN) for facial emotion recognition with RetrievalAugmented Generation (RAG) for mental health–related feedback. The AFRN architecture incorporates two key components: adaptive spectral recalibration modules that enhance emotion-relevant features through learned attention mechanisms, and a progressive multi-scale fusion scheme that captures both fine-grained local patterns and global facial configurations. On top of the FER backbone, the RAG component leverages domain-specific psychological resources to generate contextually informed textual summaries and guidance based on detected emotion trajectories. Experimental validation on a standard facial emotion recognition dataset demonstrates that AFRN achieves improved classification performance compared to a baseline CNN, while maintaining computational efficiency suitable for real-time or near real-time applications. The overall EmoSense framework illustrates a feasible pathway from automated emotion detection to psychologically grounded, human-readable feedback, and is positioned as an exploratory tool for AI-assisted mental health monitoring and clinical decision support rather than a standalone diagnostic or therapeutic system.
Authors
- Ifran Rahman Nijhum (ORCID: https://orcid.org/0009-0001-0362-4914)
- Keru Cai (ORCID: https://orcid.org/0009-0004-7759-9960)
- Soumyabrata Dev (ORCID: https://orcid.org/0000-0002-0153-1095)
- S Li
- Riju Das
- Peiang Miao
- Yuxin Tian
Institutions
- University College Dublin (IE)
- Hong Kong Polytechnic University (HK)
- King's College London (GB)
- Beijing Jiaotong University (CN)
- New York University (US)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-03-21
- DOI
- https://doi.org/10.5281/zenodo.19141745
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00