Facial Expression Recognition Through Joint Modeling of Local Visual Representations and Continuous Affect

Facial expressions are an important means of conveying human emotions. Accurately distinguishing similar expressions requires capturing subtle appearance differences across facial regions, while a single class label cannot fully represent the continuous affective relationships among expression categories. To this end, we propose a Valence-Arousal-Guided Region Attention Network (VA-RANet) for joint discrete expression classification and continuous valence-arousal (VA) estimation. The model learns multiple spatial weight maps from shared features, constructs regional representations through weighted aggregation, and fuses them with global features. A region complementarity constraint is employed to limit the similarity among the spatial weight maps and encourage differentiated regional responses. During training, the distances between the samples and the fixed class prototypes in the VA space are converted into a probability distribution and subsequently fused with the discrete expression labels to generate soft labels that provide auxiliary supervision for discrete expression classification. Ground-truth VA annotations are used for AffectNet, whereas VA pseudo-labels obtained through transfer are used for RAF-DB and CAER-S. Only facial images are required at inference. The model achieves classification accuracies of 65.71% and 62.93% under the seven-class and eight-class AffectNet settings, respectively. Experimental results indicate that the combination of differentiated multi-region visual representations and VA-guided supervision contributes to improved facial expression recognition performance.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-11-18
DOI
https://doi.org/10.3390/s26227279
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Facial Expression Recognition Through Joint Modeling of Local Visual Representations and Continuous Affect

Huili Cai, Angelo Cangelosi, Wei Xu, Qigao Sun et al.
2 links
Sensors
Emotion and Mood Recognition
article

Facial Expression Recognition Through Joint Modeling of Local Visual Representations and Continuous Affect

Huili Cai, Angelo Cangelosi, Wei Xu, Qigao Sun, Pujun Xue, Mufang Lin
article en

Abstract

Facial expressions are an important means of conveying human emotions. Accurately distinguishing similar expressions requires capturing subtle appearance differences across facial regions, while a single class label cannot fully represent the continuous affective relationships among expression categories. To this end, we propose a Valence-Arousal-Guided Region Attention Network (VA-RANet) for joint discrete expression classification and continuous valence-arousal (VA) estimation. The model learns multiple spatial weight maps from shared features, constructs regional representations through weighted aggregation, and fuses them with global features. A region complementarity constraint is employed to limit the similarity among the spatial weight maps and encourage differentiated regional responses. During training, the distances between the samples and the fixed class prototypes in the VA space are converted into a probability distribution and subsequently fused with the discrete expression labels to generate soft labels that provide auxiliary supervision for discrete expression classification. Ground-truth VA annotations are used for AffectNet, whereas VA pseudo-labels obtained through transfer are used for RAF-DB and CAER-S. Only facial images are required at inference. The model achieves classification accuracies of 65.71% and 62.93% under the seven-class and eight-class AffectNet settings, respectively. Experimental results indicate that the combination of differentiated multi-region visual representations and VA-guided supervision contributes to improved facial expression recognition performance.

SensorsVol. 26(22)
Hohai University (CN), University of Manchester (GB), Changzhou Institute of Technology (CN), Tsinghua University (CN)
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon