FaceSleuth-R: Adaptive Orientation-Aware Attention For Robust Micro-Expression Recognition
Micro-expression recognition (MER) has achieved impressive accuracy in controlled laboratory settings. However, its real-world applicability faces a significant generalization cliff, severely hindering practical deployment due to poor performance on unseen data and susceptibility to domain shifts. Existing attention mechanisms often overfit to dataset-specific appearance cues or rely on fixed spatial priors, making them fragile in diverse environments. We posit that robust MER requires focusing on quasi-invariant motion orientations inherent to micro-expressions, rather than superficial pixel-level features. To this end, we introduce FaceSleuth-R, a framework centered on our novel Single-Orientation Attention (SOA) module. SOA is a lightweight, differentiable operator that enables the network to learn layer-specific optimal orientations, effectively guiding attention towards these robust motion cues. Through extensive experiments, we demonstrate that SOA consistently discovers a universal near-vertical motion prior across diverse datasets. More critically, FaceSleuth-R showcases superior generalization in rigorous Leave-One-Dataset-Out (LODO) protocols, significantly outperforming baselines and state-of-the-art methods when confronted with domain shifts. Furthermore, our approach establishes state-of-the-art results across several benchmarks. This work highlights adaptive orientation-aware attention as a key paradigm for developing truly generalized and high-performing MER systems.
Authors
- Jacky Keung (ORCID: https://orcid.org/0000-0002-3803-9600)
- Zixuan Wang (ORCID: https://orcid.org/0000-0002-5255-3462)
- Tianxiang Jiang
- Yini Fang (ORCID: https://orcid.org/0009-0008-9478-5545)
- Wenhao Duan
- Lisa Y. Wu
Institutions
- University of Science and Technology of China (CN)
- University of Electronic Science and Technology of China (CN)
- Harbin Engineering University (CN)
- City University of Hong Kong (HK)
- Hong Kong University of Science and Technology (HK)
- Ocean University of China (CN)
Publication Details
- Published
- 2026-04-21
- DOI
- https://doi.org/10.1109/icassp55912.2026.11461772
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00