HMRM: A Hybrid Motion and Region-Fused Mamba Network for Micro-Expression Recognition
Micro-expression recognition (MER), as an important branch of intelligent visual sensing, enables the analysis of subtle facial movements for applications in emotion understanding, human-computer interaction and security monitoring. However, existing methods struggle to capture fine-grained spatiotemporal dynamics under limited data and computational resources, making them difficult to deploy in real-world sensing systems. To address this limitation, we propose HMRM, a hybrid motion and region-fused Mamba network designed for efficient and accurate MER. HMRM enhances motion representation through a hybrid feature augmentation module that integrates gated recurrent unit (GRU)-attention optical flow estimation with a regional MotionMix enhancement strategy to increase motion diversity. Furthermore, it employs a grained Mamba encoder to achieve lightweight and effective long-range temporal modeling. Additionally, a regions feature fusion strategy is introduced to strengthen the representation of localized expression dynamics. Experiments on multiple MER benchmark datasets demonstrate that HMRM achieves state-of-the-art performance with strong generalization and low computational cost, highlighting its potential for integration into compact, real-time visual sensing and emotion analysis systems.
Authors
- Ray Luo (ORCID: https://orcid.org/0000-0002-6346-8271)
- Wei Lan (ORCID: https://orcid.org/0000-0001-5839-7504)
- Yi Liu (ORCID: https://orcid.org/0000-0001-7405-7972)
- Jiayi Liu (ORCID: https://orcid.org/0000-0003-2432-4627)
- Zhe Guo (ORCID: https://orcid.org/0000-0001-8024-1434)
Institutions
- Northwestern Polytechnical University (CN)
Publication Details
- Journal
- Sensors
- Published
- 2025-12-18
- DOI
- https://doi.org/10.3390/s25247672
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China