Dual-Branch Network with Dynamic Time Warping: Enhancing Micro-Expression Recognition Through Temporal Alignment
Micro-expressions, subtle and often asymmetric facial movements, play a pivotal role in nonverbal emotional communication. Addressing the core challenges of temporal misalignment, fragmented feature extraction, and slow real-time detection in micro-expression recognition (MER), we propose a novel dual-branch spatiotemporal model for dynamic sequence MER. Leveraging MediaPipe for 3D facial feature extraction and Dynamic Time Warping (DTW) for sequence alignment, our method nonlinearly maps variable-length sequences to a fixed length. A hybrid data augmentation technique enhances model robustness, while the dual-branch network simultaneously captures local spatial features and global temporal dynamics. Experimental results on the CASMEII dataset demonstrate state-of-the-art performance with 99.22% accuracy, along with a significant improvement in real-time detection speed. This approach holds substantial practical value for applications in deception detection, mental health assessment, and human–computer interaction.
Authors
- Qiaohong Yao
- Dayu Chen
- Dan Liu
- Mengmeng Wang
- Yubin Li (ORCID: https://orcid.org/0009-0008-5770-3029)
Institutions
- Liaoning Normal University (CN)
Publication Details
- Journal
- Symmetry
- Published
- 2026-05-01
- DOI
- https://doi.org/10.3390/sym18050775
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministry of Education of the People's Republic of China