Micro-Expression Recognition Algorithm Using Regions of Interest and the Weighted ArcFace Loss
Micro-expressions often reveal more genuine emotions but are challenging to recognize due to their brief duration and subtle amplitudes. To address these challenges, this paper introduces a micro-expression recognition method leveraging regions of interest (ROIs). Firstly, four specific ROIs are selected based on an analysis of the optical flow and relevant action units activated during micro-expressions. Secondly, effective feature extraction is achieved using the optical flow method. Thirdly, a block partition module is integrated into a convolutional neural network to reduce computational complexity, thereby enhancing model accuracy and generalization. The proposed model achieves notable performance, with accuracies of 93.96%, 86.15%, and 81.17% for three-class recognition on the CASME II, SAMM, and SMIC datasets, respectively. For five-class recognition, the model achieves accuracies of 81.63% on the CASME II dataset and 84.31% on the SMIC dataset. Experimental results validate the effectiveness of using ROIs in improving micro-expression recognition accuracy.
Authors
- Lei Shi (ORCID: https://orcid.org/0000-0002-5570-7818)
- Peiying Zhang (ORCID: https://orcid.org/0000-0002-0990-5581)
- Ruixin Wang (ORCID: https://orcid.org/0000-0002-4395-8492)
- Jia Luo (ORCID: https://orcid.org/0000-0003-4936-7586)
Institutions
- Yunnan Normal University (CN)
- Beijing University of Technology (CN)
- Yangtze River Delta Physics Research Center (China) (CN)
- Institute of Software (CN)
- China University of Petroleum, East China (CN)
- Communication University of China (CN)
Publication Details
- Journal
- Electronics
- Published
- 2024-12-24
- DOI
- https://doi.org/10.3390/electronics14010002
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Beijing Municipality
- Natural Science Foundation of Shandong Province
- Fundamental Research Funds for the Central Universities