Research on Occluded Facial Expression Recognition Algorithm Based on Hybrid Attention Mechanism and Multi-scale Feature Extraction

In practical applications, the recognition performance of classical convolutional neural networks is often greatly reduced when faced with problems such as uneven facial lighting, changes in head posture, and local occlusion in real environments. Therefore, this paper proposes a network model based on hybrid attention mechanism and multi-scale feature extraction. First, ResNet-18 is used to extract the preliminary features of face images. ResNet-18 has good depth and structural stability, and can extract relatively basic facial features. Then, global features are extracted through multi-scale modules. This multi-scale convolution operation can capture the information of face images from different angles and scales, which greatly increases the generalization ability of the network model and enables it to adapt to more different situations of face images. At the same time, the hybrid attention mechanism can extract the local features of the expression image. The attention mechanism can make the model focus more on the key areas related to the expression in the image, ignore some irrelevant or interfering information, and thus increase the robustness of the network model. Finally, through the feature fusion module, the extracted global features and local features are fused, so that the model can comprehensively and accurately understand facial expression information, and output accurate classification results. Experimental results show that the algorithm can effectively capture the local features and global information of facial expressions, and has achieved remarkable results in the accuracy and robustness of facial expression recognition.

Authors

Institutions

Publication Details

Published
2025-03-14
DOI
https://doi.org/10.1145/3746709.3746726
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Occluded Facial Expression Recognition Algorithm Based on Hybrid Attention Mechanism and Multi-scale Feature Extraction

Xiaoping Tang, Shu Yin, Chun Wang
Hand Gesture Recognition Systems
article

Research on Occluded Facial Expression Recognition Algorithm Based on Hybrid Attention Mechanism and Multi-scale Feature Extraction

Xiaoping Tang, Shu Yin, Chun Wang
article en

Abstract

In practical applications, the recognition performance of classical convolutional neural networks is often greatly reduced when faced with problems such as uneven facial lighting, changes in head posture, and local occlusion in real environments. Therefore, this paper proposes a network model based on hybrid attention mechanism and multi-scale feature extraction. First, ResNet-18 is used to extract the preliminary features of face images. ResNet-18 has good depth and structural stability, and can extract relatively basic facial features. Then, global features are extracted through multi-scale modules. This multi-scale convolution operation can capture the information of face images from different angles and scales, which greatly increases the generalization ability of the network model and enables it to adapt to more different situations of face images. At the same time, the hybrid attention mechanism can extract the local features of the expression image. The attention mechanism can make the model focus more on the key areas related to the expression in the image, ignore some irrelevant or interfering information, and thus increase the robustness of the network model. Finally, through the feature fusion module, the extracted global features and local features are fused, so that the model can comprehensively and accurately understand facial expression information, and output accurate classification results. Experimental results show that the algorithm can effectively capture the local features and global information of facial expressions, and has achieved remarkable results in the accuracy and robustness of facial expression recognition.

Wuhan Donghu University (CN)
Reduced inequalities
Openalex Percentile: Top 77%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on Occluded Facial Expression Recognition Algorithm Based on Hybrid Attention Mechanism and Multi-scale Feature Extraction — Xiaoping Tang, Shu Yin, et al. · (2025) | TGRS Research Map | TGRS