Fused attention mechanisms-based facial expression recognition

In recent years, the utilization of Facial Expression Recognition (FER) has gained significant traction across diverse domains including healthcare, marketing, and human-computer interface. This trend has prompted a gradual shift towards the adoption of deep learning methodologies for facial expression recognition. The paper highlights the importance of FER systems in comprehending human communication, detailing traditional methods and recent advancements in the field. It proposes a new framework integrating attention mechanisms into the VGGNet model for FER, utilizing the FER-2013 dataset for evaluation. Data augmentation techniques are employed to enhance model robustness, and attention mechanisms are integrated into the VGGNet-SE model. Through Comparative experiments, it is shown that the model of VGGNet-SE-last which adds attention mechanisms after the last convolutional layer of VGG16 achieves the most significant improvement in accuracy and reduction in Top 5 error, particularly with a ratio of 16 in SENet. Experimental results indicate that after incorporating attention mechanisms, the model can more accurately focus on important regions related to emotions in the images, leading to improved performance in recognizing facial expressions. In the future, further research on FER will be implemented by suggesting further optimizations in model architecture and exploration of more complex datasets for future research in FER.

Authors

Institutions

Publication Details

Published
2024-12-11
DOI
https://doi.org/10.1117/12.3052253
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fused attention mechanisms-based facial expression recognition

Wenxuan Xia
Emotion and Mood Recognition
article

Fused attention mechanisms-based facial expression recognition

Wenxuan Xia
article en

Abstract

In recent years, the utilization of Facial Expression Recognition (FER) has gained significant traction across diverse domains including healthcare, marketing, and human-computer interface. This trend has prompted a gradual shift towards the adoption of deep learning methodologies for facial expression recognition. The paper highlights the importance of FER systems in comprehending human communication, detailing traditional methods and recent advancements in the field. It proposes a new framework integrating attention mechanisms into the VGGNet model for FER, utilizing the FER-2013 dataset for evaluation. Data augmentation techniques are employed to enhance model robustness, and attention mechanisms are integrated into the VGGNet-SE model. Through Comparative experiments, it is shown that the model of VGGNet-SE-last which adds attention mechanisms after the last convolutional layer of VGG16 achieves the most significant improvement in accuracy and reduction in Top 5 error, particularly with a ratio of 16 in SENet. Experimental results indicate that after incorporating attention mechanisms, the model can more accurately focus on important regions related to emotions in the images, leading to improved performance in recognizing facial expressions. In the future, further research on FER will be implemented by suggesting further optimizations in model architecture and exploration of more complex datasets for future research in FER.

East China University of Science and Technology (CN)
Openalex Percentile: Top 72%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Fused attention mechanisms-based facial expression recognition — Wenxuan Xia · (2024) | TGRS Research Map | TGRS