Enhancing Micro-Expression Recognition with Broadbent Attention Mechanism: A High-Performance Approach for Emotion Detection

Micro-expression recognition (MER) is a critical task in affective computing, yet it remains challenging due to the subtle, brief, and involuntary nature of micro-expressions. Existing methods often find it difficult to spot these quick micro facial expressions (MFEs), especially when there are obstacles, background noise, or differences between people. In this study, we propose a novel approach that integrates the Broadbent Attention Mechanism into a Convolutional Neural Network (CNN) to enhance MER. This attention mechanism is designed to focus on the most informative regions of facial images, improving the model's ability to extract relevant features and discard irrelevant information. The model is evaluated on the SAMM dataset, covering various emotions. Extensive experiments are conducted using both K-fold and Stratified K-fold cross-validation techniques to ensure a robust evaluation process. The proposed method achieves high accuracy 99.72%, precision 99.73%, Recall 99.72% and f1-Score 99.72% with Stratified K-fold & accuracy 99.65%, precision 99.65%, Recall 99.66% and f'1-Score 99.65% with K-fold, outperforming baseline models and demonstrating its effectiveness in recognizing subtle micro-expressions. These results indicate that the Broadbent Attention Mechanism significantly enhances accuracy and robustness of MER systems, offering a promising solution for applications in human-computer interaction (HCI) and emotion analysis.

Authors

Institutions

Publication Details

Published
2024-12-03
DOI
https://doi.org/10.1109/honet63146.2024.10822916
Citations
2
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
1.02
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Micro-Expression Recognition with Broadbent Attention Mechanism: A High-Performance Approach for Emotion Detection

Yanlong Cao, Adnan Akhunzada, Imran Ashraf, Tanzila Kehkashan et al.
2 citations
Emotion and Mood Recognition
1.02
article

Enhancing Micro-Expression Recognition with Broadbent Attention Mechanism: A High-Performance Approach for Emotion Detection

Yanlong Cao, Adnan Akhunzada, Imran Ashraf, Tanzila Kehkashan, Muhammad Zaman, H Talib
article en
2 citations

Abstract

Micro-expression recognition (MER) is a critical task in affective computing, yet it remains challenging due to the subtle, brief, and involuntary nature of micro-expressions. Existing methods often find it difficult to spot these quick micro facial expressions (MFEs), especially when there are obstacles, background noise, or differences between people. In this study, we propose a novel approach that integrates the Broadbent Attention Mechanism into a Convolutional Neural Network (CNN) to enhance MER. This attention mechanism is designed to focus on the most informative regions of facial images, improving the model's ability to extract relevant features and discard irrelevant information. The model is evaluated on the SAMM dataset, covering various emotions. Extensive experiments are conducted using both K-fold and Stratified K-fold cross-validation techniques to ensure a robust evaluation process. The proposed method achieves high accuracy 99.72%, precision 99.73%, Recall 99.72% and f1-Score 99.72% with Stratified K-fold & accuracy 99.65%, precision 99.65%, Recall 99.66% and f'1-Score 99.65% with K-fold, outperforming baseline models and demonstrating its effectiveness in recognizing subtle micro-expressions. These results indicate that the Broadbent Attention Mechanism significantly enhances accuracy and robustness of MER systems, offering a promising solution for applications in human-computer interaction (HCI) and emotion analysis.

University of Lahore (PK), COMSATS University Islamabad (PK), Qatar Science and Technology Park (QA), University of Technology Malaysia (MY), Zhejiang University (CN)
Openalex Percentile: Top 19%
Emotion and Mood Recognition
1.02
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.