Microexpression Recognition from Action Unit-Variational Graph Autoencoder

Emotion recognition has helped humans express their feelings, assisting in therapy sessions or criminal investigations. However, humans are clever enough to hide their feelings, making them hard to recognize. Micro-expression can help reveal their genuine emotions from very fast-changing expressions. This study attempts to recognize micro-expression based on a deep learning model. A recent related study used action unit with graph neural networks but mostly fail to generalize the facial graph structure. To overcome the issue, we propose an integrated deep learning model from action unit-graph neural networks to build the facial graph structure and variational autoencoders to extract the latent information from it called AU-VGAE. In such way, we offer better generalization to learn the facial graph structure. In this study, the proposed model was evaluated on a public micro-expression dataset. The evaluation showed the proposed model performs better than state-of-the-art models.

Authors

Institutions

Publication Details

Published
2024-12-11
DOI
https://doi.org/10.1109/isriti64779.2024.10963473
Primary Topic
Medical Imaging Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Microexpression Recognition from Action Unit-Variational Graph Autoencoder

Alvida Mustika Rukmi, Nurul Hidayat, Mohammad Iqbal, Retno Anggraini et al.
Medical Imaging Techniques and Applications
article

Microexpression Recognition from Action Unit-Variational Graph Autoencoder

Alvida Mustika Rukmi, Nurul Hidayat, Mohammad Iqbal, Retno Anggraini, Fairuuz Nurdiaz Amaanullah
article en

Abstract

Emotion recognition has helped humans express their feelings, assisting in therapy sessions or criminal investigations. However, humans are clever enough to hide their feelings, making them hard to recognize. Micro-expression can help reveal their genuine emotions from very fast-changing expressions. This study attempts to recognize micro-expression based on a deep learning model. A recent related study used action unit with graph neural networks but mostly fail to generalize the facial graph structure. To overcome the issue, we propose an integrated deep learning model from action unit-graph neural networks to build the facial graph structure and variational autoencoders to extract the latent information from it called AU-VGAE. In such way, we offer better generalization to learn the facial graph structure. In this study, the proposed model was evaluated on a public micro-expression dataset. The evaluation showed the proposed model performs better than state-of-the-art models.

Sepuluh Nopember Institute of Technology (ID)
Institut Teknologi Sepuluh Nopember
Openalex Percentile: Top 56%
Medical Imaging Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Microexpression Recognition from Action Unit-Variational Graph Autoencoder — Alvida Mustika Rukmi, Nurul Hidayat, et al. · (2024) | TGRS Research Map | TGRS