Getting Emotional Enough: Analyzing Emotional Diversity in Deepfake Avatars

When using deepfake technology to represent users, there is a need to convey a reasonable range of emotions to be able to portray different circumstances ranging from positive to negative experiences (e.g., personal struggles). Because it is not known how well deepfake avatars embody emotional diversity, we investigated this aspect among 202 deepfake avatars. Our findings suggest an overall positivity bias in deepfake avatars’ emotions. We also found significant gender differences in several emotional expressions, with, male deepfakes scoring higher in “smile” and “calm” emotions, and female deepfake avatars scoring higher in “surprised”, “fear”, and “happy” emotions. In terms of ethnicity, European and Hispanic deepfake avatars demonstrate the broadest range of “smile”, “happy”, and “calm” compared to other ethnic groups. Age had no notable bias. No emotion score was normally distributed, suggesting that the range of emotional representativeness among the tested deepfake avatars is skewed. We outline the implications for academics and professionals regarding future development and responsible deployment of deepfake avatars.

Authors

Institutions

Publication Details

Journal
Nordic Conference on Human-Computer Interaction
Published
2024-09-30
DOI
https://doi.org/10.1145/3679318.3685398
Citations
2
Primary Topic
Innovative Human-Technology Interaction
Type
article
Field-Weighted Citation Impact
0.52
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Getting Emotional Enough: Analyzing Emotional Diversity in Deepfake Avatars

Ilkka Kaate, Soon-Gyo Jung, Bernard J. Jim Jansen, Aleksandra Revina et al.
2 citations
Nordic Conference on Human-Computer Interaction
Innovative Human-Technology Interaction
0.52
article

Getting Emotional Enough: Analyzing Emotional Diversity in Deepfake Avatars

Ilkka Kaate, Soon-Gyo Jung, Bernard J. Jim Jansen, Aleksandra Revina, Nina Rizun, Joni O. Salminen
article en
2 citations

Abstract

When using deepfake technology to represent users, there is a need to convey a reasonable range of emotions to be able to portray different circumstances ranging from positive to negative experiences (e.g., personal struggles). Because it is not known how well deepfake avatars embody emotional diversity, we investigated this aspect among 202 deepfake avatars. Our findings suggest an overall positivity bias in deepfake avatars’ emotions. We also found significant gender differences in several emotional expressions, with, male deepfakes scoring higher in “smile” and “calm” emotions, and female deepfake avatars scoring higher in “surprised”, “fear”, and “happy” emotions. In terms of ethnicity, European and Hispanic deepfake avatars demonstrate the broadest range of “smile”, “happy”, and “calm” compared to other ethnic groups. Age had no notable bias. No emotion score was normally distributed, suggesting that the range of emotional representativeness among the tested deepfake avatars is skewed. We outline the implications for academics and professionals regarding future development and responsible deployment of deepfake avatars.

Nordic Conference on Human-Computer Interaction
University of Turku (FI), Gdańsk University of Technology (PL), Hamad bin Khalifa University (QA), Brandenburg University of Applied Sciences (DE), University of Vaasa (FI)
Reduced inequalities
Openalex Percentile: Top 51%
Innovative Human-Technology Interaction
0.52
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.