A4 Refereed article in a conference publication

Getting Emotional Enough: Analyzing Emotional Diversity in Deepfake Avatars




AuthorsKaate, Ilkka; Salminen, Joni; Jung, Soon-Gyo; Rizun, Nina; Revina, Aleksandra; Jansen, Bernard J.

Conference nameNordic Conference on Human-Computer Interaction

Publication year2024

Book title NordiCHI '24: Proceedings of the 13th Nordic Conference on Human-Computer Interaction

ISBN979-8-4007-0966-1

DOIhttps://doi.org/10.1145/3679318.3685398

Web address https://doi.org/10.1145/3679318.3685398

Self-archived copy’s web addresshttps://research.utu.fi/converis/portal/detail/Publication/459077243


Abstract

When using deepfake technology to represent users, there is a need to convey a reasonable range of emotions to be able to portray different circumstances ranging from positive to negative experiences (e.g., personal struggles). Because it is not known how well deepfake avatars embody emotional diversity, we investigated this aspect among 202 deepfake avatars. Our findings suggest an overall positivity bias in deepfake avatars’ emotions. We also found significant gender differences in several emotional expressions, with, male deepfakes scoring higher in “smile” and “calm” emotions, and female deepfake avatars scoring higher in “surprised”, “fear”, and “happy” emotions. In terms of ethnicity, European and Hispanic deepfake avatars demonstrate the broadest range of “smile”, “happy”, and “calm” compared to other ethnic groups. Age had no notable bias. No emotion score was normally distributed, suggesting that the range of emotional representativeness among the tested deepfake avatars is skewed. We outline the implications for academics and professionals regarding future development and responsible deployment of deepfake avatars.


Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.





Last updated on 2025-27-01 at 18:57