Replication Data for: 'Do Deepfakes Adequately Display Emotions? A Study on Deepfake Facial Emotion Expression'

DOI

Recent technological advancements in Artificial Intelligence make it easy to create deepfakes, hyper-realistic videos in which images and video clips are processed to create fake videos that appear authentic. Many of them are based on swapping faces without the consent of the person whose appearance and voice are used. As emotions are inherent in human communication, studying how deepfakes transfer emotional expressions from original to fakes is relevant. In this work, we conduct an in-depth study on facial emotional expression in deepfakes using a well-known face swap-based deepfake database. First, we extracted the photograms from their videos. Then, we analyzed the emotional expression in both the original and the faked versions of the video recordings for all performers in the database. Results show that emotional expressions are not adequately transferred between original recordings and the deepfakes created from them. The high variability in emotions and performers detected between original and fake recordings indicates that performer emotion expressiveness should be considered for better deepfake generation or for detecting them.

Identifier
DOI https://doi.org/10.34810/data262
Related Identifier IsCitedBy https://doi.org/10.1155/2022/1332122
Metadata Access https://dataverse.csuc.cat/oai?verb=GetRecord&metadataPrefix=oai_datacite&identifier=doi:10.34810/data262
Provenance
Creator García, Roberto ORCID logo; López-Gil, Juan-Miguel ORCID logo; Gil, Rosa ORCID logo
Publisher CORA.Repositori de Dades de Recerca
Contributor García, Roberto
Publication Year 2022
Funding Reference MCIN/AEI/10.13039/501100011033 PID2020-117912RB-C22
Rights CC0 1.0; info:eu-repo/semantics/openAccess; http://creativecommons.org/publicdomain/zero/1.0
OpenAccess true
Contact García, Roberto (Universitat de Lleida)
Representation
Resource Type Process-produced; Dataset
Format text/tab-separated-values; text/plain
Size 25093; 3911
Version 2.1
Discipline Other