Real, Fake and Synthetic Faces - Does the Coin Have Three Sides?

With the ever-growing power of generative artificial intelligence, deepfake and artificially generated (synthetic) media have continued to spread online, which creates various ethical and moral concerns regarding their usage. To tackle this, we thus present a novel exploration of the trends and patt...

Full description

Saved in:
Bibliographic Details
Published in2024 IEEE 18th International Conference on Automatic Face and Gesture Recognition (FG) pp. 1 - 10
Main Authors Naeem, Shahzeb, Al-Sharawi, Ramzi, Khan, M. Riyyan, Tariq, Usman, Dhall, Abhinav, Al Nashash, Hasan
Format Conference Proceeding
LanguageEnglish
Published IEEE 27.05.2024
Subjects
Accuracy
Analytical models
Deep learning
Deepfakes
Ethics
Generative AI
Sensitivity
Online AccessGet full text

Cover

More Information
Summary:With the ever-growing power of generative artificial intelligence, deepfake and artificially generated (synthetic) media have continued to spread online, which creates various ethical and moral concerns regarding their usage. To tackle this, we thus present a novel exploration of the trends and patterns observed in real, deepfake and synthetic facial images. The proposed analysis is done in two parts: firstly, we incorporate eight deep learning models and analyze their performances in distinguishing between the three classes of images. Next, we look to further delve into the similarities and differences between these three sets of images by investigating their image properties both in the context of the entire image as well as in the context of specific regions within the image. ANOVA test was also performed and provided further clarity amongst the patterns associated between the images of the three classes. From our findings, we observe that the investigated deep-learning models found it easier to detect synthetic facial images, with the ViT Patch-16 model performing best on this task with a class-averaged sensitivity, specificity, precision, and accuracy of 97.37%, 98.69%, 97.48%, and 98.25%, respectively. This observation was supported by further analysis of various image properties. We saw noticeable differences across the three category of images. This analysis can help us build better algorithms for facial image generation, and also shows that synthetic, deepfake and real face images are indeed three different classes.
ISSN:2770-8330
DOI:10.1109/FG59268.2024.10581973