Unraveling Perception and Appraisal of Synthetic Faces with the Drift Diffusion Model
Background: Generative Adversarial Networks (GANs) produce synthetic faces that are behaviorally indistinguishable from real faces by explicit evaluative criteria. However, whether and how human perceptual processing of synthetic faces differs from that of real faces remains unclear. Methods: Forty-one participants completed a face judgement task, in which they decided whether a face image of the sender of an online friend request was trustworthy. The face images were synthetic or real human faces. Gaze metrics were monitored by an eye-tracker. A hierarchical Bayesian drift diffusion model (DDM) was used to analyze explicit responses, which were compared between the two face types using repeated measures ANOVA. Results: Trustworthiness ratings did not differ between face types. However, RT and cumulative fixation time for synthetic faces were longer compared to real faces. Importantly, DDM indicated that the RT cost was driven mainly by longer non-decision time, with a small, tentative increase in boundary separation and no change in drift rate. Conclusions: Synthetic faces lengthened non-decision time, which encompasses perceptual encoding as well as response preparation and execution, whereas the rate of evidence accumulation was unchanged. The findings highlight processing differences that explicit judgments do not reveal in interaction with AI agents and inform the future design of AI systems.
Authors
- Xiao Yang (ORCID: https://orcid.org/0000-0001-6421-2051)
- Michael J Gazzanigo (ORCID: https://orcid.org/0009-0002-9311-9766)
- Katie Heberlein
Institutions
- Northeastern University (US)
- Old Dominion University (US)
Publication Details
- Journal
- Informatics
- Published
- 2026-11-16
- DOI
- https://doi.org/10.3390/informatics13110197
- Primary Topic
- Face Recognition and Perception
- Type
- article
- Field-Weighted Citation Impact
- 0.00