Face to face: Comparing ChatGPT with human performance on face matching

ChatGPT's large language model, GPT-4V, has been trained on vast numbers of image-text pairs and is therefore capable of processing visual input. This model operates very differently from current state-of-the-art neural networks designed specifically for face perception and so I chose to investigate whether ChatGPT could also be applied to this domain. With this aim, I focussed on the task of face matching, that is, deciding whether two photographs showed the same person or not. Across six different tests, ChatGPT demonstrated performance that was comparable with human accuracies despite being a domain-general 'virtual assistant' rather than a specialised tool for face processing. This perhaps surprising result identifies a new avenue for exploration in this field, while further research should explore the boundaries of ChatGPT's ability, along with how its errors may relate to those made by humans.

Authors

Institutions

Publication Details

Journal
Perception
Published
2024-11-05
DOI
https://doi.org/10.1177/03010066241295992
Citations
8
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
1.99
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Face to face: Comparing ChatGPT with human performance on face matching

Robin S. S. Kramer
8 citations
Perception
Face recognition and analysis
1.99
article

Face to face: Comparing ChatGPT with human performance on face matching

Robin S. S. Kramer
article en
8 citations

Abstract

ChatGPT's large language model, GPT-4V, has been trained on vast numbers of image-text pairs and is therefore capable of processing visual input. This model operates very differently from current state-of-the-art neural networks designed specifically for face perception and so I chose to investigate whether ChatGPT could also be applied to this domain. With this aim, I focussed on the task of face matching, that is, deciding whether two photographs showed the same person or not. Across six different tests, ChatGPT demonstrated performance that was comparable with human accuracies despite being a domain-general 'virtual assistant' rather than a specialised tool for face processing. This perhaps surprising result identifies a new avenue for exploration in this field, while further research should explore the boundaries of ChatGPT's ability, along with how its errors may relate to those made by humans.

PerceptionVol. 54(1)
University of Lincoln (GB)
Quality Education
Openalex Percentile: Top 12%
Face recognition and analysis
1.99
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Face to face: Comparing ChatGPT with human performance on face matching — Robin S. S. Kramer · Perception (2024) | TGRS Research Map | TGRS