Large language models and humans converge in judging public figures’ personalities

ChatGPT-4 and 600 human raters evaluated 226 public figures' personalities using the Ten-Item Personality Inventory. The correlation between ChatGPT-4 and aggregate human ratings ranged from <i>r</i> = 0.76 to 0.87, outperforming the models specifically trained to make such predictions. Notably, the model was not provided with any training data or feedback on its performance. We discuss the potential explanations and practical implications of ChatGPT-4's ability to mimic human responses accurately.

Authors

Institutions

Publication Details

Journal
PNAS Nexus
Published
2024-09-19
DOI
https://doi.org/10.1093/pnasnexus/pgae418
Citations
3
Primary Topic
Authorship Attribution and Profiling
Type
article
Field-Weighted Citation Impact
1.04
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Large language models and humans converge in judging public figures’ personalities

Xubo Cao, Michał Kosiński
3 citations
PNAS Nexus
Authorship Attribution and Profiling
1.04
article

Large language models and humans converge in judging public figures’ personalities

Xubo Cao, Michał Kosiński
article en
3 citations

Abstract

ChatGPT-4 and 600 human raters evaluated 226 public figures' personalities using the Ten-Item Personality Inventory. The correlation between ChatGPT-4 and aggregate human ratings ranged from <i>r</i> = 0.76 to 0.87, outperforming the models specifically trained to make such predictions. Notably, the model was not provided with any training data or feedback on its performance. We discuss the potential explanations and practical implications of ChatGPT-4's ability to mimic human responses accurately.

PNAS NexusVol. 3(10)
Stanford University (US)
Openalex Percentile: Top 19%
Authorship Attribution and Profiling
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.