Collective and augmented intelligence outperform artificial intelligence on emotion recognition tests

As artificial intelligence (AI) systems increasingly match human performance on standardized mental state recognition tasks, the question is no longer whether AI is human-level, but which humans define that level. This question remains underexplored. This study evaluates GPT-5 mini against the full spectrum of human ability, not just average performance, on standardized forced-choice emotion and mental state recognition tasks including the Reading the Mind in the Eyes Test (RMET) and the Multiracial Reading the Mind in the Eyes Test (MRMET). At the individual level, GPT-5 mini outperforms human participants across nearly all performance levels on both the RMET and MRMET. Yet this advantage is reversed when independent responses are aggregated. Using bootstrap-resampled plurality voting to aggregate independent responses, we find that human responses significantly outperform those of GPT-5 mini. This wisdom-of-crowds effect cannot be replicated through repeated sampling from AI models. Furthermore, an augmented approach that aggregates bootstrapped human and AI responses together outperforms either source alone. These findings suggest that evaluating AI against average human performance risks mistaking AI mediocrity for human excellence. We discuss the implications of these findings for combining human and machine intelligence to surpass what either achieves in isolation.

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-03-24
DOI
https://doi.org/10.1038/s41598-026-45331-5
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Collective and augmented intelligence outperform artificial intelligence on emotion recognition tests

Scientific Reports
Emotion and Mood Recognition
article

Collective and augmented intelligence outperform artificial intelligence on emotion recognition tests

article en

Abstract

As artificial intelligence (AI) systems increasingly match human performance on standardized mental state recognition tasks, the question is no longer whether AI is human-level, but which humans define that level. This question remains underexplored. This study evaluates GPT-5 mini against the full spectrum of human ability, not just average performance, on standardized forced-choice emotion and mental state recognition tasks including the Reading the Mind in the Eyes Test (RMET) and the Multiracial Reading the Mind in the Eyes Test (MRMET). At the individual level, GPT-5 mini outperforms human participants across nearly all performance levels on both the RMET and MRMET. Yet this advantage is reversed when independent responses are aggregated. Using bootstrap-resampled plurality voting to aggregate independent responses, we find that human responses significantly outperform those of GPT-5 mini. This wisdom-of-crowds effect cannot be replicated through repeated sampling from AI models. Furthermore, an augmented approach that aggregates bootstrapped human and AI responses together outperforms either source alone. These findings suggest that evaluating AI against average human performance risks mistaking AI mediocrity for human excellence. We discuss the implications of these findings for combining human and machine intelligence to surpass what either achieves in isolation.

Scientific Reports
Elon University (US)
Openalex Percentile: Top 15%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.