The ABCs of Who Benefits from Working with AI: Ability, Beliefs, and Calibration

We use a controlled experiment to show that ability and belief calibration jointly determine the benefits of working with artificial intelligence (AI). AI improves performance more for people with low baseline ability. However, holding ability constant, AI assistance is more valuable for people who are calibrated, meaning they have accurate beliefs about their own ability. People who know they have low ability gain the most from working with AI. In a counterfactual analysis, we show that eliminating miscalibration would cause AI to reduce performance inequality nearly twice as much as it already does. This paper was accepted by Marie Claire Villeval, behavioral economics and decision analysis. Funding: This work was supported by the Alfred P. Sloan Foundation (Cognitive Economics at Work). Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2024.08994 .

Authors

Institutions

Publication Details

Journal
Management Science
Published
2025-10-24
DOI
https://doi.org/10.1287/mnsc.2024.08994
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The ABCs of Who Benefits from Working with AI: Ability, Beliefs, and Calibration

Philip Marx, Ben Weidmann, Andrew Caplin, K. Ye et al.
Management Science
Explainable Artificial Intelligence (XAI)
article

The ABCs of Who Benefits from Working with AI: Ability, Beliefs, and Calibration

Philip Marx, Ben Weidmann, Andrew Caplin, K. Ye, Daniel Martin, David Deming, Shangwen Li
article en

Abstract

We use a controlled experiment to show that ability and belief calibration jointly determine the benefits of working with artificial intelligence (AI). AI improves performance more for people with low baseline ability. However, holding ability constant, AI assistance is more valuable for people who are calibrated, meaning they have accurate beliefs about their own ability. People who know they have low ability gain the most from working with AI. In a counterfactual analysis, we show that eliminating miscalibration would cause AI to reduce performance inequality nearly twice as much as it already does. This paper was accepted by Marie Claire Villeval, behavioral economics and decision analysis. Funding: This work was supported by the Alfred P. Sloan Foundation (Cognitive Economics at Work). Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2024.08994 .

Management Science
Louisiana State University (US), University of California, Santa Barbara (US), Harvard University Press (US), New York University (US)
Openalex Percentile: Top 84%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.