Algorithmic Risk Assessment in the Hands of Humans

We evaluate the impacts of adopting algorithmic risk assessments in sentencing. We find that judges changed sentencing practices in response to the risk assessment, but that discretion played a large role in mediating its impact. Judges deviated from the recommendations associated with the algorithm in systematic ways, suggestive of alternative objectives. As a result, risk assessment did not lead to detectable gains in terms of public safety or reduced incarceration rates. Using simulations, we show that strict adherence to the sentencing recommendations associated with the algorithm would have had benefits (less incarceration) but also some costs (increased sentences for youth). (JEL D81, D91, H76, K41, K42)

Authors

Institutions

Publication Details

Journal
American Economic Journal Economic Policy
Published
2024-10-31
DOI
https://doi.org/10.1257/pol.20220620
Citations
15
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
7.36
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Algorithmic Risk Assessment in the Hands of Humans

Megan T. Stevenson, Jennifer L. Doleac
15 citations
American Economic Journal Economic Policy
Ethics and Social Impacts of AI
7.36
article

Algorithmic Risk Assessment in the Hands of Humans

Megan T. Stevenson, Jennifer L. Doleac
article en
15 citations

Abstract

We evaluate the impacts of adopting algorithmic risk assessments in sentencing. We find that judges changed sentencing practices in response to the risk assessment, but that discretion played a large role in mediating its impact. Judges deviated from the recommendations associated with the algorithm in systematic ways, suggestive of alternative objectives. As a result, risk assessment did not lead to detectable gains in terms of public safety or reduced incarceration rates. Using simulations, we show that strict adherence to the sentencing recommendations associated with the algorithm would have had benefits (less incarceration) but also some costs (increased sentences for youth). (JEL D81, D91, H76, K41, K42)

American Economic Journal Economic PolicyVol. 16(4)
Arnold Ventures (US), University of Virginia (US)
Openalex Percentile: Top 3%
Ethics and Social Impacts of AI
7.36
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.