Qini Curves for Multi-Armed Treatment Rules

Qini curves have emerged as an attractive and popular approach for evaluating the benefit of data-driven targeting rules for treatment allocation. We propose a generalization of the Qini curve to multiple costly treatment arms that quantifies the value of optimally selecting among both units and treatment arms at different budget levels. We develop an efficient algorithm for computing these curves and propose bootstrap-based confidence intervals that are exact in large samples for any point on the curve. These confidence intervals can be used to conduct hypothesis tests comparing the value of treatment targeting using an optimal combination of arms with using just a subset of arms, or with a non-targeting assignment rule ignoring covariates, at different budget levels. We demonstrate the statistical performance in a simulation experiment and an application to treatment targeting for election turnout.

Authors

Institutions

Publication Details

Journal
Journal of Computational and Graphical Statistics
Published
2024-10-24
DOI
https://doi.org/10.1080/10618600.2024.2418820
Citations
5
Primary Topic
Statistical Methods and Inference
Type
article
Field-Weighted Citation Impact
3.55

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Qini Curves for Multi-Armed Treatment Rules

Susan Athey, Erik Sverdrup, Stefan Wager, Han Wu
5 citations
Journal of Computational and Graphical Statistics
Statistical Methods and Inference
3.55
article

Qini Curves for Multi-Armed Treatment Rules

Susan Athey, Erik Sverdrup, Stefan Wager, Han Wu
article en
5 citations

Abstract

Qini curves have emerged as an attractive and popular approach for evaluating the benefit of data-driven targeting rules for treatment allocation. We propose a generalization of the Qini curve to multiple costly treatment arms that quantifies the value of optimally selecting among both units and treatment arms at different budget levels. We develop an efficient algorithm for computing these curves and propose bootstrap-based confidence intervals that are exact in large samples for any point on the curve. These confidence intervals can be used to conduct hypothesis tests comparing the value of treatment targeting using an optimal combination of arms with using just a subset of arms, or with a non-targeting assignment rule ignoring covariates, at different budget levels. We demonstrate the statistical performance in a simulation experiment and an application to treatment targeting for election turnout.

Journal of Computational and Graphical StatisticsVol. 34(3)
Australian Regenerative Medicine Institute (AU), Two Sigma Investments (United States) (US), Monash University (AU), Stanford University (US)
Stanford Graduate School of Business, Office of Naval Research
Gender equality
Openalex Percentile: Top 7%
Statistical Methods and Inference
3.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.