Regularized Regression Can Reintroduce Backdoor Confounding: The Case of Mass Polarization

Regularization can improve statistical estimates made with highly correlated data. However, any regularization procedure embeds assumptions about the data generating process that can have counterintuitive consequences when those assumptions are untenable. We show that rather than simply shrinking estimates, regularization can reopen backdoor causal paths, inflating the estimates of some effects, and in the wrong circumstances, even reversing their direction. Recently, Cavari and Freedman (2023), argued that declining cooperation rates in surveys have inflated measures of mass polarization. We show that this finding is driven by large penalty terms in their regularized regressions, which leads to the estimates being confounded with time. Alternative methods do not show a clear positive or negative effect of declining cooperation on estimated levels of mass polarization.

Authors

Institutions

Publication Details

Journal
American Political Science Review
Published
2024-10-31
DOI
https://doi.org/10.1017/s0003055424000935
Citations
1
Primary Topic
Statistical Methods and Inference
Type
article
Field-Weighted Citation Impact
0.71
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Regularized Regression Can Reintroduce Backdoor Confounding: The Case of Mass Polarization

Christopher Prosser, Jonathan Mellon
1 citations
American Political Science Review
Statistical Methods and Inference
0.71
article

Regularized Regression Can Reintroduce Backdoor Confounding: The Case of Mass Polarization

Christopher Prosser, Jonathan Mellon
article en
1 citations

Abstract

Regularization can improve statistical estimates made with highly correlated data. However, any regularization procedure embeds assumptions about the data generating process that can have counterintuitive consequences when those assumptions are untenable. We show that rather than simply shrinking estimates, regularization can reopen backdoor causal paths, inflating the estimates of some effects, and in the wrong circumstances, even reversing their direction. Recently, Cavari and Freedman (2023), argued that declining cooperation rates in surveys have inflated measures of mass polarization. We show that this finding is driven by large penalty terms in their regularized regressions, which leads to the estimates being confounded with time. Alternative methods do not show a clear positive or negative effect of declining cooperation on estimated levels of mass polarization.

American Political Science ReviewVol. 119(4)
Royal Holloway University of London (GB), Universidad de Londres (MX)
Openalex Percentile: Top 25%
Statistical Methods and Inference
0.71
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.