REPAIR: Random-effect prediction adjustment for inference in regression

Random-effect predictions from multilevel models are often used to relate individual differences in processes, such as growth or stress reactivity, to other variables. Yet, regressions using these predictions can distort regression coefficients and standard errors because the predictions combine shrinkage with sampling error. Here, we introduce and evaluate Random-Effect Prediction Adjustment for Inference in Regression (REPAIR), a two-step framework for linear regressions involving random effects. For linear Gaussian multilevel models, REPAIR obtains likelihood-only predictions by generalized least squares. A regularized method-of-moments estimator then uses estimated cluster-specific sampling-error covariances to correct structural moments. Four simulation studies examined random effects as predictors, outcomes, or both, including unequal cluster sizes. REPAIR generally showed small bias at medium to high predictor reliability and often had lower root mean squared error than alternative methods. Low predictor reliability remained challenging, particularly for confidence interval coverage in small samples. These findings support REPAIR as a practical framework for estimating structural relationships involving random effects while accounting for their measurement uncertainty.

Authors

Publication Details

Published
2026-11-05
DOI
https://doi.org/10.31234/osf.io/gbwqd
Primary Topic
Statistical Methods and Bayesian Inference
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

REPAIR: Random-effect prediction adjustment for inference in regression

Michael N. Hallquist, Zachary Vig
Statistical Methods and Bayesian Inference
preprint

REPAIR: Random-effect prediction adjustment for inference in regression

Michael N. Hallquist, Zachary Vig
preprint en

Abstract

Random-effect predictions from multilevel models are often used to relate individual differences in processes, such as growth or stress reactivity, to other variables. Yet, regressions using these predictions can distort regression coefficients and standard errors because the predictions combine shrinkage with sampling error. Here, we introduce and evaluate Random-Effect Prediction Adjustment for Inference in Regression (REPAIR), a two-step framework for linear regressions involving random effects. For linear Gaussian multilevel models, REPAIR obtains likelihood-only predictions by generalized least squares. A regularized method-of-moments estimator then uses estimated cluster-specific sampling-error covariances to correct structural moments. Four simulation studies examined random effects as predictors, outcomes, or both, including unequal cluster sizes. REPAIR generally showed small bias at medium to high predictor reliability and often had lower root mean squared error than alternative methods. Low predictor reliability remained challenging, particularly for confidence interval coverage in small samples. These findings support REPAIR as a practical framework for estimating structural relationships involving random effects while accounting for their measurement uncertainty.

Statistical Methods and Bayesian Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon