Consistent and scalable composite likelihood estimation of probit models with crossed random effects

Summary Estimation of crossed random effects models commonly incurs computational costs that grow faster than linearly in the sample size $ N $, often as fast as $ \Omega(N^{3/2}) $, making them unsuitable for large datasets. For non-Gaussian responses, integrating out the random effects to obtain a marginal likelihood poses significant challenges, especially for high-dimensional integrals for which the Laplace approximation may not be accurate. In this article we develop a composite likelihood approach to probit models that replaces the crossed random effects model with some hierarchical models that require only one-dimensional integrals. We show how to consistently estimate the crossed effects model parameters from the hierarchical model fits. We find that the computation scales linearly in the sample size. The method is illustrated by applying it to approximately five million observations from Stitch Fix, where the crossed effects formulation would require an integral of dimension larger than $ 700\,000 $.

Authors

Institutions

Publication Details

Journal
Biometrika
Published
2025-01-01
DOI
https://doi.org/10.1093/biomet/asaf037
Citations
2
Primary Topic
Statistical Methods and Inference
Type
article
Field-Weighted Citation Impact
5.26

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Consistent and scalable composite likelihood estimation of probit models with crossed random effects

Art B. Owen, C Varin, Sujit K. Ghosh, Ruggero Bellio
2 citations
Biometrika
Statistical Methods and Inference
5.26
article

Consistent and scalable composite likelihood estimation of probit models with crossed random effects

Art B. Owen, C Varin, Sujit K. Ghosh, Ruggero Bellio
article en
2 citations

Abstract

Summary Estimation of crossed random effects models commonly incurs computational costs that grow faster than linearly in the sample size $ N $, often as fast as $ \Omega(N^{3/2}) $, making them unsuitable for large datasets. For non-Gaussian responses, integrating out the random effects to obtain a marginal likelihood poses significant challenges, especially for high-dimensional integrals for which the Laplace approximation may not be accurate. In this article we develop a composite likelihood approach to probit models that replaces the crossed random effects model with some hierarchical models that require only one-dimensional integrals. We show how to consistently estimate the crossed effects model parameters from the hierarchical model fits. We find that the computation scales linearly in the sample size. The method is illustrated by applying it to approximately five million observations from Stitch Fix, where the crossed effects formulation would require an integral of dimension larger than $ 700\,000 $.

BiometrikaVol. 112(3)
University of Udine (IT), Ca' Foscari University of Venice (IT), Stanford University (US)
National Science Foundation, European Commission
Openalex Percentile: Top 5%
Statistical Methods and Inference
5.26
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.