Design-Consistent Variance Estimation in Multistage Complex Surveys: A Simulation and MICS-Based Comparative Study

Ignoring survey design features such as clustering, stratification, and unequal weighting can lead to underestimated standard errors (SEs) and misleading inference in regression models. This study compares three designconsistent variance estimators, Taylor linearization (TL), Fay's balanced repeated replication (BRR), and the Rao–Wu–Yue bootstrap, using Monte Carlo simulations based on the two-stage stratified structure of UNICEF's Multiple Indicator Cluster Surveys (MICS). Nine scenarios combine intraclass correlation (ICC = 0.01–0.10) with weight variability (<img src=image/13444009_01.gif>=0.2–1.0) to assess 95% coverage, SE calibration, and confidence interval (CI) width. Coverage was generally near nominal when clustering was weak to moderate (ICC ≤ 0.05), with mild under-coverage (about 90%) at ICC = 0.10 across methods. SEs were well calibrated (SE-ratios ≈ 0.93–1.03). CI width was driven primarily by weight heterogeneity, increasing markedly with larger <img src=image/13444009_01.gif>, whereas ICC had a smaller impact. In an application to 2018–2019 MICS data on childhood diarrhea, point estimates (odds ratios) were identical across methods; BRR and RWY bootstrap yielded slightly wider, more conservative CIs. Overall, TL is most efficient under moderate design effects, while replication methods offer greater robustness when clustering and weight dispersion are high, providing practical guidance for MICS-type analyses.

Authors

Publication Details

Journal
Mathematics and Statistics
Published
2026-02-01
DOI
https://doi.org/10.13189/ms.2026.140108
Primary Topic
Statistical Methods and Bayesian Inference
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Design-Consistent Variance Estimation in Multistage Complex Surveys: A Simulation and MICS-Based Comparative Study

Zakariya M. S. Mohammed, Ali Satty
Mathematics and Statistics
Statistical Methods and Bayesian Inference
article

Design-Consistent Variance Estimation in Multistage Complex Surveys: A Simulation and MICS-Based Comparative Study

Zakariya M. S. Mohammed, Ali Satty
article en

Abstract

Ignoring survey design features such as clustering, stratification, and unequal weighting can lead to underestimated standard errors (SEs) and misleading inference in regression models. This study compares three designconsistent variance estimators, Taylor linearization (TL), Fay's balanced repeated replication (BRR), and the Rao–Wu–Yue bootstrap, using Monte Carlo simulations based on the two-stage stratified structure of UNICEF's Multiple Indicator Cluster Surveys (MICS). Nine scenarios combine intraclass correlation (ICC = 0.01–0.10) with weight variability (<img src=image/13444009_01.gif>=0.2–1.0) to assess 95% coverage, SE calibration, and confidence interval (CI) width. Coverage was generally near nominal when clustering was weak to moderate (ICC ≤ 0.05), with mild under-coverage (about 90%) at ICC = 0.10 across methods. SEs were well calibrated (SE-ratios ≈ 0.93–1.03). CI width was driven primarily by weight heterogeneity, increasing markedly with larger <img src=image/13444009_01.gif>, whereas ICC had a smaller impact. In an application to 2018–2019 MICS data on childhood diarrhea, point estimates (odds ratios) were identical across methods; BRR and RWY bootstrap yielded slightly wider, more conservative CIs. Overall, TL is most efficient under moderate design effects, while replication methods offer greater robustness when clustering and weight dispersion are high, providing practical guidance for MICS-type analyses.

Mathematics and StatisticsVol. 14(1)
Openalex Percentile: Top 68%
Statistical Methods and Bayesian Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.