Design-consistent statistical learning for rare survey outcomes: a cardiovascular-kidney-metabolic multimorbidity plasmode benchmark in women

Background Cardiovascular-kidney-metabolic (CKM) disease integrates metabolic, renal, and cardiovascular systems. Learning in probability samples is challenged by rare outcomes, unequal sampling, clustered dependence, and miscalibration. This study aimed to develop a design-consistent, calibration-first framework for concurrent CKM multimorbidity classification in complex surveys and quantify the consequences of ignoring survey design. Methods We analyzed the National Health and Nutrition Examination Survey (NHANES) 2017–March 2020 data for U.S. women aged 20–44 years. CKM multimorbidity was defined as the coexistence of at least two of the following: hypertension, diabetes mellitus, chronic kidney disease, and clinical cardiovascular disease. Five learners were compared using 20×5 whole-PSU design-aware cross-validation, fold-contained preprocessing, survey-weighted loss functions, and cross-fitted sigmoid recalibration. The evaluation used design-based and survey-bootstrap procedures across key performance metrics. A 6,000-replicate survey-plasmode benchmark was used to evaluate bias, RMSE, and 95% coverage against finite-population truth. Results Among 1,743 classifiable women, 44 unweighted cases yielded a survey-weighted prevalence of 1.97% (95% CI, 1.30%–2.65%). The elastic net minimized the calibrated weighted log loss (0.089) and achieved a ROC AUC of 0.797 (95% CI, 0.765–0.830), PR AUC of 0.062 (0.023–0.100), and calibration slope of 0.90. Naive random cross-validation yielded an absolute log-loss bias of 0.0539 and 30.2% coverage; weighted design-aware cross-validation with recalibration achieved 95.0% coverage. Conclusion For rare CKM outcomes in complex surveys, valid population-level performance estimation requires survey-aware resampling, proper scoring rules, cross-fitted calibration, and design-consistent uncertainties. The framework distinguishes investigator-defined multimorbidity from guideline-aligned CKM staging.

Authors

Publication Details

Journal
Current Biomedicine
Published
2026-11-20
DOI
https://doi.org/10.29244/currbiomed.5.1.7
Primary Topic
Survey Sampling and Estimation Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Design-consistent statistical learning for rare survey outcomes: a cardiovascular-kidney-metabolic multimorbidity plasmode benchmark in women

Oluwatimileyin C Adetunji, SUNDAY A ADETUNJI, Rhoda O Oyewusi, Bukola G Adetunji et al.
Current Biomedicine
Survey Sampling and Estimation Techniques
article

Design-consistent statistical learning for rare survey outcomes: a cardiovascular-kidney-metabolic multimorbidity plasmode benchmark in women

Oluwatimileyin C Adetunji, SUNDAY A ADETUNJI, Rhoda O Oyewusi, Bukola G Adetunji, Tomiisin Balogun
article en

Abstract

Background Cardiovascular-kidney-metabolic (CKM) disease integrates metabolic, renal, and cardiovascular systems. Learning in probability samples is challenged by rare outcomes, unequal sampling, clustered dependence, and miscalibration. This study aimed to develop a design-consistent, calibration-first framework for concurrent CKM multimorbidity classification in complex surveys and quantify the consequences of ignoring survey design. Methods We analyzed the National Health and Nutrition Examination Survey (NHANES) 2017–March 2020 data for U.S. women aged 20–44 years. CKM multimorbidity was defined as the coexistence of at least two of the following: hypertension, diabetes mellitus, chronic kidney disease, and clinical cardiovascular disease. Five learners were compared using 20×5 whole-PSU design-aware cross-validation, fold-contained preprocessing, survey-weighted loss functions, and cross-fitted sigmoid recalibration. The evaluation used design-based and survey-bootstrap procedures across key performance metrics. A 6,000-replicate survey-plasmode benchmark was used to evaluate bias, RMSE, and 95% coverage against finite-population truth. Results Among 1,743 classifiable women, 44 unweighted cases yielded a survey-weighted prevalence of 1.97% (95% CI, 1.30%–2.65%). The elastic net minimized the calibrated weighted log loss (0.089) and achieved a ROC AUC of 0.797 (95% CI, 0.765–0.830), PR AUC of 0.062 (0.023–0.100), and calibration slope of 0.90. Naive random cross-validation yielded an absolute log-loss bias of 0.0539 and 30.2% coverage; weighted design-aware cross-validation with recalibration achieved 95.0% coverage. Conclusion For rare CKM outcomes in complex surveys, valid population-level performance estimation requires survey-aware resampling, proper scoring rules, cross-fitted calibration, and design-consistent uncertainties. The framework distinguishes investigator-defined multimorbidity from guideline-aligned CKM staging.

Current BiomedicineVol. 5(1)
Survey Sampling and Estimation Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon