Auditing clinical prediction robustness under missing measurements and incomplete follow-up

Robustness stress tests for clinical prediction models remove measurements and compare prediction error, but the outcomes used for that comparison may themselves be incompletely observed. We examined whether incomplete follow-up can distort the estimated effect of missing measurements. A controlled simulation separated measurement loss from censoring. A semi-synthetic experiment used SUPPORT clinical records divided by patient into development, validation and test sets of 5,416, 1,739 and 1,812 eligible records, retaining original known 180-day outcomes as a reference while artificial censoring was imposed. Five fixed prediction strategies and standard censoring-weighted estimators were evaluated. For indicator logistic regression, albumin-dependent measurement loss worsened reference Brier score by 0.00483, yet scoring only outcomes still known after albumin-driven censoring suggested an improvement of 0.00384. Masking-effect estimation error was ?0.00867 [?0.01033, ?0.00696] for known-outcome-only scoring and ?0.00167 [?0.00303, ?0.00017] for marginal inverse-probability-of-censoring weighting, conditional on the fitted source model; corresponding source-refitting validation intervals included zero. Other pipelines showed exaggerated rather than reversed deterioration. Exploratory hepatocellular carcinoma analyses in 165 UCI and 366 TCGA records motivated the study; their original augmentation contrast was inconclusive. Robustness evaluations should report how outcomes were observed and distinguish fixed-model from source-refitting uncertainty. Keywords: Missing Predictors, Censoring, Brier Score, Clinical Prediction, Robustness, Reproducibility.

Authors

Institutions

Publication Details

Journal
Computer Science & IT Research Journal
Published
2026-11-19
DOI
https://doi.org/10.51594/csitrj.v7i10.2383
Primary Topic
Statistical Methods in Epidemiology
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Auditing clinical prediction robustness under missing measurements and incomplete follow-up

El Houcine Oussi, Hamza El Massaoudy
Computer Science & IT Research Journal
Statistical Methods in Epidemiology
article

Auditing clinical prediction robustness under missing measurements and incomplete follow-up

El Houcine Oussi, Hamza El Massaoudy
article en

Abstract

Robustness stress tests for clinical prediction models remove measurements and compare prediction error, but the outcomes used for that comparison may themselves be incompletely observed. We examined whether incomplete follow-up can distort the estimated effect of missing measurements. A controlled simulation separated measurement loss from censoring. A semi-synthetic experiment used SUPPORT clinical records divided by patient into development, validation and test sets of 5,416, 1,739 and 1,812 eligible records, retaining original known 180-day outcomes as a reference while artificial censoring was imposed. Five fixed prediction strategies and standard censoring-weighted estimators were evaluated. For indicator logistic regression, albumin-dependent measurement loss worsened reference Brier score by 0.00483, yet scoring only outcomes still known after albumin-driven censoring suggested an improvement of 0.00384. Masking-effect estimation error was ?0.00867 [?0.01033, ?0.00696] for known-outcome-only scoring and ?0.00167 [?0.00303, ?0.00017] for marginal inverse-probability-of-censoring weighting, conditional on the fitted source model; corresponding source-refitting validation intervals included zero. Other pipelines showed exaggerated rather than reversed deterioration. Exploratory hepatocellular carcinoma analyses in 165 UCI and 366 TCGA records motivated the study; their original augmentation contrast was inconclusive. Robustness evaluations should report how outcomes were observed and distinguish fixed-model from source-refitting uncertainty. Keywords: Missing Predictors, Censoring, Brier Score, Clinical Prediction, Robustness, Reproducibility.

Computer Science & IT Research JournalVol. 7(10)
Nanjing University of Information Science and Technology (CN)
Statistical Methods in Epidemiology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon