Cross-national transportability and local adaptation of a parsimonious 30-day mortality prediction model for ICU patients with bloodstream infection: from MIMIC-IV to a Chinese tertiary hospital

Timely risk stratification of ICU patients with bloodstream infection (BSI) is essential for guiding clinical decisions. Prediction models developed in Western populations may not generalize to other regions because healthcare systems, case mix, and clinical practice differ. We evaluated the cross-national transportability of a parsimonious ICU mortality model and tested local logistic recalibration in a Chinese external cohort. We developed a 30-day mortality model using MIMIC-IV ( n = 1,501) with Elastic Net regularization and multivariable logistic regression. The simplified model included five routinely available predictors: age, 24-hour Sequential Organ Failure Assessment (SOFA) score, Charlson Comorbidity Index (CCI), serum potassium, and fungal BSI. We externally validated the model in an independent cohort of 285 ICU patients with BSI from a tertiary teaching hospital in China. In internal validation, the simplified model achieved an area under the receiver operating characteristic curve (AUC) of 0.776, compared with 0.796 for the full model. In the Chinese cohort, discrimination remained acceptable (AUC 0.764), but calibration was poor, with systematic underestimation of 30-day mortality (calibration-in-the-large > 0). Local logistic recalibration improved calibration, bringing the calibration-in-the-large and slope closer to target values and reducing the Brier score to 0.182. The US-derived parsimonious model retained acceptable discrimination in this Chinese ICU cohort but showed important calibration drift. Local logistic recalibration may offer a practical, low-resource approach to support local adaptation. Because recalibration was estimated and evaluated in the same cohort, the improvement may be optimistic and requires validation in independent healthcare systems.

Authors

Institutions

Publication Details

Journal
BMC Medical Informatics and Decision Making
Published
2026-10-24
DOI
https://doi.org/10.1186/s12911-026-03929-9
Primary Topic
Sepsis Diagnosis and Treatment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cross-national transportability and local adaptation of a parsimonious 30-day mortality prediction model for ICU patients with bloodstream infection: from MIMIC-IV to a Chinese tertiary hospital

Xu Chen, Wen Song, Qiongfang Zhu, Yinting Zhu et al.
BMC Medical Informatics and Decision Making
Sepsis Diagnosis and Treatment
article

Cross-national transportability and local adaptation of a parsimonious 30-day mortality prediction model for ICU patients with bloodstream infection: from MIMIC-IV to a Chinese tertiary hospital

Xu Chen, Wen Song, Qiongfang Zhu, Yinting Zhu, Yining Wu, Jie Xu, Yalu Ren
article en

Abstract

Timely risk stratification of ICU patients with bloodstream infection (BSI) is essential for guiding clinical decisions. Prediction models developed in Western populations may not generalize to other regions because healthcare systems, case mix, and clinical practice differ. We evaluated the cross-national transportability of a parsimonious ICU mortality model and tested local logistic recalibration in a Chinese external cohort. We developed a 30-day mortality model using MIMIC-IV ( n = 1,501) with Elastic Net regularization and multivariable logistic regression. The simplified model included five routinely available predictors: age, 24-hour Sequential Organ Failure Assessment (SOFA) score, Charlson Comorbidity Index (CCI), serum potassium, and fungal BSI. We externally validated the model in an independent cohort of 285 ICU patients with BSI from a tertiary teaching hospital in China. In internal validation, the simplified model achieved an area under the receiver operating characteristic curve (AUC) of 0.776, compared with 0.796 for the full model. In the Chinese cohort, discrimination remained acceptable (AUC 0.764), but calibration was poor, with systematic underestimation of 30-day mortality (calibration-in-the-large > 0). Local logistic recalibration improved calibration, bringing the calibration-in-the-large and slope closer to target values and reducing the Brier score to 0.182. The US-derived parsimonious model retained acceptable discrimination in this Chinese ICU cohort but showed important calibration drift. Local logistic recalibration may offer a practical, low-resource approach to support local adaptation. Because recalibration was estimated and evaluated in the same cohort, the improvement may be optimistic and requires validation in independent healthcare systems.

BMC Medical Informatics and Decision Making
Soochow University (CN), First Affiliated Hospital of Soochow University (CN)
Openalex Percentile: Top 12%
Sepsis Diagnosis and Treatment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon