Development and external validation of an interpretable machine learning model for predicting prolonged postoperative ICU length of stay in coronary artery bypass grafting patients using MIMIC-IV 3.1 and eICU-CRD 2.0

BACKGROUND: Prolonged postoperative intensive care unit (ICU) length of stay (LOS) after coronary artery bypass grafting (CABG) drives resource use yet remains difficult to anticipate at the 24-hour ICU evaluation moment when extended monitoring beyond 72 h is first considered. We developed and externally validated an interpretable machine-learning decision-support calculator for this deployment moment. METHODS: Adult CABG patients were identified from MIMIC-IV 3.1 (n = 6,919; 7:3 stratified split for development) and eICU-CRD 2.0 (n = 5,972; external validation). The outcome was prolonged ICU LOS (> 3 days). Elastic Net plus Boruta selected eight bedside features collected within the first 24 h of ICU admission: 24-hour fluid intake, Charlson Comorbidity Index (CCI), Sequential Organ Failure Assessment (SOFA) score, Simplified Acute Physiology Score II (SAPS-II), Glasgow Coma Scale (GCS), vasopressor use, congestive heart failure, and atrial fibrillation. Nine machine-learning algorithms were compared by 10-fold cross-validation paired t-tests with Bonferroni and Benjamini-Hochberg correction. Calibration metrics included Hosmer-Lemeshow test, Integrated Calibration Index (ICI), expected-to-observed ratio, intercept, and slope (full Methods). SHapley Additive exPlanations (SHAP) provided per-patient feature attribution. RESULTS: CatBoost was selected as the deployed model. On the MIMIC-IV internal test set (n = 2,076), the area under the receiver-operating-characteristic curve (AUC) was 0.7739 (95% confidence interval 0.7379-0.8099), Hosmer-Lemeshow p = 0.224, calibration slope 0.973. On the eICU-CRD external cohort, AUC was 0.6452 (95% CI 0.6311-0.6602), calibration slope 0.998, ICI 0.023. At the prevalence-anchored threshold of 0.30, sensitivity was 0.55, specificity 0.65, positive predictive value 0.40, and negative predictive value 0.77. Decision Curve Analysis showed positive net benefit over treat-all and treat-none across t = 0.20-0.40. SHAP top-3 features were 24-hour fluid intake, CCI, and atrial fibrillation. CONCLUSIONS: The model provides decision support at the post-CABG 24-hour ICU evaluation moment with modest discrimination and well-calibrated probabilities at deployment. The deployed online calculator renders per-patient feature contributions transparent at the bedside via SHAP; prospective validation is required before clinical deployment.

Authors

Institutions

Publication Details

Journal
BMC Medical Informatics and Decision Making
Published
2026-06-27
DOI
https://doi.org/10.1186/s12911-026-03659-y
Primary Topic
Hemodynamic Monitoring and Therapy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development and external validation of an interpretable machine learning model for predicting prolonged postoperative ICU length of stay in coronary artery bypass grafting patients using MIMIC-IV 3.1 and eICU-CRD 2.0

Xianglong Liu, 孟玉兰, Wei Huang, pengyu LU et al.
BMC Medical Informatics and Decision Making
Hemodynamic Monitoring and Therapy
article

Development and external validation of an interpretable machine learning model for predicting prolonged postoperative ICU length of stay in coronary artery bypass grafting patients using MIMIC-IV 3.1 and eICU-CRD 2.0

Xianglong Liu, 孟玉兰, Wei Huang, pengyu LU, Dayan Liu
article en

Abstract

BACKGROUND: Prolonged postoperative intensive care unit (ICU) length of stay (LOS) after coronary artery bypass grafting (CABG) drives resource use yet remains difficult to anticipate at the 24-hour ICU evaluation moment when extended monitoring beyond 72 h is first considered. We developed and externally validated an interpretable machine-learning decision-support calculator for this deployment moment. METHODS: Adult CABG patients were identified from MIMIC-IV 3.1 (n = 6,919; 7:3 stratified split for development) and eICU-CRD 2.0 (n = 5,972; external validation). The outcome was prolonged ICU LOS (> 3 days). Elastic Net plus Boruta selected eight bedside features collected within the first 24 h of ICU admission: 24-hour fluid intake, Charlson Comorbidity Index (CCI), Sequential Organ Failure Assessment (SOFA) score, Simplified Acute Physiology Score II (SAPS-II), Glasgow Coma Scale (GCS), vasopressor use, congestive heart failure, and atrial fibrillation. Nine machine-learning algorithms were compared by 10-fold cross-validation paired t-tests with Bonferroni and Benjamini-Hochberg correction. Calibration metrics included Hosmer-Lemeshow test, Integrated Calibration Index (ICI), expected-to-observed ratio, intercept, and slope (full Methods). SHapley Additive exPlanations (SHAP) provided per-patient feature attribution. RESULTS: CatBoost was selected as the deployed model. On the MIMIC-IV internal test set (n = 2,076), the area under the receiver-operating-characteristic curve (AUC) was 0.7739 (95% confidence interval 0.7379-0.8099), Hosmer-Lemeshow p = 0.224, calibration slope 0.973. On the eICU-CRD external cohort, AUC was 0.6452 (95% CI 0.6311-0.6602), calibration slope 0.998, ICI 0.023. At the prevalence-anchored threshold of 0.30, sensitivity was 0.55, specificity 0.65, positive predictive value 0.40, and negative predictive value 0.77. Decision Curve Analysis showed positive net benefit over treat-all and treat-none across t = 0.20-0.40. SHAP top-3 features were 24-hour fluid intake, CCI, and atrial fibrillation. CONCLUSIONS: The model provides decision support at the post-CABG 24-hour ICU evaluation moment with modest discrimination and well-calibrated probabilities at deployment. The deployed online calculator renders per-patient feature contributions transparent at the bedside via SHAP; prospective validation is required before clinical deployment.

BMC Medical Informatics and Decision Making
Dalian Medical University (CN), Kaifeng University (CN), People's Hospital of Xinjiang Uygur Autonomous Region (CN), Kaifeng City Children's Hospital (CN), First Affiliated Hospital of Dalian Medical University (CN), Third Affiliated Hospital of Zhengzhou University (CN)
Openalex Percentile: Top 5%
Hemodynamic Monitoring and Therapy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.