Development and validation of machine learning models to predict mortality in elderly patients with chronic critical illness: a multi-cohort study using MIMIC, eICU, and a Chinese dataset

Background and objective Patients with chronic critical illness (CCI) often require prolonged mechanical ventilation and other ICU interventions. The significant morbidity and mortality linked to CCI make the early identification of risk factors an imperative clinical objective. Methods Data from elderly CCI patients were sourced from the MIMIC-III, MIMIC-IV and eICU databases. An independent external validation cohort of 308 patients was additionally collected from a Chinese hospital. PSM was applied to the eICU cohort to address class imbalance. Feature selection was conducted using LASSO regression and the Boruta algorithm. Twelve machine learning models were developed and validated. To identify the optimal model, we evaluated AUC, accuracy, F1-score, sensitivity, and specificity. Calibration and clinical utility were further assessed using calibration plots and DCA, with SHAP employed for model interpretation. Results A total of 1,628 elderly CCI patients were included across three cohorts (MIMIC derivation: 928; eICU: 392; Chinese local: 308). Thirty variables with significant differences between survivors and non-survivors were identified in the derivation cohort. Eight key predictors were selected: age, AKI stage, hemoglobin, platelets, RDW, potassium, body temperature, and PaCO 2 , all measured on ICU day 14. In the derivation cohort, the top-performing models were GBDT (AUC = 0.872), LGBM (AUC = 0.870), and logistic regression (LR, AUC = 0.865). The LR model was selected as the final model based on its superior clinical net benefit and consistent performance in the eICU PSM cohort (AUC = 0.819) and the full eICU cohort (AUC = 0.719). In the Chinese local validation cohort, the LR model maintained acceptable discrimination (AUC = 0.685) with stable recall, while ensemble models showed further performance degradation. SHAP analysis revealed that lower body temperature, elevated RDW, higher potassium, lower platelet count, and higher PaCO 2 were the strongest predictors of increased mortality risk, with age and AKI stage also contributing. Conclusion The LR model may assist in risk stratification for in-hospital mortality in elderly CCI patients, with consistent discrimination across U.S. and Chinese populations. Its interpretability and generalizability support its potential utility as a clinical tool for identifying high-risk individuals to guide early intervention.

Authors

Institutions

Publication Details

Journal
Frontiers in Medicine
Published
2026-11-19
DOI
https://doi.org/10.3389/fmed.2026.1889261
Primary Topic
Machine Learning in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Development and validation of machine learning models to predict mortality in elderly patients with chronic critical illness: a multi-cohort study using MIMIC, eICU, and a Chinese dataset

Xingguang Qu, Chong Li, Xing Chen, Xiaoyun Xu et al.
Frontiers in Medicine
Machine Learning in Healthcare
article

Development and validation of machine learning models to predict mortality in elderly patients with chronic critical illness: a multi-cohort study using MIMIC, eICU, and a Chinese dataset

Xingguang Qu, Chong Li, Xing Chen, Xiaoyun Xu, Chao Lei, Zhaohui Zhang, Chunzhen Zhang
article en

Abstract

Background and objective Patients with chronic critical illness (CCI) often require prolonged mechanical ventilation and other ICU interventions. The significant morbidity and mortality linked to CCI make the early identification of risk factors an imperative clinical objective. Methods Data from elderly CCI patients were sourced from the MIMIC-III, MIMIC-IV and eICU databases. An independent external validation cohort of 308 patients was additionally collected from a Chinese hospital. PSM was applied to the eICU cohort to address class imbalance. Feature selection was conducted using LASSO regression and the Boruta algorithm. Twelve machine learning models were developed and validated. To identify the optimal model, we evaluated AUC, accuracy, F1-score, sensitivity, and specificity. Calibration and clinical utility were further assessed using calibration plots and DCA, with SHAP employed for model interpretation. Results A total of 1,628 elderly CCI patients were included across three cohorts (MIMIC derivation: 928; eICU: 392; Chinese local: 308). Thirty variables with significant differences between survivors and non-survivors were identified in the derivation cohort. Eight key predictors were selected: age, AKI stage, hemoglobin, platelets, RDW, potassium, body temperature, and PaCO 2 , all measured on ICU day 14. In the derivation cohort, the top-performing models were GBDT (AUC = 0.872), LGBM (AUC = 0.870), and logistic regression (LR, AUC = 0.865). The LR model was selected as the final model based on its superior clinical net benefit and consistent performance in the eICU PSM cohort (AUC = 0.819) and the full eICU cohort (AUC = 0.719). In the Chinese local validation cohort, the LR model maintained acceptable discrimination (AUC = 0.685) with stable recall, while ensemble models showed further performance degradation. SHAP analysis revealed that lower body temperature, elevated RDW, higher potassium, lower platelet count, and higher PaCO 2 were the strongest predictors of increased mortality risk, with age and AKI stage also contributing. Conclusion The LR model may assist in risk stratification for in-hospital mortality in elderly CCI patients, with consistent discrimination across U.S. and Chinese populations. Its interpretability and generalizability support its potential utility as a clinical tool for identifying high-risk individuals to guide early intervention.

Frontiers in MedicineVol. 13
China Three Gorges University (CN), Yichang Central People's Hospital (CN)
Machine Learning in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon