Development and external validation of an interpretable machine learning model for the prediction of intubation in the intensive care unit

Given the limited capacity to accurately determine the necessity for intubation in intensive care unit settings, this study aimed to develop and externally validate an interpretable machine learning model capable of predicting the need for intubation among ICU patients. Seven widely used machine learning (ML) algorithms were employed to construct the prediction models. Adult patients from the Medical Information Mart for Intensive Care IV database who stayed in the ICU for longer than 24 h were included in the development and internal validation. The model was subsequently externally validated using the eICU-CRD database. In addition, the SHapley Additive exPlanations method was employed to interpret the influence of individual parameters on the predictions made by the model. A total of 11,988 patients were included in the final cohort for this study. The CatBoost model demonstrated the best performance (AUC: 0.881). In the external validation set, the efficacy of our model was also confirmed (AUC: 0.750), which suggests robust generalization capabilities. The Glasgow Coma Scale (GCS), body mass index (BMI), arterial partial pressure of oxygen (PaO<sub>2</sub>), respiratory rate (RR) and length of stay (LOS) before ICU were the top 5 features of the CatBoost model with the greatest impact. We developed an externally validated CatBoost model that accurately predicts the need for intubation in ICU patients within 24 to 96 h of admission, facilitating clinical decision-making and has the potential to improve patient outcomes. The prediction model utilizes readily obtainable monitoring parameters and integrates the SHAP method to enhance interpretability, providing clinicians with clear insights into the factors influencing predictions.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2024-11-08
DOI
https://doi.org/10.1038/s41598-024-77798-5
Citations
5
Primary Topic
Respiratory Support and Mechanisms
Type
article
Field-Weighted Citation Impact
2.09

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development and external validation of an interpretable machine learning model for the prediction of intubation in the intensive care unit

Wei Mao, Jianyuan Liu, Xiangjie Duan, Minjie Duan et al.
5 citations
Scientific Reports
Respiratory Support and Mechanisms
2.09
article

Development and external validation of an interpretable machine learning model for the prediction of intubation in the intensive care unit

Wei Mao, Jianyuan Liu, Xiangjie Duan, Minjie Duan, Gang Liu, Yu Jiang, Lilin Wang
article en
5 citations

Abstract

Given the limited capacity to accurately determine the necessity for intubation in intensive care unit settings, this study aimed to develop and externally validate an interpretable machine learning model capable of predicting the need for intubation among ICU patients. Seven widely used machine learning (ML) algorithms were employed to construct the prediction models. Adult patients from the Medical Information Mart for Intensive Care IV database who stayed in the ICU for longer than 24 h were included in the development and internal validation. The model was subsequently externally validated using the eICU-CRD database. In addition, the SHapley Additive exPlanations method was employed to interpret the influence of individual parameters on the predictions made by the model. A total of 11,988 patients were included in the final cohort for this study. The CatBoost model demonstrated the best performance (AUC: 0.881). In the external validation set, the efficacy of our model was also confirmed (AUC: 0.750), which suggests robust generalization capabilities. The Glasgow Coma Scale (GCS), body mass index (BMI), arterial partial pressure of oxygen (PaO<sub>2</sub>), respiratory rate (RR) and length of stay (LOS) before ICU were the top 5 features of the CatBoost model with the greatest impact. We developed an externally validated CatBoost model that accurately predicts the need for intubation in ICU patients within 24 to 96 h of admission, facilitating clinical decision-making and has the potential to improve patient outcomes. The prediction model utilizes readily obtainable monitoring parameters and integrates the SHAP method to enhance interpretability, providing clinicians with clear insights into the factors influencing predictions.

Scientific ReportsVol. 14(1)
Capital Medical University (CN), Beijing Chao-Yang Hospital, Capital Medical University (CN), Chinese PLA General Hospital (CN), Chongqing Emergency Medical Center (CN), First Affiliated Hospital of Jinan University (CN), Chongqing Medical University (CN)
Chongqing Municipal Public Health Bureau, Chongqing People's Municipal Government, Chongqing Medical University, Natural Science Foundation of Chongqing
Openalex Percentile: Top 12%
Respiratory Support and Mechanisms
2.09
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.