A comprehensive PROBAST-based assessment of mortality prediction models in adult intensive care units; an updated scoping review

Abstract Background Numerous mortality prediction models have been developed for general adult intensive care unit (ICU) populations, but concerns remain regarding their methodological quality, risk of bias, and validation. Previous reviews primarily identified available models and their predictors, without a comprehensive model-by-model risk-of-bias assessment. We therefore updated the existing evidence base and systematically assessed identified ICU mortality prediction models using the Prediction model Risk Of Bias ASsessment Tool (PROBAST), aiming to identify methodologically robust models warranting further validation. Methods and results We built on a systematic scoping review and its first update covering studies published up to February 8, 2023, and updated the search in PubMed (MEDLINE), Embase (Ovid), Web of Science, and CENTRAL through May 11, 2026. Eligible studies developed mortality prediction models for general adult critically ill populations. Data extraction and PROBAST assessment were performed independently by reviewer pairs using a standardized CHARMS- and PROBAST-based form. In total, 56 studies describing 84 mortality prediction models were included. Overall, 82/84 (98%) models were judged at high risk of bias, predominantly because of shortcomings in the analysis domain. Internal validation was absent in 21/84 (25%) models, while only 2/84 (2%) underwent external validation in the original publication. Only one model, ICNARC II, was judged at overall low risk of bias, while PREDICT was judged at unclear risk of bias. A prospective citation search identified no external validation studies for either model. Conclusion Nearly all identified ICU mortality prediction models were at high risk of bias, limiting confidence in their reported performance and practical implementation of their intended use. Rather than continuing to develop additional models, future research should prioritize rigorous external validation and, where necessary, updating of promising existing models while adhering to established methodological standards.

Authors

Institutions

Publication Details

Journal
Critical Care
Published
2026-11-12
DOI
https://doi.org/10.1186/s13054-026-06452-5
Primary Topic
Sepsis Diagnosis and Treatment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A comprehensive PROBAST-based assessment of mortality prediction models in adult intensive care units; an updated scoping review

Iwan C.C. van der Horst, Rob Driessen, Joep Schellens, Frank van Rosmalen et al.
Critical Care
Sepsis Diagnosis and Treatment
article

A comprehensive PROBAST-based assessment of mortality prediction models in adult intensive care units; an updated scoping review

Iwan C.C. van der Horst, Rob Driessen, Joep Schellens, Frank van Rosmalen, Laure Wynants, Jan-Willem E. M. Sels, Thijs T. W. van Herpt, Eline G. M. Cox, Kim Zhipei Wang, Veerle Bos
article en

Abstract

Abstract Background Numerous mortality prediction models have been developed for general adult intensive care unit (ICU) populations, but concerns remain regarding their methodological quality, risk of bias, and validation. Previous reviews primarily identified available models and their predictors, without a comprehensive model-by-model risk-of-bias assessment. We therefore updated the existing evidence base and systematically assessed identified ICU mortality prediction models using the Prediction model Risk Of Bias ASsessment Tool (PROBAST), aiming to identify methodologically robust models warranting further validation. Methods and results We built on a systematic scoping review and its first update covering studies published up to February 8, 2023, and updated the search in PubMed (MEDLINE), Embase (Ovid), Web of Science, and CENTRAL through May 11, 2026. Eligible studies developed mortality prediction models for general adult critically ill populations. Data extraction and PROBAST assessment were performed independently by reviewer pairs using a standardized CHARMS- and PROBAST-based form. In total, 56 studies describing 84 mortality prediction models were included. Overall, 82/84 (98%) models were judged at high risk of bias, predominantly because of shortcomings in the analysis domain. Internal validation was absent in 21/84 (25%) models, while only 2/84 (2%) underwent external validation in the original publication. Only one model, ICNARC II, was judged at overall low risk of bias, while PREDICT was judged at unclear risk of bias. A prospective citation search identified no external validation studies for either model. Conclusion Nearly all identified ICU mortality prediction models were at high risk of bias, limiting confidence in their reported performance and practical implementation of their intended use. Rather than continuing to develop additional models, future research should prioritize rigorous external validation and, where necessary, updating of promising existing models while adhering to established methodological standards.

Critical Care
Maastricht University Medical Centre (NL), University Medical Center Utrecht (NL), Maastricht University (NL), Albert Schweitzer Ziekenhuis (NL), Care and Public Health Research Institute (NL), KU Leuven (BE)
Good health and well-being
Sepsis Diagnosis and Treatment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon