Outcome ascertainment and decision-analytic performance across prediction windows for acute kidney injury: a landmark analysis in MIMIC-IV

Early warning systems for acute kidney injury are typically evaluated by discrimination, yet ranking ability does not indicate whether acting on a prediction is worthwhile, and how decision-analytic value changes with the prediction horizon has seldom been examined. This study assembled adult intensive care admissions from MIMIC-IV into a single at-risk cohort defined at a 12 h landmark, and applied four prediction windows of 6, 12, 24 and 48 h differing only in the censoring point. Discrimination, calibration and standardized net benefit were estimated for each, alongside the proportion of admissions in which the outcome could be ascertained. Ascertainment rose from 42.7% at 6 h to complete at 48 h, the latter following from the entry criteria, and varied from 14.2% to 93.4% with the hour of admission; among ascertained admissions the event proportion was similar across strata, indicating that sampling largely determined whether an outcome was observed. In the cohort ascertainable at 6 h, standardized net benefit fell by 14.9% against 5.2% for discrimination (difference 9.65% points); because the measures lack a common no-information value, this fell close to zero on a chance-corrected scale and across sensitivity analyses. Decision-analytic value is thus bounded by the measurement process rather than declining faster than discrimination.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-11-16
DOI
https://doi.org/10.1038/s41598-026-79979-w
Primary Topic
Acute Kidney Injury Research
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Outcome ascertainment and decision-analytic performance across prediction windows for acute kidney injury: a landmark analysis in MIMIC-IV

Feng Gao, Baohong Liu, Qijun Liu, Shuhua Teng
1 links
Scientific Reports
Acute Kidney Injury Research
article

Outcome ascertainment and decision-analytic performance across prediction windows for acute kidney injury: a landmark analysis in MIMIC-IV

Feng Gao, Baohong Liu, Qijun Liu, Shuhua Teng
article en

Abstract

Early warning systems for acute kidney injury are typically evaluated by discrimination, yet ranking ability does not indicate whether acting on a prediction is worthwhile, and how decision-analytic value changes with the prediction horizon has seldom been examined. This study assembled adult intensive care admissions from MIMIC-IV into a single at-risk cohort defined at a 12 h landmark, and applied four prediction windows of 6, 12, 24 and 48 h differing only in the censoring point. Discrimination, calibration and standardized net benefit were estimated for each, alongside the proportion of admissions in which the outcome could be ascertained. Ascertainment rose from 42.7% at 6 h to complete at 48 h, the latter following from the entry criteria, and varied from 14.2% to 93.4% with the hour of admission; among ascertained admissions the event proportion was similar across strata, indicating that sampling largely determined whether an outcome was observed. In the cohort ascertainable at 6 h, standardized net benefit fell by 14.9% against 5.2% for discrimination (difference 9.65% points); because the measures lack a common no-information value, this fell close to zero on a chance-corrected scale and across sensitivity analyses. Decision-analytic value is thus bounded by the measurement process rather than declining faster than discrimination.

Scientific Reports
Shandong Xiehe University (CN)
Natural Science Foundation of Shandong Province
Good health and well-being
Acute Kidney Injury Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon