Automating the Pediatric Index of Mortality 3 in the Electronic Health Record: Automated Risk Scoring Using Structured Clinical Documentation

Background The Pediatric Index of Mortality 3 (PIM3) is a validated severity-of-illness score widely used for risk adjustment, benchmarking, quality improvement initiatives, and research in pediatric intensive care units (PICUs). Its use in electronic workflows is limited by required variables that rely on clinical judgement and are traditionally abstracted manually from narrative documentation. Objectives To design, implement, and evaluate an automated PIM3 calculation within the electronic health record (EHR) using structured clinical documentation to capture non-discrete variables, and to assess clinician adoption, documentation accuracy, and concordance with manual abstraction. Methods A structured documentation template with standardized response options was developed to capture non-discrete PIM3 variables, including ventilation status, elective admission status, procedural recovery, and diagnosis category. These clinician-entered data were mapped to discrete structured data elements and combined with physiologic and laboratory inputs for automated score calculation. Documentation completion and accuracy were evaluated over a 12-month period. Automated scores were validated against manually abstracted gold standard PIM3 scores in a convenience sample of 20 targeted encounters. Results Among 923 PICU encounters, clinician compliance with structured PIM3 documentation was 95% (n=877). Of the completed entries, 84% (n=773) contained no documentation errors. Identified errors were primarily related to binary clinical judgements rather than diagnostic clarification. Of the 20 encounter validation sample, automated PIM3 scores and associated probabilities of death demonstrated near-complete concordance with manually calculated gold standard values, with no clinically meaningful discrepancies. Conclusion Automated PIM3 calculation using structured clinical documentation within the EHR is feasible and reliable for supporting standardized data capture and timely availability of risk-adjustment information. This approach reduces reliance on manual abstraction and provides a scalable informatics framework for quality improvement, benchmarking, and research in pediatric critical care.

Authors

Institutions

Publication Details

Journal
Applied Clinical Informatics
Published
2026-11-18
DOI
https://doi.org/10.1055/a-3004-6222
Primary Topic
Electronic Health Records Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Automating the Pediatric Index of Mortality 3 in the Electronic Health Record: Automated Risk Scoring Using Structured Clinical Documentation

Ruxin Dai, Yu Kawai, Robert J. Kahoud, Katherine J. Heise et al.
1 links
Applied Clinical Informatics
Electronic Health Records Systems
article

Automating the Pediatric Index of Mortality 3 in the Electronic Health Record: Automated Risk Scoring Using Structured Clinical Documentation

Ruxin Dai, Yu Kawai, Robert J. Kahoud, Katherine J. Heise, Travis Kirkpatrick, Arthur Gallardojohnson
article en

Abstract

Background The Pediatric Index of Mortality 3 (PIM3) is a validated severity-of-illness score widely used for risk adjustment, benchmarking, quality improvement initiatives, and research in pediatric intensive care units (PICUs). Its use in electronic workflows is limited by required variables that rely on clinical judgement and are traditionally abstracted manually from narrative documentation. Objectives To design, implement, and evaluate an automated PIM3 calculation within the electronic health record (EHR) using structured clinical documentation to capture non-discrete variables, and to assess clinician adoption, documentation accuracy, and concordance with manual abstraction. Methods A structured documentation template with standardized response options was developed to capture non-discrete PIM3 variables, including ventilation status, elective admission status, procedural recovery, and diagnosis category. These clinician-entered data were mapped to discrete structured data elements and combined with physiologic and laboratory inputs for automated score calculation. Documentation completion and accuracy were evaluated over a 12-month period. Automated scores were validated against manually abstracted gold standard PIM3 scores in a convenience sample of 20 targeted encounters. Results Among 923 PICU encounters, clinician compliance with structured PIM3 documentation was 95% (n=877). Of the completed entries, 84% (n=773) contained no documentation errors. Identified errors were primarily related to binary clinical judgements rather than diagnostic clarification. Of the 20 encounter validation sample, automated PIM3 scores and associated probabilities of death demonstrated near-complete concordance with manually calculated gold standard values, with no clinically meaningful discrepancies. Conclusion Automated PIM3 calculation using structured clinical documentation within the EHR is feasible and reliable for supporting standardized data capture and timely availability of risk-adjustment information. This approach reduces reliance on manual abstraction and provides a scalable informatics framework for quality improvement, benchmarking, and research in pediatric critical care.

Applied Clinical Informatics
Mayo Clinic (US), Children's Minnesota (US), Mayo Clinic in Florida (US)
Good health and well-being
Electronic Health Records Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon