Interpretable Machine Learning for Emergency Department Triage: Clinical Insights from 133,198 Patients Using the Korean Triage and Acuity Scale (KTAS)

<b>Background/Objectives:</b> Emergency room severity classification (KTAS) is essential for patient safety but has limitations due to its reliance on subjective judgment. Existing machine learning models have not been trusted in clinical settings due to their opaque 'black box' nature in decision-making processes. To overcome this, this study aims to develop an explainable machine learning framework that provides a transparent basis for judgment with high accuracy. <b>Method:</b> We retrospectively analyzed 133,198 emergency room visits from 2022 to 2024. We trained Random Forest (RF) and XGBoost models using vital signs and pain scores and applied explainable AI (XAI) techniques to ensure model transparency. <b>Results:</b> Although XGBoost showed the highest predictive performance (94.7% accuracy within a ±1 error margin), we ultimately selected the RF model, which provides a good balance of predictive power (91.6%) and interpretability for clinical use. The results of the XAI analysis confirmed that pain score, age, and systolic blood pressure were the key variables in prediction, strongly aligning with clinical logic. <b>Conclusions:</b> This study demonstrates that explainable AI can provide transparent insights for KTAS prediction beyond the limitations of traditional black-box models. These models may support emergency department triage by improving consistency and assisting clinicians in identifying potentially high-risk patients. However, further external validation is required before routine clinical implementation.

Authors

Institutions

Publication Details

Journal
Diagnostics
Published
2026-03-23
DOI
https://doi.org/10.3390/diagnostics16060954
Primary Topic
Machine Learning in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Interpretable Machine Learning for Emergency Department Triage: Clinical Insights from 133,198 Patients Using the Korean Triage and Acuity Scale (KTAS)

J. Kim, Eun-Chul Jang, SoonChan Kwon, MyoungJe Song
Diagnostics
Machine Learning in Healthcare
article

Interpretable Machine Learning for Emergency Department Triage: Clinical Insights from 133,198 Patients Using the Korean Triage and Acuity Scale (KTAS)

J. Kim, Eun-Chul Jang, SoonChan Kwon, MyoungJe Song
article en

Abstract

<b>Background/Objectives:</b> Emergency room severity classification (KTAS) is essential for patient safety but has limitations due to its reliance on subjective judgment. Existing machine learning models have not been trusted in clinical settings due to their opaque 'black box' nature in decision-making processes. To overcome this, this study aims to develop an explainable machine learning framework that provides a transparent basis for judgment with high accuracy. <b>Method:</b> We retrospectively analyzed 133,198 emergency room visits from 2022 to 2024. We trained Random Forest (RF) and XGBoost models using vital signs and pain scores and applied explainable AI (XAI) techniques to ensure model transparency. <b>Results:</b> Although XGBoost showed the highest predictive performance (94.7% accuracy within a ±1 error margin), we ultimately selected the RF model, which provides a good balance of predictive power (91.6%) and interpretability for clinical use. The results of the XAI analysis confirmed that pain score, age, and systolic blood pressure were the key variables in prediction, strongly aligning with clinical logic. <b>Conclusions:</b> This study demonstrates that explainable AI can provide transparent insights for KTAS prediction beyond the limitations of traditional black-box models. These models may support emergency department triage by improving consistency and assisting clinicians in identifying potentially high-risk patients. However, further external validation is required before routine clinical implementation.

DiagnosticsVol. 16(6)
Soonchunhyang University (KR), Catholic Kwandong University International St. Mary's Hospital (KR)
Peace, Justice and strong institutions
Openalex Percentile: Top 13%
Machine Learning in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.