Explainable Risk-Aware Human–AI Collaborative Clinical Decision Support for Transparent and Clinically Meaningful Heart Failure Mortality Risk Prediction

Heart failure remains a major clinical challenge because of its substantial mortality risk and the difficulty of identifying patients who may require early clinical attention. Although machine learning models can support mortality prediction, clinical use requires more than accurate classification: the system must communicate uncertainty and rationale in a form that clinicians can critically evaluate. This study therefore reframes heart failure mortality prediction as a human–AI collaborative decision-support problem in which artificial intelligence provides structured risk evidence while the clinician retains responsibility for contextual interpretation and the final clinical decision. The proposed framework integrates CatBoost machine learning, risk-aware threshold optimization, and SHAP-based explainable artificial intelligence. The Heart Failure Clinical Records Dataset was used, with the temporal variable (time) excluded to reduce information leakage and to restrict prediction to patient characteristics available during clinical assessment. The CatBoost classifier was trained with class-balanced optimization and evaluated using an independent test set and five-fold stratified cross-validation. Youden's J statistic was used to identify a clinically oriented decision threshold, while SHAP generated population-level and patient-level explanations intended to support clinician verification of AI recommendations. The AI component achieved an ROC-AUC of 0.7818 on the independent test set and a mean cross-validation ROC-AUC of 0.7501 ± 0.1327. Threshold optimization identified a cut-off of 0.1844, increasing mortality recall to 89% and detecting 17 of 19 mortality cases. SHAP analysis identified serum creatinine, ejection fraction, and age among the strongest contributors to model output. At the patient level, the framework presents the predicted risk together with factors that increase or decrease that risk, creating an interaction point at which clinicians can accept, question, or override the AI recommendation using additional clinical context. Because this retrospective study did not include a clinician user study, the findings establish the technical feasibility and collaboration-readiness of the proposed interface rather than demonstrating improved human–AI team performance. Prospective evaluation with clinicians and external cohorts is required before real-world deployment.

Authors

Institutions

Publication Details

Journal
International Journal for Applied Information Management
Published
2026-11-17
DOI
https://doi.org/10.47738/ijaim.v6i4.136
Primary Topic
Artificial Intelligence in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Explainable Risk-Aware Human–AI Collaborative Clinical Decision Support for Transparent and Clinically Meaningful Heart Failure Mortality Risk Prediction

Amineh A. Khaddam
2 links
International Journal for Applied Information Management
Artificial Intelligence in Healthcare
article

Explainable Risk-Aware Human–AI Collaborative Clinical Decision Support for Transparent and Clinically Meaningful Heart Failure Mortality Risk Prediction

Amineh A. Khaddam
article en

Abstract

Heart failure remains a major clinical challenge because of its substantial mortality risk and the difficulty of identifying patients who may require early clinical attention. Although machine learning models can support mortality prediction, clinical use requires more than accurate classification: the system must communicate uncertainty and rationale in a form that clinicians can critically evaluate. This study therefore reframes heart failure mortality prediction as a human–AI collaborative decision-support problem in which artificial intelligence provides structured risk evidence while the clinician retains responsibility for contextual interpretation and the final clinical decision. The proposed framework integrates CatBoost machine learning, risk-aware threshold optimization, and SHAP-based explainable artificial intelligence. The Heart Failure Clinical Records Dataset was used, with the temporal variable (time) excluded to reduce information leakage and to restrict prediction to patient characteristics available during clinical assessment. The CatBoost classifier was trained with class-balanced optimization and evaluated using an independent test set and five-fold stratified cross-validation. Youden's J statistic was used to identify a clinically oriented decision threshold, while SHAP generated population-level and patient-level explanations intended to support clinician verification of AI recommendations. The AI component achieved an ROC-AUC of 0.7818 on the independent test set and a mean cross-validation ROC-AUC of 0.7501 ± 0.1327. Threshold optimization identified a cut-off of 0.1844, increasing mortality recall to 89% and detecting 17 of 19 mortality cases. SHAP analysis identified serum creatinine, ejection fraction, and age among the strongest contributors to model output. At the patient level, the framework presents the predicted risk together with factors that increase or decrease that risk, creating an interaction point at which clinicians can accept, question, or override the AI recommendation using additional clinical context. Because this retrospective study did not include a clinician user study, the findings establish the technical feasibility and collaboration-readiness of the proposed interface rather than demonstrating improved human–AI team performance. Prospective evaluation with clinicians and external cohorts is required before real-world deployment.

International Journal for Applied Information ManagementVol. 6(4)
Amman Arab University (JO)
Good health and well-being
Artificial Intelligence in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon