Prediction of COVID-19 Outcome Using Machine Learning and Clinical Data for North Macedonia

Background/Objectives: This retrospective methodological case study evaluated outcome classification in the first 501 laboratory-confirmed COVID-19 cases in North Macedonia (37 deaths; 7.39%). Methods: Six machine learning classifiers were compared with ZeroR and ridge logistic regression using stratified 10-fold cross-validation, supplemented by five repetitions. The primary analysis used 19 demographic, symptom and comorbidity predictors without hospitalization status. Symptom timestamps were unavailable, so performance at initial assessment could not be established. Results: J48 matched the majority-class accuracy of 92.6%; no classifier exceeded it. Naïve Bayes achieved the highest AUROC (0.863), MCC (0.369) and Death-class sensitivity (0.486). Logistic regression achieved AUROC 0.800 (95% CI 0.709–0.891), numerically exceeding five of the six machine learning classifiers; the conventional benchmark was competitive. Its repeated cross-validation AUROC was 0.801 ± 0.003. Bagging had the lowest Brier score (0.058), whereas Naïve Bayes and Random Tree had negative scaled Brier scores despite their discrimination above chance. Including hospitalization increased the Naïve Bayes AUROC to 0.893 and sensitivity to 0.649. Decision curves suggested net benefit at selected thresholds, but uncertainty and miscalibration limit interpretation. Separate exploratory permutation and SHAP analyses of a scikit-learn Random Forest reconstruction identified difficulty breathing, age and cardiovascular disease as prominent contributors; these explanations cannot be attributed directly to the evaluated WEKA ensemble. Conclusions: The contribution is a cohort-specific demonstration of how accuracy, discrimination, calibration and net benefit can support different conclusions, rather than a new algorithm or deployable mortality model. The small event count, uncertain predictor timing and absence of external validation preclude clinical implementation.

Authors

Institutions

Publication Details

Journal
Diagnostics
Published
2026-11-19
DOI
https://doi.org/10.3390/diagnostics16223880
Primary Topic
Artificial Intelligence in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Prediction of COVID-19 Outcome Using Machine Learning and Clinical Data for North Macedonia

Aleksandra Stojanova, Natasha Stojkovikj, Sašo Koceski, Maja Kukusheva Paneva
Diagnostics
Artificial Intelligence in Healthcare
article

Prediction of COVID-19 Outcome Using Machine Learning and Clinical Data for North Macedonia

Aleksandra Stojanova, Natasha Stojkovikj, Sašo Koceski, Maja Kukusheva Paneva
article en

Abstract

Background/Objectives: This retrospective methodological case study evaluated outcome classification in the first 501 laboratory-confirmed COVID-19 cases in North Macedonia (37 deaths; 7.39%). Methods: Six machine learning classifiers were compared with ZeroR and ridge logistic regression using stratified 10-fold cross-validation, supplemented by five repetitions. The primary analysis used 19 demographic, symptom and comorbidity predictors without hospitalization status. Symptom timestamps were unavailable, so performance at initial assessment could not be established. Results: J48 matched the majority-class accuracy of 92.6%; no classifier exceeded it. Naïve Bayes achieved the highest AUROC (0.863), MCC (0.369) and Death-class sensitivity (0.486). Logistic regression achieved AUROC 0.800 (95% CI 0.709–0.891), numerically exceeding five of the six machine learning classifiers; the conventional benchmark was competitive. Its repeated cross-validation AUROC was 0.801 ± 0.003. Bagging had the lowest Brier score (0.058), whereas Naïve Bayes and Random Tree had negative scaled Brier scores despite their discrimination above chance. Including hospitalization increased the Naïve Bayes AUROC to 0.893 and sensitivity to 0.649. Decision curves suggested net benefit at selected thresholds, but uncertainty and miscalibration limit interpretation. Separate exploratory permutation and SHAP analyses of a scikit-learn Random Forest reconstruction identified difficulty breathing, age and cardiovascular disease as prominent contributors; these explanations cannot be attributed directly to the evaluated WEKA ensemble. Conclusions: The contribution is a cohort-specific demonstration of how accuracy, discrimination, calibration and net benefit can support different conclusions, rather than a new algorithm or deployable mortality model. The small event count, uncertain predictor timing and absence of external validation preclude clinical implementation.

DiagnosticsVol. 16(22)
Goce Delcev University (MK)
Artificial Intelligence in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon