Evaluating Model Complexity in a Small Single-Center Clinical Tabular Dataset: A Leakage-Controlled and Calibration-Aware Case Study of MINOCA–Coronary Slow-Flow Differentiation

This study evaluated whether model complexity adds value when differentiating myocardial infarction with non-obstructive coronary arteries (MINOCA) from coronary slow flow in a small clinical tabular dataset. The retrospective cohort included 107 coronary slow-flow and 104 MINOCA patients represented by 19 variables obtained before angiography and definitive group assignment. Penalized logistic regression was compared with kernel- and tree-based machine-learning models. Imputation, scaling, hyperparameter selection, and calibration were restricted to training folds within 5-fold nested cross-validation repeated 10 times. Discrimination, probabilistic accuracy, calibration, threshold-dependent metrics, learning curves, estimator dynamics, and paired uncertainty were evaluated. Random forest achieved the highest AUROC (0.825; 95% CI, 0.774–0.873), whereas elastic net achieved an AUROC of 0.810 (0.753–0.863). The paired random-forest minus elastic-net AUROC difference was 0.015 (−0.027 to 0.060), and the Brier-score difference was −0.0068 (−0.0291 to 0.0138); no superiority was demonstrated after Holm correction. Learning curves showed continued validation gains for the tree ensembles as training size increased, with persistent training–validation separation. Feature-group analyses indicated model-specific contributions from hemogram and lipid variables. The findings do not establish equivalence or generalizability to all small clinical datasets. They support leakage-controlled, calibration-aware, and uncertainty-aware benchmarking before any consideration of external validation or clinical use.

Authors

Institutions

Publication Details

Journal
Machine Learning and Knowledge Extraction
Published
2026-10-28
DOI
https://doi.org/10.3390/make8110357
Primary Topic
Artificial Intelligence in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating Model Complexity in a Small Single-Center Clinical Tabular Dataset: A Leakage-Controlled and Calibration-Aware Case Study of MINOCA–Coronary Slow-Flow Differentiation

Ali Duygu, Fahri Er, Halit Irmak, Mehmet Ali Işık
3 links
Machine Learning and Knowledge Extraction
Artificial Intelligence in Healthcare
article

Evaluating Model Complexity in a Small Single-Center Clinical Tabular Dataset: A Leakage-Controlled and Calibration-Aware Case Study of MINOCA–Coronary Slow-Flow Differentiation

Ali Duygu, Fahri Er, Halit Irmak, Mehmet Ali Işık
article en

Abstract

This study evaluated whether model complexity adds value when differentiating myocardial infarction with non-obstructive coronary arteries (MINOCA) from coronary slow flow in a small clinical tabular dataset. The retrospective cohort included 107 coronary slow-flow and 104 MINOCA patients represented by 19 variables obtained before angiography and definitive group assignment. Penalized logistic regression was compared with kernel- and tree-based machine-learning models. Imputation, scaling, hyperparameter selection, and calibration were restricted to training folds within 5-fold nested cross-validation repeated 10 times. Discrimination, probabilistic accuracy, calibration, threshold-dependent metrics, learning curves, estimator dynamics, and paired uncertainty were evaluated. Random forest achieved the highest AUROC (0.825; 95% CI, 0.774–0.873), whereas elastic net achieved an AUROC of 0.810 (0.753–0.863). The paired random-forest minus elastic-net AUROC difference was 0.015 (−0.027 to 0.060), and the Brier-score difference was −0.0068 (−0.0291 to 0.0138); no superiority was demonstrated after Holm correction. Learning curves showed continued validation gains for the tree ensembles as training size increased, with persistent training–validation separation. Feature-group analyses indicated model-specific contributions from hemogram and lipid variables. The findings do not establish equivalence or generalizability to all small clinical datasets. They support leakage-controlled, calibration-aware, and uncertainty-aware benchmarking before any consideration of external validation or clinical use.

Machine Learning and Knowledge ExtractionVol. 8(11)
Mardin Artuklu University (TR), Bandırma Onyedi Eylül University (TR)
Good health and well-being
Openalex Percentile: Top 8%
Artificial Intelligence in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon