Performance of AI models in ECG interpretation and risk stratification for major adverse cardiac events in the emergency department
BackgroundArtificial intelligence (AI) may support electrocardiogram (ECG) interpretation and risk stratification in emergency departments, but its clinical utility remains uncertain.ObjectiveTo evaluate the performance of ChatGPT and Gemini in ECG interpretation and risk stratification for major adverse cardiac events (MACE).MethodsIn 89 prospective ED patients presenting with chest pain or palpitations, ECGs evaluated by AI models and emergency specialists were compared against cardiologist consensus. Cohen's kappa assessed agreement; diagnostic metrics were calculated for MACE risk stratification, and McNemar's test compared paired positive-call frequencies between the models.ResultsEmergency specialists showed high agreement with cardiologists (κ = 0.689-0.874), whereas ChatGPT (κ = 0.386) and Gemini (κ = 0.224) demonstrated lower agreement. McNemar testing revealed Gemini had a significantly higher positive-call tendency for ischemic features (ST elevation, ST depression, T-wave inversion; p < 0.05) than ChatGPT. For 30-day MACE risk stratification (n = 27, 30.3%), ChatGPT (96.3% sensitivity, 85.4% accuracy) and Gemini (92.6% sensitivity, 79.8% accuracy) showed numerically higher performance for ChatGPT; the proportion of positive MACE risk calls did not differ significantly between models (McNemar's exact test, p = 0.55).ConclusionIn this single-center pilot cohort (n = 89), both AI models showed high sensitivity in an exploratory MACE risk-stratification analysis, with no significant difference in positive-call frequency; equivalence cannot be inferred. Both showed lower agreement with cardiologists than emergency specialists. These preliminary findings do not support rule-out use and, at most, suggest a supplementary decision-support role, requiring further multi-center validation.
Authors
- Faruk Aydınyılmaz (ORCID: https://orcid.org/0000-0003-1088-3559)
- Halil İbrahim Doru (ORCID: https://orcid.org/0000-0001-9467-621X)
- Şenol Arslan (ORCID: https://orcid.org/0000-0002-6636-5307)
- Nazım Onur Can (ORCID: https://orcid.org/0000-0003-4883-3776)
- Kürşat Arslan (ORCID: https://orcid.org/0000-0003-4680-9561)
- Abdulkadir ODACI
- Abdullah Onur Oflaz
- Ahmet Şenol
Institutions
- Ministry of Health (TR)
- Dokuz Eylül University (TR)
- Erzurum Regional Training and Research Hospital (TR)
Publication Details
- Journal
- Technology and Health Care
- Published
- 2026-11-18
- DOI
- https://doi.org/10.1177/09287329261509123
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00