Transformer-Based Cardiovascular Risk Assessment via Retinal and ECG Signals Under a Leakage-Free Protocol
Background: Deep learning on retinal fundus images and on the electrocardiogram (ECG) has each shown promise for cardiovascular risk assessment, and multimodal fusion is often claimed to reach near-perfect accuracy. Such claims are frequently confounded by data leakage and by evaluation on data that does not actually contain the stated modalities. Methods: We re-implemented a trans-former-based multimodal framework and evaluated it under a strict leakage-free protocol on two public datasets: PTB-XL (21,799 twelve-lead ECGs; myocardial-infarction vs. normal, 1513 held-out test ECGs on the official patient-respecting fold) and China-Fundus-CIMT (2,903 patients, carotid intima-media-thickness-defined risk; three-fold patient-level cross-validation). A spectro-temporal ECG transformer and a retinal vision transformer were trained independently and combined by decision-level fusion; all preprocessing, model selection and thresholds were confined to training folds. Each modality was compared with strong baselines. Results: The ECG transformer reached 90.75% accuracy and an AUC of 0.970 (sensitivity 88.91%, specificity 91.80%), exceeding lo-gistic-regression, random-forest and gradient-boosting baselines (AUC 0.835-0.869). The retinal transformer reached 71.34+/-4.57% accuracy and an AUC of 0.764+/-0.016; notably, an age-plus-sex logistic baseline (AUC 0.854) outperformed the image model, indicating limited added value of the fundus images for this label. Because the two cohorts share no patients, fusion could only be studied by simulation and did not constitute per-patient validation. Conclusions: Under rigorous evalua-tion, ECG-based MI detection is strong and reproducible, whereas retinal CIMT-risk prediction is modest and does not beat demographics, and genuine multimodal fusion will be investigated in future research.
Authors
- M. Sowmya Vani
- Sunil Jinkathoti
Publication Details
- Journal
- Preprints.org
- Published
- 2026-11-13
- DOI
- https://doi.org/10.20944/preprints202611.1433.v1
- Primary Topic
- ECG Monitoring and Analysis
- Type
- preprint