Transformer-Based Cardiovascular Risk Assessment via Retinal and ECG Signals Under a Leakage-Free Protocol

Background: Deep learning on retinal fundus images and on the electrocardiogram (ECG) has each shown promise for cardiovascular risk assessment, and multimodal fusion is often claimed to reach near-perfect accuracy. Such claims are frequently confounded by data leakage and by evaluation on data that does not actually contain the stated modalities. Methods: We re-implemented a trans-former-based multimodal framework and evaluated it under a strict leakage-free protocol on two public datasets: PTB-XL (21,799 twelve-lead ECGs; myocardial-infarction vs. normal, 1513 held-out test ECGs on the official patient-respecting fold) and China-Fundus-CIMT (2,903 patients, carotid intima-media-thickness-defined risk; three-fold patient-level cross-validation). A spectro-temporal ECG transformer and a retinal vision transformer were trained independently and combined by decision-level fusion; all preprocessing, model selection and thresholds were confined to training folds. Each modality was compared with strong baselines. Results: The ECG transformer reached 90.75% accuracy and an AUC of 0.970 (sensitivity 88.91%, specificity 91.80%), exceeding lo-gistic-regression, random-forest and gradient-boosting baselines (AUC 0.835-0.869). The retinal transformer reached 71.34+/-4.57% accuracy and an AUC of 0.764+/-0.016; notably, an age-plus-sex logistic baseline (AUC 0.854) outperformed the image model, indicating limited added value of the fundus images for this label. Because the two cohorts share no patients, fusion could only be studied by simulation and did not constitute per-patient validation. Conclusions: Under rigorous evalua-tion, ECG-based MI detection is strong and reproducible, whereas retinal CIMT-risk prediction is modest and does not beat demographics, and genuine multimodal fusion will be investigated in future research.

Authors

Publication Details

Journal
Preprints.org
Published
2026-11-13
DOI
https://doi.org/10.20944/preprints202611.1433.v1
Primary Topic
ECG Monitoring and Analysis
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Transformer-Based Cardiovascular Risk Assessment via Retinal and ECG Signals Under a Leakage-Free Protocol

M. Sowmya Vani, Sunil Jinkathoti
2 links
Preprints.org
ECG Monitoring and Analysis
preprint

Transformer-Based Cardiovascular Risk Assessment via Retinal and ECG Signals Under a Leakage-Free Protocol

M. Sowmya Vani, Sunil Jinkathoti
preprint en

Abstract

Background: Deep learning on retinal fundus images and on the electrocardiogram (ECG) has each shown promise for cardiovascular risk assessment, and multimodal fusion is often claimed to reach near-perfect accuracy. Such claims are frequently confounded by data leakage and by evaluation on data that does not actually contain the stated modalities. Methods: We re-implemented a trans-former-based multimodal framework and evaluated it under a strict leakage-free protocol on two public datasets: PTB-XL (21,799 twelve-lead ECGs; myocardial-infarction vs. normal, 1513 held-out test ECGs on the official patient-respecting fold) and China-Fundus-CIMT (2,903 patients, carotid intima-media-thickness-defined risk; three-fold patient-level cross-validation). A spectro-temporal ECG transformer and a retinal vision transformer were trained independently and combined by decision-level fusion; all preprocessing, model selection and thresholds were confined to training folds. Each modality was compared with strong baselines. Results: The ECG transformer reached 90.75% accuracy and an AUC of 0.970 (sensitivity 88.91%, specificity 91.80%), exceeding lo-gistic-regression, random-forest and gradient-boosting baselines (AUC 0.835-0.869). The retinal transformer reached 71.34+/-4.57% accuracy and an AUC of 0.764+/-0.016; notably, an age-plus-sex logistic baseline (AUC 0.854) outperformed the image model, indicating limited added value of the fundus images for this label. Because the two cohorts share no patients, fusion could only be studied by simulation and did not constitute per-patient validation. Conclusions: Under rigorous evalua-tion, ECG-based MI detection is strong and reproducible, whereas retinal CIMT-risk prediction is modest and does not beat demographics, and genuine multimodal fusion will be investigated in future research.

Preprints.org
Good health and well-being
ECG Monitoring and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon