PROTEUS: A Prospective RCT Evaluating Use of AI in Stress Echocardiography
Background Use of artificial intelligence (AI) in cardiovascular imaging may potentially augment clinical decision-making in disease management, but no prospective randomized controlled trials have assessed the impact on cardiovascular outcomes. This study evaluates whether AI–augmented decision-making is non-inferior to standard decision-making when selecting participants for invasive coronary angiography following stress echocardiography. Methods PROTEUS was a multicenter, parallel-group randomized controlled trial. We enrolled participants undergoing a stress echocardiogram at 20 centers across the United Kingdom between November 2021 and June 2023. Participants were randomly assigned to standard clinical decision-making (control) or decision-making augmented by AI (intervention). The primary end point was appropriate referral for coronary angiography, with true positives defined as severe coronary disease requiring revascularization in participants referred for invasive angiography and false negatives defined as an acute coronary event within 6 months. Secondary analysis examined intervention versus control in prespecified subgroups where interpretation is known to be more challenging. Results Out of 2341 randomly assigned participants, 2213 (94.53%) completed 6 months’ follow-up. Eighty-five participants were referred for angiography, 61 of whom had significant coronary disease. Of the participants not referred, 41 participants had acute coronary syndrome or died within 6 months. The difference between the area under the receiver operating characteristic curve (AUROC) for the intervention (0.63; 95% confidence interval (CI), 0.43 to 0.83) and control (0.55; 95% CI, 0.33 to 0.80), did not meet the prespecified non-inferiority margin of −0.05 (difference, 0.09; 95% CI, −0.22 to 0. 39). The sensitivity in the intervention (64.2%; 95% CI, 33.3 to 80.0%) and control (55.1%; 95% CI, 43.7 to 84.2%) was similar (difference, 9.1%; 95% CI, −21.8 to 39.6%). Likewise, the specificity in the intervention (98.6%; 95% CI, 98.1 to 99.8%) and control (99.2%; 95% CI, 97.2 to 99.5%) was similar (difference, 0.6%; 95% CI, −2.1 to 0.9%). Subgroup analyses suggest potential benefit of AI–augmentation in low-volume stress echocardiography centers. Conclusions AI–augmented decision-making in stress echocardiography did not meet the non-inferiority end point when evaluated in a large, prospective randomized controlled trial, but may be beneficial in low-volume centers.
Authors
- Ben Thompson (ORCID: https://orcid.org/0000-0002-0481-279X)
- Emily Sanderson (ORCID: https://orcid.org/0000-0003-2268-4194)
- Tine Descamps (ORCID: https://orcid.org/0000-0002-8874-2214)
- Mamta Bajre (ORCID: https://orcid.org/0000-0001-5615-8657)
- Helen Dawes (ORCID: https://orcid.org/0000-0002-2933-5213)
- William Hawkes (ORCID: https://orcid.org/0000-0001-6259-5562)
- William Woodward (ORCID: https://orcid.org/0000-0001-9875-4983)
- Rizwan Sarwar (ORCID: https://orcid.org/0000-0003-3297-2528)
- Victoria Williamson (ORCID: https://orcid.org/0000-0002-3110-9856)
- Jamie M. O’Driscoll (ORCID: https://orcid.org/0000-0002-5923-4798)
- Ross Upton (ORCID: https://orcid.org/0000-0003-3461-7538)
- Sanjeev Bhattacharyya (ORCID: https://orcid.org/0000-0002-0234-5366)
- Casey L Johnson (ORCID: https://orcid.org/0000-0001-6281-3523)
- Thomas H. Marwick (ORCID: https://orcid.org/0000-0001-9065-0899)
- Maria Breen (ORCID: https://orcid.org/0000-0003-2808-8027)
- Gerard R. Ridgway (ORCID: https://orcid.org/0000-0002-7676-7860)
- Steffen Erhard Petersen (ORCID: https://orcid.org/0000-0003-4622-5160)
- Paul Leeson (ORCID: https://orcid.org/0000-0001-9181-9297)
- Hakim‐Moulay Dehbi (ORCID: https://orcid.org/0000-0002-0816-0178)
- Eleni Frangou (ORCID: https://orcid.org/0000-0002-5978-292X)
- Virginia Chiocchia (ORCID: https://orcid.org/0000-0002-6196-3308)
- Ashley P. Akerman (ORCID: https://orcid.org/0000-0001-9194-2148)
- David P Ripley (ORCID: https://orcid.org/0000-0001-8460-9873)
- Natalie Savage
- Victoria Harris (ORCID: https://orcid.org/0000-0002-3345-2826)
- Samuel Krasner (ORCID: https://orcid.org/0000-0003-3671-6978)
- Rajan Sharma (ORCID: https://orcid.org/0000-0002-4411-9455)
- Hania Piotrowska (ORCID: https://orcid.org/0000-0002-7106-5421)
- Gary Woodward (ORCID: https://orcid.org/0000-0001-7753-6274)
Institutions
- University of Bern (CH)
- St Bartholomew's Hospital (GB)
- Baker Heart and Diabetes Institute (AU)
- University of Leicester (GB)
- Queen Mary University of London (GB)
- King's College London (GB)
- Barts Health NHS Trust (GB)
- University of Exeter (GB)
- St George’s University Hospitals NHS Foundation Trust (GB)
- University of Oxford (GB)
- MRC Clinical Trials Unit at UCL (GB)
- Oxford Medical Diagnostics (United Kingdom) (GB)
- NIHR Exeter Clinical Research Facility (GB)
- Institute of Social and Preventive Medicine (CH)
- William Harvey Research Institute (GB)
- University College London (GB)
- University of Sunderland (GB)
Publication Details
- Journal
- NEJM AI
- Published
- 2024-10-18
- DOI
- https://doi.org/10.1056/aioa2400865
- Citations
- 17
- Primary Topic
- Cardiac Imaging and Diagnostics
- Type
- article
- Field-Weighted Citation Impact
- 6.87