EchoAtlas: A Conversational, Multi-View Vision-Language Foundation Model for Echocardiography Interpretation and Clinical Reasoning
Echocardiography is the most widely used cardiac imaging modality, yet artificial intelligence-enabled interpretation remains limited by the inability of existing models to integrate visual assessment, quantitative measurement, and clinical reasoning within a unified framework. Here we present EchoAtlas, the first autoregressive vision-language model developed for echocardiographic interpretation. Trained on over 12.9 million question-answer pairs derived from approximately 2 million echocardiogram videos, EchoAtlas achieves 0.966 accuracy on multiple-choice questions in our internal test set and establishes a new state-of-the-art on the public MIMIC-EchoQA benchmark (0.699 vs. 0.508 previously). EchoAtlas also provides accurate quantitative measurements, segment-level regional wall motion assessment, longitudinal comparison, and diagnostic reasoning across diverse question formats - capabilities not previously demonstrated in this domain. These results highlight the potential of autoregressive vision-language models as a foundation for interactive echocardiographic interpretation, representing an early step toward scalable, auditable artificial intelligence systems in cardiology practice.
Authors
- Garvan C. Kane (ORCID: https://orcid.org/0000-0002-4308-6356)
- Nicolò Pecco (ORCID: https://orcid.org/0000-0002-6367-7903)
- Mohammad Asadi
- Reza Arsanjani (ORCID: https://orcid.org/0000-0001-7081-4286)
- Gokul Ramasamy (ORCID: https://orcid.org/0000-0001-8401-8061)
- Timothy J. Poterucha (ORCID: https://orcid.org/0000-0001-7284-3937)
- Jae K. Oh (ORCID: https://orcid.org/0000-0002-8303-5780)
- B. Erickson
- Le Li (ORCID: https://orcid.org/0000-0002-9340-9061)
- Li Fei-Fei (ORCID: https://orcid.org/0000-0002-7481-0810)
- Ehsan Adeli
- Chieh-Ju Chao
- Yu-Chiang Wang
- Imon Banerjee
- Curtis P Langlotz
Institutions
- Mayo Clinic (US)
- Mayo Clinic in Arizona (US)
- Stanford Medicine (US)
- Artificial Intelligence in Medicine (Canada) (CA)
- Stanford University (US)
Publication Details
- Journal
- medRxiv
- Published
- 2026-03-17
- DOI
- https://doi.org/10.64898/2026.03.14.26348388
- Primary Topic
- Explainable Artificial Intelligence (XAI)
- Type
- article
- Field-Weighted Citation Impact
- 0.00