Llama 3 Challenges Proprietary State-of-the-Art Large Language Models in Radiology Board–style Examination Questions

Meta’s Llama 3, an open-source large language model, performed on par with larger proprietary models, such as OpenAI’s GPT-4 and Anthropic’s Claude 3 Opus, on a subset of radiology board-style examination questions, highlighting the potential of open-source artificial intelligence in radiology.

Authors

Institutions

Publication Details

Journal
Radiology
Published
2024-08-01
DOI
https://doi.org/10.1148/radiol.241191
Citations
27
Primary Topic
Radiology practices and education
Type
article
Field-Weighted Citation Impact
10.92
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Llama 3 Challenges Proprietary State-of-the-Art Large Language Models in Radiology Board–style Examination Questions

Lisa C. Adams, Keno K. Bressem, Daniel Truhn, Felix Busch et al.
27 citations
Radiology
Radiology practices and education
10.92
article

Llama 3 Challenges Proprietary State-of-the-Art Large Language Models in Radiology Board–style Examination Questions

Lisa C. Adams, Keno K. Bressem, Daniel Truhn, Felix Busch, Marcus R. Makowski, Jawed Nawabi, Felix J. Dorfner
article en
27 citations

Abstract

Meta’s Llama 3, an open-source large language model, performed on par with larger proprietary models, such as OpenAI’s GPT-4 and Anthropic’s Claude 3 Opus, on a subset of radiology board-style examination questions, highlighting the potential of open-source artificial intelligence in radiology.

RadiologyVol. 312(2)
Humboldt-Universität zu Berlin (DE)
Quality Education
Openalex Percentile: Top 1%
Radiology practices and education
10.92
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.