Battle of the Bots: Solving Clinical Cases in Osteoarticular Infections With Large Language Models

OpenEvidence and Miccrosoft Copilot achieved the highest accuracy among evaluated LLMs, highlighting their potential for precisely addressing complex clinical cases. This study emphasizes the need for specialized, validated artificial intelligence tools in medical practice. Although promising, current models face limitations in real-world applications, requiring further refinement to support clinical decision making reliably.

Authors

Institutions

Publication Details

Journal
Mayo Clinic Proceedings Digital Health
Published
2025-05-23
DOI
https://doi.org/10.1016/j.mcpdig.2025.100230
Citations
6
Primary Topic
Orthopedic Infections and Treatments
Type
article
Field-Weighted Citation Impact
12.04

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Battle of the Bots: Solving Clinical Cases in Osteoarticular Infections With Large Language Models

Takahiro Matsuo, Francesco Petri, Fabio Borgonovo, Andrea Gori et al.
6 citations
Mayo Clinic Proceedings Digital Health
Orthopedic Infections and Treatments
12.04
article

Battle of the Bots: Solving Clinical Cases in Osteoarticular Infections With Large Language Models

Takahiro Matsuo, Francesco Petri, Fabio Borgonovo, Andrea Gori, Elie F. Berbari, Seyed Mohammad Amin Alavi, Laura C.M. Ndjonko
article en
6 citations

Abstract

OpenEvidence and Miccrosoft Copilot achieved the highest accuracy among evaluated LLMs, highlighting their potential for precisely addressing complex clinical cases. This study emphasizes the need for specialized, validated artificial intelligence tools in medical practice. Although promising, current models face limitations in real-world applications, requiring further refinement to support clinical decision making reliably.

Mayo Clinic Proceedings Digital HealthVol. 3(3)
Northwestern University (US), Ahvaz Jundishapur University of Medical Sciences (IR), Mayo Clinic (US), University of Milan (IT), Luigi Sacco Hospital (IT), Mayo Clinic in Arizona (US), Mayo Clinic in Florida (US)
National Institutes of Health, National Center for Advancing Translational Sciences
Quality Education
Openalex Percentile: Top 1%
Orthopedic Infections and Treatments
12.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.