Evaluation of the performance of large language models in endoscopic lumbar surgery: a comparative analysis
From the perspective of professional surgeons, Claude 3.5 Sonnet provided the highest quality and most relevant information. However, ChatGPT o1-preview was more understandable and satisfactory for non-professional users. This study not only highlights the potential of LLMs in patient education but also emphasizes the need for careful consideration of their role in medical practice, including technical limitations and ethical issues.
Authors
- Juan Xia (ORCID: https://orcid.org/0000-0002-4966-7119)
- Da He (ORCID: https://orcid.org/0000-0003-2506-5540)
- Ye Wang (ORCID: https://orcid.org/0000-0002-0123-1260)
- Lei Miao (ORCID: https://orcid.org/0000-0001-7670-4782)
- Hao Li (ORCID: https://orcid.org/0000-0002-8462-0383)
- Cheng Zeng (ORCID: https://orcid.org/0000-0001-8004-4027)
Institutions
- Capital Medical University (CN)
- Guangdong University of Foreign Studies (CN)
- Peking University (CN)
- Beijing Jishuitan Hospital (CN)
Publication Details
- Journal
- Annals of Medicine and Surgery
- Published
- 2025-06-28
- DOI
- https://doi.org/10.1097/ms9.0000000000003519
- Citations
- 1
- Primary Topic
- Medical Imaging and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.67