Assessment of decision-making with locally run and web-based large language models versus human board recommendations in otorhinolaryngology, head and neck surgery
This study demonstrates the capability of both LLMs to provide viable therapeutic recommendations in ORL head and neck surgery. Llama 3, operating locally, bypasses many data protection issues and shows promise as a clinical tool to support MDT decisions. However at present, LLMs should augment rather than replace human decision-making.
Authors
- Jonas Eckrich (ORCID: https://orcid.org/0000-0001-5498-4031)
- Christoph Raphael Buhr (ORCID: https://orcid.org/0000-0002-9551-2310)
- Sebastian Kühn (ORCID: https://orcid.org/0000-0002-8031-2973)
- Florian Jungmann (ORCID: https://orcid.org/0000-0003-1561-5174)
- Benjamin Philipp Ernst (ORCID: https://orcid.org/0000-0002-4557-2948)
- Maximilian Fleischmann
- Andrew Blaikie (ORCID: https://orcid.org/0000-0001-7913-6872)
- Harry A. Smith (ORCID: https://orcid.org/0009-0003-4497-1394)
- Tom Kelsey (ORCID: https://orcid.org/0000-0002-8091-1458)
- Sebastian Foersch (ORCID: https://orcid.org/0000-0002-4740-6900)
- Christoph Matthias (ORCID: https://orcid.org/0000-0002-7569-2393)
- Christian Brandts (ORCID: https://orcid.org/0000-0003-1732-2535)
- Peer W. Kämmerer (ORCID: https://orcid.org/0000-0002-1671-3764)
- Jürgen Alt
Institutions
- Goethe University Frankfurt (DE)
- University of St Andrews (GB)
- Johannes Gutenberg University Mainz (DE)
- Universitätsklinikum Gießen und Marburg (DE)
- University Medical Center of the Johannes Gutenberg University Mainz (DE)
- University Hospital Frankfurt (DE)
Publication Details
- Journal
- European Archives of Oto-Rhino-Laryngology
- Published
- 2025-01-10
- DOI
- https://doi.org/10.1007/s00405-024-09153-3
- Citations
- 9
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 5.89
Funders
- Universitätsmedizin der Johannes Gutenberg-Universität Mainz