Evaluating the accuracy and reliability of AI chatbots in disseminating the content of current resuscitation guidelines: a comparative analysis between the ERC 2021 guidelines and both ChatGPTs 3.5 and 4
We advise healthcare professionals not to rely solely on the tested AI-based chatbots to keep up to date with the latest evidence, as the relevant texts for the task were not part of the training texts of the underlying LLMs, and the lack of conceptual understanding of AI carries a high risk of spreading misconceptions. Original publications should always be considered for comprehensive understanding.
Authors
- Stefanie Beck (ORCID: https://orcid.org/0000-0002-5203-5745)
- Anne Daubmann (ORCID: https://orcid.org/0000-0003-0156-0926)
- Martin Semmann (ORCID: https://orcid.org/0000-0001-5316-3696)
- Manuel Kuhner
- Markus Haar (ORCID: https://orcid.org/0000-0003-2461-5002)
- Stefan Kluge (ORCID: https://orcid.org/0000-0001-8391-3988)
Institutions
- Universität Hamburg (DE)
- University Medical Center Hamburg-Eppendorf (DE)
- HAW Hamburg (DE)
Publication Details
- Journal
- Scandinavian Journal of Trauma Resuscitation and Emergency Medicine
- Published
- 2024-09-26
- DOI
- https://doi.org/10.1186/s13049-024-01266-2
- Citations
- 11
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 1.32
Funders
- Universitätsklinikum Hamburg-Eppendorf