Evaluating Web Retrieval–Assisted Large Language Models With and Without Whitelisting for Evidence-Based Neurology: Comparative Study
Restricting retrieval to authoritative neurology domains yielded a clinically meaningful 8 to 18 percentage-point gain in correctness and halved output variability, upgrading a consumer search assistant to a decision-support-level tool that at least performed on par with a specialized literature engine. Lightweight source control is therefore a pragmatic safety lever for maintaining continuously updated, web-based RAG-augmented LLMs fit for evidence-based neurology.
Authors
- Sven Guenther Meuth (ORCID: https://orcid.org/0000-0003-2571-3501)
- Lars Masanneck (ORCID: https://orcid.org/0000-0003-2496-1415)
- P. H. Epping
- Marc Pawlitzki (ORCID: https://orcid.org/0000-0003-3080-2277)
Institutions
- Düsseldorf University Hospital (DE)
- Heinrich Heine University Düsseldorf (DE)
Publication Details
- Journal
- Journal of Medical Internet Research
- Published
- 2025-09-25
- DOI
- https://doi.org/10.2196/79379
- Citations
- 3
- Primary Topic
- Biomedical Text Mining and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 2.42