The AI Reviewer: Evaluating AI’s Role in Citation Screening for Streamlined Systematic Reviews
This study serves as an exploratory analysis of the efficacy of various large language models in a direct comparison of automated title and abstract screening for systematic reviews and demonstrates promising but variable agreement levels with human reviewers emphasizing the importance of model selection for systematic review.
Authors
- Brett N. Hryciw (ORCID: https://orcid.org/0000-0002-4261-0208)
- Tim Ramsay (ORCID: https://orcid.org/0000-0001-8478-8170)
- Jamie Ghossein (ORCID: https://orcid.org/0000-0003-0070-1272)
- Kwadwo Kyeremanteng (ORCID: https://orcid.org/0000-0002-6836-2185)
Institutions
- University of Ottawa (CA)
- University of Toronto (CA)
- Ottawa Hospital (CA)
- Montfort Hospital (CA)
- Ottawa Hospital Research Institute (CA)
Publication Details
- Journal
- JMIR Formative Research
- Published
- 2025-03-28
- DOI
- https://doi.org/10.2196/58366
- Citations
- 3
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 1.96