GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews
This study demonstrated that while GPT-4 Turbo had superior specificity when compared to GPT-3.5 Turbo (0.98 vs 0.51), as well as comparable sensitivity (0.85 vs 0.83), GPT-3.5 Turbo processed 100 studies faster (0.9 min vs 1.6 min) in citation screening for systematic reviews, suggesting that GPT-4 Turbo may be more suitable due to its higher specificity and highlighting the potential of large language models in optimizing literature selection.
Authors
- Taka‐aki Nakada (ORCID: https://orcid.org/0000-0002-4480-556X)
- Yohei Okada (ORCID: https://orcid.org/0000-0002-2266-476X)
- Takehiko Oami (ORCID: https://orcid.org/0000-0003-2630-7716)
Institutions
- Chiba University (JP)
- National University of Singapore (SG)
- Kyoto University (JP)
- Duke-NUS Medical School (SG)
Publication Details
- Journal
- JMIR Medical Informatics
- Published
- 2025-03-12
- DOI
- https://doi.org/10.2196/64682
- Citations
- 5
- Primary Topic
- Meta-analysis and systematic reviews
- Type
- article
- Field-Weighted Citation Impact
- 6.99