GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews

This study demonstrated that while GPT-4 Turbo had superior specificity when compared to GPT-3.5 Turbo (0.98 vs 0.51), as well as comparable sensitivity (0.85 vs 0.83), GPT-3.5 Turbo processed 100 studies faster (0.9 min vs 1.6 min) in citation screening for systematic reviews, suggesting that GPT-4 Turbo may be more suitable due to its higher specificity and highlighting the potential of large language models in optimizing literature selection.

Authors

Institutions

Publication Details

Journal
JMIR Medical Informatics
Published
2025-03-12
DOI
https://doi.org/10.2196/64682
Citations
5
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
6.99
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews

Taka‐aki Nakada, Yohei Okada, Takehiko Oami
5 citations
JMIR Medical Informatics
Meta-analysis and systematic reviews
6.99
article

GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews

Taka‐aki Nakada, Yohei Okada, Takehiko Oami
article en
5 citations

Abstract

This study demonstrated that while GPT-4 Turbo had superior specificity when compared to GPT-3.5 Turbo (0.98 vs 0.51), as well as comparable sensitivity (0.85 vs 0.83), GPT-3.5 Turbo processed 100 studies faster (0.9 min vs 1.6 min) in citation screening for systematic reviews, suggesting that GPT-4 Turbo may be more suitable due to its higher specificity and highlighting the potential of large language models in optimizing literature selection.

JMIR Medical InformaticsVol. 13
Chiba University (JP), National University of Singapore (SG), Kyoto University (JP), Duke-NUS Medical School (SG)
Quality Education
Openalex Percentile: Top 3%
Meta-analysis and systematic reviews
6.99
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.