Human-led and artificial intelligence-automated critical appraisal of systematic reviews: Comparative evaluation

Large language models can support aspects of critical appraisal evidence but lack contextual reasoning and methodological insight required for complex judgments. While Claude 3.7 Sonnet aligned most closely with human reviewers, human oversight remains essential. Large language models should serve as adjuncts and not substitutes for evidence-based practice.

Authors

Institutions

Publication Details

Journal
Nurse Education in Practice
Published
2025-10-29
DOI
https://doi.org/10.1016/j.nepr.2025.104614
Citations
1
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
1.40
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Human-led and artificial intelligence-automated critical appraisal of systematic reviews: Comparative evaluation

Lucija Gosak, Gregor Štiglic, Wilson Tam, Dominika Vrbnjak
1 citations
Nurse Education in Practice
Meta-analysis and systematic reviews
1.40
article

Human-led and artificial intelligence-automated critical appraisal of systematic reviews: Comparative evaluation

Lucija Gosak, Gregor Štiglic, Wilson Tam, Dominika Vrbnjak
article en
1 citations

Abstract

Large language models can support aspects of critical appraisal evidence but lack contextual reasoning and methodological insight required for complex judgments. While Claude 3.7 Sonnet aligned most closely with human reviewers, human oversight remains essential. Large language models should serve as adjuncts and not substitutes for evidence-based practice.

Nurse Education in PracticeVol. 89
National University of Singapore (SG), University of Maribor (SI)
Openalex Percentile: Top 12%
Meta-analysis and systematic reviews
1.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.