Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research

ChatGPT demonstrates modest to moderate accuracy in screening and study selection tasks, but performs well in data pooling and meta-analytic calculations. These findings underscore the potential of AI to augment systematic review methodologies, while also emphasizing the need for human oversight to ensure accuracy and integrity in research workflows.

Authors

Institutions

Publication Details

Journal
Regional Anesthesia & Pain Medicine
Published
2025-02-16
DOI
https://doi.org/10.1136/rapm-2024-106358
Citations
14
Primary Topic
Musculoskeletal pain and rehabilitation
Type
article
Field-Weighted Citation Impact
19.52
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research

Ryan S. D’Souza, Johana Klasová, Anam Purewal, Nasir Hussain et al.
14 citations
Regional Anesthesia & Pain Medicine
Musculoskeletal pain and rehabilitation
19.52
article

Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research

Ryan S. D’Souza, Johana Klasová, Anam Purewal, Nasir Hussain, Kalli Fautsch
article en
14 citations

Abstract

ChatGPT demonstrates modest to moderate accuracy in screening and study selection tasks, but performs well in data pooling and meta-analytic calculations. These findings underscore the potential of AI to augment systematic review methodologies, while also emphasizing the need for human oversight to ensure accuracy and integrity in research workflows.

Regional Anesthesia & Pain Medicine
Mayo Clinic (US), SUNY Downstate Health Sciences University (US), The Ohio State University (US)
Life in Land
Openalex Percentile: Top 0%
Musculoskeletal pain and rehabilitation
19.52
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.