Evaluating large language models for automated meta-analysis generation

Large language models (LLMs) are increasingly used to support evidence synthesis, including literature interpretation, data extraction, and statistical analysis [ 1 , 2 , 3 ]. However, their ability to autonomously perform meta-analysis from primary studies remains unclear. We evaluated the accuracy of contemporary LLMs in extracting study-level data and generating meta-analysis estimates against published statistical reference standard.

Authors

Institutions

Publication Details

Journal
Eye
Published
2026-09-25
DOI
https://doi.org/10.1038/s41433-026-04899-y
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Evaluating large language models for automated meta-analysis generation

Ayushi Agarwal, Jai Ethan Paris, Ethan La, Dinesh Selva et al.
Eye
Meta-analysis and systematic reviews
article

Evaluating large language models for automated meta-analysis generation

Ayushi Agarwal, Jai Ethan Paris, Ethan La, Dinesh Selva, Weng Onn Chan
article en

Abstract

Large language models (LLMs) are increasingly used to support evidence synthesis, including literature interpretation, data extraction, and statistical analysis [ 1 , 2 , 3 ]. However, their ability to autonomously perform meta-analysis from primary studies remains unclear. We evaluated the accuracy of contemporary LLMs in extracting study-level data and generating meta-analysis estimates against published statistical reference standard.

Eye
Royal Adelaide Hospital (AU), Adelaide University (AU), The University of Adelaide (AU)
Quality Education
Openalex Percentile: Top 9%
Meta-analysis and systematic reviews
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.