An Agentic AI-Aided Review of Large Language Model Applications in Literature Reviews: A Seven-Layer Architecture

The growing volume of scientific output and the pace of AI advancement create a dual challenge: traditional systematic reviews take twelve to eighteen months to complete, risking obsolescence before publication, while the technology needed to accelerate them is itself advancing faster than it can be reviewed. This work addresses both sides of that challenge simultaneously—presenting an agentic systematic literature review of AI-assisted reviewing, conducted using the same agentic pipeline it evaluates, across 122 primary studies published between 2022 and 2026. LLM performance proves to be sharply stage-specific: screening and structured extraction are tractable under human supervision, quality appraisal remains near-chance, and no published pipeline meets the bar for unsupervised end-to-end deployment. The review proposes a seven-layer reference architecture and identifies three prerequisite investments for production readiness: a shared benchmark, validated risk-of-bias performance, and a mandatory AI reporting standard.

Authors

Institutions

Publication Details

Journal
Informatics
Published
2026-10-01
DOI
https://doi.org/10.3390/informatics13100160
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Agentic AI-Aided Review of Large Language Model Applications in Literature Reviews: A Seven-Layer Architecture

Shwe Pyi Soe, Emmanuel Alejandro Merchán-Cruz, Irina Yatskiv, Ioseb Gabelaia et al.
Informatics
Artificial Intelligence in Healthcare and Education
article

An Agentic AI-Aided Review of Large Language Model Applications in Literature Reviews: A Seven-Layer Architecture

Shwe Pyi Soe, Emmanuel Alejandro Merchán-Cruz, Irina Yatskiv, Ioseb Gabelaia, Pavlyuk Dmitry
article en

Abstract

The growing volume of scientific output and the pace of AI advancement create a dual challenge: traditional systematic reviews take twelve to eighteen months to complete, risking obsolescence before publication, while the technology needed to accelerate them is itself advancing faster than it can be reviewed. This work addresses both sides of that challenge simultaneously—presenting an agentic systematic literature review of AI-assisted reviewing, conducted using the same agentic pipeline it evaluates, across 122 primary studies published between 2022 and 2026. LLM performance proves to be sharply stage-specific: screening and structured extraction are tractable under human supervision, quality appraisal remains near-chance, and no published pipeline meets the bar for unsupervised end-to-end deployment. The review proposes a seven-layer reference architecture and identifies three prerequisite investments for production readiness: a shared benchmark, validated risk-of-bias performance, and a mandatory AI reporting standard.

InformaticsVol. 13(10)
University of the West of England (GB), Transport and Telecommunication Institute (LV), Kauno kolegija Higher Education Institution (LT), Bristol Robotics Laboratory (GB)
Openalex Percentile: Top 17%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.