Automated literature research and review-generation method based on large language models

Literature research, which is vital for scientific work, faces the challenge of surging information volumes that are exceeding researchers' processing capabilities. This paper describes an automated review-generation method based on large language models (LLMs) to overcome efficiency bottlenecks and reduce cognitive load. Our statistically validated evaluation framework demonstrates that the generated reviews match or exceed manual quality, offering broad applicability across research fields without requiring user domain knowledge. Applied to propane dehydrogenation catalysts, our method demonstrated two aspects: first, generating comprehensive reviews from 343 articles spanning 35 topics; and, second, evaluating data-mining capabilities by using 1041 articles for experimental catalyst property analysis. Through multilayered quality control, we effectively mitigated the hallucinations of LLMs, with expert verification confirming accuracy and citation integrity, while demonstrating hallucination risks reduced to <0.5% with 95% confidence. The released software application enables one-click review generation, enhancing research productivity and literature-recommendation efficiency while facilitating broader scientific explorations.

Authors

Institutions

Publication Details

Journal
National Science Review
Published
2025-04-25
DOI
https://doi.org/10.1093/nsr/nwaf169
Citations
13
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
32.25

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automated literature research and review-generation method based on large language models

Xiao Ma, Xiaoyun Lin, Xiangcheng Shi, Dehui Luo et al.
13 citations
National Science Review
Topic Modeling
32.25
article

Automated literature research and review-generation method based on large language models

Xiao Ma, Xiaoyun Lin, Xiangcheng Shi, Dehui Luo, Jinlong Gong, Changying Du, Zhi‐Jian Zhao, Shican Wu, Chunlei Pei, Lulu Li, Xin Chang, Ran Luo
article en
13 citations

Abstract

Literature research, which is vital for scientific work, faces the challenge of surging information volumes that are exceeding researchers' processing capabilities. This paper describes an automated review-generation method based on large language models (LLMs) to overcome efficiency bottlenecks and reduce cognitive load. Our statistically validated evaluation framework demonstrates that the generated reviews match or exceed manual quality, offering broad applicability across research fields without requiring user domain knowledge. Applied to propane dehydrogenation catalysts, our method demonstrated two aspects: first, generating comprehensive reviews from 343 articles spanning 35 topics; and, second, evaluating data-mining capabilities by using 1041 articles for experimental catalyst property analysis. Through multilayered quality control, we effectively mitigated the hallucinations of LLMs, with expert verification confirming accuracy and citation integrity, while demonstrating hallucination risks reduced to <0.5% with 95% confidence. The released software application enables one-click review generation, enhancing research productivity and literature-recommendation efficiency while facilitating broader scientific explorations.

National Science ReviewVol. 12(6)
Tianjin Normal University (CN), Tianjin University (CN), National University of Singapore (SG), Unité Matériaux et Transformations (FR), Collaborative Innovation Center of Chemical Science and Engineering Tianjin (CN)
National Natural Science Foundation of China, Project 211
Openalex Percentile: Top 0%
Topic Modeling
32.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.