Automated literature research and review-generation method based on large language models
Literature research, which is vital for scientific work, faces the challenge of surging information volumes that are exceeding researchers' processing capabilities. This paper describes an automated review-generation method based on large language models (LLMs) to overcome efficiency bottlenecks and reduce cognitive load. Our statistically validated evaluation framework demonstrates that the generated reviews match or exceed manual quality, offering broad applicability across research fields without requiring user domain knowledge. Applied to propane dehydrogenation catalysts, our method demonstrated two aspects: first, generating comprehensive reviews from 343 articles spanning 35 topics; and, second, evaluating data-mining capabilities by using 1041 articles for experimental catalyst property analysis. Through multilayered quality control, we effectively mitigated the hallucinations of LLMs, with expert verification confirming accuracy and citation integrity, while demonstrating hallucination risks reduced to <0.5% with 95% confidence. The released software application enables one-click review generation, enhancing research productivity and literature-recommendation efficiency while facilitating broader scientific explorations.
Authors
- Xiao Ma (ORCID: https://orcid.org/0000-0003-1288-3632)
- Xiaoyun Lin (ORCID: https://orcid.org/0000-0002-5226-4521)
- Xiangcheng Shi (ORCID: https://orcid.org/0000-0002-6806-3660)
- Dehui Luo
- Jinlong Gong (ORCID: https://orcid.org/0000-0001-7263-318X)
- Changying Du (ORCID: https://orcid.org/0000-0002-4489-0020)
- Zhi‐Jian Zhao (ORCID: https://orcid.org/0000-0002-8856-5078)
- Shican Wu (ORCID: https://orcid.org/0009-0000-6421-3273)
- Chunlei Pei (ORCID: https://orcid.org/0000-0003-4141-5387)
- Lulu Li (ORCID: https://orcid.org/0000-0002-7790-090X)
- Xin Chang (ORCID: https://orcid.org/0000-0001-9558-8422)
- Ran Luo (ORCID: https://orcid.org/0009-0000-7967-6545)
Institutions
- Tianjin Normal University (CN)
- Tianjin University (CN)
- National University of Singapore (SG)
- Unité Matériaux et Transformations (FR)
- Collaborative Innovation Center of Chemical Science and Engineering Tianjin (CN)
Publication Details
- Journal
- National Science Review
- Published
- 2025-04-25
- DOI
- https://doi.org/10.1093/nsr/nwaf169
- Citations
- 13
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 32.25
Funders
- National Natural Science Foundation of China
- Project 211