Local large language model‐assisted literature mining for on‐surface reactions

Abstract Large language models (LLMs) excel at extracting information from literatures. However, deploying LLMs necessitates substantial computational resources, and security concerns with online LLMs pose a challenge to their wider applications. Herein, we introduce a method for extracting scientific data from unstructured texts using a local LLM, exemplifying its applications to scientific literatures on the topic of on‐surface reactions. By combining prompt engineering and multi‐step text preprocessing, we show that the local LLM can effectively extract scientific information, achieving a recall rate of 91% and a precision rate of 70%. Moreover, despite significant differences in model parameter size, the performance of the local LLM is comparable to that of GPT‐3.5 turbo (81% recall, 84% precision) and GPT‐4o (85% recall, 87% precision). The simplicity, versatility, reduced computational requirements, and enhanced privacy of the local LLM makes it highly promising for data mining, with the potential to accelerate the application and development of LLMs across various fields.

Authors

Institutions

Publication Details

Journal
Materials Genome Engineering Advances
Published
2025-03-01
DOI
https://doi.org/10.1002/mgea.88
Citations
5
Primary Topic
Machine Learning in Materials Science
Type
article
Field-Weighted Citation Impact
2.59
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Local large language model‐assisted literature mining for on‐surface reactions

Qiang Sun, Xinyi Zhang, Yu He, Juan Xiang et al.
5 citations
Materials Genome Engineering Advances
Machine Learning in Materials Science
2.59
article

Local large language model‐assisted literature mining for on‐surface reactions

Qiang Sun, Xinyi Zhang, Yu He, Juan Xiang, Yizhang Li
article en
5 citations

Abstract

Abstract Large language models (LLMs) excel at extracting information from literatures. However, deploying LLMs necessitates substantial computational resources, and security concerns with online LLMs pose a challenge to their wider applications. Herein, we introduce a method for extracting scientific data from unstructured texts using a local LLM, exemplifying its applications to scientific literatures on the topic of on‐surface reactions. By combining prompt engineering and multi‐step text preprocessing, we show that the local LLM can effectively extract scientific information, achieving a recall rate of 91% and a precision rate of 70%. Moreover, despite significant differences in model parameter size, the performance of the local LLM is comparable to that of GPT‐3.5 turbo (81% recall, 84% precision) and GPT‐4o (85% recall, 87% precision). The simplicity, versatility, reduced computational requirements, and enhanced privacy of the local LLM makes it highly promising for data mining, with the potential to accelerate the application and development of LLMs across various fields.

Materials Genome Engineering AdvancesVol. 3(1)
Shanghai University (CN), Shanghai Research Institute of Materials (CN)
Openalex Percentile: Top 11%
Machine Learning in Materials Science
2.59
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.