LLM+RAG+Agent: Create an Efficient and Accurate Text Data Labeling System

With the rapid development of generative artificial intelligence, it has shown great potential in many fields, and the construction of text data labeling system has also ushered in new opportunities for change. This paper conducts in-depth research on building an efficient and accurate text data labeling system, focusing on the innovative applications of large language models, RAG, and agents. To overcome the key problem of high-precision intelligent annotation, an intelligent annotation method of vector semantic matching driven by large model was innovatively proposed. Firstly, the problems to be solved by smart labels are analyzed in detail, and then they are reasonably modeled, and then the abstract is extracted with the help of large model driven, and the annotation method design is completed by skillfully matching with the label content system. At the same time, agents play an indispensable auxiliary role in the optimization process of RAG technology search. By deeply analyzing the structure, topic and other characteristics of the input text, the agent can automatically generate accurate search keywords or phrases. After rigorous analysis of the experimental results, the accuracy of the method is verified to be more than 95%, and the application scenarios of the method are described.

Authors

Institutions

Publication Details

Published
2025-04-25
DOI
https://doi.org/10.1109/iccea65460.2025.11102337
Citations
2
Primary Topic
Mathematics, Computing, and Information Processing
Type
article
Field-Weighted Citation Impact
3.01
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLM+RAG+Agent: Create an Efficient and Accurate Text Data Labeling System

Xuanzhu Sheng, Xinyuan Qiu, Chao Yu, Jianan Shen et al.
2 citations
Mathematics, Computing, and Information Processing
3.01
article

LLM+RAG+Agent: Create an Efficient and Accurate Text Data Labeling System

Xuanzhu Sheng, Xinyuan Qiu, Chao Yu, Jianan Shen, Xin Wang, Yazhi Zheng
article en
2 citations

Abstract

With the rapid development of generative artificial intelligence, it has shown great potential in many fields, and the construction of text data labeling system has also ushered in new opportunities for change. This paper conducts in-depth research on building an efficient and accurate text data labeling system, focusing on the innovative applications of large language models, RAG, and agents. To overcome the key problem of high-precision intelligent annotation, an intelligent annotation method of vector semantic matching driven by large model was innovatively proposed. Firstly, the problems to be solved by smart labels are analyzed in detail, and then they are reasonably modeled, and then the abstract is extracted with the help of large model driven, and the annotation method design is completed by skillfully matching with the label content system. At the same time, agents play an indispensable auxiliary role in the optimization process of RAG technology search. By deeply analyzing the structure, topic and other characteristics of the input text, the agent can automatically generate accurate search keywords or phrases. After rigorous analysis of the experimental results, the accuracy of the method is verified to be more than 95%, and the application scenarios of the method are described.

Naval University of Engineering (CN), Ministry of Education (SA)
Openalex Percentile: Top 8%
Mathematics, Computing, and Information Processing
3.01
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.