Identification of Scientific Texts Generated by Large Language Models Using Machine Learning

Large language models (LLMs) are tools that help us in a variety of activities, from creating well-structured texts to quickly consulting information. But as these new technologies are so easily accessible, many people use them for their own benefit without properly citing the original author, or in other cases the student sector can be heavily compromised because students may opt for a quick answer over understanding and comprehending a specific topic in depth, considerably reducing their basic writing, editing and reading comprehension skills. Therefore, we propose to create a model to identify texts produced by LLM. To do so, we will use natural language processing (NLP) and machine-learning algorithms to recognize texts that mask LLM misuse using different types of adversarial attack, like paraphrasing or translation from one language to another. The main contributions of this work are to identify the texts generated by the large language models, and for this purpose several experiments were developed looking for the best results implementing the f1, accuracy, recall and precision metrics, together with PCA and t-SNE diagrams to see the classification of each one of the texts.

Authors

Institutions

Publication Details

Journal
Computers
Published
2024-12-19
DOI
https://doi.org/10.3390/computers13120346
Citations
2
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.69

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Identification of Scientific Texts Generated by Large Language Models Using Machine Learning

Grigori Sidorov, Blanca Cecilia López Ramírez, Liliana Chanona-Hernández, David Soto-Osorio
2 citations
Computers
Topic Modeling
0.69
article

Identification of Scientific Texts Generated by Large Language Models Using Machine Learning

Grigori Sidorov, Blanca Cecilia López Ramírez, Liliana Chanona-Hernández, David Soto-Osorio
article en
2 citations

Abstract

Large language models (LLMs) are tools that help us in a variety of activities, from creating well-structured texts to quickly consulting information. But as these new technologies are so easily accessible, many people use them for their own benefit without properly citing the original author, or in other cases the student sector can be heavily compromised because students may opt for a quick answer over understanding and comprehending a specific topic in depth, considerably reducing their basic writing, editing and reading comprehension skills. Therefore, we propose to create a model to identify texts produced by LLM. To do so, we will use natural language processing (NLP) and machine-learning algorithms to recognize texts that mask LLM misuse using different types of adversarial attack, like paraphrasing or translation from one language to another. The main contributions of this work are to identify the texts generated by the large language models, and for this purpose several experiments were developed looking for the best results implementing the f1, accuracy, recall and precision metrics, together with PCA and t-SNE diagrams to see the classification of each one of the texts.

ComputersVol. 13(12)
Tecnológico Nacional de México (MX), Technological Institute of Celaya (MX), Instituto Politécnico Nacional (MX)
Instituto Politécnico Nacional, Consejo Nacional de Ciencia y Tecnología
Quality Education
Openalex Percentile: Top 23%
Topic Modeling
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Identification of Scientific Texts Generated by Large Language Models Using Machine Learning — Grigori Sidorov, Blanca Cecilia López Ramírez, et al. · Computers (2024) | TGRS Research Map | TGRS