EduGuard-LLM: An AI-Generated Content Detector Using Large Language Models for Safeguarding Educational Integrity

In response to the widespread use of AI-generated tools by students to complete assignments, which poses significant challenges to educational integrity and fairness, this study proposes a novel detection model called EduGuard-LLM. EduGuard-LLM leverages the powerful text recognition capabilities of large language models to accurately distinguish between student-authored content and AI-generated content across different educational stages. By deeply analyzing text content and identifying AI-generated features, this model can effectively detect the authenticity of student submissions in primary, middle, high school, and university levels. In our experiments, we utilized 21 publicly available datasets, comprising a total of 164,543 text samples, covering various types of texts from elementary to university levels. The model achieved an accuracy of 93.96% on the pre-training dataset, and accuracies of 95.01%, 94.64%, 93.97%, and 94.94% on four external validation sets, respectively. The experimental results demonstrate that EduGuard-LLM has high detection accuracy across different educational stages, effectively ensuring the authenticity of student submissions. This provides strong technical support for educational institutions, maintaining educational integrity.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1109/icet62460.2024.10869067
Primary Topic
Academic integrity and plagiarism
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EduGuard-LLM: An AI-Generated Content Detector Using Large Language Models for Safeguarding Educational Integrity

Binbin Yan, Longfei Liu, Dan Wu, D. Zhang
Academic integrity and plagiarism
article

EduGuard-LLM: An AI-Generated Content Detector Using Large Language Models for Safeguarding Educational Integrity

Binbin Yan, Longfei Liu, Dan Wu, D. Zhang
article en

Abstract

In response to the widespread use of AI-generated tools by students to complete assignments, which poses significant challenges to educational integrity and fairness, this study proposes a novel detection model called EduGuard-LLM. EduGuard-LLM leverages the powerful text recognition capabilities of large language models to accurately distinguish between student-authored content and AI-generated content across different educational stages. By deeply analyzing text content and identifying AI-generated features, this model can effectively detect the authenticity of student submissions in primary, middle, high school, and university levels. In our experiments, we utilized 21 publicly available datasets, comprising a total of 164,543 text samples, covering various types of texts from elementary to university levels. The model achieved an accuracy of 93.96% on the pre-training dataset, and accuracies of 95.01%, 94.64%, 93.97%, and 94.94% on four external validation sets, respectively. The experimental results demonstrate that EduGuard-LLM has high detection accuracy across different educational stages, effectively ensuring the authenticity of student submissions. This provides strong technical support for educational institutions, maintaining educational integrity.

Chinese Academy of Sciences (CN), Beijing Normal University (CN), Shenzhen Institutes of Advanced Technology (CN)
Quality Education
Openalex Percentile: Top 68%
Academic integrity and plagiarism
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

EduGuard-LLM: An AI-Generated Content Detector Using Large Language Models for Safeguarding Educational Integrity — Binbin Yan, Longfei Liu, et al. · (2024) | TGRS Research Map | TGRS