Detection of AI-Generated Text

This research paper investigates the challenges posed by the proliferation of AI-generated content in the context of plagiarism detection and classification. Leveraging advanced language models, particularly the GPT-2 model, in tandem with tailored metrics and confidence thresholds, our approach provides a comprehensive solution to tackle this pressing issue. By employing tokenization and perplexity calculation techniques, we evaluate the coherence and naturalness of text inputs, thereby identifying potential AI-generated content. Additionally, burstiness score computation aids in discerning repetitive language patterns, further contributing to the detection process. Furthermore, integrating a BERT-based text classification model enables the classification of text based on its conformity to AI-generated characteristics, with a set confidence threshold determining the likelihood of AI generation. Through experimental evaluation, our approach demonstrates high accuracy in detecting AI-generated content while minimizing false positives. Moreover, we explore the impact of adjusting the confidence threshold on the sensitivity and specificity of the classification mechanism. Overall, this research presents a robust framework for AI plagiarism detection and classification, offering a scalable and adaptable solution for effectively identifying AI-generated text.

Authors

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/icpids65698.2024.00032
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Detection of AI-Generated Text

Gyaneshwari Patil, Akshata Gile, Shrinivas Hatyalikar, R. Dugad et al.
Topic Modeling
article

Detection of AI-Generated Text

Gyaneshwari Patil, Akshata Gile, Shrinivas Hatyalikar, R. Dugad, Rakhi Bharadwaj
article en

Abstract

This research paper investigates the challenges posed by the proliferation of AI-generated content in the context of plagiarism detection and classification. Leveraging advanced language models, particularly the GPT-2 model, in tandem with tailored metrics and confidence thresholds, our approach provides a comprehensive solution to tackle this pressing issue. By employing tokenization and perplexity calculation techniques, we evaluate the coherence and naturalness of text inputs, thereby identifying potential AI-generated content. Additionally, burstiness score computation aids in discerning repetitive language patterns, further contributing to the detection process. Furthermore, integrating a BERT-based text classification model enables the classification of text based on its conformity to AI-generated characteristics, with a set confidence threshold determining the likelihood of AI generation. Through experimental evaluation, our approach demonstrates high accuracy in detecting AI-generated content while minimizing false positives. Moreover, we explore the impact of adjusting the confidence threshold on the sensitivity and specificity of the classification mechanism. Overall, this research presents a robust framework for AI plagiarism detection and classification, offering a scalable and adaptable solution for effectively identifying AI-generated text.

Openalex Percentile: Top 73%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.