Human vs AI: Evaluating the Effectiveness of Deep Learning in AI Text Detection

This study looks on the effectiveness of fine-tuned DistilBERT and LSTM models for distinguishing between human-written and AI-generated text. We address the growing demand for reliable AI text identification as an outcome of the potential misuse of large language models (LLMs) in instances related to the transmission of misleading data. This approach combines advantage of the beneficial characteristics of both model, LSTMs’ capacity to extract sequential information from text input, and DistilBERT’s pre-trained interpretation of contextualize associations. We build these models employing a set of labels that includes writings created through machines and people indiscriminately. The evaluation metrics exhibit outstanding achievement, with DistilBERT and LSTM achieving 100% classification accuracy (1.00) of the test sample. By stimulating the ethical use of LLMs while minimizing any adverse effects, the study advances the development of dependable methods that can identify text composed with machines with intelligence.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/iccit64611.2024.11021749
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Human vs AI: Evaluating the Effectiveness of Deep Learning in AI Text Detection

Abubokor Hanip, Sarv Priya, Mohammad Kamal Uddin, Swagata Roy et al.
Ethics and Social Impacts of AI
article

Human vs AI: Evaluating the Effectiveness of Deep Learning in AI Text Detection

Abubokor Hanip, Sarv Priya, Mohammad Kamal Uddin, Swagata Roy, Tanjim Mahmud, Taohidur Rahman, Mohammad Shahadat Hossain, Hifju Huma Khanam Redhi, Muhammad Mizanur Rahman Mizan
article en

Abstract

This study looks on the effectiveness of fine-tuned DistilBERT and LSTM models for distinguishing between human-written and AI-generated text. We address the growing demand for reliable AI text identification as an outcome of the potential misuse of large language models (LLMs) in instances related to the transmission of misleading data. This approach combines advantage of the beneficial characteristics of both model, LSTMs’ capacity to extract sequential information from text input, and DistilBERT’s pre-trained interpretation of contextualize associations. We build these models employing a set of labels that includes writings created through machines and people indiscriminately. The evaluation metrics exhibit outstanding achievement, with DistilBERT and LSTM achieving 100% classification accuracy (1.00) of the test sample. By stimulating the ethical use of LLMs while minimizing any adverse effects, the study advances the development of dependable methods that can identify text composed with machines with intelligence.

Chittagong University of Engineering & Technology (BD), International Islamic University Chittagong (BD), Rangamati Science and Technology University (BD), BGC Trust University Bangladesh (BD), University of Chittagong (BD)
Quality Education
Openalex Percentile: Top 66%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.