Human and AI Written Text Detection Using Deep Learning and Machine Learning

This research investigates classifying human and AI-generated text, which is crucial in this era of AI technology and the evolution of large language models (LLMs). This highlights a comparative approach using classical machine learning and deep learning models to enhance detection accuracy. A private dataset with 1.6 million text samples (1,000,001 human-written samples and 608,397 AI-generated samples) has been introduced for model training to detect human and AI-generated text. Four models—Decision Tree, Gradient Boosting, LSTM (Long Short-Term Memory) and Bi-GRU (Bidirectional Gated Recurrent Unit) are trained and evaluated to ensure optimal performance. Decision Tree and Gradient Boosting have been chosen for their ability to capture non-linear relationships, where LSTM can capture long-term dependencies and Bi-GRU understands the context through bidirectional processing for sequential data. The Bi-GRU model and LSTM model outperform, where Bi-GRU has the highest validation accuracy of 99.69% and LSTM has the validation score of 99.68%. And both have perfect F1-Score of 100%. However, the classical models, the Decision Tree and Gradient Boosting models have lower accuracy of 97.51% and 95.95% respectively. The outstanding performance of recurrent neural network variants proves their ability to work on complex sequential tasks like text classification. Visualization techniques like word clouds reveal distinct linguistic patterns in AI versus human texts. A web application has been developed using Streamlit enabling detection of content in the real world, such as plagiarism and content authenticity.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/iccit64611.2024.11022524
Citations
1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.12
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Human and AI Written Text Detection Using Deep Learning and Machine Learning

Afsana Nadia, Mohammad Nuruzzaman, Md Mashum Billal, Khan Md Shibli Nomani
1 citations
Artificial Intelligence in Healthcare and Education
0.12
article

Human and AI Written Text Detection Using Deep Learning and Machine Learning

Afsana Nadia, Mohammad Nuruzzaman, Md Mashum Billal, Khan Md Shibli Nomani
article en
1 citations

Abstract

This research investigates classifying human and AI-generated text, which is crucial in this era of AI technology and the evolution of large language models (LLMs). This highlights a comparative approach using classical machine learning and deep learning models to enhance detection accuracy. A private dataset with 1.6 million text samples (1,000,001 human-written samples and 608,397 AI-generated samples) has been introduced for model training to detect human and AI-generated text. Four models—Decision Tree, Gradient Boosting, LSTM (Long Short-Term Memory) and Bi-GRU (Bidirectional Gated Recurrent Unit) are trained and evaluated to ensure optimal performance. Decision Tree and Gradient Boosting have been chosen for their ability to capture non-linear relationships, where LSTM can capture long-term dependencies and Bi-GRU understands the context through bidirectional processing for sequential data. The Bi-GRU model and LSTM model outperform, where Bi-GRU has the highest validation accuracy of 99.69% and LSTM has the validation score of 99.68%. And both have perfect F1-Score of 100%. However, the classical models, the Decision Tree and Gradient Boosting models have lower accuracy of 97.51% and 95.95% respectively. The outstanding performance of recurrent neural network variants proves their ability to work on complex sequential tasks like text classification. Visualization techniques like word clouds reveal distinct linguistic patterns in AI versus human texts. A web application has been developed using Streamlit enabling detection of content in the real world, such as plagiarism and content authenticity.

American International University-Bangladesh (BD), University of Science and Technology of China (CN), Hajee Mohammad Danesh Science and Technology University (BD), East West University (BD)
Quality Education
Openalex Percentile: Top 45%
Artificial Intelligence in Healthcare and Education
0.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Human and AI Written Text Detection Using Deep Learning and Machine Learning — Afsana Nadia, Mohammad Nuruzzaman, et al. · (2024) | TGRS Research Map | TGRS