Enhancing AI-Generated Text Identification with BERT-CNN and DistilBERT-BiLSTM Models

This study proposes two advanced transformer-based architectures for enhancing the identification of AI-generated text: a fine-tuned BERT-CNN model and a hybrid DistilBERT-BiLSTM framework. The BERT-CNN architecture combines pre-trained BERT embeddings with convolutional neural networks to detect localized linguistic patterns indicative of synthetic text. The DistilBERT-BiLSTM model integrates the efficiency of DistilBERT with bidirectional LSTM layers to capture sequential dependencies and long-range contextual features. Both approaches employ standardized preprocessing using the BERT tokenizer, including tokenization, padding, and truncation, to ensure consistency in input representation. The BERT-CNN model achieved strong performance with 95.67% accuracy, 94.32% F1-score, and 93.45% precision, demonstrating its capability to discern subtle AI-generated patterns. The DistilBERT-BiLSTM framework further enhanced detection accuracy to 97%, with precision, recall, and F1-score values of 98%, 97%, and 97%, respectively, attributed to its ability to model temporal relationships in text sequences. Both models exhibited robustness against paraphrasing-based evasion techniques, with DistilBERT-BiLSTM showing superior generalization due to its balanced architecture of lightweight language understanding and sequential analysis. This research underscores the efficacy of transformer-based hybrid models in advancing AI-generated text detection, offering scalable solutions for maintaining content authenticity in academic, professional, and digital platforms. The findings contribute to the development of reliable tools for ethical AI adoption and mitigation of misinformation risks.

Authors

Publication Details

Published
2025-07-18
DOI
https://doi.org/10.1109/ciacon65473.2025.11189402
Citations
1
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing AI-Generated Text Identification with BERT-CNN and DistilBERT-BiLSTM Models

Rajat K. Dey, Bikash Sadhukhan, Ritankar Das, Sorbojit Mondal et al.
1 citations
Handwritten Text Recognition Techniques
1.28
article

Enhancing AI-Generated Text Identification with BERT-CNN and DistilBERT-BiLSTM Models

Rajat K. Dey, Bikash Sadhukhan, Ritankar Das, Sorbojit Mondal, Nabanita Das
article en
1 citations

Abstract

This study proposes two advanced transformer-based architectures for enhancing the identification of AI-generated text: a fine-tuned BERT-CNN model and a hybrid DistilBERT-BiLSTM framework. The BERT-CNN architecture combines pre-trained BERT embeddings with convolutional neural networks to detect localized linguistic patterns indicative of synthetic text. The DistilBERT-BiLSTM model integrates the efficiency of DistilBERT with bidirectional LSTM layers to capture sequential dependencies and long-range contextual features. Both approaches employ standardized preprocessing using the BERT tokenizer, including tokenization, padding, and truncation, to ensure consistency in input representation. The BERT-CNN model achieved strong performance with 95.67% accuracy, 94.32% F1-score, and 93.45% precision, demonstrating its capability to discern subtle AI-generated patterns. The DistilBERT-BiLSTM framework further enhanced detection accuracy to 97%, with precision, recall, and F1-score values of 98%, 97%, and 97%, respectively, attributed to its ability to model temporal relationships in text sequences. Both models exhibited robustness against paraphrasing-based evasion techniques, with DistilBERT-BiLSTM showing superior generalization due to its balanced architecture of lightweight language understanding and sequential analysis. This research underscores the efficacy of transformer-based hybrid models in advancing AI-generated text detection, offering scalable solutions for maintaining content authenticity in academic, professional, and digital platforms. The findings contribute to the development of reliable tools for ethical AI adoption and mitigation of misinformation risks.

Openalex Percentile: Top 15%
Handwritten Text Recognition Techniques
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing AI-Generated Text Identification with BERT-CNN and DistilBERT-BiLSTM Models — Rajat K. Dey, Bikash Sadhukhan, et al. · (2025) | TGRS Research Map | TGRS