Distinguishing Human-Written and AI-Generated Text: A: Comprehensive Study Using Explainable Artificial Intelligence in Text Classification

Enhancing interpretability without compromising accuracy is a critical challenge in text classification. This research explores the integration of Explainable Artificial Intelligence (XAI) techniques with advanced machine learning models, utilizing the Local Interpretable Model-Agnostic Explanations (LIME) framework to provide transparency. A fine-tuned BERT model achieved state-of-the-art performance, surpassing Random Forest and Sentence Embedding-based models with a perfect 100% accuracy (ROC-AUC score of 1.00). While Random Forest classifiers offered a solid baseline, they struggled with semantic nuances, underscoring the need for embedding-based approaches. The study highlights the inherent trade-off between interpretability and accuracy, demonstrating that while transformer-based models like BERT excel at capturing complex linguistic patterns, their "black-box" nature necessitates tools like LIME for explainability. By bridging this gap, the research contributes to the development of more transparent, reliable, and high-performing AI systems.

Authors

Institutions

Publication Details

Published
2025-06-27
DOI
https://doi.org/10.1109/ncim65934.2025.11160309
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Distinguishing Human-Written and AI-Generated Text: A: Comprehensive Study Using Explainable Artificial Intelligence in Text Classification

Azmain Yakin Srizon, Koshik Debanath, Sagor Aich
Topic Modeling
article

Distinguishing Human-Written and AI-Generated Text: A: Comprehensive Study Using Explainable Artificial Intelligence in Text Classification

Azmain Yakin Srizon, Koshik Debanath, Sagor Aich
article en

Abstract

Enhancing interpretability without compromising accuracy is a critical challenge in text classification. This research explores the integration of Explainable Artificial Intelligence (XAI) techniques with advanced machine learning models, utilizing the Local Interpretable Model-Agnostic Explanations (LIME) framework to provide transparency. A fine-tuned BERT model achieved state-of-the-art performance, surpassing Random Forest and Sentence Embedding-based models with a perfect 100% accuracy (ROC-AUC score of 1.00). While Random Forest classifiers offered a solid baseline, they struggled with semantic nuances, underscoring the need for embedding-based approaches. The study highlights the inherent trade-off between interpretability and accuracy, demonstrating that while transformer-based models like BERT excel at capturing complex linguistic patterns, their "black-box" nature necessitates tools like LIME for explainability. By bridging this gap, the research contributes to the development of more transparent, reliable, and high-performing AI systems.

University of Rajshahi (BD)
Openalex Percentile: Top 87%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.