AI Text Detection with RoBERTa-BiGRU and Double Multi-Head Attention

The rapid proliferation of AI-generated content has raised pressing concerns in domains such as education, publishing, and digital media. To address the challenges of detecting semantically invariant and humanized AI text, this paper introduces RoBERTa-BDMA, a novel architecture that integrates RoBERTa-based contextual embeddings, BiGRU-driven bidirectional sequence modeling, and a dual multi-head attention mechanism for hierarchical feature extraction. Extensive experiments on the HC3 and HC3-Plus datasets demonstrate its effectiveness, achieving 98.76% accuracy on the question-answer dataset and 92.42% on the semantic-invariant dataset. It also maintains $\mathbf{9 1. 3 \%}$ detection confidence on paraphrased inputs and 89.5% accuracy under natural noise conditions, including typographical errors and code-switching. Compared with DetectGPT and GPTZero, RoBERTa-BDMA offers enhanced semantic discrimination and greater adaptability to structurally varied or humanized inputs, making it a more effective solution in supervised detection scenarios. Future research will focus on expanding evaluation to multilingual, noise-rich corpora and exploring lightweight model optimization techniques.

Authors

Institutions

Publication Details

Published
2025-07-18
DOI
https://doi.org/10.1109/icbase66587.2025.11181360
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI Text Detection with RoBERTa-BiGRU and Double Multi-Head Attention

Lingaï Luo, Jun Zhan, Jiawei Wang, Sicheng Wang
Handwritten Text Recognition Techniques
article

AI Text Detection with RoBERTa-BiGRU and Double Multi-Head Attention

Lingaï Luo, Jun Zhan, Jiawei Wang, Sicheng Wang
article en

Abstract

The rapid proliferation of AI-generated content has raised pressing concerns in domains such as education, publishing, and digital media. To address the challenges of detecting semantically invariant and humanized AI text, this paper introduces RoBERTa-BDMA, a novel architecture that integrates RoBERTa-based contextual embeddings, BiGRU-driven bidirectional sequence modeling, and a dual multi-head attention mechanism for hierarchical feature extraction. Extensive experiments on the HC3 and HC3-Plus datasets demonstrate its effectiveness, achieving 98.76% accuracy on the question-answer dataset and 92.42% on the semantic-invariant dataset. It also maintains $\mathbf{9 1. 3 \%}$ detection confidence on paraphrased inputs and 89.5% accuracy under natural noise conditions, including typographical errors and code-switching. Compared with DetectGPT and GPTZero, RoBERTa-BDMA offers enhanced semantic discrimination and greater adaptability to structurally varied or humanized inputs, making it a more effective solution in supervised detection scenarios. Future research will focus on expanding evaluation to multilingual, noise-rich corpora and exploring lightweight model optimization techniques.

Zhejiang University of Science and Technology (CN)
Openalex Percentile: Top 72%
Handwritten Text Recognition Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

AI Text Detection with RoBERTa-BiGRU and Double Multi-Head Attention — Lingaï Luo, Jun Zhan, et al. · (2025) | TGRS Research Map | TGRS