CROSS-LINGUISTIC EVALUATION OF AI-GENERATED TEXT DETECTION: A COMPARATIVE STUDY ON ENGLISH AND INDONESIAN USING PRECISION, RECALL AND F1 SCORE

In the age of generative AI, the line between human-written and machine-generated text is becoming increasingly blurred. This paper explores the performance of AI content detection systems across two linguistically and structurally diverse languages—English and Indonesian—through an empirical evaluation using 5,000 samples. The study evaluates detection outcomes using widely accepted performance metrics: precision, recall, and F1 score. Results reveal higher detection accuracy for English compared to Indonesian, due to linguistic complexities and dataset bias. This study underscores the growing importance of multilingual AI verification tools, especially in academic and regulatory environments.

Authors

Institutions

Publication Details

Journal
ShodhKosh Journal of Visual and Performing Arts
Published
2025-04-12
DOI
https://doi.org/10.29121/shodhkosh.v6.i1.2025.5423
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CROSS-LINGUISTIC EVALUATION OF AI-GENERATED TEXT DETECTION: A COMPARATIVE STUDY ON ENGLISH AND INDONESIAN USING PRECISION, RECALL AND F1 SCORE

K Yatheendra, Sudhakara Arabagatte
ShodhKosh Journal of Visual and Performing Arts
Topic Modeling
article

CROSS-LINGUISTIC EVALUATION OF AI-GENERATED TEXT DETECTION: A COMPARATIVE STUDY ON ENGLISH AND INDONESIAN USING PRECISION, RECALL AND F1 SCORE

K Yatheendra, Sudhakara Arabagatte
article en

Abstract

In the age of generative AI, the line between human-written and machine-generated text is becoming increasingly blurred. This paper explores the performance of AI content detection systems across two linguistically and structurally diverse languages—English and Indonesian—through an empirical evaluation using 5,000 samples. The study evaluates detection outcomes using widely accepted performance metrics: precision, recall, and F1 score. Results reveal higher detection accuracy for English compared to Indonesian, due to linguistic complexities and dataset bias. This study underscores the growing importance of multilingual AI verification tools, especially in academic and regulatory environments.

ShodhKosh Journal of Visual and Performing ArtsVol. 6(1)
Mangalore University (IN)
Openalex Percentile: Top 93%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.