The Urdu Cloak: Quantifying Cultural Alignment Shifts and the Two-Layer Evasion of Plagiarism and AI Detectors

Large Language Models (LLMs) and text-analysis systems are predominantly evaluated in English, leaving a critical blind spot in AI safety research for low-resource languages. We present The Urdu Cloak, a socio-technical audit framework that investigates vulnerabilities in current AI governance systems using Urdu—a language spoken by over 230 million people. First, we expose a Two-Layer Evasion Vulnerability against plagiarism and AI text detectors. We demonstrate that translating English AI-generated text into Urdu creates an absolute ”blind spot” for standard plagiarism algorithms (100% Evasion Rate, 0.0 TF-IDF word overlap) and severely degrades AI detectors (54.0% Evasion Rate). Even when this text is back-translated into English (the ”Cloaking Attack”), it retains a 100% Plagiarism Evasion Rate while maintaining high semantic fidelity (BERTScore F1 = 0.84). However, RoBERTa-based AI detectors prove highly robust against the English back-translation, successfully catching 94% of cloaked texts. Second, we quantify linguistic alignment bias: across 50 socio-culturally grounded prompts, the LLM exhibited a significant cultural stance divergence of 0.17 when responding in Urdu versus English. Our open-source pipeline exposes how current plagiarism systems are fundamentally broken by cross-lingual pivots, while demonstrating that AI detectors are learning machine-translation artifacts rather than deep semantics.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-05
DOI
https://doi.org/10.5281/zenodo.20043256
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

The Urdu Cloak: Quantifying Cultural Alignment Shifts and the Two-Layer Evasion of Plagiarism and AI Detectors

Abdul Rehman
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
article

The Urdu Cloak: Quantifying Cultural Alignment Shifts and the Two-Layer Evasion of Plagiarism and AI Detectors

Abdul Rehman
article en

Abstract

Large Language Models (LLMs) and text-analysis systems are predominantly evaluated in English, leaving a critical blind spot in AI safety research for low-resource languages. We present The Urdu Cloak, a socio-technical audit framework that investigates vulnerabilities in current AI governance systems using Urdu—a language spoken by over 230 million people. First, we expose a Two-Layer Evasion Vulnerability against plagiarism and AI text detectors. We demonstrate that translating English AI-generated text into Urdu creates an absolute ”blind spot” for standard plagiarism algorithms (100% Evasion Rate, 0.0 TF-IDF word overlap) and severely degrades AI detectors (54.0% Evasion Rate). Even when this text is back-translated into English (the ”Cloaking Attack”), it retains a 100% Plagiarism Evasion Rate while maintaining high semantic fidelity (BERTScore F1 = 0.84). However, RoBERTa-based AI detectors prove highly robust against the English back-translation, successfully catching 94% of cloaked texts. Second, we quantify linguistic alignment bias: across 50 socio-culturally grounded prompts, the LLM exhibited a significant cultural stance divergence of 0.17 when responding in Urdu versus English. Our open-source pipeline exposes how current plagiarism systems are fundamentally broken by cross-lingual pivots, while demonstrating that AI detectors are learning machine-translation artifacts rather than deep semantics.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 6%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.