Script Shift: LLM-Written Bangla and Banglish Indirect Prompt Injection Against Tool-Using LLM Agents

Tool-using LLM agents read emails, messages and documents written by third parties, which exposes them to indirect prompt injection (IPI). Multilingual IPI studies usually create non-English attack text by machine translation (MT), but an attacker can instead ask a language model to write it. Holding the goal, injection point and identifiers fixed, we compare English, NLLB-translated Bangla, and Bengali-script Bangla and romanised Banglish written by an open-weight LLM, on AgentDojo against five open-weight agents. Three findings emerge. First, we found no evidence that LLM-written Bangla was more effective than MT Bangla (pooled +1.0 percentage points (pp), 95% CI [−2.1, 4.0]); the difference was equivalent to zero within ±5 pp under stock AgentDojo, but not when Bengali script was delivered intact (+2.0 pp [−1.9, 6.3]). Second, English injections were far stronger than every Bangla form (pooled attack success 45.4% vs 7.9%), and English susceptibility did not predict Bangla susceptibility: the agent most susceptible in English was the least susceptible in every Bangla form. Third, stock AgentDojo serialises structured tool output as ASCII-only YAML, so in 54–67% of Bengali-script episodes per model the agent received \uXXXX escapes instead of script; benchmarks of non-Latin-script injections should check what the agent actually receives. Code, payloads and traces are released at https://github.com/oliurrahmanoli/scriptshift-artifact.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-02
DOI
https://doi.org/10.5281/zenodo.23878540
Primary Topic
Adversarial Robustness in Machine Learning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Script Shift: LLM-Written Bangla and Banglish Indirect Prompt Injection Against Tool-Using LLM Agents

Zabedur Rahman, Nuha Fadilah Zahidy, Oliur Rahman Oli
2 links
Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
preprint

Script Shift: LLM-Written Bangla and Banglish Indirect Prompt Injection Against Tool-Using LLM Agents

Zabedur Rahman, Nuha Fadilah Zahidy, Oliur Rahman Oli
preprint en

Abstract

Tool-using LLM agents read emails, messages and documents written by third parties, which exposes them to indirect prompt injection (IPI). Multilingual IPI studies usually create non-English attack text by machine translation (MT), but an attacker can instead ask a language model to write it. Holding the goal, injection point and identifiers fixed, we compare English, NLLB-translated Bangla, and Bengali-script Bangla and romanised Banglish written by an open-weight LLM, on AgentDojo against five open-weight agents. Three findings emerge. First, we found no evidence that LLM-written Bangla was more effective than MT Bangla (pooled +1.0 percentage points (pp), 95% CI [−2.1, 4.0]); the difference was equivalent to zero within ±5 pp under stock AgentDojo, but not when Bengali script was delivered intact (+2.0 pp [−1.9, 6.3]). Second, English injections were far stronger than every Bangla form (pooled attack success 45.4% vs 7.9%), and English susceptibility did not predict Bangla susceptibility: the agent most susceptible in English was the least susceptible in every Bangla form. Third, stock AgentDojo serialises structured tool output as ASCII-only YAML, so in 54–67% of Bengali-script episodes per model the agent received \uXXXX escapes instead of script; benchmarks of non-Latin-script injections should check what the agent actually receives. Code, payloads and traces are released at https://github.com/oliurrahmanoli/scriptshift-artifact.

Zenodo (CERN European Organization for Nuclear Research)
Charles Darwin University (AU), Macquarie University (AU)
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon