Do large language models hallucinate more in Uzbek? A cross-lingual measurement of factual reliability and its implications for non-English higher education

Introduction Students in non-English higher education are increasingly using large language models (LLMs) as informal study aids; however, the factual reliability of these systems in lower-resource languages - and its consequences for learning - remain largely unmeasured. Methods We report a controlled, fully reproducible evaluation of factual hallucination in eight open-weight LLMs answering 100 verifiable factual questions in English, Russian, and Uzbek. Uzbek, an agglutinative and comparatively low-resource Turkic language, is the primary language of instruction at our institution. Responses were scored with a deterministic answer-key procedure. Results The factual error rate increased monotonically with the resource level of the query language: 3.5% in English, 10.9% in Russian, and 15.9% in Uzbek (pooled over models; chi-square = 68.5, df = 2, p < 10 -14 ). The gap was present in nearly every model, but its size varied widely: a 12B general-purpose model answered reliably across all three languages, whereas the smaller 1-4B models had an error rate of 24%-27% in Uzbek. Language-adapted models - open checkpoints continued-pretrained or fine-tuned on Uzbek - closed the gap almost entirely, reaching an error rate of 2%-8% in Uzbek, comparable to their reliability in English. Discussion A student querying an off-the-shelf model in Uzbek is several times more likely to receive an incorrect fact than an English-speaking peer, which is both an equity concern and a hazard for academic integrity when unverified output enters student work. The risk, however, is not intrinsic to the language: it can be substantially reduced by preferring language-adapted models and by auditing per-language reliability before classroom deployment. All questions, code, and model outputs are released to support replication.

Authors

Institutions

Publication Details

Journal
Frontiers in Education
Published
2026-10-29
DOI
https://doi.org/10.3389/feduc.2026.1929327
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Do large language models hallucinate more in Uzbek? A cross-lingual measurement of factual reliability and its implications for non-English higher education

Алишер Абдупаттоевич Пармонов, Bekhzod Olimov, Xalilova Nilufarxon Bahromovna, Begmatov Azizbek Tursunbayevich et al.
2 links
Frontiers in Education
Topic Modeling
article

Do large language models hallucinate more in Uzbek? A cross-lingual measurement of factual reliability and its implications for non-English higher education

Алишер Абдупаттоевич Пармонов, Bekhzod Olimov, Xalilova Nilufarxon Bahromovna, Begmatov Azizbek Tursunbayevich, Gʻopporova Nigoraxon Moʻminjon qizi, Dildora Sherqo'ziyevna Aliyeva, Bakhtiyorjon Kh. Omonov, Botirjon Axmedov, Vazira Q. Abdullayeva, Usmonkhuja T. Tursunkhujaev
article en

Abstract

Introduction Students in non-English higher education are increasingly using large language models (LLMs) as informal study aids; however, the factual reliability of these systems in lower-resource languages - and its consequences for learning - remain largely unmeasured. Methods We report a controlled, fully reproducible evaluation of factual hallucination in eight open-weight LLMs answering 100 verifiable factual questions in English, Russian, and Uzbek. Uzbek, an agglutinative and comparatively low-resource Turkic language, is the primary language of instruction at our institution. Responses were scored with a deterministic answer-key procedure. Results The factual error rate increased monotonically with the resource level of the query language: 3.5% in English, 10.9% in Russian, and 15.9% in Uzbek (pooled over models; chi-square = 68.5, df = 2, p < 10 -14 ). The gap was present in nearly every model, but its size varied widely: a 12B general-purpose model answered reliably across all three languages, whereas the smaller 1-4B models had an error rate of 24%-27% in Uzbek. Language-adapted models - open checkpoints continued-pretrained or fine-tuned on Uzbek - closed the gap almost entirely, reaching an error rate of 2%-8% in Uzbek, comparable to their reliability in English. Discussion A student querying an off-the-shelf model in Uzbek is several times more likely to receive an incorrect fact than an English-speaking peer, which is both an equity concern and a hazard for academic integrity when unverified output enters student work. The risk, however, is not intrinsic to the language: it can be substantially reduced by preferring language-adapted models and by auditing per-language reliability before classroom deployment. All questions, code, and model outputs are released to support replication.

Frontiers in EducationVol. 11
Kokand University (UZ), Kokand University Andijan branch (UZ)
Openalex Percentile: Top 14%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon