Are Large Language Models for Education Reliable Across Languages?

Large language models (LLMs) are increasingly being adopted in educational settings.These applications expand beyond English, though current LLMs remain primarily Englishcentric.In this work, we ascertain if their use in education settings in non-English languages is warranted.We evaluated the performance of popular LLMs on four educational tasks: identifying student misconceptions, providing targeted feedback, interactive tutoring, and grading translations in eight languages (Mandarin, Hindi, Arabic, German, Farsi, Telugu, Ukrainian, Czech) in addition to English.We find that the performance on these tasks somewhat corresponds to the amount of language represented in training data, with lowerresource languages having poorer task performance.However, at least some models are able to more or less maintain their levels of performance across all languages.Thus, we recommend that practitioners first verify that the LLM works well in the target language for their educational task before deployment.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.bea-1.44
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Are Large Language Models for Education Reliable Across Languages?

Mrinmaya Sachan, Sankalan Pal Chowdhury, Vansh Gupta, Vilém Zouhar et al.
Topic Modeling
article

Are Large Language Models for Education Reliable Across Languages?

Mrinmaya Sachan, Sankalan Pal Chowdhury, Vansh Gupta, Vilém Zouhar, Donya Rooein
article en

Abstract

Large language models (LLMs) are increasingly being adopted in educational settings.These applications expand beyond English, though current LLMs remain primarily Englishcentric.In this work, we ascertain if their use in education settings in non-English languages is warranted.We evaluated the performance of popular LLMs on four educational tasks: identifying student misconceptions, providing targeted feedback, interactive tutoring, and grading translations in eight languages (Mandarin, Hindi, Arabic, German, Farsi, Telugu, Ukrainian, Czech) in addition to English.We find that the performance on these tasks somewhat corresponds to the amount of language represented in training data, with lowerresource languages having poorer task performance.However, at least some models are able to more or less maintain their levels of performance across all languages.Thus, we recommend that practitioners first verify that the LLM works well in the target language for their educational task before deployment.

European Commission, École Polytechnique Fédérale de Lausanne
Quality Education
Openalex Percentile: Top 90%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Are Large Language Models for Education Reliable Across Languages? — Mrinmaya Sachan, Sankalan Pal Chowdhury, et al. · (2025) | TGRS Research Map | TGRS