Current LLMs and English syntax terminology translation

We aim to examine the extent to which Large Language Models (LLMs), specifically ChatGPT-5 can translate English syntax terminology into Arabic. We collected 44 terms from generative syntax previous works, including books and journal articles, as well as from our experience in the field. These terms were translated by humans, and then by ChatGPT-5. We then analyzed and compared both translations. We used the analytical and comparative approach amalgamated with micro approach in our analysis. Findings unveil that ChatGPT still cannot translate the core syntax properties embedded in the terms under study involving several syntactic (and semantic) challenges: only 25% of ChatGPT translations were accurate, while 38.6% were inaccurate, and 36.4.% were partially correct, which we consider appropriate. Based on these findings, a set of actionable strategies were proposed, the most notable of which is finetuning LLMs on syntactic terminology in both languages to better LLMs’ working mechanism for accurate or at least appropriate translation.

Authors

Institutions

Publication Details

Journal
Discover Artificial Intelligence
Published
2026-11-09
DOI
https://doi.org/10.1007/s44163-026-01836-6
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Current LLMs and English syntax terminology translation

Mohammed Q. Shormani, Yehia A. AlSohbani
2 links
Discover Artificial Intelligence
Natural Language Processing Techniques
article

Current LLMs and English syntax terminology translation

Mohammed Q. Shormani, Yehia A. AlSohbani
article en

Abstract

We aim to examine the extent to which Large Language Models (LLMs), specifically ChatGPT-5 can translate English syntax terminology into Arabic. We collected 44 terms from generative syntax previous works, including books and journal articles, as well as from our experience in the field. These terms were translated by humans, and then by ChatGPT-5. We then analyzed and compared both translations. We used the analytical and comparative approach amalgamated with micro approach in our analysis. Findings unveil that ChatGPT still cannot translate the core syntax properties embedded in the terms under study involving several syntactic (and semantic) challenges: only 25% of ChatGPT translations were accurate, while 38.6% were inaccurate, and 36.4.% were partially correct, which we consider appropriate. Based on these findings, a set of actionable strategies were proposed, the most notable of which is finetuning LLMs on syntactic terminology in both languages to better LLMs’ working mechanism for accurate or at least appropriate translation.

Discover Artificial IntelligenceVol. 6(1)
Arab Open University (SA), Ibb University (YE)
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon