Evaluating the Translation Accuracy of ChatGPT and DeepL Through the Lens of Implied Subjects

This research aims to offer deeper insights into the translation quality of large language models and neural machine translation systems. It compares the performance of two state-of-the-art models, ChatGPT and DeepL, to explore which system achieves higher translation accuracy. This research employs a highly focused and specialized method to evaluate translation performance, enabling the identification of nuanced differences between advanced AI/machine models. It focuses on implied subjects in contemporary Chinese writer Qiuyu Yu’s Iraq travelogue and examines how the two models handle these implied subjects when translating the text into English. The analysis shows that both ChatGPT and DeepL exhibit high-level intelligence when dealing with the implied subjects. They can flexibly adjust sentence structures to maintain the implicitness or to make the implied subjects explicit. The analysis further reveals that ChatGPT performs better in accurately inferring the implied subjects, which thereby reflects ChatGPT’s superior contextual understanding capability. The comparison of the source text and target texts also shows that ChatGPT’s translation is more succinct, nuanced, and easier to read. DeepL’s translation, by comparison, prioritizes reducing potential misunderstanding. This research tentatively concludes that, though not specialized for translation, ChatGPT translates with higher accuracy and demonstrates more sophisticated intelligence compared to DeepL when translating literary texts.

Authors

Publication Details

Journal
Arab World English Journal For Translation and Literary Studies
Published
2024-10-19
DOI
https://doi.org/10.24093/awejtls/vol8no4.5
Citations
2
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.24
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating the Translation Accuracy of ChatGPT and DeepL Through the Lens of Implied Subjects

Rui Sun
2 citations
Arab World English Journal For Translation and Literary Studies
Artificial Intelligence in Healthcare and Education
0.24
article

Evaluating the Translation Accuracy of ChatGPT and DeepL Through the Lens of Implied Subjects

Rui Sun
article en
2 citations

Abstract

This research aims to offer deeper insights into the translation quality of large language models and neural machine translation systems. It compares the performance of two state-of-the-art models, ChatGPT and DeepL, to explore which system achieves higher translation accuracy. This research employs a highly focused and specialized method to evaluate translation performance, enabling the identification of nuanced differences between advanced AI/machine models. It focuses on implied subjects in contemporary Chinese writer Qiuyu Yu’s Iraq travelogue and examines how the two models handle these implied subjects when translating the text into English. The analysis shows that both ChatGPT and DeepL exhibit high-level intelligence when dealing with the implied subjects. They can flexibly adjust sentence structures to maintain the implicitness or to make the implied subjects explicit. The analysis further reveals that ChatGPT performs better in accurately inferring the implied subjects, which thereby reflects ChatGPT’s superior contextual understanding capability. The comparison of the source text and target texts also shows that ChatGPT’s translation is more succinct, nuanced, and easier to read. DeepL’s translation, by comparison, prioritizes reducing potential misunderstanding. This research tentatively concludes that, though not specialized for translation, ChatGPT translates with higher accuracy and demonstrates more sophisticated intelligence compared to DeepL when translating literary texts.

Arab World English Journal For Translation and Literary StudiesVol. 8(4)
Openalex Percentile: Top 40%
Artificial Intelligence in Healthcare and Education
0.24
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.