Differentiating DeepSeek AI-generated translations from NMT translations and human translations within Chinese white paper discourse: a computer-based method for analyzing writing style

This study investigates whether distinct “machine-translationese” and “LLM-translationese” exist in Chinese–English government translation by comparing DeepSeek V4Pro, Google neural machine translation, and pre-neural human translation. We built the corpus as 24 minimally overlapping 5,000-word windows per translation condition, yielding 72 matched observations. Using 21 normalized linguistic features selected exclusively within a group-aware training partition, five classifiers were trained and evaluated with a fully held-out, chunk-disjoint test set, and their stability was cross-checked with nested cross-validation and 50 repeated group-aware splits. Naive Bayes and Random Forest emerged as the most consistently above-chance classifiers, while the remaining classifiers were weaker or more sensitive to the specific partition. This indicates that the three translation agents are distinguishable from linguistic form alone. A five-factor multidimensional analysis identified discourse cohesion and causal-deictic linking as the strongest and most stable group contrast separating human translation from both machine systems, alongside four additional, comparatively weaker dimensions capturing nominal/lexical density, nominalization and wh-subordination, lexical diversity and dynamic aspect, and elaborative/predicative complexity. Corrected pairwise comparisons confirmed that human translation exceeds both machine systems on discourse cohesion, and that Google NMT and DeepSeek V4Pro are statistically indistinguishable from one another on most dimensions. A chunk-level bootstrap analysis confirmed that, in five-dimensional factor space, DeepSeek V4Pro and Google NMT sit reliably closer to each other than either does to human translation, supporting a shared machine-translationese distinct from institutional human translation. The study documents differences in stylistic profile and presents the proposed links to reader cognitive load and RLHF-driven hedging as hypotheses emerging from these structural findings. These results provide an empirically grounded, methodologically conservative basis for discussing LLM- and NMT-based translation in official contexts.

Authors

Institutions

Publication Details

Journal
Frontiers in Psychology
Published
2026-10-26
DOI
https://doi.org/10.3389/fpsyg.2026.1931933
Primary Topic
Translation Studies and Practices
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Differentiating DeepSeek AI-generated translations from NMT translations and human translations within Chinese white paper discourse: a computer-based method for analyzing writing style

Jun Zou, Ruoyang ZHANG, Xiaoting Ji
Frontiers in Psychology
Translation Studies and Practices
article

Differentiating DeepSeek AI-generated translations from NMT translations and human translations within Chinese white paper discourse: a computer-based method for analyzing writing style

Jun Zou, Ruoyang ZHANG, Xiaoting Ji
article en

Abstract

This study investigates whether distinct “machine-translationese” and “LLM-translationese” exist in Chinese–English government translation by comparing DeepSeek V4Pro, Google neural machine translation, and pre-neural human translation. We built the corpus as 24 minimally overlapping 5,000-word windows per translation condition, yielding 72 matched observations. Using 21 normalized linguistic features selected exclusively within a group-aware training partition, five classifiers were trained and evaluated with a fully held-out, chunk-disjoint test set, and their stability was cross-checked with nested cross-validation and 50 repeated group-aware splits. Naive Bayes and Random Forest emerged as the most consistently above-chance classifiers, while the remaining classifiers were weaker or more sensitive to the specific partition. This indicates that the three translation agents are distinguishable from linguistic form alone. A five-factor multidimensional analysis identified discourse cohesion and causal-deictic linking as the strongest and most stable group contrast separating human translation from both machine systems, alongside four additional, comparatively weaker dimensions capturing nominal/lexical density, nominalization and wh-subordination, lexical diversity and dynamic aspect, and elaborative/predicative complexity. Corrected pairwise comparisons confirmed that human translation exceeds both machine systems on discourse cohesion, and that Google NMT and DeepSeek V4Pro are statistically indistinguishable from one another on most dimensions. A chunk-level bootstrap analysis confirmed that, in five-dimensional factor space, DeepSeek V4Pro and Google NMT sit reliably closer to each other than either does to human translation, supporting a shared machine-translationese distinct from institutional human translation. The study documents differences in stylistic profile and presents the proposed links to reader cognitive load and RLHF-driven hedging as hypotheses emerging from these structural findings. These results provide an empirically grounded, methodologically conservative basis for discussing LLM- and NMT-based translation in official contexts.

Frontiers in PsychologyVol. 17
Tianjin Normal University (CN), Shaoxing University (CN)
Openalex Percentile: Top 3%
Translation Studies and Practices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon