Dynamic semantic fusion based transformer modelling for automatic translation of Chinese–English languages using deep embeddings

Chinese English neural machine translation remains challenging due to substantial syntactic divergence, word-order variation, lexical ambiguity, and cross-lingual semantic mismatch. These challenges often lead to semantic omissions, over-translation, and weak source–target semantic alignment in transformer-based translation systems. Although transformer architecture has achieved remarkable progress, they frequently exhibit limitations in capturing complementary lexical and sentence-level semantic information while offering limited interpretability of the translation process. To address these challenges, this paper proposes DSF–MarianMT, a semantic fusion enhanced neural machine translation framework built upon MarianMT. The proposed framework integrates word-level and sentence-level semantic representations through a dynamic semantic fusion mechanism and employs a contrastive semantic learning objective to improve source–target semantic consistency during training. Experimental evaluation on a Chinese English translation dataset demonstrates the effectiveness of the proposed approach, achieving 36.5 BLEU, 60.2 chrF, 39.8 TER, and a COMET score of 0.78, outperforming the standard MarianMT baseline across all evaluation metrics. In addition to improved translation quality, interpretability analyses reveal reduced attention entropy, lower redundancies among attention heads, and stable token-level semantic learning. Furthermore, error analysis indicates fewer semantic omissions and over-translation errors, while consistent performance is maintained across sentences of varying lengths. These findings demonstrate that the proposed framework effectively enhances semantic representation learning and translation fidelity for Chinese–English neural machine translation.

Authors

Institutions

Publication Details

Journal
Discover Computing
Published
2026-08-25
DOI
https://doi.org/10.1007/s10791-026-10452-y
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dynamic semantic fusion based transformer modelling for automatic translation of Chinese–English languages using deep embeddings

Qingqing Xu, Haoyu Wang, Cuiping Song, Yongbin Ge et al.
Discover Computing
Natural Language Processing Techniques
article

Dynamic semantic fusion based transformer modelling for automatic translation of Chinese–English languages using deep embeddings

Qingqing Xu, Haoyu Wang, Cuiping Song, Yongbin Ge, Ziqian Zhousong
article en

Abstract

Chinese English neural machine translation remains challenging due to substantial syntactic divergence, word-order variation, lexical ambiguity, and cross-lingual semantic mismatch. These challenges often lead to semantic omissions, over-translation, and weak source–target semantic alignment in transformer-based translation systems. Although transformer architecture has achieved remarkable progress, they frequently exhibit limitations in capturing complementary lexical and sentence-level semantic information while offering limited interpretability of the translation process. To address these challenges, this paper proposes DSF–MarianMT, a semantic fusion enhanced neural machine translation framework built upon MarianMT. The proposed framework integrates word-level and sentence-level semantic representations through a dynamic semantic fusion mechanism and employs a contrastive semantic learning objective to improve source–target semantic consistency during training. Experimental evaluation on a Chinese English translation dataset demonstrates the effectiveness of the proposed approach, achieving 36.5 BLEU, 60.2 chrF, 39.8 TER, and a COMET score of 0.78, outperforming the standard MarianMT baseline across all evaluation metrics. In addition to improved translation quality, interpretability analyses reveal reduced attention entropy, lower redundancies among attention heads, and stable token-level semantic learning. Furthermore, error analysis indicates fewer semantic omissions and over-translation errors, while consistent performance is maintained across sentences of varying lengths. These findings demonstrate that the proposed framework effectively enhances semantic representation learning and translation fidelity for Chinese–English neural machine translation.

Discover ComputingVol. 29(1)
Shandong University of Technology (CN), Ningxia University (CN), North Minzu University (CN), Yibin University (CN), Dalian Minzu University (CN), Xi’an Jiaotong-Liverpool University (CN)
Openalex Percentile: Top 8%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.