Deep learning-based automatic evaluation model for translation quality of master of translation and interpreting

Translation quality assessment functions as a vital component which Master of Translation and Interpreting programs use to evaluate students’ language skills and their translation abilities. Conventional human-based translation scoring is highly subjective, labour-intensive, and lacking in reliability. To overcome these limitations, the research offers a Lotus Effect-Attention-based Bi-directional Gated Recurrent Unit (LE-Att-Bi-GRU) deep learning (DL) model for automatic translation quality assessment. The Translation Quality Evaluation dataset incorporates large parallel corpora involving of MTI student translations, expert reference translations, and consistent bilingual datasets. Collected text undergoes pre-processing steps such as text normalization and sentence alignment, which are used to ensure data standardisation and accuracy. Feature extraction adopts Term Frequency-Inverse Document Frequency (TF-IDF) to quantify linguistic features such as terminology accuracy, lexical richness, and structural coherence, and Sentence-Bidirectional Encoder Representations from Transformers (Sentence-BERT) embeddings to capture semantic equivalence between source and translated texts. The proposed LE-Att-Bi-GRU model improves semantic representation by incorporating a lotus-inspired division method that decreases noise and focuses essential semantic cues. The Bi-GRU captures bidirectional contextual dependencies, while the integrated attention module dynamically assigns weight to essential translation segments, developing translation accuracy, and style evaluation. The supervised model is trained using expert-annotated quality scores as ground truth. Experimental outcomes reveal high correlation with professional assessment standards and superior performance compared to precision (95.1%), accuracy (92.3%), F-measure (94.2%), AUC (0.926), recall (93.4%), Pearson (0.842), and Spearman (0.829). This research contributes to automatic, scalable, and pedagogically meaningful evaluation for MTI training, curriculum development, and future AI-assisted translation evaluation systems. Graphical abstract show the Overview of the proposed LE-Att-Bi-GRU framework for automatic MTI translation quality evaluation using semantic and linguistic features.

Authors

Institutions

Publication Details

Journal
Discover Artificial Intelligence
Published
2026-08-18
DOI
https://doi.org/10.1007/s44163-026-01711-4
Primary Topic
Educational Technology and Pedagogy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep learning-based automatic evaluation model for translation quality of master of translation and interpreting

Jianxun Guo, Jilin Chang, Li Zhang, Xiaotong Wang et al.
Discover Artificial Intelligence
Educational Technology and Pedagogy
article

Deep learning-based automatic evaluation model for translation quality of master of translation and interpreting

Jianxun Guo, Jilin Chang, Li Zhang, Xiaotong Wang, Biao Li, Chun Ding
article en

Abstract

Translation quality assessment functions as a vital component which Master of Translation and Interpreting programs use to evaluate students’ language skills and their translation abilities. Conventional human-based translation scoring is highly subjective, labour-intensive, and lacking in reliability. To overcome these limitations, the research offers a Lotus Effect-Attention-based Bi-directional Gated Recurrent Unit (LE-Att-Bi-GRU) deep learning (DL) model for automatic translation quality assessment. The Translation Quality Evaluation dataset incorporates large parallel corpora involving of MTI student translations, expert reference translations, and consistent bilingual datasets. Collected text undergoes pre-processing steps such as text normalization and sentence alignment, which are used to ensure data standardisation and accuracy. Feature extraction adopts Term Frequency-Inverse Document Frequency (TF-IDF) to quantify linguistic features such as terminology accuracy, lexical richness, and structural coherence, and Sentence-Bidirectional Encoder Representations from Transformers (Sentence-BERT) embeddings to capture semantic equivalence between source and translated texts. The proposed LE-Att-Bi-GRU model improves semantic representation by incorporating a lotus-inspired division method that decreases noise and focuses essential semantic cues. The Bi-GRU captures bidirectional contextual dependencies, while the integrated attention module dynamically assigns weight to essential translation segments, developing translation accuracy, and style evaluation. The supervised model is trained using expert-annotated quality scores as ground truth. Experimental outcomes reveal high correlation with professional assessment standards and superior performance compared to precision (95.1%), accuracy (92.3%), F-measure (94.2%), AUC (0.926), recall (93.4%), Pearson (0.842), and Spearman (0.829). This research contributes to automatic, scalable, and pedagogically meaningful evaluation for MTI training, curriculum development, and future AI-assisted translation evaluation systems. Graphical abstract show the Overview of the proposed LE-Att-Bi-GRU framework for automatic MTI translation quality evaluation using semantic and linguistic features.

Discover Artificial IntelligenceVol. 6(1)
Tianjin University of Technology and Education (CN), Tianjin Economic-Technological Development Area (CN)
Quality Education
Openalex Percentile: Top 8%
Educational Technology and Pedagogy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.