The Construction of Translation Memory and Terminology Database Using Deep Learning and XGBoost Algorithm

Machine translation quality can be significantly enhanced by integrating external information into the translation process. Unlike traditional generative approaches, using external information enables models to access additional data during training, reducing reliance on limited training datasets. Three fusion methods are primarily utilized in this context: those based on bilingual dictionaries, translation memories, and templates. This study investigates techniques for incorporating external information, specifically through the construction of a translation memory and terminology database. The translation memory is optimized using deep learning methods and the XGBoost (eXtreme Gradient Boosting) algorithm. A comparative analysis evaluates the performance of both algorithms on translation accuracy and efficiency. Experimental findings reveal that, with only 10 hours of training on 5,000 data entries, the XGBoost algorithm achieves an 88.5% accuracy rate and covers 75% of the terminology database, demonstrating its advantage in large-scale data processing and predictive tasks. These findings highlight the importance of selecting appropriate algorithms to maximize translation memory applications, offering technical insights to further improve machine translation efficacy.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/iciics63763.2024.10859573
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Construction of Translation Memory and Terminology Database Using Deep Learning and XGBoost Algorithm

Yanjun Zhou, Dong Xie
Natural Language Processing Techniques
article

The Construction of Translation Memory and Terminology Database Using Deep Learning and XGBoost Algorithm

Yanjun Zhou, Dong Xie
article en

Abstract

Machine translation quality can be significantly enhanced by integrating external information into the translation process. Unlike traditional generative approaches, using external information enables models to access additional data during training, reducing reliance on limited training datasets. Three fusion methods are primarily utilized in this context: those based on bilingual dictionaries, translation memories, and templates. This study investigates techniques for incorporating external information, specifically through the construction of a translation memory and terminology database. The translation memory is optimized using deep learning methods and the XGBoost (eXtreme Gradient Boosting) algorithm. A comparative analysis evaluates the performance of both algorithms on translation accuracy and efficiency. Experimental findings reveal that, with only 10 hours of training on 5,000 data entries, the XGBoost algorithm achieves an 88.5% accuracy rate and covers 75% of the terminology database, demonstrating its advantage in large-scale data processing and predictive tasks. These findings highlight the importance of selecting appropriate algorithms to maximize translation memory applications, offering technical insights to further improve machine translation efficacy.

Hunan University of Humanities, Science and Technology (CN), Guilin University of Electronic Technology (CN)
Quality Education
Openalex Percentile: Top 76%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Construction of Translation Memory and Terminology Database Using Deep Learning and XGBoost Algorithm — Yanjun Zhou, Dong Xie · (2024) | TGRS Research Map | TGRS