Gradient optimisation and cross-language transfer mechanism of English translation model based on LSTM-transformer

Amid globalisation and growing cross-language information needs, machine translation is crucial for overcoming language barriers.Deep learning has advanced it, but transformer faces limitations: insufficient efficiency in capturing long-range dependencies and poor performance in low-resource translation.To address these, this study proposes three core solutions: 1) a hybrid LSTM-transformer architecture fusing LSTM's gating mechanism (long-sequence modelling) and transformer's self-attention (global context capture); 2) an adaptive gradient clipping (AGC) strategy for training stability; 3) dynamic weight sharing with adversarial domain adaptation to enhance cross-language transfer.Experiments on WMT14 English-German/French corpora show the model's BLEU value is 2.8 higher than benchmark Transformer, with 18% faster convergence; in English Romanian low-resource scenarios, the transfer mechanism boosts BLEU by 5.3.This study validates the hybrid architecture and optimisation strategies, offering new ideas for efficient gradient optimisation and low-resource translation models.

Authors

Institutions

Publication Details

Journal
International Journal of Information and Communication Technology
Published
2026-01-01
DOI
https://doi.org/10.1504/ijict.2026.152530
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Gradient optimisation and cross-language transfer mechanism of English translation model based on LSTM-transformer

Meizhen Zou
International Journal of Information and Communication Technology
Natural Language Processing Techniques
article

Gradient optimisation and cross-language transfer mechanism of English translation model based on LSTM-transformer

Meizhen Zou
article en

Abstract

Amid globalisation and growing cross-language information needs, machine translation is crucial for overcoming language barriers.Deep learning has advanced it, but transformer faces limitations: insufficient efficiency in capturing long-range dependencies and poor performance in low-resource translation.To address these, this study proposes three core solutions: 1) a hybrid LSTM-transformer architecture fusing LSTM's gating mechanism (long-sequence modelling) and transformer's self-attention (global context capture); 2) an adaptive gradient clipping (AGC) strategy for training stability; 3) dynamic weight sharing with adversarial domain adaptation to enhance cross-language transfer.Experiments on WMT14 English-German/French corpora show the model's BLEU value is 2.8 higher than benchmark Transformer, with 18% faster convergence; in English Romanian low-resource scenarios, the transfer mechanism boosts BLEU by 5.3.This study validates the hybrid architecture and optimisation strategies, offering new ideas for efficient gradient optimisation and low-resource translation models.

International Journal of Information and Communication TechnologyVol. 27(26)
Shaoxing University (CN), ZheJiang Academy of Agricultural Sciences (CN)
Openalex Percentile: Top 8%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.