Semi-Supervised Marginal Likelihood Training with Curriculum-Guided Rewriting for Low-Resource Machine Translation
Large language models continue to face challenges in translating low-resource languages with scarce parallel data. This study investigates how to fine-tune them effectively using target-side monolingual data. Existing approaches—dominated by back-translation and recent LLM-based rewriting—remain limited by noisy synthetic sources, unguided simplification, and the absence of a principled mechanism for integrating monolingual sentences into the training objective. To address this, we developed a semi-supervised framework that integrates marginal distribution estimation and curriculum-guided rewriting to exploit monolingual data for low-resource translation. Experiments in four low-resource directions demonstrated substantial gains, averaging +8 spBLEU and +10 COMET over strong baselines, while three additional mid-resource directions showed stable improvements and consistent trends. Reference-free metrics further validated robust gains in fluency and adequacy. The findings establish a scalable paradigm for low-resource translation, revealing that the principled integration of marginal likelihood estimation and generative rewriting enables large language models to achieve superior performance under extreme data scarcity.
Authors
- Zhiqiang Yu (ORCID: https://orcid.org/0000-0002-9654-7742)
- Wudao Yang (ORCID: https://orcid.org/0000-0001-8411-1450)
- Wenjie Yu (ORCID: https://orcid.org/0000-0003-4641-6514)
- Jiang Zuo (ORCID: https://orcid.org/0009-0005-7412-1213)
- Wenqian Bao (ORCID: https://orcid.org/0009-0004-6470-9921)
- Yu Ju (ORCID: https://orcid.org/0009-0006-5936-5858)
Institutions
- Minzu University of China (CN)
- Intelligent Systems Research (United States) (US)
Publication Details
- Journal
- ACM Transactions on Asian and Low-Resource Language Information Processing
- Published
- 2026-07-23
- DOI
- https://doi.org/10.1145/3830466
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00