Rebalancing Curriculum Learning via In-Batch Difficulty Reallocation for Neural Machine Translation

The advent of large language models has reshaped the landscape of artificial intelligence, yet their learning dynamics remain constrained by rigid training strategies. Curriculum learning (CL), inspired by the human learning process, improves model performance over conventional randomly shuffled training while incurring no additional computational overhead. However, its competence-conservative mechanism often leads to diminished learning stimuli and suboptimal performance plateaus. Inspired by the flow theory in psychology, this study proposes in-batch hard sample injection curriculum learning (DACL), a learning strategy that dynamically balances stability and challenge. DACL regulates sample selection by aligning the model’s competence with the intrinsic complexity of the data, allocating the Reasy proportion of each batch to instances within the competence range and the remaining (1−Reasy) to higher-difficulty samples that stimulate adaptive learning. Experiments on the English–Vietnamese pair demonstrate that DACL achieves superior performance over curriculum learning baselines across multiple difficulty evaluation criteria. Further experiments reveal the effectiveness of the similarity-based difficulty standard, demonstrating the ability to capture task complexity with greater precision.

Authors

Institutions

Publication Details

Journal
Mathematics
Published
2026-05-09
DOI
https://doi.org/10.3390/math14101607
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Rebalancing Curriculum Learning via In-Batch Difficulty Reallocation for Neural Machine Translation

Chanjun Park, Sugyeong Eo
Mathematics
Natural Language Processing Techniques
article

Rebalancing Curriculum Learning via In-Batch Difficulty Reallocation for Neural Machine Translation

Chanjun Park, Sugyeong Eo
article en

Abstract

The advent of large language models has reshaped the landscape of artificial intelligence, yet their learning dynamics remain constrained by rigid training strategies. Curriculum learning (CL), inspired by the human learning process, improves model performance over conventional randomly shuffled training while incurring no additional computational overhead. However, its competence-conservative mechanism often leads to diminished learning stimuli and suboptimal performance plateaus. Inspired by the flow theory in psychology, this study proposes in-batch hard sample injection curriculum learning (DACL), a learning strategy that dynamically balances stability and challenge. DACL regulates sample selection by aligning the model’s competence with the intrinsic complexity of the data, allocating the Reasy proportion of each batch to instances within the competence range and the remaining (1−Reasy) to higher-difficulty samples that stimulate adaptive learning. Experiments on the English–Vietnamese pair demonstrate that DACL achieves superior performance over curriculum learning baselines across multiple difficulty evaluation criteria. Further experiments reveal the effectiveness of the similarity-based difficulty standard, demonstrating the ability to capture task complexity with greater precision.

MathematicsVol. 14(10)
Soongsil University (KR), Yonsei University (KR)
Quality Education
Openalex Percentile: Top 3%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.