Why curricula help some learners and not others

Curriculum learning, the deliberate ordering of learning experiences, is central to how humans and animals learn, yet its benefits in neural networks are inconsistent. We argue that curricula succeed when they prevent or correct early commitments that might otherwise predispose learners to underfit or overfit to training data. Early experience can lead learners to overlook relevant information, or to rely on irrelevant details that do not generalise well. Curricula help by preventing these mistakes or making them easier to correct. Their benefits diminish when learners have spare capacity or suitable representations, and curricula can even harm learning when early experience establishes patterns that later experience cannot build on. The main source of curriculum benefit, thus, is helping learners `unlearn' overly simple or overly complex solutions.

Authors

Institutions

Publication Details

Journal
PsyArXiv (OSF Preprints)
Published
2026-11-16
DOI
https://doi.org/10.31234/osf.io/muhzq_v1
Primary Topic
Neural Networks and Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Why curricula help some learners and not others

Christopher Summerfield, Mohammed Amara
2 links
PsyArXiv (OSF Preprints)
Neural Networks and Applications
preprint

Why curricula help some learners and not others

Christopher Summerfield, Mohammed Amara
preprint en

Abstract

Curriculum learning, the deliberate ordering of learning experiences, is central to how humans and animals learn, yet its benefits in neural networks are inconsistent. We argue that curricula succeed when they prevent or correct early commitments that might otherwise predispose learners to underfit or overfit to training data. Early experience can lead learners to overlook relevant information, or to rely on irrelevant details that do not generalise well. Curricula help by preventing these mistakes or making them easier to correct. Their benefits diminish when learners have spare capacity or suitable representations, and curricula can even harm learning when early experience establishes patterns that later experience cannot build on. The main source of curriculum benefit, thus, is helping learners `unlearn' overly simple or overly complex solutions.

PsyArXiv (OSF Preprints)
University of Oxford (GB)
Quality education
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon