Why curricula help some learners and not others
Curriculum learning, the deliberate ordering of learning experiences, is central to how humans and animals learn, yet its benefits in neural networks are inconsistent. We argue that curricula succeed when they prevent or correct early commitments that might otherwise predispose learners to underfit or overfit to training data. Early experience can lead learners to overlook relevant information, or to rely on irrelevant details that do not generalise well. Curricula help by preventing these mistakes or making them easier to correct. Their benefits diminish when learners have spare capacity or suitable representations, and curricula can even harm learning when early experience establishes patterns that later experience cannot build on. The main source of curriculum benefit, thus, is helping learners `unlearn' overly simple or overly complex solutions.
Authors
- Christopher Summerfield (ORCID: https://orcid.org/0000-0002-2941-2653)
- Mohammed Amara (ORCID: https://orcid.org/0009-0001-0524-6830)
Institutions
- University of Oxford (GB)
Publication Details
- Journal
- PsyArXiv (OSF Preprints)
- Published
- 2026-11-16
- DOI
- https://doi.org/10.31234/osf.io/muhzq_v1
- Primary Topic
- Neural Networks and Applications
- Type
- preprint