An apicomplexan-specific foundation model improves prediction of regulatory genomic signals in Plasmodium falciparum
Genomic foundation models learn transferable sequence representations through self-supervision, yet their practical value is contested. In data-rich mammalian genomes, task-specific models trained from scratch can match or exceed pretrained models on many regulatory prediction tasks. Whether self-supervised pretraining provides an advantage in small, data-sparse genomes has not been directly tested. We address this in the compact, 23Mbp, A/T-rich genome of the malaria parasite, Plasmodium falciparum. We trained a Genomic Pretrained Network (GPN) via masked-nucleotide reconstruction on 455 genome assemblies spanning 76 apicomplexan species. We then fine-tuned the model to predict a variety of epigenomic features in a held-out chromosome, including transcription factor binding sites, chromatin-accessibility, histone modifications, and 10 chromatin states. Pretraining followed by fine tuning improved prediction of most features, with most of the benefit concentrated on datasets with relatively little labeled data (fewer than 3,000 training examples). In contrast, a human-pretrained model transferred poorly, indicating that phylogenetically relevant pretraining, not foundation-model status alone, drives beneficial performance. Self-supervised pretraining on clade-specific assemblies is thus a practical route to data-efficient regulatory modeling in small genomes where training data is scarce.
Authors
- Manuel Llinás (ORCID: https://orcid.org/0000-0002-6173-5882)
- Shaun Mahony (ORCID: https://orcid.org/0000-0002-2641-1807)
- Jianyu Yang (ORCID: https://orcid.org/0000-0002-0195-4100)
- Alan S. Brown
Institutions
- Pennsylvania State University (US)
Publication Details
- Journal
- bioRxiv (Cold Spring Harbor Laboratory)
- Published
- 2026-11-16
- DOI
- https://doi.org/10.64898/2026.11.12.766050
- Primary Topic
- Genomics and Chromatin Dynamics
- Type
- preprint
Funders
- GlaxoSmithKline
- Pennsylvania State University
- National Institutes of Health
- National Institute of General Medical Sciences