2025 Ginkgo Datapoints Antibody Developability Competition outcomes: limited model performance and a call for data standardization

The Ginkgo Datapoints Antibody Developability (AbDev) Competition, a blinded benchmark for developability prediction characterized entirely on a single, industrial-scale experimental platform, was conducted from September 8 to November 18, 2025. We benchmarked predictors across five biophysical properties - hydrophobicity, thermostability, self-association, expression titer, and polyreactivity - using a public training set of 246 clinical antibodies and a blinded, held-out test set of 80 antibodies. We received submissions from 113 teams spanning 25 countries, 38 companies, and 39 universities. Winning submissions differed by assay. Top Spearman's ρ values on the test set reached 0.708 (hydrophobicity), 0.392 (thermostability), 0.356 (polyreactivity), 0.337 (self-association), and 0.310 (titer). Cross-validation scores from the public training set consistently exceeded held-out test performance, indicating overfitting and limited out-of-distribution generalization. Together, these results provide a standardized snapshot of current antibody developability modeling capabilities and highlight a key bottleneck: available datasets are too small and heterogeneous to support robust, assay-spanning prediction. Meaningful progress will require larger, standardized, and diverse experimental datasets - with harmonized protocols and rich metadata - to train and validate models that generalize reliably for future antibody discovery campaigns.

Authors

Institutions

Publication Details

Journal
mAbs
Published
2026-02-22
DOI
https://doi.org/10.1080/19420862.2026.2634216
Primary Topic
Ginkgo biloba and Cashew Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

2025 Ginkgo Datapoints Antibody Developability Competition outcomes: limited model performance and a call for data standardization

Maximilian Schwenk, Nels Thorsteinson, Peter M. Tessier, Oliver M. Turnbull et al.
mAbs
Ginkgo biloba and Cashew Applications
article

2025 Ginkgo Datapoints Antibody Developability Competition outcomes: limited model performance and a call for data standardization

Maximilian Schwenk, Nels Thorsteinson, Peter M. Tessier, Oliver M. Turnbull, Michael Chungyoun, Aanal Bhatt, Ammar Arsiwala, Georgia Channing, Xiang Ao, Nathaniel L Blalock, Shyam Chandra, Netsanet Gebremedhin, Nimra Asi, Lucía Daniela Grippo, Ameya Kulkarni, Alexander Smith, Porfirio Quintero-Cadena, Vivek Kohar, J Kim, Daksh Sammi, Valentin Badea, Yolaine Pierre, Rushikesh Jadhav, Seth Ritter, Aviral Singh, Lood van Niekerk, Antonín Dušek, Rich Cohen, Olga Allen, Jiang Zhu, Blake Harris, Joshua Moller, Charlotte M. Deane, Laura Rand, Adam Rosenbaum
article en

Abstract

The Ginkgo Datapoints Antibody Developability (AbDev) Competition, a blinded benchmark for developability prediction characterized entirely on a single, industrial-scale experimental platform, was conducted from September 8 to November 18, 2025. We benchmarked predictors across five biophysical properties - hydrophobicity, thermostability, self-association, expression titer, and polyreactivity - using a public training set of 246 clinical antibodies and a blinded, held-out test set of 80 antibodies. We received submissions from 113 teams spanning 25 countries, 38 companies, and 39 universities. Winning submissions differed by assay. Top Spearman's ρ values on the test set reached 0.708 (hydrophobicity), 0.392 (thermostability), 0.356 (polyreactivity), 0.337 (self-association), and 0.310 (titer). Cross-validation scores from the public training set consistently exceeded held-out test performance, indicating overfitting and limited out-of-distribution generalization. Together, these results provide a standardized snapshot of current antibody developability modeling capabilities and highlight a key bottleneck: available datasets are too small and heterogeneous to support robust, assay-spanning prediction. Meaningful progress will require larger, standardized, and diverse experimental datasets - with harmonized protocols and rich metadata - to train and validate models that generalize reliably for future antibody discovery campaigns.

mAbsVol. 18(1)
Harvard University (US), Johns Hopkins University (US), Duke University (US), University of Michigan (US), University of Oxford (GB), Uni Research (Norway) (NO), Systems Dynamics (United States) (US), Creatv MicroTech (United States) (US), Ginkgo Bioworks, Inc. (United States) (US), Boehringer Ingelheim (Egypt) (EG), FACE Foundation (US), UCT Coatings (United States) (US), National Intelligence University (US), Hugging Face (US)
Openalex Percentile: Top 46%
Ginkgo biloba and Cashew Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.