Configuration Sensitivity and Metric Validity in Computational Screening of De Novo Protein Binders: An Empirical Study of 16,055 Pipeline-Generated Designs

The maturation of generative protein design has made it routine to produce thousands of de novo binder candidates in a single campaign, shifting the bottleneck from design to computational screening. We report an empirical dissection of one screening stack built from RFdiffusion, ProteinMPNN, ColabFold, Boltz-2, and the interface-confidence metric ipSAE, covering 16,055 pipeline-generated designs across two structurally distinct targets (KRAS G12D pMHC and EGFR domain III), of which 42 were selected for deep validation. Three findings emerge. (1) MSA configuration dominates the verdict: for one and the same sequence, suppressing the target MSA drops ipSAE from 0.826 (HIGH) to 0.316 (REJECT), and capping MSA depth at 512 drives 8/8 candidates to exactly 0.000, whereas a cap of 2048 restores 0.823. (2) Plausible metrics are dissociated from interface quality: contact count and epitope overlap correlate at r=+0.19 and r=+0.13 with ipSAE, while ipTM (rho=+0.99) and pTM (rho=+0.96) are strongly predictive. (3) The hard-target narrative is weaker than the configuration problem: hit rates (ipSAE>=0.61) were 11% for EGFR (4/36) and 17% for pMHC (1/6; Fisher p=0.56). Our best EGFR design reaches ipSAE 0.858, the same level as cetuximab (0.857-0.866).

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-13
DOI
https://doi.org/10.5281/zenodo.24206655
Primary Topic
Protein Structure and Dynamics
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Configuration Sensitivity and Metric Validity in Computational Screening of De Novo Protein Binders: An Empirical Study of 16,055 Pipeline-Generated Designs

Shiqiang Chen
3 links
Zenodo (CERN European Organization for Nuclear Research)
Protein Structure and Dynamics
preprint

Configuration Sensitivity and Metric Validity in Computational Screening of De Novo Protein Binders: An Empirical Study of 16,055 Pipeline-Generated Designs

Shiqiang Chen
preprint en

Abstract

The maturation of generative protein design has made it routine to produce thousands of de novo binder candidates in a single campaign, shifting the bottleneck from design to computational screening. We report an empirical dissection of one screening stack built from RFdiffusion, ProteinMPNN, ColabFold, Boltz-2, and the interface-confidence metric ipSAE, covering 16,055 pipeline-generated designs across two structurally distinct targets (KRAS G12D pMHC and EGFR domain III), of which 42 were selected for deep validation. Three findings emerge. (1) MSA configuration dominates the verdict: for one and the same sequence, suppressing the target MSA drops ipSAE from 0.826 (HIGH) to 0.316 (REJECT), and capping MSA depth at 512 drives 8/8 candidates to exactly 0.000, whereas a cap of 2048 restores 0.823. (2) Plausible metrics are dissociated from interface quality: contact count and epitope overlap correlate at r=+0.19 and r=+0.13 with ipSAE, while ipTM (rho=+0.99) and pTM (rho=+0.96) are strongly predictive. (3) The hard-target narrative is weaker than the configuration problem: hit rates (ipSAE>=0.61) were 11% for EGFR (4/36) and 17% for pMHC (1/6; Fisher p=0.56). Our best EGFR design reaches ipSAE 0.858, the same level as cetuximab (0.857-0.866).

Zenodo (CERN European Organization for Nuclear Research)
Protein Structure and Dynamics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon