Frozen sequence encoders with gradient boosting match the state of the art on drug–target affinity domain generalization, and a sequence defect in the Davis kinase benchmark

We report two results on public kinase drug–target interaction (DTI) benchmarks. First, a deliberately simple model — frozen pretrained encoders for molecules and proteins, with gradient-boosted trees on top and no end-to-end training — reaches PCC 0.591 ± 0.004 on the Therapeutics Data Commons DTI-DG benchmark (BindingDB_Patent), evaluated with TDC’s own split and evaluator over five seeds. This is statistically indistinguishable from the best published entry (0.588 ± 0.002; difference 0.003 against a combined standard error of 0.0045, 0.67 SE) and separated from the second entry (0.538 ± 0.008) by 5.9 SE. The result reproduced exactly on an independent run. Second, we document a defect in the widely used Davis kinase dataset that affects any work using its mutant kinases. Davis lists 442 protein names but contains only 379 distinct sequences: all 45 mutation-labelled entries are assigned the wild-type sequence of their gene. ABL1 and ABL1(E255K) have bit-identical ESM-2 embeddings (L2 = 0.0000, cosine = 1.000000). The affinity labels differ while the model input does not, so these pairs are irreducible contradictions in training — 9.63% of all Davis rows. Reconstructing the mutant sequences from the names raises the distinct-sequence count to 423, reduces contradictory rows to 3.97%, and improves concordance index on mutant proteins by +0.0173 (5/5 seeds, t = 23.16) under an otherwise identical protocol.

Authors

Publication Details

Journal
ChemRxiv
Published
2026-10-28
DOI
https://doi.org/10.26434/chemrxiv.15011207/v1
Primary Topic
Computational Drug Discovery Methods
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Frozen sequence encoders with gradient boosting match the state of the art on drug–target affinity domain generalization, and a sequence defect in the Davis kinase benchmark

Avinash Kumar
ChemRxiv
Computational Drug Discovery Methods
preprint

Frozen sequence encoders with gradient boosting match the state of the art on drug–target affinity domain generalization, and a sequence defect in the Davis kinase benchmark

Avinash Kumar
preprint en

Abstract

We report two results on public kinase drug–target interaction (DTI) benchmarks. First, a deliberately simple model — frozen pretrained encoders for molecules and proteins, with gradient-boosted trees on top and no end-to-end training — reaches PCC 0.591 ± 0.004 on the Therapeutics Data Commons DTI-DG benchmark (BindingDB_Patent), evaluated with TDC’s own split and evaluator over five seeds. This is statistically indistinguishable from the best published entry (0.588 ± 0.002; difference 0.003 against a combined standard error of 0.0045, 0.67 SE) and separated from the second entry (0.538 ± 0.008) by 5.9 SE. The result reproduced exactly on an independent run. Second, we document a defect in the widely used Davis kinase dataset that affects any work using its mutant kinases. Davis lists 442 protein names but contains only 379 distinct sequences: all 45 mutation-labelled entries are assigned the wild-type sequence of their gene. ABL1 and ABL1(E255K) have bit-identical ESM-2 embeddings (L2 = 0.0000, cosine = 1.000000). The affinity labels differ while the model input does not, so these pairs are irreducible contradictions in training — 9.63% of all Davis rows. Reconstructing the mutant sequences from the names raises the distinct-sequence count to 423, reduces contradictory rows to 3.97%, and improves concordance index on mutant proteins by +0.0173 (5/5 seeds, t = 23.16) under an otherwise identical protocol.

ChemRxiv
Computational Drug Discovery Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon