ChEMBL-Derived Benchmark Dataset and Computational Results of Boltz-2-Based Binding Affinity Prediction

Accurate prediction of protein–ligand binding affinities is a critical step in accelerating drug discovery by reducing experimental costs and development times. Recently developed co-folding AI models predict how multiple biomolecules fold and interact with each other in three-dimensional space. The emergence of a new co-folding model, Boltz-2, has made highly accurate and efficient predictions of protein–ligand binding affinities increasingly feasible. However, the generalization and reliability of these models remain unclear due to the absence of standardized and target-wide benchmark datasets. In this study, we constructed an independent external benchmark dataset derived from ChEMBL version 35 to rigorously evaluate Boltz-2’s performance for affinity prediction. The dataset includes 356 unique protein targets and 10,933 compounds, carefully collected to ensure no overlap with the Boltz-2 training data. Binding affinity measurements were standardized into pChEMBL values and linked to the compound SMILES and protein UniProt accessions. Using this benchmark dataset, we compared the performance of the original Boltz-2 model and its NVIDIA Inference Microservice (NIM) implementation. The results showed that the original Boltz-2 and NIM achieved comparable and fair predictive performance across targets (mean absolute error of approximately 0.9), while NIM reduced computational time by approximately 60–90%. The error analysis indicated that no clear correlation existed between the prediction errors and sequence or compound novelty relative to the Boltz-2 training data, underscoring the model’s broad coverage. This work provides a transparent and reproducible benchmark for evaluating AI-driven affinity prediction models and offers valuable insights into Boltz-2’s applicability, limitations, and potential as a practical tool for data-driven drug discovery.

Authors

Institutions

Publication Details

Journal
Chem-Bio Informatics Journal
Published
2026-03-17
DOI
https://doi.org/10.1273/cbij.26.11
Primary Topic
Protein Structure and Dynamics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ChEMBL-Derived Benchmark Dataset and Computational Results of Boltz-2-Based Binding Affinity Prediction

Masateru Ohta, Kazuyoshi Ikeda, Tatsuki Akabane, Yugo Shimizu et al.
Chem-Bio Informatics Journal
Protein Structure and Dynamics
article

ChEMBL-Derived Benchmark Dataset and Computational Results of Boltz-2-Based Binding Affinity Prediction

Masateru Ohta, Kazuyoshi Ikeda, Tatsuki Akabane, Yugo Shimizu, Teruki Honma
article en

Abstract

Accurate prediction of protein–ligand binding affinities is a critical step in accelerating drug discovery by reducing experimental costs and development times. Recently developed co-folding AI models predict how multiple biomolecules fold and interact with each other in three-dimensional space. The emergence of a new co-folding model, Boltz-2, has made highly accurate and efficient predictions of protein–ligand binding affinities increasingly feasible. However, the generalization and reliability of these models remain unclear due to the absence of standardized and target-wide benchmark datasets. In this study, we constructed an independent external benchmark dataset derived from ChEMBL version 35 to rigorously evaluate Boltz-2’s performance for affinity prediction. The dataset includes 356 unique protein targets and 10,933 compounds, carefully collected to ensure no overlap with the Boltz-2 training data. Binding affinity measurements were standardized into pChEMBL values and linked to the compound SMILES and protein UniProt accessions. Using this benchmark dataset, we compared the performance of the original Boltz-2 model and its NVIDIA Inference Microservice (NIM) implementation. The results showed that the original Boltz-2 and NIM achieved comparable and fair predictive performance across targets (mean absolute error of approximately 0.9), while NIM reduced computational time by approximately 60–90%. The error analysis indicated that no clear correlation existed between the prediction errors and sequence or compound novelty relative to the Boltz-2 training data, underscoring the model’s broad coverage. This work provides a transparent and reproducible benchmark for evaluating AI-driven affinity prediction models and offers valuable insights into Boltz-2’s applicability, limitations, and potential as a practical tool for data-driven drug discovery.

Chem-Bio Informatics JournalVol. 26(0)
Keio University (JP), RIKEN Center for Computational Science (JP), RIKEN Center for Integrative Medical Sciences (JP), Molecular Biology Consortium (US)
Openalex Percentile: Top 19%
Protein Structure and Dynamics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.