HiFiPL-Bench: A Fidelity-First and Bias-Aware Benchmark for Diagnosing Protein–Ligand Scoring Functions

Accurate prediction of protein-ligand binding affinities is fundamental to structure-based drug design, yet existing benchmarks are often limited by outdated structural coverage, uncertain local structural fidelity, and physicochemical or protocol-dependent bias. Here, we present HiFiPL-Bench, a fidelity-first and bias-aware benchmark curated from RCSB PDB and BindingDB through hierarchical filtering, manual electron-density validation, affinity verification, and property-matched decoy generation. Across nine representative scoring functions, HiFiPL-Bench revealed reduced performance in scoring, ranking, and most docking evaluations relative to CASF-2016, whereas a controlled screening-like task using computationally generated property-matched decoys produced model-specific gains and losses that altered relative rankings rather than uniformly lowering performance. Model-specific overlap and deoverlap analyses further showed that documented development-data exposure differed substantially among methods and that deoverlapped sensitivity analyses affected models and evaluation tasks nonuniformly. Together, these findings indicate that performance estimates remain sensitive to starting-structure curation, task-specific preparation, data set composition, decoy design, benchmark protocol, and recoverable development-data exposure. HiFiPL-Bench therefore provides a reusable diagnostic framework for evaluating scoring-function performance in a structurally curated and bias-aware benchmark setting.

Authors

Institutions

Publication Details

Journal
Journal of Chemical Information and Modeling
Published
2026-11-18
DOI
https://doi.org/10.1021/acs.jcim.6c03060
Primary Topic
Computational Drug Discovery Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

HiFiPL-Bench: A Fidelity-First and Bias-Aware Benchmark for Diagnosing Protein–Ligand Scoring Functions

Xiaodong Ren, Pengyao Jin, Mengguang Liu, Likang Zhai et al.
Journal of Chemical Information and Modeling
Computational Drug Discovery Methods
article

HiFiPL-Bench: A Fidelity-First and Bias-Aware Benchmark for Diagnosing Protein–Ligand Scoring Functions

Xiaodong Ren, Pengyao Jin, Mengguang Liu, Likang Zhai, Rugui Xiao, Yali Zhang
article en

Abstract

Accurate prediction of protein-ligand binding affinities is fundamental to structure-based drug design, yet existing benchmarks are often limited by outdated structural coverage, uncertain local structural fidelity, and physicochemical or protocol-dependent bias. Here, we present HiFiPL-Bench, a fidelity-first and bias-aware benchmark curated from RCSB PDB and BindingDB through hierarchical filtering, manual electron-density validation, affinity verification, and property-matched decoy generation. Across nine representative scoring functions, HiFiPL-Bench revealed reduced performance in scoring, ranking, and most docking evaluations relative to CASF-2016, whereas a controlled screening-like task using computationally generated property-matched decoys produced model-specific gains and losses that altered relative rankings rather than uniformly lowering performance. Model-specific overlap and deoverlap analyses further showed that documented development-data exposure differed substantially among methods and that deoverlapped sensitivity analyses affected models and evaluation tasks nonuniformly. Together, these findings indicate that performance estimates remain sensitive to starting-structure curation, task-specific preparation, data set composition, decoy design, benchmark protocol, and recoverable development-data exposure. HiFiPL-Bench therefore provides a reusable diagnostic framework for evaluating scoring-function performance in a structurally curated and bias-aware benchmark setting.

Journal of Chemical Information and Modeling
Guizhou University (CN)
Computational Drug Discovery Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon