HiFiPL-Bench: A Fidelity-First and Bias-Aware Benchmark for Diagnosing Protein–Ligand Scoring Functions
Accurate prediction of protein-ligand binding affinities is fundamental to structure-based drug design, yet existing benchmarks are often limited by outdated structural coverage, uncertain local structural fidelity, and physicochemical or protocol-dependent bias. Here, we present HiFiPL-Bench, a fidelity-first and bias-aware benchmark curated from RCSB PDB and BindingDB through hierarchical filtering, manual electron-density validation, affinity verification, and property-matched decoy generation. Across nine representative scoring functions, HiFiPL-Bench revealed reduced performance in scoring, ranking, and most docking evaluations relative to CASF-2016, whereas a controlled screening-like task using computationally generated property-matched decoys produced model-specific gains and losses that altered relative rankings rather than uniformly lowering performance. Model-specific overlap and deoverlap analyses further showed that documented development-data exposure differed substantially among methods and that deoverlapped sensitivity analyses affected models and evaluation tasks nonuniformly. Together, these findings indicate that performance estimates remain sensitive to starting-structure curation, task-specific preparation, data set composition, decoy design, benchmark protocol, and recoverable development-data exposure. HiFiPL-Bench therefore provides a reusable diagnostic framework for evaluating scoring-function performance in a structurally curated and bias-aware benchmark setting.
Authors
- Xiaodong Ren (ORCID: https://orcid.org/0000-0002-1438-6173)
- Pengyao Jin
- Mengguang Liu
- Likang Zhai
- Rugui Xiao
- Yali Zhang
Institutions
- Guizhou University (CN)
Publication Details
- Journal
- Journal of Chemical Information and Modeling
- Published
- 2026-11-18
- DOI
- https://doi.org/10.1021/acs.jcim.6c03060
- Primary Topic
- Computational Drug Discovery Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00