Pre-Training Synthetic Accessibility Filtering in PyRMD under Transferred Percentile Cutoffs across 95 Target Data Sets

Abstract Synthetic accessibility filtering before cross-validation changes both the compounds available for learning and those used to evaluate ligand-based virtual screening models. We assessed SAscore filtering in PyRMD using SA-Filter Impact Benchmarking (SA-FIB), with 95 unfiltered target data sets and 438 filtered conditions across five thresholds. Historical residual-distance percentile cutoffs were transferred, while absolute epsilon values were estimated within each training subset. Mean paired F1 differences were −0.1078, −0.0361, −0.0147, −0.0074, and −0.0011 at SA ≤ 2.5, 3.0, 3.5, 4.0, and 5.0, respectively, relative to the corresponding eligible-cohort baselines. At SA ≤ 5.0, the F1 difference was not significant after Bonferroni correction, while ROC-AUC and PRC-AUC increased by 0.005085 and 0.003060. Combining duplicated processed pools into 92 units retained significance for ROC-AUC but not PRC-AUC. Reoptimizing percentile cutoffs within inner folds for the 92 eligible SA ≤ 3.5 data sets changed mean outer-fold F1 by +0.000294, with 30 improvements, 22 ties, and 40 decreases. Responses varied by target and metric. Historical parameter selection, reused outer folds, and differences between baseline and filtered evaluation populations limit interpretation to sensitivity within this PyRMD protocol. These findings support target-specific validation of synthetic accessibility filters.

Authors

Institutions

Publication Details

Journal
ACS Omega
Published
2026-11-16
DOI
https://doi.org/10.1021/acsomega.6c10178
Primary Topic
Computational Drug Discovery Methods
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Pre-Training Synthetic Accessibility Filtering in PyRMD under Transferred Percentile Cutoffs across 95 Target Data Sets

Fernanda Guilhon‐Simplicio, Fábio J. N. Ferreira, Tallita Marques Machado
ACS Omega
Computational Drug Discovery Methods
article

Pre-Training Synthetic Accessibility Filtering in PyRMD under Transferred Percentile Cutoffs across 95 Target Data Sets

Fernanda Guilhon‐Simplicio, Fábio J. N. Ferreira, Tallita Marques Machado
article en

Abstract

Abstract Synthetic accessibility filtering before cross-validation changes both the compounds available for learning and those used to evaluate ligand-based virtual screening models. We assessed SAscore filtering in PyRMD using SA-Filter Impact Benchmarking (SA-FIB), with 95 unfiltered target data sets and 438 filtered conditions across five thresholds. Historical residual-distance percentile cutoffs were transferred, while absolute epsilon values were estimated within each training subset. Mean paired F1 differences were −0.1078, −0.0361, −0.0147, −0.0074, and −0.0011 at SA ≤ 2.5, 3.0, 3.5, 4.0, and 5.0, respectively, relative to the corresponding eligible-cohort baselines. At SA ≤ 5.0, the F1 difference was not significant after Bonferroni correction, while ROC-AUC and PRC-AUC increased by 0.005085 and 0.003060. Combining duplicated processed pools into 92 units retained significance for ROC-AUC but not PRC-AUC. Reoptimizing percentile cutoffs within inner folds for the 92 eligible SA ≤ 3.5 data sets changed mean outer-fold F1 by +0.000294, with 30 improvements, 22 ties, and 40 decreases. Responses varied by target and metric. Historical parameter selection, reused outer folds, and differences between baseline and filtered evaluation populations limit interpretation to sensitivity within this PyRMD protocol. These findings support target-specific validation of synthetic accessibility filters.

ACS Omega
Universidade Federal de Minas Gerais (BR), Universidade Federal do Amazonas (BR)
Fundação de Amparo à Pesquisa do Estado de São Paulo, Coordenação de Aperfeiçoamento de Pessoal de Nível Superior, Fundação de Amparo à Pesquisa do Estado de Minas Gerais
Good health and well-being
Computational Drug Discovery Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon