Enhancing Blood–BrainBarrier Penetration Predictionby Machine Learning-Based Integration of Novel and Existing, In Silicoand Experimental Molecular Parameters from a Standardized Database

Predicting blood–brain barrier (BBB) penetration is crucial for developing central nervous system (CNS) drugs, representing a significant hurdle in successful clinical phase I studies. One of the most valuable properties for this prediction is the polar surface area (PSA). However, molecular structures are missing geometric optimization, which, together with lack of standardization, leads to variations in calculation. Additionally, prediction rules have been established by combining different molecular properties such as the BBB score or CNS multiparameter optimization (CNS MPO). This study aims to create an approach for 3D PSA calculation, to directly apply this value in combination with a set of 23 other parameters in a novel machine learning (ML)-based scoring, and to further evaluate existing prediction models using a standardized database. We developed and analyzed a standardized data set derived from the same laboratory, encompassing 24 calculated and experimentally determined molecular parameters such as PSA from various models, HPLC log <i>P</i> values, and hydrogen bond characteristics for 154 radiolabeled molecules and licensed or well-characterized drugs. These molecules were classified into categories based on BBB penetration, nonpenetration, and interactions with efflux transporters. We supplemented these with a novel in silico 3D calculation of nonclassical PSA. Additionally, we have calculated published prediction rules based on this standardized and transparent database. Using these data, we trained various ML models within a 100-fold Monte Carlo cross-validation framework to derive a novel ML-based prediction score for BBB penetration and validated the three most used existing predictive rules. To interpret the influence of individual molecular parameters and different existing predictive rules, we employed explainable artificial intelligence methods including Shapley additive explanations (SHAP) and surrogate modeling. The ML approach outperformed existing scores for BBB penetration by applying a complex nonlinear integration of molecular properties, with the random forest model achieving the best performance for predicting binary BBB penetration (area under the receiver operating characteristic curve (AUC) 0.88, 95% confidence intervals: 0.87–0.90), and multiclass efflux transporter versus CNS-positive and CNS-negative prediction (AUC 0.82, 95% CI: 0.81–0.82). SHAP analysis revealed the multifactorial nature of the problem, highlighting the advantage of multivariate models over single predictive parameters. The ML model’s superior predictive capability was demonstrated in comparison with existing scoring systems, like the CNS MPO (AUC 0.53), the CNS MPO Positron emission tomography (PET) (AUC 0.51), and BBB score (AUC 0.68) while also enabling the identification of efflux transporter substrates and inhibitors. Our integrated ML approach, combining experimental and in silico measurements with novel in silico methods based on a standardized database including a plethora of different substance groups (licensed drugs and in vivo evaluated PET tracers), enhances the prediction of BBB penetration. This approach may reduce the reliance on extensive experimental measurements and animal testing, accelerating CNS drug development.

Publication Details

Journal
Figshare
Published
2025-03-04
DOI
https://doi.org/10.1021/acs.jcim.4c02212.s001
Primary Topic
Computational Drug Discovery Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Blood–BrainBarrier Penetration Predictionby Machine Learning-Based Integration of Novel and Existing, In Silicoand Experimental Molecular Parameters from a Standardized Database

Figshare
Computational Drug Discovery Methods
article

Enhancing Blood–BrainBarrier Penetration Predictionby Machine Learning-Based Integration of Novel and Existing, In Silicoand Experimental Molecular Parameters from a Standardized Database

article en

Abstract

Predicting blood–brain barrier (BBB) penetration is crucial for developing central nervous system (CNS) drugs, representing a significant hurdle in successful clinical phase I studies. One of the most valuable properties for this prediction is the polar surface area (PSA). However, molecular structures are missing geometric optimization, which, together with lack of standardization, leads to variations in calculation. Additionally, prediction rules have been established by combining different molecular properties such as the BBB score or CNS multiparameter optimization (CNS MPO). This study aims to create an approach for 3D PSA calculation, to directly apply this value in combination with a set of 23 other parameters in a novel machine learning (ML)-based scoring, and to further evaluate existing prediction models using a standardized database. We developed and analyzed a standardized data set derived from the same laboratory, encompassing 24 calculated and experimentally determined molecular parameters such as PSA from various models, HPLC log <i>P</i> values, and hydrogen bond characteristics for 154 radiolabeled molecules and licensed or well-characterized drugs. These molecules were classified into categories based on BBB penetration, nonpenetration, and interactions with efflux transporters. We supplemented these with a novel in silico 3D calculation of nonclassical PSA. Additionally, we have calculated published prediction rules based on this standardized and transparent database. Using these data, we trained various ML models within a 100-fold Monte Carlo cross-validation framework to derive a novel ML-based prediction score for BBB penetration and validated the three most used existing predictive rules. To interpret the influence of individual molecular parameters and different existing predictive rules, we employed explainable artificial intelligence methods including Shapley additive explanations (SHAP) and surrogate modeling. The ML approach outperformed existing scores for BBB penetration by applying a complex nonlinear integration of molecular properties, with the random forest model achieving the best performance for predicting binary BBB penetration (area under the receiver operating characteristic curve (AUC) 0.88, 95% confidence intervals: 0.87–0.90), and multiclass efflux transporter versus CNS-positive and CNS-negative prediction (AUC 0.82, 95% CI: 0.81–0.82). SHAP analysis revealed the multifactorial nature of the problem, highlighting the advantage of multivariate models over single predictive parameters. The ML model’s superior predictive capability was demonstrated in comparison with existing scoring systems, like the CNS MPO (AUC 0.53), the CNS MPO Positron emission tomography (PET) (AUC 0.51), and BBB score (AUC 0.68) while also enabling the identification of efflux transporter substrates and inhibitors. Our integrated ML approach, combining experimental and in silico measurements with novel in silico methods based on a standardized database including a plethora of different substance groups (licensed drugs and in vivo evaluated PET tracers), enhances the prediction of BBB penetration. This approach may reduce the reliance on extensive experimental measurements and animal testing, accelerating CNS drug development.

Figshare
Openalex Percentile: Top 51%
Computational Drug Discovery Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.