Quantitative fidelity, signal attribution, and cross-domain generalization of literature-derived machine learning in preclinical cancer nanomedicine

Introduction Literature-derived machine learning may guide preclinical cancer nanomedicine, but its value for predicting treatment efficacy depends on what it learns and where its predictions remain reliable. We examined quantitative predictive fidelity, the relative contributions of treatment context and nanoparticle design, and generalization across experimental domains. Methods We independently reanalysed the NanoAnalysis resource of 745 preclinical studies of inorganic nanoparticles in cancer. The released modelling matrix included 397 studies and 130 predictors. Repeated cross-validation assessed classification of >90% tumor-volume reduction relative to untreated controls and prediction of continuous reduction. Feature-family comparisons and grouped permutation analyses examined signal attribution. Last-author-grouped validation, within-corpus chronological tests and domain holdouts benchmarked against random holdouts matched for sample size and outcome-class counts assessed generalization. Results The full random forest achieved an out-of-fold area under the receiver operating characteristic curve (AUC) of 0.712 (95% bootstrap confidence interval 0.659–0.763), average precision of 0.688 and Brier score of 0.214. Continuous prediction explained little variation (R 2 = 0.118), with mean absolute error of 12.1 percentage points versus 12.9 for a training-fold median baseline. A 13-feature model comprising therapy modality and combination-therapy status achieved AUC 0.695, whereas nanoparticle-design-only features achieved 0.568. Removing treatment context reduced AUC to 0.607; removing nanoparticle-design features retained 0.686. Last-author grouping had little effect on discrimination, while the latest chronological test included only 30 studies and had wide uncertainty. Iron-oxide holdout AUC was 0.583 versus a matched-random median of 0.709, whereas gold showed little penalty. Discussion Moderate discrimination of high-response studies coexisted with limited prediction of response magnitude. Under the evaluated representation and models, treatment context carried most of the recoverable discriminatory signal, and transferability varied by material domain. For preclinical pharmacology, these findings support context-aware hypothesis generation and emphasize quantitative error and applicability-domain evaluation before using literature-derived predictions to select formulations.

Authors

Institutions

Publication Details

Journal
Frontiers in Pharmacology
Published
2026-11-16
DOI
https://doi.org/10.3389/fphar.2026.1984198
Primary Topic
Nanoparticle-Based Drug Delivery
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Quantitative fidelity, signal attribution, and cross-domain generalization of literature-derived machine learning in preclinical cancer nanomedicine

Zhen Huang, Wenhan Wu
1 links
Frontiers in Pharmacology
Nanoparticle-Based Drug Delivery
article

Quantitative fidelity, signal attribution, and cross-domain generalization of literature-derived machine learning in preclinical cancer nanomedicine

Zhen Huang, Wenhan Wu
article en

Abstract

Introduction Literature-derived machine learning may guide preclinical cancer nanomedicine, but its value for predicting treatment efficacy depends on what it learns and where its predictions remain reliable. We examined quantitative predictive fidelity, the relative contributions of treatment context and nanoparticle design, and generalization across experimental domains. Methods We independently reanalysed the NanoAnalysis resource of 745 preclinical studies of inorganic nanoparticles in cancer. The released modelling matrix included 397 studies and 130 predictors. Repeated cross-validation assessed classification of >90% tumor-volume reduction relative to untreated controls and prediction of continuous reduction. Feature-family comparisons and grouped permutation analyses examined signal attribution. Last-author-grouped validation, within-corpus chronological tests and domain holdouts benchmarked against random holdouts matched for sample size and outcome-class counts assessed generalization. Results The full random forest achieved an out-of-fold area under the receiver operating characteristic curve (AUC) of 0.712 (95% bootstrap confidence interval 0.659–0.763), average precision of 0.688 and Brier score of 0.214. Continuous prediction explained little variation (R 2 = 0.118), with mean absolute error of 12.1 percentage points versus 12.9 for a training-fold median baseline. A 13-feature model comprising therapy modality and combination-therapy status achieved AUC 0.695, whereas nanoparticle-design-only features achieved 0.568. Removing treatment context reduced AUC to 0.607; removing nanoparticle-design features retained 0.686. Last-author grouping had little effect on discrimination, while the latest chronological test included only 30 studies and had wide uncertainty. Iron-oxide holdout AUC was 0.583 versus a matched-random median of 0.709, whereas gold showed little penalty. Discussion Moderate discrimination of high-response studies coexisted with limited prediction of response magnitude. Under the evaluated representation and models, treatment context carried most of the recoverable discriminatory signal, and transferability varied by material domain. For preclinical pharmacology, these findings support context-aware hypothesis generation and emphasize quantitative error and applicability-domain evaluation before using literature-derived predictions to select formulations.

Frontiers in PharmacologyVol. 17
The Affiliated Yongchuan Hospital of Chongqing Medical University (CN)
Good health and well-being
Nanoparticle-Based Drug Delivery
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon