Benchmarking Statistical Methods for Environmental Chemical Mixtures: Prediction, Interaction Detection, and an Applied Analysis of Metals, Essential Elements and Diabetes

Background. Human populations are exposed to complex chemical mixtures, making interaction detection a central challenge in environmental epidemiology. We benchmarked methods for prediction and recovery of interaction structure. Methods. Eight approaches—main-effects Lasso (glmnet_main), interaction Lasso (glmnet_int), hierNet, Random Forests, Bayesian Kernel Machine Regression (BKMR), quantile g-computation (qgcomp), weighted quantile sum regression (gWQS) and SuperLearner—were evaluated across eight linear/nonlinear, additive/interaction, continuous/binary data-generating processes (500 replicates each). Every method completed in all 500 replicates of all eight scenarios. Prediction was assessed on held-out test data using observed-outcome and oracle-referenced metrics; interaction detection was assessed against three known pairwise interactions among 45 candidate pairs, using both hard selection and a threshold-free ranking criterion. BKMR was evaluated at 2000 versus 25,000 MCMC iterations with multi-chain convergence diagnostics. Sensitivity analyses varied sample size, exposure correlation, signal strength, and interaction form. BKMR was also applied illustratively to six metals and prevalent diabetes in NHANES. Results. In additive settings, observed-outcome prediction was similar across methods, but oracle-referenced continuous-outcome error differed by up to six-fold. With interactions, interaction-aware methods clearly outperformed additive-only approaches on the continuous oracle-referenced metrics: in LMI, the oracle MSE was 1.57 for hierNet and 1.87 for glmnet_int against 3.80 for glmnet_main and 4.94 for qgcomp. glmnet_int and hierNet showed comparable sensitivity; hierNet had a modestly lower mean per-replicate false discovery proportion in paired comparisons, while pooled false discovery favored hierNet in the continuous scenarios and glmnet_int in the binary ones; pooled false discovery rates were 0.79 to 0.82 in every interaction scenario, so roughly four in five selected pairs were false. In the scenarios without true interactions, the pooled false discovery rate was exactly 1. Under threshold-free ranking, BKMR was competitive with the penalized methods (pair-ranking AUC: 0.758 to 0.781 across the four interaction scenarios). BKMR’s apparent instability at 2000 iterations reflected inadequate sampling: 93% of monitored parameters had a Gelman–Rubin statistic above 1.1 and the minimum effective sample size was 7.5, whereas at 25,000 iterations the median statistic was 1.02 and the oracle MSE in LMI fell from 6.38 to 2.08. In NHANES, lead, manganese, and iron had the highest posterior inclusion probabilities, with predominantly nonlinear exposure–response functions. Conclusions. Method choice matters most when interactions are present. Interaction-aware methods are preferable when joint effects are relevant, selected interactions require replication given the high false discovery burden, and BKMR comparisons should report sampling budgets and convergence diagnostics rather than treating a short chain as characteristic of the method.

Authors

Institutions

Publication Details

Journal
Stats
Published
2026-09-04
DOI
https://doi.org/10.3390/stats9050096
Primary Topic
Computational Drug Discovery Methods
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Benchmarking Statistical Methods for Environmental Chemical Mixtures: Prediction, Interaction Detection, and an Applied Analysis of Metals, Essential Elements and Diabetes

Emmanuel Obeng-Gyasi, Aderonke Gbemi Adetunji
Stats
Computational Drug Discovery Methods
article

Benchmarking Statistical Methods for Environmental Chemical Mixtures: Prediction, Interaction Detection, and an Applied Analysis of Metals, Essential Elements and Diabetes

Emmanuel Obeng-Gyasi, Aderonke Gbemi Adetunji
article en

Abstract

Background. Human populations are exposed to complex chemical mixtures, making interaction detection a central challenge in environmental epidemiology. We benchmarked methods for prediction and recovery of interaction structure. Methods. Eight approaches—main-effects Lasso (glmnet_main), interaction Lasso (glmnet_int), hierNet, Random Forests, Bayesian Kernel Machine Regression (BKMR), quantile g-computation (qgcomp), weighted quantile sum regression (gWQS) and SuperLearner—were evaluated across eight linear/nonlinear, additive/interaction, continuous/binary data-generating processes (500 replicates each). Every method completed in all 500 replicates of all eight scenarios. Prediction was assessed on held-out test data using observed-outcome and oracle-referenced metrics; interaction detection was assessed against three known pairwise interactions among 45 candidate pairs, using both hard selection and a threshold-free ranking criterion. BKMR was evaluated at 2000 versus 25,000 MCMC iterations with multi-chain convergence diagnostics. Sensitivity analyses varied sample size, exposure correlation, signal strength, and interaction form. BKMR was also applied illustratively to six metals and prevalent diabetes in NHANES. Results. In additive settings, observed-outcome prediction was similar across methods, but oracle-referenced continuous-outcome error differed by up to six-fold. With interactions, interaction-aware methods clearly outperformed additive-only approaches on the continuous oracle-referenced metrics: in LMI, the oracle MSE was 1.57 for hierNet and 1.87 for glmnet_int against 3.80 for glmnet_main and 4.94 for qgcomp. glmnet_int and hierNet showed comparable sensitivity; hierNet had a modestly lower mean per-replicate false discovery proportion in paired comparisons, while pooled false discovery favored hierNet in the continuous scenarios and glmnet_int in the binary ones; pooled false discovery rates were 0.79 to 0.82 in every interaction scenario, so roughly four in five selected pairs were false. In the scenarios without true interactions, the pooled false discovery rate was exactly 1. Under threshold-free ranking, BKMR was competitive with the penalized methods (pair-ranking AUC: 0.758 to 0.781 across the four interaction scenarios). BKMR’s apparent instability at 2000 iterations reflected inadequate sampling: 93% of monitored parameters had a Gelman–Rubin statistic above 1.1 and the minimum effective sample size was 7.5, whereas at 25,000 iterations the median statistic was 1.02 and the oracle MSE in LMI fell from 6.38 to 2.08. In NHANES, lead, manganese, and iron had the highest posterior inclusion probabilities, with predominantly nonlinear exposure–response functions. Conclusions. Method choice matters most when interactions are present. Interaction-aware methods are preferable when joint effects are relevant, selected interactions require replication given the high false discovery burden, and BKMR comparisons should report sampling budgets and convergence diagnostics rather than treating a short chain as characteristic of the method.

StatsVol. 9(5)
North Carolina Agricultural and Technical State University (US)
National Institute of General Medical Sciences
Good health and well-being
Openalex Percentile: Top 9%
Computational Drug Discovery Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.