Ziang Zhang, Patrick E. Brown, Meredith Franklin, and Samuel Perreault's contribution to the Discussion of ‘Methods for estimating the exposure–response curve to inform the new safety standards for fine particulate matter’ by Cork et al.

We would like to congratulate the authors on their commendable work investigating various exposure-response curve (ERC) estimation methods under different data-generating mechanisms.Simulations show that for the most part the design-based methods from the causal inference framework outperform their regression-based counterparts, although when the true ERC exhibits sub-linear behavior (e.g., sublinear,int ) the design-based Entropy-GAM performs worse than the original regression splines.The authors conjecture that this exception may stem from an insufficient number of knots placed in the low-exposure region.Regression splines are un-penalized smoothers, where the balance between flexibility and overfitting is managed though the number and placement of knots.Penalized methods manage this trade-off using an estimated smoothing parameter that penalizes basis function coefficients, typically with a quadratic penalty (see Green and Silverman, 1994).As the number of bases increases, penalized splines converge to an Integrated Wiener process, a specific type of Gaussian process (IWP, see Zhang et al., 2024).We repeat the authors' simulations of GAM and entropy-GAM models using three different smoothing specifications: 1) a penalized regression spline with four basis functions (what authors present); 2) an unpenalized regression spline with four basis functions; and 3) an approximation to a continuous IWP with 100 penalized basis functions.Smoothing parameters were estimated with maximum likelihood.Contrary to the authors' conjecture, the poor performance of the entropy-based GAM is not caused by the placement of knots.The unpenalized regression splines shown as green symbols are in most cases a modest improvement on the two penalized models, while the 100 basis function penalized model in blue is comparable to (and in some cases slightly better than) the four basis function penalized model in red.Four basis functions appear to be sufficient and penalizing is unnecessary, although the true ERC used to simulate the data is very smooth and different results would be expected when the underlying ERC is rougher.Also, in Perreault et al. (2024) we found that prediction intervals and coverage probabilities can be highly sensitive to the smoothing method, even when point predictions are not.Are the authors advocating for regression splines with a modest number of knots as the preferred method for ERC estimation in air pollution studies?Relative to the other types of model assumptions (i.e.independent observations, accurate exposure assessment) is limiting the curvature of the ERC a minor concern?Are there circumstances where a more flexible model with a principled choice of smoothing parameter is warranted? 1

Authors

Institutions

Publication Details

Journal
Journal of the Royal Statistical Society Series A (Statistics in Society)
Published
2025-05-02
DOI
https://doi.org/10.1093/jrsssa/qnaf051
Primary Topic
Air Quality and Health Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Ziang Zhang, Patrick E. Brown, Meredith Franklin, and Samuel Perreault's contribution to the Discussion of ‘Methods for estimating the exposure–response curve to inform the new safety standards for fine particulate matter’ by Cork et al.

Patrick J. Brown, Meredith Franklin, Samuel Perreault, Ziang Zhang
Journal of the Royal Statistical Society Series A (Statistics in Society)
Air Quality and Health Impacts
article

Ziang Zhang, Patrick E. Brown, Meredith Franklin, and Samuel Perreault's contribution to the Discussion of ‘Methods for estimating the exposure–response curve to inform the new safety standards for fine particulate matter’ by Cork et al.

Patrick J. Brown, Meredith Franklin, Samuel Perreault, Ziang Zhang
article en

Abstract

We would like to congratulate the authors on their commendable work investigating various exposure-response curve (ERC) estimation methods under different data-generating mechanisms.Simulations show that for the most part the design-based methods from the causal inference framework outperform their regression-based counterparts, although when the true ERC exhibits sub-linear behavior (e.g., sublinear,int ) the design-based Entropy-GAM performs worse than the original regression splines.The authors conjecture that this exception may stem from an insufficient number of knots placed in the low-exposure region.Regression splines are un-penalized smoothers, where the balance between flexibility and overfitting is managed though the number and placement of knots.Penalized methods manage this trade-off using an estimated smoothing parameter that penalizes basis function coefficients, typically with a quadratic penalty (see Green and Silverman, 1994).As the number of bases increases, penalized splines converge to an Integrated Wiener process, a specific type of Gaussian process (IWP, see Zhang et al., 2024).We repeat the authors' simulations of GAM and entropy-GAM models using three different smoothing specifications: 1) a penalized regression spline with four basis functions (what authors present); 2) an unpenalized regression spline with four basis functions; and 3) an approximation to a continuous IWP with 100 penalized basis functions.Smoothing parameters were estimated with maximum likelihood.Contrary to the authors' conjecture, the poor performance of the entropy-based GAM is not caused by the placement of knots.The unpenalized regression splines shown as green symbols are in most cases a modest improvement on the two penalized models, while the 100 basis function penalized model in blue is comparable to (and in some cases slightly better than) the four basis function penalized model in red.Four basis functions appear to be sufficient and penalizing is unnecessary, although the true ERC used to simulate the data is very smooth and different results would be expected when the underlying ERC is rougher.Also, in Perreault et al. (2024) we found that prediction intervals and coverage probabilities can be highly sensitive to the smoothing method, even when point predictions are not.Are the authors advocating for regression splines with a modest number of knots as the preferred method for ERC estimation in air pollution studies?Relative to the other types of model assumptions (i.e.independent observations, accurate exposure assessment) is limiting the curvature of the ERC a minor concern?Are there circumstances where a more flexible model with a principled choice of smoothing parameter is warranted? 1

Journal of the Royal Statistical Society Series A (Statistics in Society)Vol. 188(4)
University of Toronto (CA), University of Chicago (US)
Openalex Percentile: Top 88%
Air Quality and Health Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.