Evaluating CMAQ Representation of Wildfire PM₂.₅ in California (2008–2018): Regime-Dependent Performance and Nonlinear Error Structure
Abstract We evaluated daily paired Community Multiscale Air Quality (CMAQ) estimates and observations during California fire seasons (June–October), 2008–2018, using conventional metrics, classifications at 12 and 35 µg m⁻³, two case studies, and a leakage-resistant Random Forest diagnostic. After quarantining 18 CMAQ total PM₂.₅ values above 557 µg m⁻³ without capping, the primary analysis contained 187,051 records. Observed and modeled means were 10.69 and 9.29 µg m⁻³; Pearson r was 0.502 (r² = 0.252), mean bias was − 1.40 µg m⁻³, and RMSE was 9.96 µg m⁻³. CMAQ detected 45.4% of observed events at the descriptive/former annual level of 12 µg m⁻³ and 40.8% at the current 35 µg m⁻³ 24-hour standard level. At 35 µg m⁻³, CMAQ produced more events overall but missed 1,273 of 2,151 observed events because modeled and observed events often did not coincide by site-day. The Random Forest excluded observed PM₂.₅, CMAQ total PM₂.₅, and the no-fire component from its primary features. In an untouched site-year test partition (n = 37,430), R² was 0.711, RMSE was 5.82 µg m⁻³, and MAE was 3.44 µg m⁻³; fire-only CMAQ PM₂.₅ was the dominant predictor. CMAQ remains useful for regional and multi-year analyses, but paired-event detection and localized extreme-smoke estimates require explicit uncertainty treatment.
Authors
- Sambit Bhattacharya (ORCID: https://orcid.org/0000-0001-6407-0217)
- John C. Flunker (ORCID: https://orcid.org/0000-0003-0715-6254)
- Rachel E. Connolly (ORCID: https://orcid.org/0000-0002-0728-1779)
- Joseph L. Wilkins (ORCID: https://orcid.org/0000-0003-1888-787X)
- Claire L. Schollaert (ORCID: https://orcid.org/0000-0002-5046-0414)
- Miriam E. Marlier (ORCID: https://orcid.org/0000-0001-9333-8411)
- Christopher S. Blaszczak-Boxe (ORCID: https://orcid.org/0000-0002-5288-961X)
- Eimy Bonilla (ORCID: https://orcid.org/0000-0003-1448-6438)
- Mohammad Z. Al‐Hamdan (ORCID: https://orcid.org/0000-0001-8772-4885)
- Osinachi F. Ajoku (ORCID: https://orcid.org/0000-0002-3973-471X)
- Samuel Kane
- Daja Elum (ORCID: https://orcid.org/0009-0007-7224-867X)
- Jose Perez-Chavez
- Olutoyosi Oyelowo
- Jihoon Jung
- Huikyo Lee
Institutions
- University of North Carolina at Chapel Hill (US)
- University of Iowa (US)
- Jet Propulsion Laboratory (US)
- Howard University (US)
- University of California, Los Angeles (US)
- Fayetteville State University (US)
- University of Mississippi (US)
Publication Details
- Journal
- Research Square
- Published
- 2026-11-01
- DOI
- https://doi.org/10.21203/rs.3.rs-11167409/v1
- Primary Topic
- Atmospheric chemistry and aerosols
- Type
- preprint
Funders
- National Science Foundation
- U.S. Department of Energy
- National Aeronautics and Space Administration
- John D. and Catherine T. MacArthur Foundation
- Gordon and Betty Moore Foundation
- Science for Nature and People Partnership
- National Institutes of Health
- U.S. Forest Service
- Office of Advanced Research Computing, Rutgers, The State University of New Jersey
- Northern Research Station