Spatial-Aware Uncertainty Quantification for Low-Cost PM2.5 Sensors: GeoConformal Prediction vs. Monte Carlo Dropout Under Wildfire Distribution Shift

Low-cost air quality sensors can expand PM2.5 monitoring networks but require calibration against regulatory-grade monitors to correct systematic bias towards trustworthy observations. Although interest in predictive uncertainty for air quality estimation has increased, the reliability of uncertainty under spatial sparsity and wildfire-induced distribution shift remains poorly understood. With the increasing use of low-cost sensors during wildfire-smoke episodes, uncertainty quantification during calibration is essential to determine when corrected PM2.5 estimates are reliable enough to support near-real-time alert, public-health, and exposure-related decisions. This study presents a spatial uncertainty evaluation framework for trustworthy AI-enabled environmental sensing. The framework is implemented with a transformer-based PM2.5 calibration model and two uncertainty quantification methods, GeoConformal Prediction (GCP) and Monte Carlo Dropout (MCD), using sensor pairs in California and the Northeast United States. The calibration model achieved strong performance at short spatial distances, with test R2 values of 0.89 and 0.91 at the 1 km threshold in California and the Northeast, respectively, with accuracy declining as sensor separation increased. GCP generally produced calibration curves closer to the ideal diagonal, while MCD generated tighter prediction intervals under normal conditions. During wildfire events, the uncertainty performance depended on sensor separation. At short distances, MCD expanded its uncertainty intervals and captured PM2.5 spikes more effectively than GCP (71% vs. 61% coverage). At larger separations, MCD captured only 44% of elevated observations, whereas GCP widened its intervals and achieved 83% coverage. These results demonstrate that uncertainty reliability is strongly influenced by spatial separation and environmental conditions, highlighting the need for uncertainty-aware and spatially adaptive calibration of low-cost PM2.5 sensors for trustworthy actionable air quality observation.

Authors

Institutions

Publication Details

Journal
Atmosphere
Published
2026-07-16
DOI
https://doi.org/10.3390/atmos17070692
Primary Topic
Air Quality Monitoring and Forecasting
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Spatial-Aware Uncertainty Quantification for Low-Cost PM2.5 Sensors: GeoConformal Prediction vs. Monte Carlo Dropout Under Wildfire Distribution Shift

Mohammad Pourhomayoun, Joe T. Roberts, Chaowei Yang, Anusha Srirenganathan Malarvizhi et al.
Atmosphere
Air Quality Monitoring and Forecasting
article

Spatial-Aware Uncertainty Quantification for Low-Cost PM2.5 Sensors: GeoConformal Prediction vs. Monte Carlo Dropout Under Wildfire Distribution Shift

Mohammad Pourhomayoun, Joe T. Roberts, Chaowei Yang, Anusha Srirenganathan Malarvizhi, Seren Smith, George Chang, Kaylee Smith
article en

Abstract

Low-cost air quality sensors can expand PM2.5 monitoring networks but require calibration against regulatory-grade monitors to correct systematic bias towards trustworthy observations. Although interest in predictive uncertainty for air quality estimation has increased, the reliability of uncertainty under spatial sparsity and wildfire-induced distribution shift remains poorly understood. With the increasing use of low-cost sensors during wildfire-smoke episodes, uncertainty quantification during calibration is essential to determine when corrected PM2.5 estimates are reliable enough to support near-real-time alert, public-health, and exposure-related decisions. This study presents a spatial uncertainty evaluation framework for trustworthy AI-enabled environmental sensing. The framework is implemented with a transformer-based PM2.5 calibration model and two uncertainty quantification methods, GeoConformal Prediction (GCP) and Monte Carlo Dropout (MCD), using sensor pairs in California and the Northeast United States. The calibration model achieved strong performance at short spatial distances, with test R2 values of 0.89 and 0.91 at the 1 km threshold in California and the Northeast, respectively, with accuracy declining as sensor separation increased. GCP generally produced calibration curves closer to the ideal diagonal, while MCD generated tighter prediction intervals under normal conditions. During wildfire events, the uncertainty performance depended on sensor separation. At short distances, MCD expanded its uncertainty intervals and captured PM2.5 spikes more effectively than GCP (71% vs. 61% coverage). At larger separations, MCD captured only 44% of elevated observations, whereas GCP widened its intervals and achieved 83% coverage. These results demonstrate that uncertainty reliability is strongly influenced by spatial separation and environmental conditions, highlighting the need for uncertainty-aware and spatially adaptive calibration of low-cost PM2.5 sensors for trustworthy actionable air quality observation.

AtmosphereVol. 17(7)
Jet Propulsion Laboratory (US), George Mason University (US), California State University Los Angeles (US), University of Michigan (US)
National Science Foundation, National Aeronautics and Space Administration, National Institute of Advanced Industrial Science and Technology, National Oceanic and Atmospheric Administration, Goddard Space Flight Center
Openalex Percentile: Top 14%
Air Quality Monitoring and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.