Attention mechanism augmented random forest model for multiple air pollutants estimation
• MPA-RF model can estimate six air pollutants simultaneously with high accuracy. • Attention mechanism coupled into RF can enhance the retrieval performance. • An estimation accuracy improvement of up to 26% was achieved. • Hourly six air pollutants can be generated simultaneously and seamlessly. Machine learning techniques based on satellite observations energize the derivation of near-surface air pollutant concentrations. However, most of previous studies mainly focused on estimating single air pollutant concentration, ignoring the interactions and dependencies between different air pollutants. Therefore, we proposed a Multiple Pollutants simultaneous estimation method based on Attention mechanism augmented Random Forest model (MPA-RF), including PM 2.5 , PM 10 , O 3 , NO 2 , CO and SO 2 . Specifically, self-attention mechanism was incorporated with the multi-output random forest first to emphasize pertinent features in inputs during model training. Additionally, the multi-head self-attention was also integrated to derive the interactions and temporal dependencies of different air pollutants from historical data. Satellite observations from Advanced Himawari Imager (AHI) in three major urban agglomerations in China were extracted to demonstrate the model performance using sample- and site-based cross-validation schemes. Results elucidate that the proposed model is capable of deriving simultaneous estimations of six air pollutants with high accuracy, R 2 ranging from 0.74 to 0.93. Benefiting from the consideration of interactions and dependencies between different air pollutants, the proposed model outperforms other single-task contrast models with an R 2 improvement ranging from 9% to 26%. Moreover, the derived seamless estimations offer a basis for air pollution spatio-temporal patterns and dynamic evolution analysis with time-saving and efficient manner.
Authors
- Man Sing Wong (ORCID: https://orcid.org/0000-0002-6439-6775)
- Xinyu Yu (ORCID: https://orcid.org/0000-0002-8223-5625)
- Kwon‐Ho Lee (ORCID: https://orcid.org/0000-0002-0844-5245)
Institutions
- Gangneung–Wonju National University (KR)
- Hong Kong Polytechnic University (HK)
Publication Details
- Journal
- International Journal of Applied Earth Observation and Geoinformation
- Published
- 2025-06-16
- DOI
- https://doi.org/10.1016/j.jag.2025.104661
- Primary Topic
- Air Quality Monitoring and Forecasting
- Type
- article
- Field-Weighted Citation Impact
- 0.00