Attention mechanism augmented random forest model for multiple air pollutants estimation

• MPA-RF model can estimate six air pollutants simultaneously with high accuracy. • Attention mechanism coupled into RF can enhance the retrieval performance. • An estimation accuracy improvement of up to 26% was achieved. • Hourly six air pollutants can be generated simultaneously and seamlessly. Machine learning techniques based on satellite observations energize the derivation of near-surface air pollutant concentrations. However, most of previous studies mainly focused on estimating single air pollutant concentration, ignoring the interactions and dependencies between different air pollutants. Therefore, we proposed a Multiple Pollutants simultaneous estimation method based on Attention mechanism augmented Random Forest model (MPA-RF), including PM 2.5 , PM 10 , O 3 , NO 2 , CO and SO 2 . Specifically, self-attention mechanism was incorporated with the multi-output random forest first to emphasize pertinent features in inputs during model training. Additionally, the multi-head self-attention was also integrated to derive the interactions and temporal dependencies of different air pollutants from historical data. Satellite observations from Advanced Himawari Imager (AHI) in three major urban agglomerations in China were extracted to demonstrate the model performance using sample- and site-based cross-validation schemes. Results elucidate that the proposed model is capable of deriving simultaneous estimations of six air pollutants with high accuracy, R 2 ranging from 0.74 to 0.93. Benefiting from the consideration of interactions and dependencies between different air pollutants, the proposed model outperforms other single-task contrast models with an R 2 improvement ranging from 9% to 26%. Moreover, the derived seamless estimations offer a basis for air pollution spatio-temporal patterns and dynamic evolution analysis with time-saving and efficient manner.

Authors

Institutions

Publication Details

Journal
International Journal of Applied Earth Observation and Geoinformation
Published
2025-06-16
DOI
https://doi.org/10.1016/j.jag.2025.104661
Primary Topic
Air Quality Monitoring and Forecasting
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Attention mechanism augmented random forest model for multiple air pollutants estimation

Man Sing Wong, Xinyu Yu, Kwon‐Ho Lee
International Journal of Applied Earth Observation and Geoinformation
Air Quality Monitoring and Forecasting
article

Attention mechanism augmented random forest model for multiple air pollutants estimation

Man Sing Wong, Xinyu Yu, Kwon‐Ho Lee
article en

Abstract

• MPA-RF model can estimate six air pollutants simultaneously with high accuracy. • Attention mechanism coupled into RF can enhance the retrieval performance. • An estimation accuracy improvement of up to 26% was achieved. • Hourly six air pollutants can be generated simultaneously and seamlessly. Machine learning techniques based on satellite observations energize the derivation of near-surface air pollutant concentrations. However, most of previous studies mainly focused on estimating single air pollutant concentration, ignoring the interactions and dependencies between different air pollutants. Therefore, we proposed a Multiple Pollutants simultaneous estimation method based on Attention mechanism augmented Random Forest model (MPA-RF), including PM 2.5 , PM 10 , O 3 , NO 2 , CO and SO 2 . Specifically, self-attention mechanism was incorporated with the multi-output random forest first to emphasize pertinent features in inputs during model training. Additionally, the multi-head self-attention was also integrated to derive the interactions and temporal dependencies of different air pollutants from historical data. Satellite observations from Advanced Himawari Imager (AHI) in three major urban agglomerations in China were extracted to demonstrate the model performance using sample- and site-based cross-validation schemes. Results elucidate that the proposed model is capable of deriving simultaneous estimations of six air pollutants with high accuracy, R 2 ranging from 0.74 to 0.93. Benefiting from the consideration of interactions and dependencies between different air pollutants, the proposed model outperforms other single-task contrast models with an R 2 improvement ranging from 9% to 26%. Moreover, the derived seamless estimations offer a basis for air pollution spatio-temporal patterns and dynamic evolution analysis with time-saving and efficient manner.

International Journal of Applied Earth Observation and GeoinformationVol. 141
Gangneung–Wonju National University (KR), Hong Kong Polytechnic University (HK)
Openalex Percentile: Top 87%
Air Quality Monitoring and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Attention mechanism augmented random forest model for multiple air pollutants estimation — Man Sing Wong, Xinyu Yu, et al. · International Journal of Applied Earth Observation and Geoinformation (2025) | TGRS Research Map | TGRS