Relaxing the clear-sky assumption: Cloud-tolerant spatiotemporal fusion via mask-guided feature modulation and temporal-memory collaboration
The precise characterization of dynamic Earth surface processes relies on time-series remote sensing imagery with both high spatial fidelity and frequent temporal coverage. While spatiotemporal fusion (STF) bridges this resolution trade-off by integrating complementary observations, its practical application remains constrained by the idealized ”clear-sky assumption”. This requirement often favors the selection of temporally distant cloud-free acquisitions over temporally closer but cloud-contaminated observations, potentially reducing the relevance of reference information. To address this limitation, we propose CloudSTF, a robust framework designed to achieve high-fidelity reconstruction by effectively exploiting partially occluded observations. Our approach employs a Mask-guided Multi-scale Swin Transformer (M 2 ST) encoder to capture cloud spatial patterns and suppress noise propagation during feature extraction. This is coupled with a Cross-temporal Memory-guided Fusion (CTMF) module that adaptively integrates temporal trends with textural details retrieved from a spatio-temporal memory bank. To validate this paradigm, we introduce the Global Cloud-shrouded Regions (GCR-STF) benchmark, a geographically distributed dataset comprising 24 representative agricultural and urban sites across six continents. Extensive experiments demonstrate that CloudSTF consistently outperforms state-of-the-art methods. Additional assessments across varying cloud densities and diverse landscapes further demonstrate the robustness and applicability of CloudSTF under realistic cloud-contaminated conditions. These results suggest that CloudSTF provides a reliable solution for continuous Earth monitoring in realistic, cloud-prone environments. Source code and the GCR-STF benchmark are available at https://github.com/Sichen-Lu/CloudSTF .
Authors
- Juanjuan Jing (ORCID: https://orcid.org/0009-0002-0371-7245)
- Lei Yang (ORCID: https://orcid.org/0000-0001-8297-0868)
- Sichen Lu (ORCID: https://orcid.org/0009-0009-3215-6521)
- Jinsong Zhou (ORCID: https://orcid.org/0009-0006-4704-0685)
- Boyang Nie
- Junhua Yu
Institutions
- Chinese Academy of Sciences (CN)
- University of Macau (MO)
- China University of Geosciences (Beijing) (CN)
- Wuhan University (CN)
- Beijing Academy of Artificial Intelligence (CN)
- Aerospace Information Research Institute (CN)
- University of Chinese Academy of Sciences (CN)
- City University of Macau (MO)
Publication Details
- Journal
- International Journal of Applied Earth Observation and Geoinformation
- Published
- 2026-09-21
- DOI
- https://doi.org/10.1016/j.jag.2026.105571
- Primary Topic
- Image Enhancement Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00