Spatiotemporal Interactive Learning for Cloud Removal Based on Multi-Temporal SAR–Optical Images
Optical remote sensing images suffer from information loss due to cloud interference, while Synthetic Aperture Radar (SAR), capable of all-weather and day–night imaging capabilities, provides crucial auxiliary data for cloud removal and reconstruction. However, existing cloud removal methods face the following key challenges: insufficient utilization of spatiotemporal information in multi-temporal data, and fusion challenges arising from fundamentally different imaging mechanisms between optical and SAR images. To address these challenges, a spatiotemporal feature interaction-based cloud removal method is proposed to effectively fuse SAR and optical images. Built upon a conditional generative adversarial network framework, the method incorporates three key modules: a multi-temporal spatiotemporal feature joint extraction module, a spatiotemporal information interaction module, and a spatiotemporal discriminator module. These components jointly establish a many-to-many spatiotemporal interactive learning network, which separately extracts and fuses spatiotemporal features from multi-temporal SAR–optical image pairs to generate temporally consistent, cloud-free image sequences. Experiments on both simulated and real datasets demonstrate the superior performance of the proposed method.
Authors
- Zhenfei Wang (ORCID: https://orcid.org/0009-0003-8407-8840)
- Xiangchao Meng (ORCID: https://orcid.org/0000-0001-9896-8690)
- Xu Chen (ORCID: https://orcid.org/0000-0003-0144-1775)
- Liang Chen (ORCID: https://orcid.org/0000-0002-2974-8616)
Institutions
- Ningbo University (CN)
Publication Details
- Journal
- Remote Sensing
- Published
- 2025-06-24
- DOI
- https://doi.org/10.3390/rs17132169
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Ningbo