Downstream Task-Aware Cloud Removal for Very-High-Resolution Remote Sensing Images: An Information Loss Perspective
Cloud removal (CR) methods have been widely studied and discussed to address the issue of cloud occlusion in Earth observation tasks. Existing CR methods heavily rely on image similarity metrics such as Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) to evaluate the quality of CR results. However, due to factors including rapid changes in landforms and viewpoint differences between cloudy and reference images, image similarity metrics could be ineffective, even misleading. To address these challenges, this study investigates CR by evaluating whether CR algorithms effectively produce information beneficial for downstream tasks. We introduce CUHKCR-EXT, the first very-high-resolution CR dataset explicitly designed for post-CR downstream task performance assessment. Furthermore, we propose DFCFormer, a dynamic filter-based transformer that generates adaptive kernels conditioned on cloud characteristics, enabling more precise recovery across diverse cloud types within a unified framework. In addition, we design a feature alignment loss that enforces consistency between cloud-removed and reference features at the semantic level, which guides the model to retain landform-relevant information crucial for downstream analysis. Using scene classification as a representative downstream task, we conduct extensive experiments and evaluate performance using both image similarity and information loss metrics. The results demonstrate that the proposed method achieves strong performance across all evaluated metrics. More importantly, the improvements lie not only in image similarity but also in the preservation of task-relevant semantics, which enhances the effective quality of output images for downstream applications rather than merely their visual fidelity. The project code will be released at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/wzy6055/DFCFormer</uri>.
Authors
- Man-On Pun (ORCID: https://orcid.org/0000-0003-3316-5381)
- Xianping Ma (ORCID: https://orcid.org/0000-0002-2180-2964)
- Ziyao Wang
Institutions
- Chinese University of Hong Kong, Shenzhen (CN)
- Southwest Jiaotong University (CN)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jstars.2025.3610641
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00