Downstream Task-Aware Cloud Removal for Very-High-Resolution Remote Sensing Images: An Information Loss Perspective

Cloud removal (CR) methods have been widely studied and discussed to address the issue of cloud occlusion in Earth observation tasks. Existing CR methods heavily rely on image similarity metrics such as Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) to evaluate the quality of CR results. However, due to factors including rapid changes in landforms and viewpoint differences between cloudy and reference images, image similarity metrics could be ineffective, even misleading. To address these challenges, this study investigates CR by evaluating whether CR algorithms effectively produce information beneficial for downstream tasks. We introduce CUHKCR-EXT, the first very-high-resolution CR dataset explicitly designed for post-CR downstream task performance assessment. Furthermore, we propose DFCFormer, a dynamic filter-based transformer that generates adaptive kernels conditioned on cloud characteristics, enabling more precise recovery across diverse cloud types within a unified framework. In addition, we design a feature alignment loss that enforces consistency between cloud-removed and reference features at the semantic level, which guides the model to retain landform-relevant information crucial for downstream analysis. Using scene classification as a representative downstream task, we conduct extensive experiments and evaluate performance using both image similarity and information loss metrics. The results demonstrate that the proposed method achieves strong performance across all evaluated metrics. More importantly, the improvements lie not only in image similarity but also in the preservation of task-relevant semantics, which enhances the effective quality of output images for downstream applications rather than merely their visual fidelity. The project code will be released at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/wzy6055/DFCFormer</uri>.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2025-01-01
DOI
https://doi.org/10.1109/jstars.2025.3610641
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Downstream Task-Aware Cloud Removal for Very-High-Resolution Remote Sensing Images: An Information Loss Perspective

Man-On Pun, Xianping Ma, Ziyao Wang
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Advanced Image Fusion Techniques
article

Downstream Task-Aware Cloud Removal for Very-High-Resolution Remote Sensing Images: An Information Loss Perspective

Man-On Pun, Xianping Ma, Ziyao Wang
article en

Abstract

Cloud removal (CR) methods have been widely studied and discussed to address the issue of cloud occlusion in Earth observation tasks. Existing CR methods heavily rely on image similarity metrics such as Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) to evaluate the quality of CR results. However, due to factors including rapid changes in landforms and viewpoint differences between cloudy and reference images, image similarity metrics could be ineffective, even misleading. To address these challenges, this study investigates CR by evaluating whether CR algorithms effectively produce information beneficial for downstream tasks. We introduce CUHKCR-EXT, the first very-high-resolution CR dataset explicitly designed for post-CR downstream task performance assessment. Furthermore, we propose DFCFormer, a dynamic filter-based transformer that generates adaptive kernels conditioned on cloud characteristics, enabling more precise recovery across diverse cloud types within a unified framework. In addition, we design a feature alignment loss that enforces consistency between cloud-removed and reference features at the semantic level, which guides the model to retain landform-relevant information crucial for downstream analysis. Using scene classification as a representative downstream task, we conduct extensive experiments and evaluate performance using both image similarity and information loss metrics. The results demonstrate that the proposed method achieves strong performance across all evaluated metrics. More importantly, the improvements lie not only in image similarity but also in the preservation of task-relevant semantics, which enhances the effective quality of output images for downstream applications rather than merely their visual fidelity. The project code will be released at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/wzy6055/DFCFormer</uri>.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
Chinese University of Hong Kong, Shenzhen (CN), Southwest Jiaotong University (CN)
Openalex Percentile: Top 64%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.