CFFormer: Channel Fourier Transformer for Remote Sensing Super Resolution
The objective of super-resolution in remote sensing imagery is to enhance low-resolution images to recover high-quality details. With the rapid progress of deep learning technology, the deep learning-based super-resolution technology for remote sensing images has also made remarkable achievements. However, these methods encounter several challenges. They often struggle with processing long-range spatial information that encompasses complex scene changes, adversely affecting the image's coherence and accuracy. Furthermore, the lack of connectivity in feature extraction blocks hinders effective feature utilization in deeper network layers, leading to issues such as gradient vanishing and exploding. Additionally, constraints in the spatial domain of previous methods frequently result in severe shape distortion and blurring. To address these issues, this study proposes the CFFormer, a new super-resolution framework that employs the Swin Transformer as its core architecture and incorporates the Channel Fourier Block (CFB) to refine features in the frequency domain. The Global Attention Block (GAB) is also integrated to enhance global information capture, thereby improving the extraction of spatial features. To increase model stability and feature utilization efficiency, a Jump-Joint Fusion Mechanism is designed, culminating in a Residual Fusion Swin Transformer Block (RFSTB) that alleviates the gradient vanishing issue and optimizes feature reuse. Experimental results confirm the CFFormer's superior performance in remote sensing image reconstruction, demonstrating outstanding perceptual quality and reliability. Notably, the CFFormer achieves a Peak Signal-to-Noise Ratio (PSNR) of 29.83 dB on the UcMercedx4 dataset, surpassing the SwinIR method by approximately 0.5 dB, indicating a substantial enhancement.
Authors
- Qingqing Yang (ORCID: https://orcid.org/0000-0002-5829-5863)
- Wei Song (ORCID: https://orcid.org/0000-0002-0604-5563)
- Jian Wang (ORCID: https://orcid.org/0000-0002-0337-2657)
- Yanlin Du
- Huifang Xu
- Zexin Xie
Institutions
- Shanghai Jian Qiao University (CN)
- Shanghai Ocean University (CN)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2024-11-05
- DOI
- https://doi.org/10.1109/jstars.2024.3492044
- Citations
- 9
- Primary Topic
- Optical Polarization and Ellipsometry
- Type
- article
- Field-Weighted Citation Impact
- 1.66