CCST: Lightweight Criss-Cross Swin Transformer for Remote Sensing Image Super-Resolution under Multi-Degradation Scenarios
Transformer-based methods excel in remote sensing image super-resolution (RSISR) due to their ability to capture abundant self-similarity textures and structural information, which are critical for restoring high-resolution details. However, the core component of these methods, the self-attention mechanism, requires substantial computational resources, resulting in a restriction of deployment on resource-constrained remote sensing devices. The redundant feature extraction and insufficient refinement of local features also cause the significant RSISR performance drop in multi-degradation scenarios where RSI often suffers from optical blur and transmission noise caused by adverse imaging environments. To mitigate the above limitations, we present a Lightweight Criss-Cross Swin Transformer (CCST) for Blind Remote Sensing Image Super-Resolution. Concretely, we introduce criss-cross encoding into the self-attention mechanism to establish criss-cross feature correlations of each pixel in an RSI. Along with the shifted window mechanism, repeated criss-cross encoding indirectly builds global feature dependencies. Compared to the conventional self-attention mechanism that spans the entire window, the proposed criss-cross self-attention mechanism drastically reduces computational overhead and feature redundancy while capturing more global information by using large-size windows. Furthermore, to enhance the ability of the RSISR model to extract local features while expanding its receptive field, we incorporate a gated feed-forward tiny network to integrate multi-scale features and introduce gated coefficient learning to adaptively filter redundant counterparts. Experimental results show that our CCST achieves superior performance with lower computational demand compared to state-of-the-art Transformer-based SR algorithms and traditional RSISR methods in multi-degradation scenarios.
Authors
- Shipeng Fu (ORCID: https://orcid.org/0000-0002-5015-3860)
- Kai Liu (ORCID: https://orcid.org/0000-0002-6433-6529)
- Xiaomin Yang (ORCID: https://orcid.org/0000-0002-1094-3841)
- Haoran Yang (ORCID: https://orcid.org/0000-0003-0751-6491)
Institutions
- Sichuan University (CN)
- Chengdu University of Information Technology (CN)
- Chengdu University of Technology (CN)
Publication Details
- Journal
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tgrs.2025.3604437
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Sichuan University