ViT-ISRGAN: A High-Quality Super-Resolution Reconstruction Method for Multispectral Remote Sensing Images
The reflective characteristics of remote sensing image information depend on the scale of the observed area, with high-resolution images providing more detailed feature information. Currently, monitoring refined industries and extracting regional information necessitate higher-resolution remote sensing images. Super-resolution reconstruction of remote sensing multispectral images not only enhances the spatial resolution of these images but also preserves and improves the spectral information of multispectral data, thereby providing richer ground object information and more accurate environmental monitoring data. To improve the effectiveness of feature extraction in the generator network while maintaining model efficiency, this paper proposes the Vision Transformer Improved Super-Resolution Generative Adversarial Network (ViT-ISRGAN) model. This model is an improvement upon the original SRGAN super-resolution image reconstruction method, incorporating lightweight network modules, channel attention modules, spatial-spectral residual attention, and the Vision Transformer structure. The ViT-ISRGAN model focuses on reconstructing four types of typical ground objects based on Sentinel-2 images: urban, water, farmland, and forest. Results indicate that the ViT-ISRGAN model excels in capturing texture details and color restoration, effectively extracting spectral and texture information from multispectral remote sensing images across various scenes. Compared to other super-resolution models, this approach demonstrates superior effectiveness and performance in the super-resolution (SR) tasks of remote sensing multispectral images. For study replication, the source code will be released at: <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <uri>https://github.com/RS-agr/ViT-ISRGAN</uri></b>
Authors
- Hengqian Zhao (ORCID: https://orcid.org/0000-0003-0776-142X)
- Pan Wang (ORCID: https://orcid.org/0000-0003-2846-9882)
- Zihan Li (ORCID: https://orcid.org/0009-0004-3839-0611)
- Yifeng Yang
- Xiadan Huangfu
Institutions
- China University of Mining and Technology (CN)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jstars.2025.3527226
- Citations
- 5
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 5.68
Funders
- National Natural Science Foundation of China