Dual-Branch Rectangle Transformer for Hierarchical Hyperspectral Super Resolution via Spectral Reversion Contrastive Learning
Fusion-based hyperspectral super-resolution methods use complementary data to address single-source limitations. However, existing approaches prioritize spatial resolution and color fidelity, neglecting spectral preservation—critical for data interpretability. This oversight, combined with the limited adaptability of conventional spectral constraint methods, causes significant spectral distortions in high-resolution outputs. Multiscale feature integration issues further lead to inadequate detail restoration. To tackle these, we propose DRT-Net. Our dual-branch rectangular transformer uses cross-attention to fuse spatial-spectral features, enhancing inter-modality interactions. The scale-adaptive aggregator dynamically selects multiscale features for accurate spectral modeling and detail recovery. Additionally, a contrastive learning mechanism enforces spectral feature similarity to ground truth, offering a new approach for modeling complex hyperspectral distributions. Extensive experiments conducted on six mainstream hyperspectral datasets a real-world dataset demonstrated that the proposed DRT-Net outperformed state-of-the-art methods. Furthermore, our network exhibited robust performance and versatility in various scenarios. The related code will be available at https://github.com/phaeton2017/DRTNet.
Authors
- Kai Xü (ORCID: https://orcid.org/0000-0001-6310-2977)
- Weiwei Zhao (ORCID: https://orcid.org/0000-0001-8507-1921)
- Yan Wang (ORCID: https://orcid.org/0000-0001-9324-4191)
- Yongyi Chen (ORCID: https://orcid.org/0000-0003-4420-7145)
Institutions
- Anhui University (CN)
- State Key Laboratory of Remote Sensing Science (CN)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jstars.2025.3581202
- Citations
- 1
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.14