Spectral domain strategies for hyperspectral super-resolution: Transfer learning and channel enhance network
As the network structures continue to innovate and evolve, significant achievements have been achieved in hyperspectral image super-resolution tasks. However, how to further explore the spectral domain potential from prior knowledge and channel-enhanced structures to achieve better performance has inspired the following two works: Firstly, to systematically compare prior knowledge of spectral with spatial domain for HSI-SR tasks, four transfer learning strategies are proposed. The superior performance of the Relevant Channel/Random Space (RCRS) strategy reveals the importance of spectral feature reconstruction in HSI-SR tasks. Meanwhile, an interesting phenomenon has been observed that even without training on real datasets, the model can already exhibit a core or even decent super-resolution capability based solely on prior knowledge of above four strategies. Secondly, a dual-branch channel network with complementary channel feature extraction (CCFE) and adjacent channel feature extraction (ACFE) module is designed for spectral feature enhancement, which demonstrate superior performance compared to state-of-the-art methods on six datasets. To conclude, the effectiveness of RCRS strategy with pseudo prior channel knowledge on seven dual-input and eight single-input networks, as well as superiority of the proposed channel-enhanced network indicate the importance of spectral properties for HSI-SR tasks.
Authors
- Chen Yang (ORCID: https://orcid.org/0000-0001-5738-9641)
- Yang Wang (ORCID: https://orcid.org/0000-0002-7447-6330)
- Lifeng Bian (ORCID: https://orcid.org/0000-0001-6196-7424)
- Zhao Ding
- Zhi-Zhu Ge
Publication Details
- Journal
- International Journal of Applied Earth Observation and Geoinformation
- Published
- 2024-09-26
- DOI
- https://doi.org/10.1016/j.jag.2024.104180
- Citations
- 2
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.64
Funders
- National Natural Science Foundation of China