Extensive Feature-Inferring Deep Network for Hyperspectral and Multispectral Image Fusion

Hyperspectral (HS) and multispectral (MS) image fusion is the most favorable way to obtain a hyperspectral image that has high resolution in terms of spatial and spectral information. This fusion problem can be accomplished by formulating a mathematical model and solving it either analytically or iteratively. The mathematical solutions class has serious challenges, e.g., computation cost, manually tuning parameters, and the absence of imaging models that laboriously affect the fusion process. With the revolution of deep learning, the recent HS-MS image fusion techniques gained good outcomes by utilizing the power of the convolutional neural network (CNN) for feature extraction. Moreover, extracting intrinsic information, e.g., non-local spatial and global spectral features, is the most critical issue faced by deep learning methods. Therefore, this paper proposes an Extensive Feature-Inferring Deep Network (EFINet) with extensive-scale feature-interacting and global correlation refinement modules to improve the effectiveness of HS-MS image fusion. The proposed network retains the most vital information through the extensive-scale feature-interacting module in various feature scales. Moreover, the global semantic information is achieved by utilizing the global correlation refinement module. The proposed network is validated through rich experiments conducted on two popular datasets, the Houston and Chikusei datasets, and it attains good performance compared to the state-of-the-art HS-MS image fusion techniques.