Spectral domain strategies for hyperspectral super-resolution: Transfer learning and channel enhance network

Abstract

As the network structures continue to innovate and evolve, significant achievements have been achieved in hyperspectral image super-resolution tasks. However, how to further explore the spectral domain potential from prior knowledge and channel-enhanced structures to achieve better performance has inspired the following two works: Firstly, to systematically compare prior knowledge of spectral with spatial domain for HSI-SR tasks, four transfer learning strategies are proposed. The superior performance of the Relevant Channel/Random Space (RCRS) strategy reveals the importance of spectral feature reconstruction in HSI-SR tasks. Meanwhile, an interesting phenomenon has been observed that even without training on real datasets, the model can already exhibit a core or even decent super-resolution capability based solely on prior knowledge of above four strategies. Secondly, a dual-branch channel network with complementary channel feature extraction (CCFE) and adjacent channel feature extraction (ACFE) module is designed for spectral feature enhancement, which demonstrate superior performance compared to state-of-the-art methods on six datasets. To conclude, the effectiveness of RCRS strategy with pseudo prior channel knowledge on seven dual-input and eight single-input networks, as well as superiority of the proposed channel-enhanced network indicate the importance of spectral properties for HSI-SR tasks.

Keywords

• Hyperspectral image super-resolution
• Transfer learning
• Convolutional neural network (CNN)
• Feature fusion