Hyperspectral Compressive Image Reconstruction With Deep Tucker Decomposition and Spatial–Spectral Learning Network

Abstract

Hyperspectral compressive imaging has taken advantage of compressive sensing theory to capture spectral information of the dynamic world in recent decades of years, where an optical encoder is employed to compress high dimensional signals into a single 2-D measurement. The core issue is how to reconstruct the underlying hyperspectral image (HSI), although deep neural network methods have achieved much success in compressed sensing image reconstruction in recent years, they still have some unsolved issues, such as tradeoffs between performance and efficiency, and accurate exploitation of cubic structure information. In this article, we propose a deep Tucker decomposition and spatial–spectral learning network (DS-net) to learn the tensor low-lank structure features and spatial–spectral correlation of HSI for reconstruction quality promotion. Inspired by tensor decomposition, we first construct a deep Tucker decomposition module to learn the principal components from different modes of the image features. Then, we cascade a series of decomposition modules to learn multihierarchical features. Furthermore, to jointly capture the spatial–spectral correlation of HSI, we propose a spatial–spectral correlation learning module in a U-net structure for more robust reconstruction performance. Finally, experimental results on both synthetic and real datasets demonstrate the superiority of the proposed method compared to several state-of-the-art methods in quantitative assessment and visual effects.

Keywords

• Deep Tucker decomposition
• deep neural network
• hyperspectral compressive imaging
• spatial–spectral correlation