Multiscale cross-fusion network for hyperspectral image classification

Abstract

Recently, hyperspectral image (HSI) classification methods based on deep-learning have attracted widespread attention. Convolutional neural networks, as a crucial deep-learning technique, have exhibited outstanding performance in HSI classification. However, there are still some challenges, such as limited labeled samples, and feature extraction of complex land cover objects. To address these challenges, in this paper, we propose a multiscale cross-fusion network for HSI classification. It consists of three components: a spectral signatures extraction network, a spatial features extraction network and a classification network, which are utilized to extract spectral signatures, extract spatial contextual information and generate classification results, respectively. Specifically, the cross-branch multiscale convolutional block and the channel global contextual attention are integrated to extract spectral signatures, and the cross-hierarchy multiscale convolutional blocks and the spatial global contextual attention are combined to extract spatial features. Furthermore, special fusion strategies are proposed in these blocks to promote the interaction between features and achieve better feature connectivity. A series of experiments are conducted on three public HCI datasets, and the results show that the overall accuracy of the proposed network is 0.57%, 0.61%, and 0.3% higher than that of the state-of-the-art method on the PU, SV, and HH datasets, respectively.

Keywords

• Convolutional neural network
• Hyperspectral image classification
• Multiscale features extraction
• Cross-fusion
• Attention mechanism