TDSSC: A Three-Directions Spectral–Spatial Convolution Neural Network for Hyperspectral Image Change Detection

Abstract

Change detection (CD) is a hot issue in the research of remote sensing technology. Hyperspectral images (HSIs) greatly promote the development of CD technology because of their high resolution in the spectral domain. However, some traditional CD methods currently applied to low-dimensional and multispectral images cannot adapt to the complex high-dimensional features of the HSIs. In addition, the spectral measurements of the HSI contain a lot of noise and redundancy, which greatly contaminates spectral-only information for CD. In order to fully extract the discriminant features of HSI to improve the accuracy of CD, this article proposes a three-directions spectral-spatial convolution neural network (TDSSC). A novel method for three-direction decomposition of hyperspectral change tensors is proposed-change tensor is decomposed along the spectral direction and two spatial directions to get a single tensor containing the spectral information and two kinds of tensors containing the spectral-spatial information. TDSSC uses 1-D convolution to extract spectral features from the spectral direction as well as reducing the tensor dimension, which helps the latter network to be lightweight and significantly improves the speed of change detection. Also, it uses 2-D convolution to extract spectral-spatial features from two spatial directions of the reduced tensor, and to extract features from different directions to improve the accuracy and Kappa value of CD. The experimental results of three real hyperspectral datasets show that TDSSC is superior to most existing CD methods.

Keywords

• Change detection (CD)
• hyperspectral image (HSI)
• spectral–spatial combination
• three directions convolution neural network