Study of Spatial–Spectral Feature Extraction Frameworks With 3-D Convolutional Neural Network for Robust Hyperspectral Imagery Classification

Abstract

Advances in hyperspectral remote sensing have instigated multitude of applications for better understanding of our planet through remote data acquisition and observation of natural phenomena such as weather monitoring and prediction to include tornado, wild fires, global warming, etc. For this, data analysis methods that exploit the rich spectral and spatial information in hyperspectral data are often employed to gain insights about the natural phenomenon. This work presents a new deep learning based hyperspectral data analysis framework, which efficiently utilizes both spatial and spectral information present in the data to achieve superior classification performance. Gabor filtering is used for spatial feature extraction in conjunction with sparse random projections for spectral feature extraction and dimensionality reduction. Finally, supervised classification using a 3-D convolutional neural network was employed to perform a volumetric hyperspectral data analysis. Experimental results reveal that the proposed spatial–spectral hyperspectral data analysis frameworks outperform the conventional 2-D convolution neural network-based spectral–spatial feature extraction techniques.

Keywords

• 3-D convolutional neural network (3-D CNN)
• deep learning
• dimensionality reduction (DR)
• feature extraction
• Gabor filtering
• Gaussian filtering