Tensor-Based Few-Shot Learning for Cross-Domain Hyperspectral Image Classification

Abstract

Few-shot learning (FSL) is an effective solution for cross-domain hyperspectral image (HSI) classification, which could address the limited labeled samples of the target domain. Current FSL methods mostly utilize the 3D-CNN to transform the spatial and spectral information into a single feature to model an HSI, which means that spatial and spectral information are treated equally in the feature-modeling process. However, spectral information is considered to be more domain-invariant than spatial information. Treating the spatial and spectral information equally may result in parameter redundancy and undesirable cross-domain classification performance. In this paper, we attempt to use tensor mathematics for modeling the HSI and propose a novel few-shot learning method, called tensor-based few-shot Learning (TFSL) for cross-domain HSI classification, which aims to guide the model to focus on the extraction of domain-invariant spectral dependencies. Specifically, we first propose a spatial–spectral tensor decomposition (SSTD) model to provide a mathematical explanation of the input HSI, representing the local spatial–spectral information as 1D and 2D local tensors to reduce the data redundancy. Additionally, a tensor-based hybrid two-stream (THT) model is proposed for extracting the domain-invariant spatial–spectral tensor feature by using 1D-CNN and 2D-CNN. Furthermore, we adopt a 1D-CNN tensor feature enhancement block to enhance the spectral feature of hybrid two-stream tensors and guide the THT model to concentrate on the modeling of spectral dependencies. Finally, the proposed TFSL is evaluated on four public HSI datasets, and the extensive experimental results demonstrate that the proposed TFSL significantly outperforms other advanced FSL methods.

Keywords

• few-shot learning
• cross-domain hyperspectral image classification
• tensor mathematics