Domain Adaptive Remote Sensing Scene Classification With Middle-Layer Feature Extraction and Nuclear Norm Maximization

Abstract

Unsupervised domain adaptation (UDA) methods have become a research hotspot in remote sensing scene classification to reduce dependence on labeled samples. However, most current methods focus on extracting domain invariant features, ignoring the problem of large intraclass differences and the imbalanced sample numbers between categories in remote sensing images. To address these issues, we propose a remote sensing scene domain adaptive method based on middle-layer feature extraction and nuclear norm maximization (MFE-NM). In the MFE module, the middle-layer features of the feature extractor are randomly extracted and processed. Since the receptive field of the middle-layer features is smaller and the resolution is higher, the effective use of the middle-layer features can reduce the impact of image feature heterogeneity caused by large intraclass differences in remote sensing images. In addition, it can be concluded that the constrained nuclear norm can simultaneously improve the prediction diversity and discriminability of the model through theoretical derivation. Therefore, the NM module is proposed to solve the problem of reduced prediction diversity caused by entropy minimization methods when dealing with scene classification problems with imbalanced sample numbers between categories. Extensive experiments and analyses on three public remote sensing datasets demonstrate the effectiveness and competitiveness of our proposed method.

Keywords

• Middle-layer feature extraction (MFE)
• nuclear norm maximization (NM)
• remote sensing scene classification
• unsupervised domain adaptation (UDA)