Deep Evidential Remote Sensing Landslide Image Classification With a New Divergence, Multiscale Saliency and an Improved Three-Branched Fusion

Abstract

Hitherto, image-level classification on remote sensing landslide images has been paid attention to, but the accuracy of traditional deep learning-based methods still have room for improvement. The evidence theory is found efficient to boost the accuracy of neural networks, however, the present study argues three challenges that hinder the lead-in of this theory in deep landslide image classification. Aiming at the three problems, this study makes three improvements. For the interpretability and decision-invariance losses of three previous divergences, we propose a belief Jensen–Renyi divergence with properties proven. To couple the evidence theory with deep remote sensing landslide image classification, a channelwise multiscale visual saliency fusion is developed. We additionally find that the channelwise fusion is capable to reduce false recognition of networks as compared with original RGB images. To avoid decision failures in evidence-theoretic fusion process, we design an interpretability improved three-branched fusion. Experiments on Bijie Landslide dataset corroborate the synergistic benefits of the three improvements, where the proposal is compared with state-of-the-art image classification backbone networks, remote sensing image scene classifiers, evidence fusion algorithms, and versatile evidence-theoretic deep learning classifiers. We also evaluated the new method with two sort of image degradation, as well as an actual scenario in Luding County, China, whose data is publicly available.

Keywords

• Evidence theory
• evidential deep learning
• Jensen–Renyi (JR) divergence measure
• multisource decision fusion
• remote sensing landslide image classification