Method for Landslide Area Detection Based on EfficientNetV2 with Optical Image Converted from SAR Image Using pix2pixHD with Spatial Attention Mechanism in Loss Function

Abstract

A method for landslide area detection based on EfficientNetV2 with optical image converted from SAR image using pix2pixHD with a spatial attention mechanism in the loss function is proposed. Meteorological landslides such as landslides after heavy rains occur regardless of day or night and weather conditions. Meteorological landslides such as landslides are easier to visually judge using optical images than SAR images, but optical images cannot be observed at night, in the rain, or on cloudy days. Therefore, we devised a method to convert SAR images, which allow all-weather observation regardless of day or night, into optical images using pix2pixHD, and to learn about landslide areas using the converted optical images to build a trained model. We used SAR and optical images derived from Sentinel-1 and -2, which captured landslides caused by the earthquake on 14 April 2016, as training data, and constructed a learning model that classifies landslide areas using EfficientNetV2. We evaluated the superiority of the proposed method by comparing it with a learning model that uses only SAR images. As a result, it was confirmed that the F1-score and AUC were 0.3396 and 0.2697, respectively, when using only SAR images, but were improved by 1.52 to 1.84 times to 0.6250 and 0.4109, respectively, when using the proposed method.

Keywords

• px2pixHD
• spatial attention mechanism
• EfficientNetV2
• Sentinel-1 and -2