IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2022)

SNLRUX++ for Building Extraction From High-Resolution Remote Sensing Images

  • Yanjing Lei,
  • Jiamin Yu,
  • Sixian Chan,
  • Wei Wu,
  • Xiaoying Liu

DOI
https://doi.org/10.1109/JSTARS.2021.3135705
Journal volume & issue
Vol. 15
pp. 409 – 421

Abstract

Read online

Building extraction plays an important role in high-resolution remote sensing image processing, which can be used as the basis for urban planning and demographic analysis. In recent years, many powerful general semantic segmentation models have emerged, but these models often perform poorly when transferred to remote sensing images because of the characteristics of remote sensing images. To this end, we propose a new deep learning network called Selective Nonlocal ResUNeXt++ (SNLRUX++) for building extraction. First, the cascaded multiscale feature fusion is proposed to transform the high-performance image classification network ResNeXt into the segmentation network ResUNeXt++. Second, selective nonlocal operation is designed to establish long-range dependencies while avoiding introducing excessive noise and computational effort. Finally, multiscale prediction is applied as deep supervision to accelerate training and convergence, and improves prediction performance of objects at different scales. The experimental results on two different remote sensing image datasets show the effectiveness and generalization ability of the proposed method.

Keywords