IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2023)

ResAt-UNet: A U-Shaped Network Using ResNet and Attention Module for Image Segmentation of Urban Buildings

  • Zhiyong Fan,
  • Yu Liu,
  • Min Xia,
  • Jianmin Hou,
  • Fei Yan,
  • Qiang Zang

DOI
https://doi.org/10.1109/JSTARS.2023.3238720
Journal volume & issue
Vol. 16
pp. 2094 – 2111

Abstract

Read online

Architectural image segmentation refers to the extraction of architectural objects from remote sensing images. At present, most neural networks ignore the relationship between feature information, and there are problems such as model overfitting and gradient explosion. Thus, this article proposes an improved UNet based on ResNet34 and Attention Module (ResAt-UNet) to solve the related problems. The algorithm adds a two-layer residual structure (BasicBlock) and a regional enhancement attention mechanism (Space Enhancement Area Enhancement, SEAE) to the original framework of UNet, which enhances the network depth, improves the fitting performance, and extracts small objects more accurately. The experimental results show that the network has achieved MIOU of 78.81% in the Massachusetts dataset, and the newly developed model outperforms UNet in both quantitative and qualitative aspects.

Keywords