IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2022)

A CBAM Based Multiscale Transformer Fusion Approach for Remote Sensing Image Change Detection

  • Wei Wang,
  • Xinai Tan,
  • Peng Zhang,
  • Xin Wang

DOI
https://doi.org/10.1109/JSTARS.2022.3198517
Journal volume & issue
Vol. 15
pp. 6817 – 6825

Abstract

Read online

Change detection methods play an indispensable role in remote sensing. Some change detection methods have obtained a fairly good performance by introducing attention mechanism on the basis of the convolutional neural network (CNN), but identifying intricate changes remains difficult. In response to these problems, this article proposes a new model for detecting changes in remote sensing, namely, MTCNet, which combines the advantages of multiscale transformer with the convolutional block attention module (CBAM) to improve the detection quality of different remote sensing images. On the basis of traditional convolutions, the transformer module is introduced to extract bitemporal image features by modeling contextual information. Based on the transformer module, a multiscale module is designed to form a multiscale transformer, which can obtain features at different scales in bitemporal images, thereby identifying the changes we are interested in. Based on the multiscale transformer module, the CBAM is introduced. The CBAM is split into a spatial attention module and a channel attention module, which are applied to the front and back ends of the multiscale transformer, respectively. Spatial information and channel information of feature maps are modeled separately. In this article, the validity and efficiency of the method are verified by a large number of experiments on the LEVIR-CD dataset and the WHU-CD dataset.

Keywords