Change Detection in VHR Imagery With Severe Co-Registration Errors Using Deep Learning: A Comparative Study

Abstract

Change detection (CD) through Earth observation techniques can offer very significant information for monitoring tasks in a time-efficient manner. Very high-resolution (VHR) images can display objects in fine detail, thus making it possible to rapidly perceive isolated changes. However, this is a challenging task because of the increased within-class variance and geometric registration errors caused by different satellite view directions and angles. Lately, deep learning (DL) CD methods have proven very appealing for the CD problem because of their flexibility to combine and process different types of information along with the increased availability of higher processing power systems. Even though previous research has developed several notable DL methodologies, it has mostly focused on images with minor co-registration errors. Based on that, the goal of this study is to evaluate the performance of five state-of-the-art DL CD methods, two unsupervised and three supervised, on VHR images with severe co-registration errors. The methods are implemented on four urban European areas of versatile morphology. In addition, before applying the CD process, four popular automatic co-registration methods were evaluated because of the importance of this pre-processing step for the successful output of the CD problem. It was shown that phase correlation used on the Fourier-Mellin Transform produced the most satisfactory co-registration results and STANet detected building-related changes most successfully. Its success can be attributed to its particular attention mechanism and its training dataset. The rest of the co-registration and CD methods showed low performance.

Keywords

• Change detection algorithms
• artificial neural networks
• very high-resolution imagery
• image registration
• land cover monitoring
• buildings