MFFNet: a building change detection method based on fusion of spectral and geometric information

Abstract

AbstractAccurate detection and extraction of changes in buildings heights is important in monitoring construction (both legal and illegal) and assessing disasters. It is also important information for updating real 3D scenes. However, when using remote sensing images, shadows, vegetation and objects with similar spectral and morphological characteristics as buildings can cause false detections, omissions and incomplete patch edges. To address this issue, we develop the multiscale feature fusion network for dual-modal data (MFFNet), which has two main aspects: (1) The multi-dual-modal feature fusion module detects changes in features with similar spectral and morphological characteristics as buildings. This mitigates false detections by making the model more aware of areas where the elevation has changed over time. (2) Because building extraction is affected by shadows and vegetation, we designed a multiscale feature shuffle module. It takes multiscale features and establishes relationships between neighbouring pixels using the pixel-shuffle algorithm, then fuses and reorganizes the multiscale features to highlight the relationships between global contexts, thereby mitigating the problem of building occlusion by shadows. Comparative experiments show that MFFNet achieves better results on GF7-CD and 3DCD datasets than other similar methods. The proposed method can more accurately monitor building changes over large areas.

Keywords

• Building change detection
• digital surface model
• dual-modal data fusion
• multiscale feature shuffle