Multiview Hypergraph Fusion Network for Change Detection in High-Resolution Remote Sensing Images

Abstract

Currently, convolutional neural networks and transformers have been the dominant paradigms for change detection (CD) thanks to their powerful local and global feature extraction capabilities. However, with the improvement of resolution, spatial, spectral, and temporal relationships among objects in remote sensing images are becoming more complicated and cannot be modeled efficiently by the existing methods. To capture the high-order complex relationships in images, we propose a multiview hypergraph fusion network (MVHFNet) for CD, in which the high-order relationships along spatial, spectral, and temporal views are extracted by hypergraph learning. Specifically, this network is composed of three branches, including the spectral hypergraph learning branch, the spatial hypergraph learning branch, and the temporal hypergraph learning branch. In these branches, multiview features are extracted by different attention modules, and hypergraph learning consisting of hypergraph construction and hypergraph convolution is imposed on these features to model the high-order relationships. Then, to integrate the multiview features from different branches, a multiview feature fusion module is designed, in which the multiview features are fused and condensed for the following prediction. Finally, the change map is produced by a prediction head. We conduct extensive experiments on three datasets, such as LEVIR-CD, SYSU-CD, and CLCD. The experimental results demonstrate that the proposed MVHFNet achieves better CD performance compared to some state-of-the-art methods.

Keywords

• Change detection (CD)
• hypergraph network
• multiview fusion
• remote sensing images