A Dual Branch Multiscale Stereo Matching Network for High-Resolution Satellite Remote Sensing Images

Abstract

Accurate disparity estimation of high-resolution satellite remote sensing stereo images serves as a crucial method for generating precise digital surface models. However, the complex intractable regions in satellite images (textureless regions, repeated texture regions, occlusion regions) pose serious challenges for accurate disparity estimation. To enhance the matching accuracy within intractable regions, a dual branch multiscale stereo matching network for high-resolution satellite stereo images is proposed. First, a dual branch feature extraction module is designed, which can perform efficient downsampling. This module can enhance the scene awareness capability of the model, enabling it to extract multiscale feature maps and construct multiscale cost volumes. Then, the cost aggregation process is executed in a coarse-to-fine manner. The method employs a simple hourglass structure and leverages low-scale information to guide the aggregation of high-scale cost volumes. Next, a disparity-channel attention mechanism is proposed for the cost aggregation process to obtain more representative feature information. Finally, a simple disparity refinement module is designed by utilizing both intensity and gradient information of the left image to improve the local details of the disparity map. Experiments are performed separately on the GaoFen-7 and US3D datasets. The experimental results indicate that the proposed method is conducive to improving the matching accuracy within intractable regions of satellite images. The structure of the proposed network is simple, which can effectively reduce the network parameters and realize the lightweight of the model.

Keywords

• Disparity-channel attention
• dual branch feature extraction (DBFE)
• satellite remote sensing stereo images
• stereo matching