Deep Learning-Based Digital Surface Model Reconstruction of ZY-3 Satellite Imagery

Abstract

This study introduces a novel satellite image digital surface model (DSM) reconstruction framework grounded in deep learning methodology. The proposed framework effectively utilizes a rational polynomial camera (RPC) model to establish the mapping relationship between image coordinates and geographic coordinates. Given the expansive coverage and abundant ground object data inherent in satellite images, we designed a lightweight deep network model. This model facilitates both coarse and fine estimation of a height map through two distinct stages. Our approach harnesses shallow and deep image information via a feature extraction module, subsequently employing RPC Warping to construct feature volumes for various angles. We employ variance as a similarity metric to achieve image matching and derive the fused cost volume. Following this, we aggregate cost information across different scales and height directions using a regularization module. This process yields the confidence level of the current height plane, which is then regressed to predict the height map. Once the height map from stage 1 is obtained, we gauge the prediction’s uncertainty based on the variance in the probability distribution in the height direction. This allows us to adjust the height estimation range according to this uncertainty, thereby enabling precise height value prediction in stage 2. After conducting geometric consistency detection filtering of fine height maps from diverse viewpoints, we generate 3D point clouds through the inverse projection of RPC models. Finally, we resample these 3D point clouds to produce high-precision DSM products. By analyzing the results of our method’s height map predictions and comparing them with existing deep learning-based reconstruction methods, we assess the DSM reconstruction performance of our proposed framework. The experimental findings underscore the robustness of our method against discontinuous regions, occlusions, uneven illumination areas in satellite imagery, and weak texture regions during height map generation. Furthermore, the reconstructed digital surface model (DSM) surpasses existing solutions in terms of completeness and root mean square error metrics while concurrently reducing the model parameters by 42.93%. This optimization markedly diminishes memory usage, thereby conserving both software and hardware resources as well as system overhead. Such savings pave the way for a more efficient system design and development process.

Keywords

• digital surface model (DSM)
• rational polynomial camera
• cost volume
• height map