Generative 3D Reconstruction of Martian Surfaces using Monocular Images

Abstract

High-resolution digital terrain models (DEM) are crucial for Mars scientific exploration and engineering demands, such as mission route planning, landing site selection, and topography research. However, DEMs generated based on photogrammetry or photometry suffer from limited stereo coverage and complex generative processes. Therefore, we propose a GAN-based monocular 3D reconstruction method, which utilizes high-resolution monocular orbital images to achieve pixel-level Martian terrain reconstruction. We preprocess the image data and then invert the elevation using the trained generative model. Finally, we recover the absolute scale through post-processing. In this work, we use HiRISE orthorectified images and DEMs with a resolution of 2 m and 0.25 m to validate the effectiveness of our method. We evaluated our method in four areas with different landforms and found that the predicted DEM and HiRISE DEM have height consistency with the root mean square error of about 2 m. This indicates that the proposed GAN-based method has certain effectiveness and generalization and great potential in high-resolution monocular Martian DEM reconstruction.