ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences (Jun 2024)

A Method for Roof Wireframe Reconstruction Based on Self-Supervised Pretraining

  • H. Yang,
  • S. Huang,
  • R. Wang,
  • R. Wang

DOI
https://doi.org/10.5194/isprs-annals-X-2-2024-239-2024
Journal volume & issue
Vol. X-2-2024
pp. 239 – 246

Abstract

Read online

In this paper, we present a two-stage method for roof wireframe reconstruction employing a self-supervised pretraining technique. The initial stage utilizes a multi-scale mask autoencoder to generate point-wise features. The subsequent stage involves three steps for edge parameter regression. Firstly, the initial edge directions are generated under the guidance of edge point identification. The next step employs edge parameter regression and matching modules to extract the parameters (namely, direction vector and length) of edge representation from the obtained edge features. Finally, a specifically designed edge non-maximum suppression and an edge similarity loss function are employed to optimize the representation of the final wireframe models and eliminate redundant edges. Experimental results indicate that the pre-trained self-supervised model, enriched by the roof wireframe reconstruction task, demonstrates superior performance on both the publicly available Building3D dataset and its post-processed iterations, specifically the Dense dataset, outperforming even traditional methods.