Automatic reconstruction of semantic façade model of architectural heritage

Abstract

Abstract Façade elements, such as windows, doors, balconies, sculptures, and totems, in architectural heritage images with incomplete structures should be automatically reconstructed for applications in 3D analysis, 3D modeling, virtual tourism, city planning, and the protection and reconstruction of architectural heritage. This study segments façade elements of architectural heritage semantically using YOLOv9. A parameterized expression for the semantic façade model is designed. In addition, the façade layer graph (FLG) and element layer graph (ELG) algorithms are developed based on topological, geometric, and structural constraints to automatically reconstruct the semantic façade model for architectural heritages. The results showed that the average precision (AP) and mean intersection over union (MIoU) achieved using YOLOv9 + FLG-ELG are 86.91% and 85.63%, respectively, on the dataset concerning façade elements of architectural heritages. The AP values obtained from the proposed method are 98.5% on the ECP2011 dataset and 95.3% on the Graz2012 dataset. The YOLOv9 + FLG-ELG method automatically reconstructs regular, irregular, and complex façade layouts with high accuracy and robustness.

Keywords

• Automatic reconstruction
• Semantic segmentation
• Façade element
• Architectural heritage