The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (Jun 2024)

Comparative Evaluation of NeRF Algorithms on Single Image Dataset for 3D Reconstruction

  • F. Condorelli,
  • M. Perticarini

DOI
https://doi.org/10.5194/isprs-archives-XLVIII-2-2024-73-2024
Journal volume & issue
Vol. XLVIII-2-2024
pp. 73 – 79

Abstract

Read online

The reconstruction of three-dimensional scenes from a single image represents a significant challenge in computer vision, particularly in the context of cultural heritage digitisation, where datasets may be limited or of poor quality. This paper addresses this challenge by conducting a study of the latest and most advanced algorithms for single-image 3D reconstruction, with a focus on applications in cultural heritage conservation. Exploiting different single-image datasets, the research evaluates the strengths and limitations of various artificial intelligence-based algorithms, in particular Neural Radiance Fields (NeRF), in reconstructing detailed 3D models from limited visual data. The study includes experiments on scenarios such as inaccessible or non-existent heritage sites, where traditional photogrammetric methods fail. The results demonstrate the effectiveness of NeRF-based approaches in producing accurate, high-resolution reconstructions suitable for visualisation and metric analysis. The results contribute to advancing the understanding of NeRF-based approaches in handling single-image inputs and offer insights for real-world applications such as object location and immersive content generation.