International Journal of Digital Earth (Dec 2022)

A real 3D scene rendering optimization method based on region of interest and viewing frustum prediction in virtual reality

  • Pei Dang,
  • Jun Zhu,
  • Jianlin Wu,
  • Weilian Li,
  • Jigang You,
  • Lin Fu,
  • Yiqun Shi,
  • Yuhang Gong

DOI
https://doi.org/10.1080/17538947.2022.2080878
Journal volume & issue
Vol. 15, no. 1
pp. 1081 – 1100

Abstract

Read online

As an important technology of digital construction, real 3D models can improve the immersion and realism of virtual reality (VR) scenes. The large amount of data for real 3D scenes requires more effective rendering methods, but the current rendering optimization methods have some defects and cannot render real 3D scenes in virtual reality. In this study, the location of the viewing frustum is predicted by a Kalman filter, and eye-tracking equipment is used to recognize the region of interest (ROI) in the scene. Finally, the real 3D model of interest in the predicted frustum is rendered first. The experimental results show that the method of this study can predict the frustrum location approximately 200 ms in advance, the prediction accuracy is approximately 87%, the scene rendering efficiency is improved by 8.3%, and the motion sickness is reduced by approximately 54.5%. These studies help promote the use of real 3D models in virtual reality and ROI recognition methods. In future work, we will further improve the prediction accuracy of viewing frustums in virtual reality and the application of eye tracking in virtual geographic scenes.

Keywords