Interactive Exploration of Virtual Heritage by Means of Natural Gestures

Abstract

This paper is situated at the intersection of using Virtual Reality as a tool for cultural heritage preservation and using gesture interaction-based technology in order to achieve touchless, distant interaction of users with reconstructed artifacts. Various studies emphasize the positive effect on the cultural experience brought on by the use of Virtual Reality in a museum context. We build our approach on this idea, by modeling and reconstructing museum exhibits, both small artifacts and large architectural edifices. We propose and design navigation and interaction scenarios, at the same time taking into account present day limitations regarding social interaction, imposed during the COVID-19 pandemic. By considering the user in the center of the experience and focusing on enabling him/her to adjust the perspective on the visualized artifacts and to freely interact with them through natural gestures, we allow the user to immerse in the virtual environment and interact with the reconstructed artifacts by means of simple hand gestures, with no touch. Finally, we assess the usability and utility of the Virtual Reality system in a questionnaire-based study with 137 participants over a period of 6 months, whose results we discuss in the paper.

Keywords

• natural interaction
• cultural heritage
• virtual reality
• 3D scanning
• museums
• user study