FingerTouch: Touch Interaction Using a Fingernail-Mounted Sensor on a Head-Mounted Display for Augmented Reality

Abstract

This study proposes FingerTouch, a method of touch interaction using a head-mounted display for mobile augmented reality. FingerTouch allows users to manipulate virtual content with one-finger touch interaction regardless of the material or tilt of the plane the finger is touching. In addition, users can interact freely with virtual contents using FingerTouch. As the prototype developed in this study uses only one inertial measurement unit sensor attached to a fingernail, it features high mobility and allows users to feel natural tactile feedback, which is important for performing everyday tasks. The user evaluation of FingerTouch indicated that it provides high accuracy, with an average cursor navigation error of 2.15 mm and an average finger gesture recognition accuracy of 95% across 22 participants, two surface orientations, and three surface materials.

Keywords

• Augmented reality
• finger gesture
• inertial sensor
• nail-mounted sensor
• touch interaction