Review of constraints on vision‐based gesture recognition for human–computer interaction

Abstract

The ability of computers to recognise hand gestures visually is essential for progress in human–computer interaction. Gesture recognition has applications ranging from sign language to medical assistance to virtual reality. However, gesture recognition is extremely challenging not only because of its diverse contexts, multiple interpretations, and spatio‐temporal variations but also because of the complex non‐rigid properties of the hand. This study surveys major constraints on vision‐based gesture recognition occurring in detection and pre‐processing, representation and feature extraction, and recognition. Current challenges are explored in detail.

Keywords

• vision-based gesture recognition
• human-computer interaction
• hand gesture recognition
• sign language
• medical assistance
• virtual reality