A Pathway into Metaverse: Gesture Recognition Enabled by Wearable Resistive Sensors

Abstract

Abstract Hand gesture recognition is of great importance for human–Metaverse interaction. The human hand is relatively smaller, with very complex articulations than the entire human body. Therefore, precise hand gesture recognition, especially in complicated environments, is still a great challenge. Wearable resistive sensors that could directly characterize joint movements are one of the most promising technologies for hand gesture recognition due to their easy integration, low cost, and simple signal acquisition. Here, we summarize common categories of wearable resistive sensors for hand gesture recognition and review the recent advances. Besides, common strategies for improving waterproofness (molecular design, material modification, and interfacial encapsulation) are also outlined. Perspectives on the advantages of combining machine vision and resistive sensors for accurate hand gesture recognition and dynamic hand gesture tracking are then provided. We hope this review could inspire future research in wearable technologies for human–Metaverse systems.

Keywords

• human‐machine interfaces
• flexible electronics
• gesture recognition
• machine vision
• Metaverse
• resistive sensors