INTELLIGENT GESTURE RECOGNITION GLOVE

Abstract

Background. hands are used in all areas of everyday life, from simple tasks, such as the selection of an object, to complex ones, such as communication between people with speech and hearing defects. Therefore, it is necessary to find a way not only to track the movements and gestures of human hands, but also to integrate them, and gesture recognition is especially important for people who use their hands to communicate. Materials and methods. A method of organizing communication between people with hearing loss and speech defects is proposed, including the use of a robotic glove, which allows, in the future, to use this proposal for when the standard sign language is exhausted and its addition is required. Results. The connection scheme of industrially manufactured boards has been worked out: the HC-05 Bluetooth module and the Arduino Nano debugging board together with a rough, simplified version of the human robotic brush layout with fixed strain-resistant sensors. Conclusions. The proposed technique, together with the technology of robotic gloves, allows communication not only between people with speech and hearing defects, but also eliminates misunderstandings when communicating people with speech and hearing impairments with ordinary, healthy citizens.

Keywords

• hand
• glove
• gestures
• hearing impaired
• speech defect