In-Situ Measuring sEMG and Muscle Shape Change With a Flexible and Stretchable Hybrid Sensor for Hand Gesture Recognition

Abstract

The accurate recognition of hand motion intentions is an essential prerequisite for efficient human-machine interaction (HMI) systems such as multifunctional prostheses and rehabilitation robots. Surface electromyography (sEMG) signals and muscle shape change (MSC) signals which are usually detected with different types of sensors have been used for human hand motion intention recognition. However, using different sensors to measure sEMG and MSC respectively, it would be inconvenient and add deploying difficulty for human-machine interaction systems. In this study, a novel flexible and stretchable sensor was fabricated with a nano gold conductive material, which could simultaneously sense both sEMG and MSC signals. Accordingly, a wireless signal acquisition device was developed to record both sEMG and MSC signals with the fabricated hybrid sensors. The performance of the proposed in-situ dual-mode signal measurement (IDSM) system was evaluated by the recording signal quality and the accuracy of hand gesture recognition. The results demonstrated that by using two pairs of the hybrid sensors, the proposed IDSM system could obtain two-channel sEMG at a noise level of about $0.89~\mu $ Vrms and four-channel MSC with a resolution of about $0.1~\Omega $ . For a recognition task of 11 classes of hand gestures, the results showed that only with two pairs of the hybrid sensors, the average accuracy over all the subjects was 95.6 ± 2.9%, which was about 7% higher than that with two-channel sEMG and six-channel accelerometer signals. These results suggest that the proposed IDSM method would be an efficient way to simplify the human-machine interaction system with fewer sensors for high recognition accuracy of hand motions.

Keywords

• Human–machine interaction
• hand gesture recognition
• flexible and stretchable sensor
• muscle shape change
• surface electromyography