Deep Learning-Based Post-Stroke Myoelectric Gesture Recognition: From Feature Construction to Network Design

Abstract

Recently, robot-assisted rehabilitation has emerged as a promising solution to increase the training intensity of stroke patients while reducing workload on therapists, whilst surface electromyography (sEMG) is expected to serve as a viable control source. In this paper, we delve into the potential of deep learning (DL) for post-stroke hand gesture recognition by collecting the sEMG signals of eight chronic stroke subjects, focusing on three primary aspects: feature domains of sEMG (time, frequency, and wavelet), data structures (one or two-dimensional images), and neural network architectures (CNN, CNN-LSTM, and CNN-LSTM-Attention). A total of 18 DL models were comprehensively evaluated in both intra-subject testing and inter-subject transfer learning tasks, with two post-processing algorithms (Model Voting and Bayesian Fusion) analysed subsequently. Experiment results infer that for intra-subject testing, the average accuracy of CNN-LSTM using two-dimensional frequency features is the highest, reaching 72.95%. For inter-subject transfer learning, the average accuracy of CNN-LSTM-Attention using one-dimensional frequency features is the highest, reaching 68.38%. Through these two experiments, it was found that frequency features had significant advantages over other features in gesture recognition after stroke. Moreover, the post-processing algorithm can further improve the recognition accuracy, and the recognition effect can be increased by 2.03% through the model voting algorithm.

Keywords

• Deep learning
• hand gesture recognition
• post-processing
• surface electromyography
• stroke patients