Application of Deep Learning Algorithm to Monitor Upper Extremity Task Practice

Abstract

Upper extremity hemiplegia is a serious problem affecting the lives of many people post-stroke. Motor recovery requires high repetitions and quality of task-specific practice. Sufficient practice cannot be completed during therapy sessions, requiring patients to perform additional task practices at home on their own. Adherence to and quality of these home task practices are often limited, which is likely a factor reducing rehabilitation effectiveness post-stroke. However, home adherence is typically measured by self-reports that are known to be inconsistent with objective measurement. The objective of this study was to develop algorithms to enable the objective identification of task type and quality. Twenty neurotypical participants wore an IMU sensor on the wrist and performed four representative tasks in prescribed fashions that mimicked correct, compensatory, and incomplete movement qualities typically seen in stroke survivors. LSTM classifiers were trained to identify the task being performed and its movement quality. Our models achieved an accuracy of 90.8% for task identification and 84.9%, 81.1%, 58.4%, and 73.2% for movement quality classification for the four tasks for unseen participants. The results warrant further investigation to determine the classification performance for stroke survivors and if quantity and quality feedback from objective monitoring facilitates effective task practice at home, thereby improving motor recovery.

Keywords

• stroke
• upper extremity
• rehabilitation
• accelerometer
• inertial measurement unit (IMU)
• wearable sensor