Video-Based Detection of Freezing of Gait in Daily Clinical Practice in Patients With Parkinsonism

Abstract

Freezing of gait (FoG) is a prevalent symptom among individuals with Parkinson’s disease and related disorders. FoG detection from videos has been developed recently; however, the process requires using videos filmed within a controlled environment. We attempted to establish an automatic FoG detection method from videos taken in uncontrolled environments such as in daily clinical practices. Motion features of 16 patients were extracted from timed-up-and-go test in 109 video data points, through object tracking and three-dimension pose estimation. These motion features were utilized to form the FoG detection model, which combined rule-based and machine learning-based models. The rule-based model distinguished the frames in which the patient was walking from those when the patient has stopped, using the pelvic position coordinates; the machine learning-based model distinguished between FoG and stop using a combined one-dimensional convolutional neural network and long short-term memory (1dCNN-LSTM). The model achieved a high intraclass correlation coefficient of 0.75–0.94 with a manually-annotated duration of FoG and %FoG. This method is novel as it combines object tracking, 3D pose estimation, and expert-guided feature selection in the preprocessing and modeling phases, enabling FoG detection even from videos captured in uncontrolled environments.

Keywords

• Freezing of gait
• machine learning
• Parkinson’s disease
• pose estimation
• video