Utilizing a tablet-based artificial intelligence system to assess movement disorders in a prospective study

Abstract

Abstract Spiral drawings on paper are used as routine measures in hospitals to assess Parkinson’s Disease motor deficiencies. In the age of emerging mobile health tools and Artificial Intelligence a comprehensive digital setup enables granular biomarker analyses and improved differential diagnoses in movement disorders. This study aims to evaluate on discriminatory features among Parkison’s Disease patients, healthy subjects and diverse movement disorders. Overall, 24 Parkinson’s Disease patients, 27 healthy controls and 26 patients with similar differential diagnoses were assessed with a novel tablet-based system. It utilizes an integrative assessment by combining a structured symptoms questionnaire—the Parkinson’s Disease Non-Motor Scale—and 2-handed spiral drawing captured on a tablet device. Three different classification tasks were evaluated: Parkinson’s Disease patients versus healthy control group (Task 1), all Movement disorders versus healthy control group (Task 2) and Parkinson’s Disease patients versus diverse other movement disorder patients (Task 3). To systematically study feature importances of digital biomarkers a Machine Learning classifier is cross-validated and interpreted with SHapley Additive exPlanations (SHAP) values. The number of non-motor symptoms differed significantly for Tasks 1 and 2 but not for Task 3. The proposed drawing features partially differed significantly for all three tasks. The diagnostic accuracy was on average 94.0% in Task 1, 89.4% in Task 2, and 72% in Task 3. While the accuracy in Task 3 only using the symptom questionnaire was close to the baseline, it greatly improved when including the tablet-based features from 60 to 72%. The accuracies for all three tasks were significantly improved by integrating the two modalities. These results show that tablet-based drawing features can not only be captured by consumer grade devices, but also capture specific features to Parkinson’s Disease that significantly improve the diagnostic accuracy compared to the symptom questionnaire. Therefore, the proposed system provides an objective type of disease characterization of movement disorders, which could be utilized for home-based assessments as well. Clinicaltrials.gov Study-ID: NCT03638479.