Neuropsychiatric Disease and Treatment (Nov 2018)
Detection of cognitive impairment using a machine-learning algorithm
Abstract
Young Chul Youn,1 Seong Hye Choi,2 Hae-Won Shin,1 Ko Woon Kim,3 Jae-Won Jang,4 Jason J Jung,5 Ging-Yuek Robin Hsiung,6 SangYun Kim7 1Department of Neurology, College of Medicine, Chung-Ang University, Seoul, South Korea; 2Department of Neurology, Inha University College of Medicine, Incheon, South Korea; 3Department of Neurology, Chonbuk National University Medical School and Hospital, Chonbuk, South Korea; 4Department of Neurology, Kangwon National University Hospital, Chuncheon, South Korea; 5Department of Computer Engineering, Chung-Ang University, Seoul, South Korea; 6Division of Neurology, Department of Medicine, University of British Columbia, Vancouver, BC, Canada; 7Department of Neurology, Seoul National University College of Medicine and Seoul National University Bundang Hospital, Seoul, South Korea Purpose: The Mini-Mental State Examination (MMSE) is one of the most frequently used bedside screening measures of cognition. However, the Korean Dementia Screening Questionnaire (KDSQ) is an easier and more reliable screening method. Instead, other clinical variables and raw data were used for this study without the consideration of a cutoff value. The objective of this study was to develop a machine-learning algorithm for the detection of cognitive impairment (CI) based on the KDSQ and the MMSE.Patients and methods: The original dataset from the Clinical Research Center for Dementia of South Korea study was obtained. In total, 9,885 and 300 patients were randomly allocated to the training and test datasets, respectively. We selected up to 24 variables including sex, age, education duration, diabetes mellitus, and hypertension. We trained a machine-learning algorithm using TensorFlow based on the training dataset and then calculated its accuracy using the test dataset. The cost was calculated by conducting a logistic regression.Results: The accuracy of the model in predicting CI based on the KDSQ only, the MMSE only, and the combination of the KDSQ and MMSE was 84.3%, 88.3%, and 86.3%, respectively. For the KDSQ, the sensitivity for detecting CI was 91.50% and the specificity for detecting normal cognition (NL) was 59.60%. The sensitivity of the MMSE was 94.35%, and the specificity was 59.62%. When combining the KDSQ and the MMSE, the sensitivity for detecting CI was 91.5% and the specificity for detecting NL was 61.5%.Conclusion: The algorithm predicting CI based on the MMSE is superior. However, the KDSQ can be administered more easily in clinical practice and the algorithm using KDSQ is a comparable screening tool. Keywords: dementia, mild cognitive impairment, machine learning, TensorFlow, Mini-Mental State Examination, dementia questionnaire
