Capturing Usability Problems for People Living With Dementia by Applying the DEMIGNED Principles in Usability Evaluation Methods: Mixed Methods Study

Abstract

BackgroundDementia-related impairments can cause complex barriers to access, use, and adopt digital health technologies (DHTs). These barriers can contribute to digital health inequities. Therefore, literature-based design principles called DEMIGNED have been developed to support the design and evaluation of DHTs for this rapidly increasing population. ObjectiveThis study aims to apply the DEMIGNED principles in usability evaluation methods to (1) capture usability problems on a mobile website providing information resources for people visiting a memory clinic, including those living with subjective cognitive decline (SCD), mild cognitive impairment (MCI), or dementia, and (2) investigate the realness of usability problems captured by the DEMIGNED principles in expert testing, specifically for mobile websites that act as a means of providing DHTs. MethodsFirst, a heuristic evaluation was conducted, with the DEMIGNED principles serving as domain-specific guidelines, with 3 double experts (experienced in both usability and dementia) and 2 usability engineering experts. Second, think-aloud sessions were conducted with patients visiting a memory clinic who were living with SCD, MCI, or dementia. ResultsThe heuristic evaluation resulted in 36 unique usability problems. A representative sample of 7 people visiting a memory clinic participated in a think-aloud session, including 4 (57%) with SCD, 1 (14%) with MCI, and 2 (29%) with dementia. The analysis of the think-aloud sessions revealed 181 encounters with usability problems. Of these encounters, 144 (79.6%) could be mapped to 18 usability problems identified in the heuristic evaluation. The remaining 37 (20.4%) encounters from the user testing revealed another 10 unique usability problems. Usability problems frequently described in the think-aloud sessions encompassed difficulties with using the search function, discrepancies between the user’s expectations and the content organization, the need for scrolling, information overload, and unclear system feedback. ConclusionsBy applying the DEMIGNED principles in expert testing, evaluators were able to capture 79.6% (144/181) of all usability problem encounters in the user testing of a mobile website for people visiting a memory clinic, including people living with dementia. Regarding unique usability problems, 50% (18/36) of the unique usability problems identified during the heuristic evaluation were captured by the user-testing sessions. Future research should look into the applicability of the DEMIGNED principles to other digital health functionalities to increase the accessibility of digital health and decrease digital health inequity for this complex and rapidly increasing population.