Evaluating a German learning disorders platform using the RE-AIM framework

Abstract

In recent years, online platforms have made educational, medical, and other professional content easily accessible, but research evaluating such platforms is still scarce. The purpose of the current study is to evaluate LONDI, a German learning disorders platform. The platform offers scientifically based information for different user groups, and an algorithm-based help system that professionals can use to facilitate diagnosing and planning interventions. The evaluation is focused on the user group of learning therapists using the platform and its help system. It is theoretically grounded on the RE-AIM framework and assesses four of its dimensions: Reach, Adoption, Implementation and Maintenance. Results from an online questionnaire (N = 496) showed that the platform reaches a large proportion of learning therapists. Another online questionnaire (N = 150) revealed that most users say they would adopt the help system, and this is predicted by its pragmatic qualities. Data from the Matomo web analytics software (N = 8,459 online visits) displayed diverse patterns in the platform’s implementation. Future research is needed to further examine their meaning in the context of health-related education. Web analytics also revealed that usage patterns are not maintained. Rather, there is an increase in the number of users and in smartphone usage over time, coinciding with a decrease in the average time spent on the platform. Consequently, future efforts will be dedicated to optimizing smartphone compatibility. This study is the first to utilize the RE-AIM framework with web analytics, paving the way for further theory-grounded platform evaluations.

Keywords

• Online platform evaluation
• Learning disorders
• Matomo analytics
• User experience