Effect of Personalized Email-Based Reminders on Participants’ Timeliness in an Online Education Program: Randomized Controlled Trial

Abstract

BackgroundPostsecondary students need to be able to handle self-regulated learning and manage schedules set by instructors. This is particularly the case with online courses, as they often come with a limited number of social reminders and less information directly from the teacher compared to courses with physical presence. This may increase procrastination and reduce timeliness of the students. Reminders may be a tool to improve the timeliness of students’ study behavior, but previous research shows that the effect of reminders differs between types of reminders, whether the reminder is personalized or general, and depending on the background of the students. In the worst cases, reminders can even increase procrastination. ObjectiveThe aim of this study was to test if personalized email reminders, as compared to general email reminders, affect the time to completion of scheduled online coursework. The personalized reminders included information on which page in the online material the participants ought to be on at the present point in time and the last page they were on during their last session. The general reminders only contained the first part of this information: where they ought to be at the present point in time. MethodsWeekly email reminders were sent to all participants enrolled in an online program, which included 39 professional learners from three East African countries. All participants in the Online Education for Leaders in Nutrition and Sustainability program, which uses a question-based learning methodology, were randomly assigned to either personalized or general reminders. The structure of the study was AB-BA, so that group A received personalized reminders for the first unit, then general reminders for the rest of the course, while group B started with general reminders and received personalized reminders only in the third (and last) unit in the course. ResultsIn total, 585 email reminders were distributed, of which 390 were general reminders and 195 were personalized. A Bayesian mixed-effects logistic regression was used to estimate the difference in the probability of being on time with one’s studies. The probability of being on time was 14 percentage points (95% credible interval 3%-25%) higher following personalized reminders compared to that following general reminders. For a course with 100 participants, this means 14 more students would be on time. ConclusionsPersonalized reminders had a greater positive effect than general reminders for a group of adults working full-time while enrolled in our online educational program. Considering how small the intervention was—adding a few words with the page number the student ought to be on to a reminder—we consider this effect fairly substantial. This intervention could be repeated manually by anyone and in large courses with some basic programming.