A Personalized Data Dashboard to Improve Compliance with Ecological Momentary Assessments in College Students: Protocol for a Microrandomized Trial

Abstract

BackgroundEcological momentary assessments (EMA) are ideal for capturing the dynamic nature of young adult substance use behavior in daily life and identifying contextual risk factors that signal higher-risk episodes. These methods could provide a signal to trigger real-time intervention delivery. Study compliance and engagement are common barriers to participation but may be improved by personalizing messages. This study compares compliance outcomes between one group of young adults receiving standard (generic) prompts at each assessment and another group that received additional personalization and an updated data dashboard (DD) showing study progress to date at 1 randomly selected prompt per day. ObjectiveThe primary objectives are to (1) develop a real-time DD for giving participants personalized updates on their progress in the study and (2) examine its preliminary overall effects on study compliance and experiences. Secondary objectives are to identify person-, day-, and moment-level characteristics associated with study compliance and person-level characteristics associated with perceived usefulness of the DD. MethodsThis is a protocol for Project ENGAGE, a 2-arm randomized controlled trial. Arm 1 (EMA group) is engaged in a standard EMA protocol, and arm 2 (EMA+DD group) is engaged in the same study but with additional personalization and feedback. Inclusion criteria are (1) previous participation in a recent college student survey about health behavior and mental health who indicated willingness to participate in future research studies and (2) indicated past-month alcohol use; lifetime marijuana, hashish, or Delta-8-tetrahydrocannabinol (THC) use; or some combination of these on that survey. All participants in this study completed a baseline survey; EMA at 11 AM, 2 PM, 5 PM, and 8 PM each day for 21 days; and an exit survey. Participants in arm 2 engaged in a microrandomized trial, receiving a personalized DD at 1 randomly selected prompt per day. Primary outcomes include whether a survey was completed, time to complete a survey, and subjective experiences in the study. Primary analyses will compare groups on overall study compliance and, for arm 2, use marginal models to assess the momentary effect of receiving 1 updated DD per day. ResultsApproval was granted by the university’s institutional review board on February 8, 2023. Recruitment via direct email occurred on March 30 and April 6, 2023; data collection was completed by April 29, 2023. A total of 91 individuals participated in the study. Results have been accepted for publication in JMIR Formative Research. ConclusionsResults from the evaluation of this study will indicate whether providing (at randomly selected prompts) real-time, personalized feedback on a participant’s progress in an EMA study improves study compliance. Overall, this study will inform whether a simple, automated DD presenting study compliance and incentives earned to date may improve young adults’ compliance and engagement in intensive longitudinal studies. International Registered Report Identifier (IRRID)DERR1-10.2196/57664