Smartphone App–Based Noncontact Ecological Momentary Assessment With Experienced and Naïve Older Participants: Feasibility Study

Abstract

BackgroundSmartphone app–based ecological momentary assessment (EMA) without face-to-face contact between researcher and participant (app-based noncontact EMA) potentially provides a valuable data collection tool when geographic, time, and situational factors (eg, COVID-19 restrictions) place constraints on in-person research. Nevertheless, little is known about the feasibility of this method, particularly in older and naïve EMA participants. ObjectiveThis study aims to assess the feasibility of app-based noncontact EMA as a function of previous EMA experience, by recruiting and comparing a group of participants who had never participated in EMA before against a group of participants who had been part of an earlier in-person EMA study, and age, by recruiting middle-aged to older adults. MethodsOverall, 151 potential participants were invited via email; 46.4% (70/151) enrolled in the study by completing the baseline questionnaire set and were emailed instructions for the EMA phase. Of these participants, 67% (47/70) downloaded an EMA app and ran the survey sequence for 1 week. In total, 5 daytime surveys and 1 evening survey, each day, assessed participants’ listening environment, social activity, and conversational engagement. A semistructured exit telephone interview probed the acceptability of the method. As markers of feasibility, we assessed the enrollment rate, study completion rate, reason for noncompletion, EMA survey response rate, and likelihood of reporting an issue with survey alerts and requested assistance from researchers, family, or friends. ResultsEnrollment rates among invitees (63.3% vs 38.2%; P=.004) and completion rates among enrollees (83.9% vs 53.8%; P<.001) were higher in the experienced than in the naïve EMA group. On average, experienced participants responded to 64.1% (SD 30.2%) of the daytime EMA surveys, and naïve participants responded to 54.3% (SD 29.5%) of the daytime EMA surveys (P=.27). Among participants who retrospectively reported issues with survey alerts, only 19% (3/16) requested researcher assistance during data collection. Older participants were more likely to report not being alerted to EMA surveys (P=.008), but age was unrelated to all other markers of feasibility. Post hoc analyses of the effect of the phone operating system on markers of feasibility revealed that response rates were higher among iOS users (mean 74.8%, SD 20.25%) than among Android users (mean 48.5%, SD 31.35%; P=.002). ConclusionsSmartphone app–based noncontact EMA appears to be feasible, although participants with previous EMA experience, younger participants, and iOS users performed better on certain markers of feasibility. Measures to increase feasibility may include extensive testing of the app with different phone types, encouraging participants to seek timely assistance for any issues experienced, and recruiting participants who have some previous EMA experience where possible. The limitations of this study include participants’ varying levels of existing relationship with the researcher and the implications of collecting data during the COVID-19 social restrictions.