223 Enhancing the Impact of a Community Feedback Session Service Through Ongoing Evaluation

Abstract

OBJECTIVES/GOALS: UNC-Chapel Hill’s CTSA implemented a community feedback session (CFS) service to help researchers gather actionable, authentic, and constructive feedback on their projects from community experts. Simultaneously, we conducted an ongoing, participatory evaluation process to improve the experience for researchers and community members. METHODS/STUDY POPULATION: Informed by the Community Engagement Studio model (Yoosten, 2015), a CFS is a 2-hour consultative session that includes facilitated discussion with community experts around topics or questions posed by a research team. UNC-Chapel Hill’s CTSA staff conducted 7 CFSs during the pilot phase of the service and collected evaluation surveys from researchers and community experts. We held a data party – a participatory evaluation method – to analyze and interpret survey data. Resulting recommendations were used to improve CFS materials and processes. We conducted 11 CFSs after the pilot phase, then analyzed survey data again to gauge improvement and make further adjustments to the service. We also surveyed researchers three months after their last CFS to assess the impact of community experts’ feedback on their studies. RESULTS/ANTICIPATED RESULTS: Since January 2022, 108 community experts have participated in 18 CFSs spanning 9 research projects. Data party interpretations of pilot evaluation data yielded several changes in service delivery; since those changes were instituted, all researchers have highly rated the service, unanimously recommending it to colleagues. Researchers praised well-structured sessions and productive engagement, citing direct benefits to their work and significant impact on recruitment processes 3 months post CFS. Community experts also echoed satisfaction, with 100% finding CFSs worthwhile and 95% desiring to participate again, emphasizing the sessions' supportive atmosphere. A community expert reported that the sessions 'made me feel seen and allowed for a greater understanding of what I have been dealing with.' DISCUSSION/SIGNIFICANCE: The CFS model allows research teams to elicit rapid and meaningful community input, which is key to improving research relevance and impact. Ongoing participatory evaluation of the service ensures continuous improvement, yielding more meaningful interactions and studies that reflect the perspectives of people affected by the research.