478 You liked it, but did you learn anything? A process for redesigning follow-up surveys in attempts to measure success beyond satisfaction

Abstract

OBJECTIVES/GOALS: Project objectives: Collect, analyze, redesign, and redeploy the follow-up surveys sent after services rendered or educational offerings attended to improve outcome measurement. Presentation objectives: Provide a process for others to optimize their assessment surveys. METHODS/STUDY POPULATION: A team of interdisciplinary experts from Evaluation and Improvement, Workforce Development, and Administration took a systematic and collaborative approach to optimizing service and educational offering assessment. The team collected all 35 existing surveys currently in use at the CTSA, developed a matrix table to organize findings, cross-analyzed/normed to recognize and reduce bias, engaged other staff and faculty at specific intervals to encourage buy-in, and responded to feedback. The team then updated both surveys and format, programmed revised surveys into a centralized platform, and provided instructions and training for implementation. RESULTS/ANTICIPATED RESULTS: This effort resulted in streamlining both the assessment process and the surveys used by the Southern California Clinical and Translational Science Institute (SC CTSI). Instead of using different versions of surveys or none at all, now SC CTSI commits to using the same follow-up survey for events and for educational offerings institute-wide, and agrees to store and access that data via a single platform, REDCap, allowing any member to see data in real time. This will allow SC CTSI to monitor and evaluate its short-term outcomes at an institutional level, and determine areas for improvement or best practices. Future plans include training on survey data interpretation for decision making. DISCUSSION/SIGNIFICANCE: Presenters will share lessons learned and considerations when embarking on streamlining assessment practices institute-wide, highlighting the importance of leveraging educational methodology to go beyond measuring satisfaction and into measuring learning. Presenters will share revised surveys.