577 EQUATOR network implementation science reporting and adherence challenges for learning health systems

Abstract

Objectives/Goals: The Standards for Reporting Implementation Studies (StaRI) are the Enhancing the Quality and Transparency of Health Research (EQUATOR) Network 27-item checklist for Implementation Science. This study quantifies StaRI adherence among self-defined Implementation Science studies in published Learning Health Systems (LHS) research. Methods/Study Population: A medical librarian-designed a search strategy identified original Implementation Science research published in one of the top 20 Implementation Science journals between 2017 and 2021. Inclusion criteria included studies or protocols describing the implementation of any intervention in healthcare settings. Exclusion criteria included concept papers, non-implementation research, or editorials. Full-text documents were reviewed by two investigators to abstract and judge StaRI implementation and intervention adherence, partial adherence, or non-adherence. Results/Anticipated Results: A total of 330 documents were screened, 97 met inclusion criteria, and 47 were abstracted including 30 research studies and 17 protocols. Adherence to individual StaRI reporting items ranged from 13% to 100%. Most StaRI items were reported in >60% of manuscripts and protocols. The lowest adherence in research studies was noted around economic evaluation reporting for implementation (16%) or intervention (13%) strategies, harms (13%), contextual changes (30%), or fidelity of either the intervention (34%) or implementation (53%) approach. Subgroup analyses were infrequently contemplated or reported (43%). In protocols, the implications of the implementation strategy (41%) or intervention approach (47%) were not commonly reported. Discussion/Significance of Impact: When leveraging implementation science to report reproducible and sustainable practice change initiatives, LHS researchers will need to include assessments of economics, harms, context, and fidelity in order to attain higher levels of adherence to EQUATOR’s StaRI checklist.