Implementation of an electronic monitoring and evaluation system for the antiretroviral treatment programme in the Cape Winelands district, South Africa: a qualitative evaluation.

Abstract

BackgroundA pragmatic three-tiered approach to monitor the world's largest antiretroviral treatment (ART) programme was adopted by the South African National Department of Health in 2010. With the rapid expansion of the programme, the limitations of the paper-based register (tier 1) were the catalyst for implementation of the stand-alone electronic register (tier 2), which offers simple digitisation of the paper-based register. This article engages with theory on implementation to identify and contextualise enabling and constraining factors for implementation of the electronic register, to describe experiences and use of the register, and to make recommendations for implementation in similar settings where standardisation of ART monitoring and evaluation has not been achieved.MethodsWe conducted a qualitative evaluation of the roll-out of the register. This comprised twenty in-depth interviews with a diverse sample of stakeholders at facility, sub-district, and district levels of the health system. Facility-level participants were selected across five sub-districts, including one facility per sub-district. Responses were coded and analysed using a thematic approach. An implementation science framework guided interpretation of the data.Results & discussionWe identified the following seven themes: 1) ease of implementation, 2) perceived value of an electronic M&E system, 3) importance of stakeholder engagement, 4) influence of a data champion, 5) operational and logistical factors, 6) workload and role clarity, and 7) importance of integrating the electronic register with routine facility monitoring and evaluation. Interpreting our findings through an implementation theory enabled us to construct the scaffolding for implementation across the five facility-settings. This approach illustrated that implementation was not a linear process but occurred at two nodes: at the adoption of the register for roll-out, and at implementation at facility-level.ConclusionIn this study we found that relative advantage of an intervention and stakeholder engagement are critical to implementation. We suggest that without these aspects of implementation, formative and summative outcomes of implementation at both the adoption and coalface stages of implementation would be negatively affected.