Evaluation of a laboratory capacity strengthening project: a case of the summative assessment of the African Field Epidemiology Network (AFENET) laboratory project 2010 - 2016

Abstract

INTRODUCTION: Between September 2010 and September 2016, the African Field Epidemiology Network (AFENET) implemented laboratory strengthening initiatives through a cooperative agreement with the International Laboratory Branch of the US Centers for Disease Control and Prevention (CDC). This project aimed at improving laboratory Quality Management Systems (QMS) towards accreditation in Africa and the Caribbean region and was implemented in 11 countries in the Caribbean and seven African countries. This paper describes the results of a summative evaluation that was commissioned at the end of the project. METHODS: the evaluation team comprised an external consultant who led the evaluation design and implementation and AFENET project staff. The evaluation was done in all 11 Caribbean and seven African countries where the project was implemented. We formulated three evaluation questions to focus and guide the exercise: 1) Were project activities implemented as originally intended? 2) Did the project achieve the objectives it was intended to accomplish over its life? 3) Are the impacts of project interventions likely to survive in the long run? We developed 14 sub-questions from the three evaluation questions and obtained data using a set of online questionnaires. We conducted validation visits to six participating countries; four in Africa and two in the Caribbean. RESULTS: out of 14 sub-questions that were used to evaluate the project, six (43%) were fully achieved, six (43%) were partially achieved, and two (14%) were not achieved. In effect, > 80% of the sub-questions were either fully achieved or partially achieved. The most frequently mentioned success was the introduction of QMS in participating laboratories, which led to quality improvement in laboratory processes, participation in SLMTA (Strengthening Laboratory Management Towards Accreditation)/SLIPTA (Stepwise Laboratory Quality Improvement Process Towards Accreditation) and attainment of accreditation by some of the project laboratories. However, there were neither clear plans nor budget lines to mainstream activities that were supported under the project into regular activities of the ministries of health of participating countries.

Keywords

• evaluation
• laboratory strengthening
• evaluation design matrix
• word cloud
• afenet