Outcome evaluation of capacity building and mentorship partnership (CBMP) program on data quality in the public health facilities of Amhara National Regional State, Ethiopia: a quasi-experimental evaluation

Abstract

Abstract Background Capacity Building and Mentorship Partnership (CBMP) is a flagship program designed by the Ethiopian Ministry of Health in collaboration with six local universities to strengthen the national health information system and facilitate evidence-informed decision making through various initiatives. The program was initiated in 2018. This evaluation was aimed to assess the outcome of CBMP on health data quality in the public health facilities of Amhara National Regional State, Ethiopia. Methods A matched comparison group evaluation design with a sequential explanatory mixed-method was used to evaluate the outcome of CBMP on data quality. A total of 23 health facilities from the intervention group and 17 comparison health facilities from a randomly selected district were used for this evaluation. The Organization for Economic Cooperation and Development (OECD) evaluation framework with relevance, effectiveness, and impact dimensions was used to measure the program’s outcome using the judgment parameter. The program’s average treatment effect on data quality was estimated using propensity score matching (PSM). Results The overall outcome of CBMP was found to be 90.75 %. The mean data quality in the intervention health facility was 89.06 % [95 %CI: 84.23, 93.88], which has a significant mean difference with the comparison health facilities (66.5 % [95 % CI: 57.9–75]). In addition, the CBMP increases the data quality of pilot facilities by 27.75 % points [95 %CI: 17.94, 37.58] on the nearest neighboring matching. The qualitative data also noted that there was a data quality problem in the health facility and CBMP improved the data quality gap among the intervention health facilities. Conclusions The outcome of the CBMP was highly satisfactory. The program effectively increased the data quality in the health facilities. Therefore, the finding of this evaluation can be used by policymakers, program implementers, and funding organizations to scale the program at large to improve the overall health data quality for health outcome improvement.

Keywords

• CBMP
• Effectiveness
• Impact
• Outcome
• Evaluation
• Data quality