BMC Medical Informatics and Decision Making (Jul 2024)
Effect of the data-informed platform for health intervention on the culture of data use for decision-making among district health office staff in North Shewa Zone, Ethiopia: a cluster-randomised controlled trial
Abstract
Abstract Background Similar to other low and middle-income countries, Ethiopia faces limitations in using local health data for decision-making.We aimed to assess the effect of an intervention, namely the data-informed platform for health, on the culture of data-based decision making as perceived by district health office staff in Ethiopia’s North Shewa Zone. Methods By designating district health offices as ‘clusters’, a cluster-randomised controlled trial was implemented. Out of a total of 24 districts in the zone, 12 districts were allocated to intervention arm and the other 12 in the control group arms. In the intervention arm district health office teams were supported in four-monthly cycles of data-driven decision-making over 20 months. This support included: (a) defining problems using a health system framework; (b) reviewing data; (c) considering possible solutions; (d) value-based prioritizing; and (e) a consultative process to develop, commit to, and follow up on action plans. To measure the culture of data use for decision-making in both intervention and control arms, we interviewed 120 health management staff (5 per district office). Using a Likert scale based standard Performance of Routine Information System Management tool, the information is categorized into six domains:- evidence-based decision making, emphasis on data quality, use of information, problem solving, responsibility and motivation. After converting the Likert scale responses into percentiles, difference-in-difference methods were applied to estimate the net effect of the intervention. In intervention districts, analysis of variance was used to summarize variation by staff designation. Results The overall decision-making culture in health management staff showed a net improvement of 13% points (95% C.I:9, 18) in intervention districts. The net effect of each of the six domains in turn was an 11% point increase (95% C.I:7, 15) on culture of evidence based decision making, a 16% point increase (95% C.I:8, 24) on emphasis on data quality, a 20% point increase (95% C.I:12, 28) on use of information, a 21% point increase (95% C.I:13, 29) on problem solving, and a 10% point increase (95% C.I:4, 16) on responsibility and motivation. In terms of variation by staff designation within intervention districts, statistically significant differences were observed only for problem solving and responsibility. Conclusion The data-informed platform for health strategy resulted in a measurable improvement in data use and structured decision-making culture by using existing systems, namely the Performance Monitoring Team meetings. The intervention supported district health offices in identifying and solving problems through a structured process. After further research, DIPH intervention could also be applied to other health administration and facility levels. Trial registration ClinicalTrials.gov ID: NCT05310682, Dated 25/03/ 2022.
Keywords