Navigating complexity in evaluation with participatory systems mapping: A systematic review

Abstract

Background: Traditional evaluation methods suffer from some reductionism in dealing with complex interventions. To cope with this issue, researchers advocate for a more participatory approach to better understand how an intervention interacts with other factors within a broader system. Objectives: Given the limited research incorporating Participatory Systems Mapping (PSM) into the evaluation process, this systematic review offers insights into how the PSM method can be applied to assess complex interventions. Method: We conducted a systematic review of the PSM method’s application in the evaluation field. This review examined scientific publications in peer-reviewed journals dealing with the PSM and its use in evaluation. Results: The research demonstrated that PSM has been a helpful tool for generating a comprehensive and profound understanding of how interventions function in complex settings. The findings indicate that PSM primarily utilises network analysis, integrated with stakeholders’ insights. However, several challenges have been identified: (1) PSM may fail to incorporate all stakeholders, resulting in an incomplete comprehension, (2) Addressing diverse stakeholder perceptions presents a significant hurdle and (3) Combining PSM with other methods is necessary to foster a more comprehensive approach. Conclusion: This article provides insights into the application of PSM for evaluation purposes. It achieves this by summarising and analysing previous works, shedding light on the potential and limitations of its meaningful usage. Contribution: This article addresses the lack of research employing PSM within the evaluation field, providing evaluators with valuable insights to leverage the use of this method in evaluating complex interventions.

Keywords

• complexity
• participatory systems mapping
• systematic review
• complexity
• system thinking.