Benefits of transport subsidisation: Comparing findings from a customer perception survey and Most Significant Change Technique interviews

Abstract

Background: An evaluation of a transport subsidisation programme in the Western Cape, South Africa, was undertaken to capture the outcomes and benefits of the service from the perspective of the bus user. Objectives: The objective of this article was to compare the findings from the adopted parallel mixed-methods design that included a perception survey and the Most Significant Change (MSC) technique. The article presented the advantages of each approach and reflected on the benefits and challenges in applying the MSC technique. Method: Data on the intended outcomes of the Provincial Transport Operations Grant programme were collected from 458 commuters on four bus routes through a structured close-ended questionnaire. The MSC technique was applied to collect 69 stories of change that captured changes regarded as most significant by beneficiaries of the public transport subsidy. Results: It was found that the survey better captured the intended and predetermined objectives of the programme, while the large response group allowed for comparisons and cross-tabulations. The MSC interviews better captured the real-life experience of participants and identified the benefits most valued by commuters, including outcomes not specifically anticipated by the programme. It also served to clarify contradicting responses or ratings on the closed-ended questionnaire and informed further bivariate analysis of the structured questionnaire data. Conclusion: To maximise benefits from the MSC technique, sufficient time is needed to solicit value responses from respondents, while decision-makers should allow time for multiple iterations and discussions at different levels of the hierarchy.

Keywords

• mixed-methods design
• outcome evaluation
• value clarification
• methodology reflections
• public transport programme