Inter-examiner reliability when using the Objective Structured Practical Examination (OSPE) mark sheet for physiotherapy practical

B. Olivier; V. Naidoo; C. Humphries; L. Godlwana; M. Romm; V. Ntsiea; H. van Aswegen; H. Myezwa; R. Roos; W. Mudzi; J. Potterton; B Watt; D. Maleka; S. Mtshali; A. Stewart

doi:10.4102/sajp.v69i4.375

South African Journal of Physiotherapy (Jan 2013)

Inter-examiner reliability when using the Objective Structured Practical Examination (OSPE) mark sheet for physiotherapy practical

B. Olivier,
V. Naidoo,
C. Humphries,
L. Godlwana,
M. Romm,
V. Ntsiea,
H. van Aswegen,
H. Myezwa,
R. Roos,
W. Mudzi,
J. Potterton,
B Watt,
D. Maleka,
S. Mtshali,
A. Stewart

Affiliations

B. Olivier: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
V. Naidoo: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
C. Humphries: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
L. Godlwana: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
M. Romm: King’s College London
V. Ntsiea: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
H. van Aswegen: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
H. Myezwa: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
R. Roos: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
W. Mudzi: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
J. Potterton: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
B Watt: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
D. Maleka: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
S. Mtshali: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
A. Stewart: Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand

DOI: https://doi.org/10.4102/sajp.v69i4.375
Journal volume & issue: Vol. 69, no. 4

Abstract

Read online

The Objective Structured Practical Examination (OSPE) format is used during practical examinations as part of the physiotherapy undergraduate curriculum at the University of the Witwatersrand. Various factors influence inter-examiner reliability and investigating the inter-examiner reliability when using the OSPE can lead to improvement of the examination process. The aim of this study was to establish inter-examiner reliability when using the OSPE mark sheet. Methods: Twelve examiners participated in this study. Thirty-three second year PT students were examined at six stations and by two examiners at each station. The Spearman’s correlation test was used to establish inter-examiner reliability. Results: The general inter-examiner reliability of the OSPE mark sheet was high. There was a high correlation between examiners who had the same level of experience (r=0.79 to r=0.93; p<0.001). The background knowledge section of the OSPE mark sheet showed the greatest inter-examiner reliability (r=0.75 to r=0.91; p<0.001). Discussion: In general, a high inter-examiner reliability was found. Examiners with the same level of experience seemed to generally have better inter-examiner reliability when using the OSPE mark sheet. Furthermore, a well-described, operationalised list of micro-skills also improved inter-examiner reliability. Conclusion: The OSPE mark sheet aids inter-examiner reliability. The use of this method of examination should be encouraged.

Published in South African Journal of Physiotherapy

ISSN: 0379-6175 (Print); 2410-8219 (Online)
Publisher: AOSIS
Country of publisher: South Africa
LCC subjects: Medicine: Therapeutics. Pharmacology
Website: https://sajp.co.za/index.php/sajp

About the journal

Abstract

Keywords