Implementing work place based assessment: the modified direct observation of procedural skills (DOPS) across medical specialties. An experience from a developing country

Abstract

Objective: To assess the skill level of residents regarding central venous catheterisation insertion, and to assess the reliability of scores in a simulated situation. Methods: The quasi-experimental study with pre- and post-test design was conducted from February to June 2013 at the Aga Khan University, Karachi, and comprised four workshops attended by residents. The workshops were video-recorded for feedback and self-assessment. At the end of the workshops, knowledge and procedural skills were assessed using a self-generated 38-item, task-specific instrument after ensuring its content validity. Data was analysed using SPSS 19. Results: There were 40 residents in the sample. The self-generated instrument was reliable with Cronbach’s alpha value 0.83 and inter-rater coefficient 0.79. There was significant improvement in the skills level post-intervention compared to the baselines mean values (p=0.001). The subjects were satisfied with the workshops, as indicated by a mean score of 8.83+/-1.367. Conclusions: The workshops appeared to improve the central venous catheterisation insertion skills of the residents. Key Words: Direct observation of procedural skills, Workplace-based assessment, Postgraduate medical education, Resident, Central venous catheterisation. Continue..