Establishing Inter-Rater Reliability of the Occupation-Centered Intervention Assessment for Student Observation of Rehabilitation Interventions

Abstract

The Occupation-Centered Intervention Assessment (OCIA) is a tool designed to capture and rank occupational therapy interventions through an occupational lens to improve occupational therapy students’ professional reasoning skills. The purpose of this study was to determine the inter-rater reliability of the OCIA for occupational therapy interventions provided to adults with physical rehabilitation needs as observed by occupational therapy students. Utilizing a methodological research approach, 111 students completed training for application of the OCIA and independently scored five standardized videos of occupational therapy interventions. Results indicated an overall agreement of α=0.856 using Krippendorff’s alpha. Student raters demonstrated good agreement for rating adult physical rehabilitation interventions, indicating that the OCIA may be a beneficial learning tool for didactic coursework prior to experiential learning.

Keywords

• professional reasoning
• professional identity
• clinical reasoning
• students
• outcome and process assessment (health care)