Critical Synthesis Package: Assessment of Professional Behaviors (APB)

Abstract

Abstract This Critical Synthesis Package contains: (1) a Critical Analysis of the psychometric properties and application to health sciences education for the Assessment of Professional Behaviors (APB) Instrument, and (2) a copy of the APB Instrument and two sample reports from the National Board of Medical Examiners (NBME), developed by the NBME. The APB program is a multisource feedback program designed to evaluate the observable behaviors of residents/fellows during their clinical training. The core component of the program is a multisource feedback assessment measure, the APB Instrument, which is the focus of this critical analysis. There are two electronic versions of the APB Instrument. One is provided to the resident/fellow (self-assessment) and the other to those observing their behaviors (i.e., faculty, nurses, peers, etc.). Both versions evaluate 23 behaviors, rated using a 5-point frequency scale, as well as two free-text fields intended to provide room for specific critiques and/or praise. Behaviors assessed as part of formative assessment include interpersonal and communication skills, systems based practice, professionalism, and practice-based learning and improvement. The research on this instrument has resulted in mixed outcomes related to response process validity and identified a potential difficulty related to the preparation of successful rater training sessions. Observers' skills in providing useful written feedback may be amenable to improvement through better modeling, training, and practice. Training that generates awareness of the elements of effective feedback may lead to improved written feedback specific to professionalism.

Keywords

• DREAM
• Directory and Repository of Educational Assessment Measures
• Professionalism Behaviors
• Multisource (360) Feedback
• Formative