Development and Implementation of Multi-source Assessment Tools for ACGME Residents and Fellows

Abstract

Abstract Effective evaluation is a cornerstone of medical education. The ACGME requires that trainees are assessed and provided feedback for each rotation, and that competency-based, multi-source evaluation is incorporated. National data from the ACGME's 2013 resident survey indicates dissatisfaction with faculty feedback among 27% of residents; this finding has been consistent over several years. ACGME migration to milestones as part of the Next Accreditation System (NAS) has helped focus increased graduate medical education director and faculty attention on assessment and underscores the potential usefulness of thoughtfully developed standardized evaluations. Semi-annual reporting of individual achievement of specified milestones must rely upon ongoing formative (e.g., end of rotation) assessment utilizing a variety of tools. Indeed, the ACGME continues to require formative, competency-based multi-source assessment at the conclusion of each rotation or educational assignment. This work represents a collection of multi-source assessment tools (e.g., evaluation of trainee by faculty, peer, other healthcare professional, self- assessment) intended for formative competency-based feedback and evaluation. They meet ACGME requirements for formative competency-based evaluation at the end of each rotation and are intended for multi-source assessment in both ACGME and non-ACGME residency and fellowship programs. Content included relates to knowledge, skills, and behavior relevant to all specialties. This will be particularly important as specialty-based milestones are determined at the national level. The resulting assessment tools provide multi-source, competency-based evaluation for assessment of ACGME trainees. They have been provided to the approximately 100 ACGME-accredited GME programs at Massachusetts General and Brigham and Women's hospitals and are currently in use by 36 programs. Twenty-four faculty development sessions have been provided since 2011. These sessions introduce the assessment tools with tips for implementation and evidence-based feedback and evaluation strategies. Competency-based 360 assessment tools combined with faculty development may improve the quality and consistency of feedback and evaluation of trainees. These assessment tools provide the framework for ongoing formative verbal feedback, end of rotation formative evaluation as required by the ACGME, and serve to inform the biannual specialty-specific milestone assessments.

Keywords

• Feedback
• Medical
• Evaluation Studies
• Core Competencies
• Resident
• Outcomes Assessment