Blinding of Residency Applications in Medical Physics: Promises and Pitfalls

Abstract

Purpose: The feasibility of blinding applications for a medical physics residency program has yet to be demonstrated in the literature. We explore the application of an automated approach with human review and intervention to blind applications during the annual medical physics residency review cycle. Methods and Materials: Applications were blinded using an automated process and used for the first phase of residency review in the program. We retrospectively compared self-reported demographic and gender data with blinded and nonblinded cohorts from 2 sequential years of review from a medical physics residency program. Demographic data were analyzed comparing applicants with candidates selected to move to the next phase of the review process. Interrater agreement was also evaluated from the applicant reviewers. Results: We show the feasibility of blinding applications for a medical physics residency program. We observed no more than a 3% difference between the gender selection within the first phase of application review but greater differences when examining race and ethnicity between the 2 methods. The greatest difference was shown to be between Asian and White candidates, where there are statistical differences in the scores in the rubric categories of essay and overall impression. Conclusions: We suggest that each training program critically evaluate its selection criteria for potential sources of bias within the review process. We recommend further critical investigation of processes to promote equity and inclusion to ensure the methods and outcomes are aligned with the mission of the program. Finally, we recommend that the common application provide an option for blinding applications at the source so this can be an option to facilitate efforts for evaluating unconscious bias in the review process.