MedEdPublish (Mar 2017)

Have we got the selection process right? The validity of selection tools for predicting academic performance in the first year of undergraduate medicine

  • Marita Lynagh,
  • Brian Kelly,
  • Graeme Horton,
  • Ben Walker,
  • David Powis,
  • Miles Bore,
  • Donald Munro,
  • Ian Symonds,
  • Graham Jones,
  • Amanda Nagle,
  • Tim Regan,
  • Patrick McElduff,
  • Michael David

Journal volume & issue
Vol. 6, no. 1

Abstract

Read online

Content: There remains much debate over the 'best' method for selecting students in to medicine. This study aimed to assess the predictive validity of four different selection tools with academic performance outcomes in first-year undergraduate medical students. Methods: Regression analyses were conducted between admission scores on previous academic performance - the Australian Tertiary Admission Rank (ATAR), the Undergraduate Medicine and Health Sciences Admission Test (UMAT), Multiple-Mini Interview (MMI) and the Personal Qualities Assessment (PQA) with student performance in first-year assessments of Multiple Choice Questions, Short Answer Questions, Objective Structured Clinical Examinations (OSCE) and Problem-Based Learning (PBL) Tutor ratings in four cohorts of students (N = 604, 90%). Results: All four selection tools were found to have significant predictive associations with one or more measures of student performance in Year One of undergraduate medicine. UMAT, ATAR and MMI scores consistently predicted first year performance on a number of outcomes. ATAR was the only selection tool to predict the likelihood of making satisfactory progress overall. Conclusions: All four selection tools play a contributing role in predicting academic performance in first year medical students. Further research is required to assess the validity of selection tools in predicting performance in the later years of medicine.

Keywords