A Short Tutorial on Validation in Educational and Psychological Assessment

Abstract

Validity theory has evolved considerably over time, transitioning from a simplistic notion of what tests purport to measure to a more nuanced understanding encompassing the interpretation and uses of test scores. This latter understanding of validity places equal importance on how test scores are interpreted and how tests are used in society. Despite the central role validity plays in assessment, there exists a divergence of perspectives regarding the inclusion of test consequences in validation processes. While some argue for a focus solely on the inference of score meaning, others advocate for a comprehensive consideration of test use implications. This tutorial aligns with the latter perspective, drawing heavily on the Standards for Educational and Psychological Testing and socioculturally sustaining assessment. A pedagogical activity is presented through concept maps to enhance understanding of validity and validation among graduate students in social sciences, humanities, and health sciences. The activity consists of three scaffolded steps: (1) a pre-teaching concept map, (2) a gap-filling concept map, and (3) the development of culturally sustaining perspectives for test validation and guiding research questions to address sources of validity evidence..

Keywords

• put keywords here
• in a comma separated list
• cmaptools