The USE Test in History and Its Validity: Experts of Regional Subject-Specific Committees Speculating on Free-Response Items

Abstract

The Unified State Exam (USE) in Russia is both an achievement and admission test, yet its validity has not been looked into on a large scale. The evolution of USE tests is distinctly marked by a growing number of constructed-response items, which might be affecting the validity of test results in many ways. In-depth semi-structured interviews with 36 USE experts in history allow identifying three major threats to USE validity: assessment criteria for items 24 and 25, item content, and expert bias. Interview transcripts were analyzed using content analysis, the results of which are presented along with recommendations on how to further improve the processes of item design and evaluation.

Keywords

• testing
• validity
• constructed-response items
• free-response items
• history performance assessments
• subjectivity in assessment
• unified state exam (use)