Journal of Work and Organizational Psychology (Dec 2023)

Predictive Validity, Applicant Reactions, and Influence of Personal Characteristics of a Gamefully Designed Assessment

  • Pedro J. Ramos-Villagrasa,
  • Elena Fernández-del-Río

DOI
https://doi.org/10.5093/jwop2023a18
Journal volume & issue
Vol. 39, no. 3
pp. 169 – 178

Abstract

Read online

The use of game-related assessments (GRAs) in personnel selection is increasing. However, the type of GRA under investigation should be considered. This study focuses on game-based assessments, which closely resemble leisure-oriented videogames. We specifically examined a serious game that assesses personality traits (assertiveness, sociability, tolerance, and rules). We analyzed its predictive validity, applicant reactions, and the impact of personal and job-related factors on scores. The study included 182 participants who played the GRA and completed a Big Five questionnaire. Findings revealed that the game predicts adaptive performance, offering incremental value over the Big Five (ΔR2 = .107). Additionally, candidates reacted more positively to the GRA in terms of comfort and fit, although the effect size was small (d = -0.1757 and -0.3119, respectively). Relating to personal and job-related characteristics, only job experience significantly affected the assertiveness score, albeit with a small effect size (d = -0.3870).

Keywords