Mental models as moderating variable in 360 degree competency assessments

Abstract

The purpose of this study is to determine whether raterroups have different mental models regarding the construct that is being assessed. Sixty-eight marketing employees, working in the petro-chemical industry, were evaluated by themselves, their managers, customers and peers. The performance dimensions included in the Marketing Competency Questionnaire (MCQ) were generated on a consensus basis between representatives of the different rater-groups in an attempt to improve the inter-rater reliabilities of the questionnaire. Item scores were inter-correlated and simplified factor scores were compiled for each of the rater-groups. These simplified factor scores were again intercorrelated and single factors with high internal consistencies for each rater-group were obtained. An inter-battery factor analysis between these factors yielded a single factor with different factor loads from the various rater-groups' factors. The implications for these findings are further discussed. Opsomming Die doel van hierdie studie is om vas te stel of beoordelingsgroepe verskillende denkbeelde het met betrekking tot die konstruk wat beoordeel word. Agt-en-sestig bemarkingspersone wat in die petro-chemiese bedryfwerksaam is, is deur hulleself, hulle bestuurders, kliente en medewerkers geevalueer. Die prestasiedimensies wat in die Bemarkingsbevoegdheidsvraelys (MCQ) ingesluit is, is op n konsensusbasis tussen verteenwoordigers van die verskillende beoordelingsgroepe gegenereer in n poging om die tussen-beoordelaarbetroubaarhede van die vraelys te verhoog. Itemtellings is geinterkorreleer en vereenvoudigde faktortellings is vir elke beoordelingsgroep bereken. Hierdie vereenvoudigde faktortellings is weer geinterkorreleer en enkelfaktore met hoe interne betroubaarhede vir eike groep is verkry 'n Inter-battery faktorontleding tussen hierdie faktore het 'n enkele faktor met verskillende faktorladings vir faktore van die verskillende beoordelingsgroepe opgelewer. Die implikasies van hierdie bevindinge word verder bespreek.

Keywords

• 360 degree competency assessments
• Mental models