Analysis of the Interrater Reliability and Agreement of Breaking Battles in the 2018 Buenos Aires Youth Olympics

Abstract

PURPOSE This study aimed to establish a standardized evaluation of the consistency and reliability of the results of the 2018 Buenos Aires Youth Olympics. METHODS The results of the preliminary and the final rounds of the individual Boys and Girls competition of the 2018 Buenos Aires Youth Olympics were collected. Data were organized using Microsoft Windows Excel 2021. Windows SPSS 26.0 was used for descriptive statistics. Intraclass correlation coefficient calculation was used to analyze the evaluation score. The winner/loser decision, and the evaluation interrater agreement was confirmed using Fleiss' kappa. RESULTS There was a difference in the scores given by the judges in both the preliminary and final rounds of both competitions. A low correlation was observed between the decided winner of the judges, and the point variance for each item. CONCLUSIONS In the trivium value system, differences in the evaluation strategies of the judges may exist. Thus, improvements to standardize evaluation should be implemented. In addition, this scoring system considers various factors in the evaluation process, and the scoring system is complicated. Therefore, there may be a need to revise the evaluation system and find the optimal number of judges to create a better evaluation.

Keywords

• breaking battle
• trivium value system
• interrater reliability
• interrater agreement