The Method of League Analysis and Its Application in Comparing Global University Rankings and Russia’s University Performance Monitoring

Abstract

A new technique called Method of Analysis of Leagues (MethALeague) is proposed for comparing performance of higher education institutions measured by different assessment methods. The MethALeague uses the convolution operations from the theory of small-group decision making to create aggregate charts of university leagues based on the performance indicators obtained with different assessment techniques. Specifically, researchers are given the opportunity to bring widely divergent university performance indicators into unified assessment charts and carry out comparative analysis of different assessment approaches. The MethALeague was applied successfully to compare the performance indicators of the Project 5–100 universities reflected in three major global rankings, Academic Ranking of World Universities, QS World University Rankings, and Times Higher Education World University Rankings. A formalized concept of “world ranking” proposed in the article makes it possible to visualize the performance dynamics of Russia’s top universities and compare it to that of the top universities in other countries (United States, Great Britain, Australia, Germany, and China). Suggestions are made on using a modified version of the MethALeague at the national level to analyze the results of university performance monitoring and compare them to the universities’ global ranking positions. The method described in the article could be applied by educational authorities, researchers and higher education institutions to determine the frameworks of strategic development, both for specific universities and for Russia’s higher education system as a whole.

Keywords

• higher education institutions
• ranking
• global rankings
• performance monitoring
• convolution operations
• the borda count method
• method of analysis of leagues (methaleague)