University rankings: A review of methodological flaws

• Main Authors: Muhammad Ashraf, Fauzi, Tan, Christine Nya-Ling, Mahyuddin, Daud, Muhammad Mukhtar, Noor Awalludin
• Format: Article
• Language: English
• Published: Institutes for Educational Research 2020
• Subjects: L Education (General); LB2300 Higher Education
• Online Access: http://umpir.ump.edu.my/id/eprint/27941/1/2020-%20IIER-University%20rankings-%20A%20review%20of%20methodological%20flaws.pdf; http://umpir.ump.edu.my/id/eprint/27941/; http://www.iier.org.au/iier30/fauzi-abs.html
• Institution: Universiti Malaysia Pahang

University rankings have gradually become an issue for concern in the academic community worldwide. Several mechanisms with different methodologies have been developed to rank the universities appropriately. However, some ranking tools have notable issues, especially with the indicators adopted. Some are based merely on research performance, whilst others have focused solely on specific fields, such as science and technology - which could have deprived those in the arts and social sciences. This paper uses a narrative review to highlight a number of inconsistencies in the methodologies applied to rank universities. Five main ranking tools commonly applied to the world's universities are reviewed, namely Quacquarelli Symonds (QS), Times Higher Education (THE), Academic Ranking of World Universities (ARWU), Leiden University ranking and Webometrics ranking. We found that several flaws in the rankings caused inconsistencies in university placings in different rankings. Suggestions for integrating multiple criteria and indicators for better ranking exercises are proposed.