Rankings revisited

Ignacy Kaliszewski


We argue that rankings, as they are commonly used, can be, and perhaps are, misleading and potentially harmful.

With little extra effort, however, one can gain much more insight into relations among the objects ranked and, in the consequence, gain a better understanding of the ranking. The fundamental notion used to compare and evaluate rankings in our analysis is that of Pareto optymality. General claims are illustrated with the ranking of Polish universities published by Perspektywy monthly in 2016.

This note is based on results that are well known in the areas of multiobjective optimization and multiple-criteria decision analysis. The objective of the note is to point to the shortcomings and potential pitfalls behind the common use and understanding of rankings.

Słowa kluczowe

rankings, dominance, incomparability, subjectivity

Pełny tekst / Download full text:

PDF (English)


Perspektywy 2016 ranking (2016). http://www.perspektywy.pl/RSW2016/ranking-uczelni-akademickich, as by October 2018 .

Ehrgott, M. (2005). Multicriteria Optimization. Springer.

Jastrzębski, P., Kaliszewski, I. (2011). Computer-aided decision making {the multiple criteria approach; the case of planning Via Baltica expressway} (in Polish). Contemporary Management Problems, 1, 63-70. Warsaw School of Information Technology.

Kaliszewski, I. (1994). Quantitative Pareto Analysis by Cone Separation Technique. Kluwer Academic Publishers, Boston.

Kaliszewski, I. (2006). Soft Computing for Complex Multiple Criteria Decision Making. Springer, New York.

Kaliszewski, I., Miroforidis, J., Podkopaev, D. (2016). Multiple Criteria Decision Making by Multiobjective Optimization - A Toolbox. Springer.

Kaliszewski, I., Samuelson, D.A. (2016). Models that are never wrong. OR/MS Today, June 2017, 24-27.

Miettinen, K.M. (1999). Nonlinear Multiobjective Optimization. Kluwer Academic Publishers, Boston.

Rankings (2018). An electronic companion. http://www.ibspan.waw.pl/_kaliszew/Rankingi.

Simon, H. (1977). The New Science of Management Decision. Prentice Hall.

DOI: http://dx.doi.org/10.7206/DEC.1733-0092.115


  • There are currently no refbacks.