Document (#39501)

Author

Dobrota, M.
Bulajic, M.
Bornmann, L.
Jeremic, V.

Title

¬A new approach to the QS university ranking using the composite I-distance indicator : uncertainty and sensitivity analyses

Source

Journal of the Association for Information Science and Technology. 67(2016) no.1, S.200-211

Year

2016

Abstract

Some major concerns of universities are to provide quality in higher education and enhance global competitiveness, thus ensuring a high global rank and an excellent performance evaluation. This article examines the Quacquarelli Symonds (QS) World University Ranking methodology, pointing to a drawback of using subjective, possibly biased, weightings to build a composite indicator (QS scores). We propose an alternative approach to creating QS scores, which is referred to as the composite I-distance indicator (CIDI) methodology. The main contribution is the proposal of a composite indicator weights correction based on the CIDI methodology. It leads to the improved stability and reduced uncertainty of the QS ranking system. The CIDI methodology is also applicable to other university rankings by proposing a specific statistical approach to creating a composite indicator.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23355/abstract.

Similar documents (author)

1. Bornmann, L.: Complex tasks and simple solutions : the use of heuristics in the evaluation of research (2015) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 8911) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 8911, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=8911)
   

2. Bornmann, L.: What is societal impact of research and how can it be assessed? : a literature survey (2013) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 606) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 606, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=606)
   

3. Bornmann, L.: How to analyze percentile citation impact data meaningfully in bibliometrics : the statistical analysis of distributions, percentile rank classes, and top-cited papers (2013) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 656) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 656, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=656)
   

4. Bornmann, L.: Lässt sich die Qualität von Forschung messen? (2013) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 928) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 928, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=928)
   

5. Bornmann, L.: On the function of university rankings (2014) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 1188) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 1188, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=1188)
   

Similar documents (content)

1. Franceschet, M.: ¬A cluster analysis of scholar and journal bibliometric indicators (2009) 0.23

   0.23043917 = sum of:
     0.23043917 = product of:
       1.1521958 = sum of:
         0.061076816 = weight(abstract_txt:possibly in 3109) [ClassicSimilarity], result of:
           0.061076816 = score(doc=3109,freq=1.0), product of:
             0.10574896 = queryWeight, product of:
               1.0453779 = boost
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.013683354 = queryNorm
             0.57756424 = fieldWeight in 3109, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.078125 = fieldNorm(doc=3109)
         0.052492306 = weight(abstract_txt:global in 3109) [ClassicSimilarity], result of:
           0.052492306 = score(doc=3109,freq=1.0), product of:
             0.12043857 = queryWeight, product of:
               1.5777313 = boost
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.013683354 = queryNorm
             0.435843 = fieldWeight in 3109, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.078125 = fieldNorm(doc=3109)
         0.08196052 = weight(abstract_txt:methodology in 3109) [ClassicSimilarity], result of:
           0.08196052 = score(doc=3109,freq=2.0), product of:
             0.16209576 = queryWeight, product of:
               2.5885172 = boost
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.013683354 = queryNorm
             0.50563025 = fieldWeight in 3109, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.078125 = fieldNorm(doc=3109)
         0.41281462 = weight(abstract_txt:indicator in 3109) [ClassicSimilarity], result of:
           0.41281462 = score(doc=3109,freq=3.0), product of:
             0.4482065 = queryWeight, product of:
               4.8123736 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.013683354 = queryNorm
             0.92103666 = fieldWeight in 3109, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.078125 = fieldNorm(doc=3109)
         0.54385155 = weight(abstract_txt:composite in 3109) [ClassicSimilarity], result of:
           0.54385155 = score(doc=3109,freq=2.0), product of:
             0.61658376 = queryWeight, product of:
               5.6443806 = boost
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.013683354 = queryNorm
             0.88204 = fieldWeight in 3109, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.078125 = fieldNorm(doc=3109)
       0.2 = coord(5/25)
   

2. Dobrota, M.; Dobrota, M.: ARWU ranking uncertainty and sensitivity : what if the award factor was Excluded? (2016) 0.19

   0.18986703 = sum of:
     0.18986703 = product of:
       0.79111266 = sum of:
         0.09332572 = weight(abstract_txt:stability in 2652) [ClassicSimilarity], result of:
           0.09332572 = score(doc=2652,freq=2.0), product of:
             0.11134808 = queryWeight, product of:
               1.0726959 = boost
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.013683354 = queryNorm
             0.83814394 = fieldWeight in 2652, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.078125 = fieldNorm(doc=2652)
         0.08429997 = weight(abstract_txt:sensitivity in 2652) [ClassicSimilarity], result of:
           0.08429997 = score(doc=2652,freq=1.0), product of:
             0.13109218 = queryWeight, product of:
               1.1639214 = boost
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.013683354 = queryNorm
             0.6430587 = fieldWeight in 2652, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.078125 = fieldNorm(doc=2652)
         0.035182156 = weight(abstract_txt:university in 2652) [ClassicSimilarity], result of:
           0.035182156 = score(doc=2652,freq=1.0), product of:
             0.10558783 = queryWeight, product of:
               1.8092675 = boost
               4.264995 = idf(docFreq=1688, maxDocs=44218)
               0.013683354 = queryNorm
             0.33320275 = fieldWeight in 2652, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.264995 = idf(docFreq=1688, maxDocs=44218)
               0.078125 = fieldNorm(doc=2652)
         0.101198204 = weight(abstract_txt:uncertainty in 2652) [ClassicSimilarity], result of:
           0.101198204 = score(doc=2652,freq=1.0), product of:
             0.18655936 = queryWeight, product of:
               1.9636259 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.013683354 = queryNorm
             0.54244506 = fieldWeight in 2652, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.078125 = fieldNorm(doc=2652)
         0.23876797 = weight(abstract_txt:ranking in 2652) [ClassicSimilarity], result of:
           0.23876797 = score(doc=2652,freq=9.0), product of:
             0.181957 = queryWeight, product of:
               2.375091 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.013683354 = queryNorm
             1.3122219 = fieldWeight in 2652, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.078125 = fieldNorm(doc=2652)
         0.23833866 = weight(abstract_txt:indicator in 2652) [ClassicSimilarity], result of:
           0.23833866 = score(doc=2652,freq=1.0), product of:
             0.4482065 = queryWeight, product of:
               4.8123736 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.013683354 = queryNorm
             0.5317608 = fieldWeight in 2652, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.078125 = fieldNorm(doc=2652)
       0.24 = coord(6/25)
   

3. Waltman, L.; Calero-Medina, C.; Kosten, J.; Noyons, E.C.M.; Tijssen, R.J.W.; Eck, N.J. van; Leeuwen, T.N. van; Raan, A.F.J. van; Visser, M.S.; Wouters, P.: ¬The Leiden ranking 2011/2012 : data collection, indicators, and interpretation (2012) 0.14

   0.14212562 = sum of:
     0.14212562 = product of:
       0.5921901 = sum of:
         0.052793 = weight(abstract_txt:stability in 514) [ClassicSimilarity], result of:
           0.052793 = score(doc=514,freq=1.0), product of:
             0.11134808 = queryWeight, product of:
               1.0726959 = boost
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.013683354 = queryNorm
             0.47412583 = fieldWeight in 514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.041993845 = weight(abstract_txt:global in 514) [ClassicSimilarity], result of:
           0.041993845 = score(doc=514,freq=1.0), product of:
             0.12043857 = queryWeight, product of:
               1.5777313 = boost
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.013683354 = queryNorm
             0.3486744 = fieldWeight in 514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.039804064 = weight(abstract_txt:university in 514) [ClassicSimilarity], result of:
           0.039804064 = score(doc=514,freq=2.0), product of:
             0.10558783 = queryWeight, product of:
               1.8092675 = boost
               4.264995 = idf(docFreq=1688, maxDocs=44218)
               0.013683354 = queryNorm
             0.37697586 = fieldWeight in 514, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.264995 = idf(docFreq=1688, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.22056438 = weight(abstract_txt:ranking in 514) [ClassicSimilarity], result of:
           0.22056438 = score(doc=514,freq=12.0), product of:
             0.181957 = queryWeight, product of:
               2.375091 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.013683354 = queryNorm
             1.2121786 = fieldWeight in 514, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.04636387 = weight(abstract_txt:methodology in 514) [ClassicSimilarity], result of:
           0.04636387 = score(doc=514,freq=1.0), product of:
             0.16209576 = queryWeight, product of:
               2.5885172 = boost
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.013683354 = queryNorm
             0.28602767 = fieldWeight in 514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.19067092 = weight(abstract_txt:indicator in 514) [ClassicSimilarity], result of:
           0.19067092 = score(doc=514,freq=1.0), product of:
             0.4482065 = queryWeight, product of:
               4.8123736 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.013683354 = queryNorm
             0.42540863 = fieldWeight in 514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
       0.24 = coord(6/25)
   

4. Rousseau, R.: Basic properties of both percentile rank scores and the I3 indicator (2012) 0.09

   0.092888 = sum of:
     0.092888 = product of:
       0.7740667 = sum of:
         0.1065467 = weight(abstract_txt:scores in 4993) [ClassicSimilarity], result of:
           0.1065467 = score(doc=4993,freq=1.0), product of:
             0.17097831 = queryWeight, product of:
               1.8798393 = boost
               6.6470313 = idf(docFreq=155, maxDocs=44218)
               0.013683354 = queryNorm
             0.62315917 = fieldWeight in 4993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6470313 = idf(docFreq=155, maxDocs=44218)
               0.09375 = fieldNorm(doc=4993)
         0.09550719 = weight(abstract_txt:ranking in 4993) [ClassicSimilarity], result of:
           0.09550719 = score(doc=4993,freq=1.0), product of:
             0.181957 = queryWeight, product of:
               2.375091 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.013683354 = queryNorm
             0.52488875 = fieldWeight in 4993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.09375 = fieldNorm(doc=4993)
         0.5720128 = weight(abstract_txt:indicator in 4993) [ClassicSimilarity], result of:
           0.5720128 = score(doc=4993,freq=4.0), product of:
             0.4482065 = queryWeight, product of:
               4.8123736 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.013683354 = queryNorm
             1.2762259 = fieldWeight in 4993, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.09375 = fieldNorm(doc=4993)
       0.12 = coord(3/25)
   

5. Zeynali-Tazehkandi, M.; Nowkarizi, M.: ¬ A dialectical approach to search engine evaluation (2020) 0.08

   0.078133106 = sum of:
     0.078133106 = product of:
       0.6511092 = sum of:
         0.065991245 = weight(abstract_txt:stability in 185) [ClassicSimilarity], result of:
           0.065991245 = score(doc=185,freq=1.0), product of:
             0.11134808 = queryWeight, product of:
               1.0726959 = boost
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.013683354 = queryNorm
             0.59265727 = fieldWeight in 185, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.078125 = fieldNorm(doc=185)
         0.041266445 = weight(abstract_txt:approach in 185) [ClassicSimilarity], result of:
           0.041266445 = score(doc=185,freq=3.0), product of:
             0.08142477 = queryWeight, product of:
               1.588818 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.013683354 = queryNorm
             0.5068045 = fieldWeight in 185, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=185)
         0.54385155 = weight(abstract_txt:composite in 185) [ClassicSimilarity], result of:
           0.54385155 = score(doc=185,freq=2.0), product of:
             0.61658376 = queryWeight, product of:
               5.6443806 = boost
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.013683354 = queryNorm
             0.88204 = fieldWeight in 185, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.078125 = fieldNorm(doc=185)
       0.12 = coord(3/25)