Document (#39173)

Author
Mutz, R.
Daniel, H.-D.
Title
What is behind the curtain of the Leiden Ranking?
Source
Journal of the Association for Information Science and Technology. 66(2015) no.9, S.1950-1953
Year
2015
Series
Brief communication
Abstract
Even with very well-documented rankings of universities, it is difficult for an individual university to reconstruct its position in the ranking. What is the reason behind whether a university places higher or lower in the ranking? Taking the example of ETH Zurich, the aim of this communication is to reconstruct how the high position of ETHZ (in Europe rank no. 1 in PP[top 10%]) in the Centre for Science and Technology Studies (CWTS) Leiden Ranking 2013 in the field "social sciences, arts and humanities" came about. According to our analyses, the bibliometric indicator values of a university depend very strongly on weights that result in differing estimates of both the total number of a university's publications and the number of publications with a citation impact in the 90th percentile, or PP(top 10%). In addition, we examine the effect of weights at the level of individual publications. Based on the results, we offer recommendations for improving the Leiden Ranking (for example, publication of sample calculations to increase transparency).
Content
Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23360/abstract.
Theme
Informetrie

Similar documents (author)

  1. Bornmann, L.; Mutz, R.; Daniel, H.-D.: Are there better indices for evaluation purposes than the h index? : a comparison of nine different variants of the h index using data from biomedicine (2008) 4.61
    4.612736 = sum of:
      4.612736 = sum of:
        1.8739642 = weight(author_txt:daniel in 3609) [ClassicSimilarity], result of:
          1.8739642 = score(doc=3609,freq=1.0), product of:
            0.6133076 = queryWeight, product of:
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.075270824 = queryNorm
            3.0555046 = fieldWeight in 3609, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.375 = fieldNorm(doc=3609)
        2.738772 = weight(author_txt:mutz in 3609) [ClassicSimilarity], result of:
          2.738772 = score(doc=3609,freq=1.0), product of:
            0.78984416 = queryWeight, product of:
              1.1348319 = boost
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.075270824 = queryNorm
            3.467484 = fieldWeight in 3609, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.375 = fieldNorm(doc=3609)
    
  2. Bornmann, L.; Mutz, R.; Daniel, H.D.: Do we need the h index and its variants in addition to standard bibliometric measures? (2009) 4.61
    4.612736 = sum of:
      4.612736 = sum of:
        1.8739642 = weight(author_txt:daniel in 27) [ClassicSimilarity], result of:
          1.8739642 = score(doc=27,freq=1.0), product of:
            0.6133076 = queryWeight, product of:
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.075270824 = queryNorm
            3.0555046 = fieldWeight in 27, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.375 = fieldNorm(doc=27)
        2.738772 = weight(author_txt:mutz in 27) [ClassicSimilarity], result of:
          2.738772 = score(doc=27,freq=1.0), product of:
            0.78984416 = queryWeight, product of:
              1.1348319 = boost
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.075270824 = queryNorm
            3.467484 = fieldWeight in 27, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.375 = fieldNorm(doc=27)
    
  3. Bornmann, L.; Mutz, R.; Daniel, H.-D.: Multilevel-statistical reformulation of citation-based university rankings : the Leiden ranking 2011/2012 (2013) 4.61
    4.612736 = sum of:
      4.612736 = sum of:
        1.8739642 = weight(author_txt:daniel in 3008) [ClassicSimilarity], result of:
          1.8739642 = score(doc=3008,freq=1.0), product of:
            0.6133076 = queryWeight, product of:
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.075270824 = queryNorm
            3.0555046 = fieldWeight in 3008, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.375 = fieldNorm(doc=3008)
        2.738772 = weight(author_txt:mutz in 3008) [ClassicSimilarity], result of:
          2.738772 = score(doc=3008,freq=1.0), product of:
            0.78984416 = queryWeight, product of:
              1.1348319 = boost
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.075270824 = queryNorm
            3.467484 = fieldWeight in 3008, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.375 = fieldNorm(doc=3008)
    
  4. Mutz, R.; Bornmann, L.; Daniel, H.-D.: Testing for the fairness and predictive validity of research funding decisions : a multilevel multiple imputation for missing data approach using ex-ante and ex-post peer evaluation data from the Austrian science fund (2015) 4.61
    4.612736 = sum of:
      4.612736 = sum of:
        1.8739642 = weight(author_txt:daniel in 4271) [ClassicSimilarity], result of:
          1.8739642 = score(doc=4271,freq=1.0), product of:
            0.6133076 = queryWeight, product of:
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.075270824 = queryNorm
            3.0555046 = fieldWeight in 4271, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.375 = fieldNorm(doc=4271)
        2.738772 = weight(author_txt:mutz in 4271) [ClassicSimilarity], result of:
          2.738772 = score(doc=4271,freq=1.0), product of:
            0.78984416 = queryWeight, product of:
              1.1348319 = boost
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.075270824 = queryNorm
            3.467484 = fieldWeight in 4271, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.375 = fieldNorm(doc=4271)
    
  5. Mutz, R.; Wolbring, T.; Daniel, H.-D.: ¬The effect of the "very important paper" (VIP) designation in Angewandte Chemie International Edition on citation impact : a propensity score matching analysis (2017) 4.61
    4.612736 = sum of:
      4.612736 = sum of:
        1.8739642 = weight(author_txt:daniel in 357) [ClassicSimilarity], result of:
          1.8739642 = score(doc=357,freq=1.0), product of:
            0.6133076 = queryWeight, product of:
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.075270824 = queryNorm
            3.0555046 = fieldWeight in 357, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.148012 = idf(docFreq=32, maxDocs=41962)
              0.375 = fieldNorm(doc=357)
        2.738772 = weight(author_txt:mutz in 357) [ClassicSimilarity], result of:
          2.738772 = score(doc=357,freq=1.0), product of:
            0.78984416 = queryWeight, product of:
              1.1348319 = boost
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.075270824 = queryNorm
            3.467484 = fieldWeight in 357, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              9.246624 = idf(docFreq=10, maxDocs=41962)
              0.375 = fieldNorm(doc=357)
    

Similar documents (content)

  1. Waltman, L.; Calero-Medina, C.; Kosten, J.; Noyons, E.C.M.; Tijssen, R.J.W.; Eck, N.J. van; Leeuwen, T.N. van; Raan, A.F.J. van; Visser, M.S.; Wouters, P.: ¬The Leiden ranking 2011/2012 : data collection, indicators, and interpretation (2012) 0.28
    0.28175414 = sum of:
      0.28175414 = product of:
        1.1739756 = sum of:
          0.059356067 = weight(abstract_txt:university's in 2515) [ClassicSimilarity], result of:
            0.059356067 = score(doc=2515,freq=1.0), product of:
              0.12840642 = queryWeight, product of:
                1.0678606 = boost
                7.3960247 = idf(docFreq=69, maxDocs=41962)
                0.01625825 = queryNorm
              0.46225154 = fieldWeight in 2515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3960247 = idf(docFreq=69, maxDocs=41962)
                0.0625 = fieldNorm(doc=2515)
          0.020682631 = weight(abstract_txt:number in 2515) [ClassicSimilarity], result of:
            0.020682631 = score(doc=2515,freq=1.0), product of:
              0.0801107 = queryWeight, product of:
                1.192838 = boost
                4.1308103 = idf(docFreq=1832, maxDocs=41962)
                0.01625825 = queryNorm
              0.25817564 = fieldWeight in 2515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1308103 = idf(docFreq=1832, maxDocs=41962)
                0.0625 = fieldNorm(doc=2515)
          0.047950312 = weight(abstract_txt:university in 2515) [ClassicSimilarity], result of:
            0.047950312 = score(doc=2515,freq=2.0), product of:
              0.12749742 = queryWeight, product of:
                1.8430306 = boost
                4.254956 = idf(docFreq=1618, maxDocs=41962)
                0.01625825 = queryNorm
              0.3760885 = fieldWeight in 2515, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.254956 = idf(docFreq=1618, maxDocs=41962)
                0.0625 = fieldNorm(doc=2515)
          0.11537949 = weight(abstract_txt:publications in 2515) [ClassicSimilarity], result of:
            0.11537949 = score(doc=2515,freq=3.0), product of:
              0.19999959 = queryWeight, product of:
                2.308322 = boost
                5.3291616 = idf(docFreq=552, maxDocs=41962)
                0.01625825 = queryNorm
              0.57689863 = fieldWeight in 2515, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.3291616 = idf(docFreq=552, maxDocs=41962)
                0.0625 = fieldNorm(doc=2515)
          0.48160106 = weight(abstract_txt:leiden in 2515) [ClassicSimilarity], result of:
            0.48160106 = score(doc=2515,freq=4.0), product of:
              0.47107354 = queryWeight, product of:
                3.542633 = boost
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.01625825 = queryNorm
              1.0223479 = fieldWeight in 2515, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.0625 = fieldNorm(doc=2515)
          0.449006 = weight(abstract_txt:ranking in 2515) [ClassicSimilarity], result of:
            0.449006 = score(doc=2515,freq=12.0), product of:
              0.36957934 = queryWeight, product of:
                4.0509796 = boost
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.01625825 = queryNorm
              1.214911 = fieldWeight in 2515, product of:
                3.4641016 = tf(freq=12.0), with freq of:
                  12.0 = termFreq=12.0
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.0625 = fieldNorm(doc=2515)
        0.24 = coord(6/25)
    
  2. Bornmann, L.; Moya Anegón, F.de: What proportion of excellent papers makes an institution one of the best worldwide? : Specifying thresholds for the interpretation of the results of the SCImago Institutions Ranking and the Leiden Ranking (2014) 0.20
    0.1975417 = sum of:
      0.1975417 = product of:
        0.82309043 = sum of:
          0.055348523 = weight(abstract_txt:2013 in 3236) [ClassicSimilarity], result of:
            0.055348523 = score(doc=3236,freq=1.0), product of:
              0.12255961 = queryWeight, product of:
                1.0432656 = boost
                7.225679 = idf(docFreq=82, maxDocs=41962)
                0.01625825 = queryNorm
              0.45160493 = fieldWeight in 3236, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.225679 = idf(docFreq=82, maxDocs=41962)
                0.0625 = fieldNorm(doc=3236)
          0.03985182 = weight(abstract_txt:example in 3236) [ClassicSimilarity], result of:
            0.03985182 = score(doc=3236,freq=1.0), product of:
              0.12404676 = queryWeight, product of:
                1.4843247 = boost
                5.1402316 = idf(docFreq=667, maxDocs=41962)
                0.01625825 = queryNorm
              0.32126448 = fieldWeight in 3236, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1402316 = idf(docFreq=667, maxDocs=41962)
                0.0625 = fieldNorm(doc=3236)
          0.033905994 = weight(abstract_txt:university in 3236) [ClassicSimilarity], result of:
            0.033905994 = score(doc=3236,freq=1.0), product of:
              0.12749742 = queryWeight, product of:
                1.8430306 = boost
                4.254956 = idf(docFreq=1618, maxDocs=41962)
                0.01625825 = queryNorm
              0.26593474 = fieldWeight in 3236, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.254956 = idf(docFreq=1618, maxDocs=41962)
                0.0625 = fieldNorm(doc=3236)
          0.09420696 = weight(abstract_txt:publications in 3236) [ClassicSimilarity], result of:
            0.09420696 = score(doc=3236,freq=2.0), product of:
              0.19999959 = queryWeight, product of:
                2.308322 = boost
                5.3291616 = idf(docFreq=552, maxDocs=41962)
                0.01625825 = queryNorm
              0.47103578 = fieldWeight in 3236, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.3291616 = idf(docFreq=552, maxDocs=41962)
                0.0625 = fieldNorm(doc=3236)
          0.34054336 = weight(abstract_txt:leiden in 3236) [ClassicSimilarity], result of:
            0.34054336 = score(doc=3236,freq=2.0), product of:
              0.47107354 = queryWeight, product of:
                3.542633 = boost
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.01625825 = queryNorm
              0.72290915 = fieldWeight in 3236, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.0625 = fieldNorm(doc=3236)
          0.25923374 = weight(abstract_txt:ranking in 3236) [ClassicSimilarity], result of:
            0.25923374 = score(doc=3236,freq=4.0), product of:
              0.36957934 = queryWeight, product of:
                4.0509796 = boost
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.01625825 = queryNorm
              0.7014292 = fieldWeight in 3236, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.0625 = fieldNorm(doc=3236)
        0.24 = coord(6/25)
    
  3. Egghe, L.: Informetric explanation of some Leiden Ranking graphs (2014) 0.11
    0.11150984 = sum of:
      0.11150984 = product of:
        0.9292487 = sum of:
          0.18841392 = weight(abstract_txt:publications in 3237) [ClassicSimilarity], result of:
            0.18841392 = score(doc=3237,freq=2.0), product of:
              0.19999959 = queryWeight, product of:
                2.308322 = boost
                5.3291616 = idf(docFreq=552, maxDocs=41962)
                0.01625825 = queryNorm
              0.94207156 = fieldWeight in 3237, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.3291616 = idf(docFreq=552, maxDocs=41962)
                0.125 = fieldNorm(doc=3237)
          0.48160106 = weight(abstract_txt:leiden in 3237) [ClassicSimilarity], result of:
            0.48160106 = score(doc=3237,freq=1.0), product of:
              0.47107354 = queryWeight, product of:
                3.542633 = boost
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.01625825 = queryNorm
              1.0223479 = fieldWeight in 3237, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.125 = fieldNorm(doc=3237)
          0.25923374 = weight(abstract_txt:ranking in 3237) [ClassicSimilarity], result of:
            0.25923374 = score(doc=3237,freq=1.0), product of:
              0.36957934 = queryWeight, product of:
                4.0509796 = boost
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.01625825 = queryNorm
              0.7014292 = fieldWeight in 3237, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.125 = fieldNorm(doc=3237)
        0.12 = coord(3/25)
    
  4. Perianes-Rodriguez, A.; Ruiz-Castillo, J.: University citation distributions (2016) 0.11
    0.11012272 = sum of:
      0.11012272 = product of:
        0.5506136 = sum of:
          0.055348523 = weight(abstract_txt:2013 in 153) [ClassicSimilarity], result of:
            0.055348523 = score(doc=153,freq=1.0), product of:
              0.12255961 = queryWeight, product of:
                1.0432656 = boost
                7.225679 = idf(docFreq=82, maxDocs=41962)
                0.01625825 = queryNorm
              0.45160493 = fieldWeight in 153, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.225679 = idf(docFreq=82, maxDocs=41962)
                0.0625 = fieldNorm(doc=153)
          0.035140872 = weight(abstract_txt:very in 153) [ClassicSimilarity], result of:
            0.035140872 = score(doc=153,freq=1.0), product of:
              0.11406744 = queryWeight, product of:
                1.4233675 = boost
                4.9291363 = idf(docFreq=824, maxDocs=41962)
                0.01625825 = queryNorm
              0.30807102 = fieldWeight in 153, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.9291363 = idf(docFreq=824, maxDocs=41962)
                0.0625 = fieldNorm(doc=153)
          0.089706816 = weight(abstract_txt:university in 153) [ClassicSimilarity], result of:
            0.089706816 = score(doc=153,freq=7.0), product of:
              0.12749742 = queryWeight, product of:
                1.8430306 = boost
                4.254956 = idf(docFreq=1618, maxDocs=41962)
                0.01625825 = queryNorm
              0.7035971 = fieldWeight in 153, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.254956 = idf(docFreq=1618, maxDocs=41962)
                0.0625 = fieldNorm(doc=153)
          0.24080053 = weight(abstract_txt:leiden in 153) [ClassicSimilarity], result of:
            0.24080053 = score(doc=153,freq=1.0), product of:
              0.47107354 = queryWeight, product of:
                3.542633 = boost
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.01625825 = queryNorm
              0.51117396 = fieldWeight in 153, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.0625 = fieldNorm(doc=153)
          0.12961687 = weight(abstract_txt:ranking in 153) [ClassicSimilarity], result of:
            0.12961687 = score(doc=153,freq=1.0), product of:
              0.36957934 = queryWeight, product of:
                4.0509796 = boost
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.01625825 = queryNorm
              0.3507146 = fieldWeight in 153, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.0625 = fieldNorm(doc=153)
        0.2 = coord(5/25)
    
  5. Bornmann, L.: How much does the expected number of citations for a publication change if it contains the address of a specific scientific institute? : a new approach for the analysis of citation data on the institutional level based on regression models (2016) 0.10
    0.104528084 = sum of:
      0.104528084 = product of:
        0.5226404 = sum of:
          0.029249657 = weight(abstract_txt:number in 96) [ClassicSimilarity], result of:
            0.029249657 = score(doc=96,freq=2.0), product of:
              0.0801107 = queryWeight, product of:
                1.192838 = boost
                4.1308103 = idf(docFreq=1832, maxDocs=41962)
                0.01625825 = queryNorm
              0.3651155 = fieldWeight in 96, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.1308103 = idf(docFreq=1832, maxDocs=41962)
                0.0625 = fieldNorm(doc=96)
          0.056358982 = weight(abstract_txt:example in 96) [ClassicSimilarity], result of:
            0.056358982 = score(doc=96,freq=2.0), product of:
              0.12404676 = queryWeight, product of:
                1.4843247 = boost
                5.1402316 = idf(docFreq=667, maxDocs=41962)
                0.01625825 = queryNorm
              0.45433658 = fieldWeight in 96, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.1402316 = idf(docFreq=667, maxDocs=41962)
                0.0625 = fieldNorm(doc=96)
          0.06661438 = weight(abstract_txt:publications in 96) [ClassicSimilarity], result of:
            0.06661438 = score(doc=96,freq=1.0), product of:
              0.19999959 = queryWeight, product of:
                2.308322 = boost
                5.3291616 = idf(docFreq=552, maxDocs=41962)
                0.01625825 = queryNorm
              0.3330726 = fieldWeight in 96, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3291616 = idf(docFreq=552, maxDocs=41962)
                0.0625 = fieldNorm(doc=96)
          0.24080053 = weight(abstract_txt:leiden in 96) [ClassicSimilarity], result of:
            0.24080053 = score(doc=96,freq=1.0), product of:
              0.47107354 = queryWeight, product of:
                3.542633 = boost
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.01625825 = queryNorm
              0.51117396 = fieldWeight in 96, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.178783 = idf(docFreq=31, maxDocs=41962)
                0.0625 = fieldNorm(doc=96)
          0.12961687 = weight(abstract_txt:ranking in 96) [ClassicSimilarity], result of:
            0.12961687 = score(doc=96,freq=1.0), product of:
              0.36957934 = queryWeight, product of:
                4.0509796 = boost
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.01625825 = queryNorm
              0.3507146 = fieldWeight in 96, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6114335 = idf(docFreq=416, maxDocs=41962)
                0.0625 = fieldNorm(doc=96)
        0.2 = coord(5/25)