Document (#36752)

Author
Bouyssou, D.
Marchant, T.
Title
Ranking scientists and departments in a consistent manner
Source
Journal of the American Society for Information Science and Technology. 62(2011) no.9, S.1761-1769
Year
2011
Abstract
The standard data that we use when computing bibliometric rankings of scientists are their publication/ citation records, i.e., so many papers with 0 citation, so many with 1 citation, so many with 2 citations, etc. The standard data for bibliometric rankings of departments have the same structure. It is therefore tempting (and many authors gave in to temptation) to use the same method for computing rankings of scientists and rankings of departments. Depending on the method, this can yield quite surprising and unpleasant results. Indeed, with some methods, it may happen that the "best" department contains the "worst" scientists, and only them. This problem will not occur if the rankings satisfy a property called consistency, recently introduced in the literature. In this article, we explore the consequences of consistency and we characterize two families of consistent rankings.
Theme
Informetrie

Similar documents (content)

  1. Hooydonk, G. Van: Standardizing relative impacts : estimating the quality of research from citation counts (1998) 0.25
    0.2518361 = sum of:
      0.2518361 = product of:
        0.7869878 = sum of:
          0.018735578 = weight(abstract_txt:data in 1791) [ClassicSimilarity], result of:
            0.018735578 = score(doc=1791,freq=2.0), product of:
              0.050826564 = queryWeight, product of:
                3.3363478 = idf(docFreq=4274, maxDocs=44218)
                0.015234192 = queryNorm
              0.36861783 = fieldWeight in 1791, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3363478 = idf(docFreq=4274, maxDocs=44218)
                0.078125 = fieldNorm(doc=1791)
          0.046000823 = weight(abstract_txt:method in 1791) [ClassicSimilarity], result of:
            0.046000823 = score(doc=1791,freq=2.0), product of:
              0.09250313 = queryWeight, product of:
                1.349065 = boost
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.015234192 = queryNorm
              0.49728936 = fieldWeight in 1791, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.078125 = fieldNorm(doc=1791)
          0.06518753 = weight(abstract_txt:standard in 1791) [ClassicSimilarity], result of:
            0.06518753 = score(doc=1791,freq=3.0), product of:
              0.10195111 = queryWeight, product of:
                1.4162848 = boost
                4.725219 = idf(docFreq=1065, maxDocs=44218)
                0.015234192 = queryNorm
              0.6393999 = fieldWeight in 1791, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.725219 = idf(docFreq=1065, maxDocs=44218)
                0.078125 = fieldNorm(doc=1791)
          0.03802147 = weight(abstract_txt:same in 1791) [ClassicSimilarity], result of:
            0.03802147 = score(doc=1791,freq=1.0), product of:
              0.10264598 = queryWeight, product of:
                1.4211031 = boost
                4.7412944 = idf(docFreq=1048, maxDocs=44218)
                0.015234192 = queryNorm
              0.37041363 = fieldWeight in 1791, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.7412944 = idf(docFreq=1048, maxDocs=44218)
                0.078125 = fieldNorm(doc=1791)
          0.015760291 = weight(abstract_txt:with in 1791) [ClassicSimilarity], result of:
            0.015760291 = score(doc=1791,freq=2.0), product of:
              0.057064433 = queryWeight, product of:
                1.498485 = boost
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.015234192 = queryNorm
              0.27618414 = fieldWeight in 1791, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.078125 = fieldNorm(doc=1791)
          0.14523026 = weight(abstract_txt:bibliometric in 1791) [ClassicSimilarity], result of:
            0.14523026 = score(doc=1791,freq=3.0), product of:
              0.17390831 = queryWeight, product of:
                1.8497576 = boost
                6.1714344 = idf(docFreq=250, maxDocs=44218)
                0.015234192 = queryNorm
              0.8350967 = fieldWeight in 1791, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.1714344 = idf(docFreq=250, maxDocs=44218)
                0.078125 = fieldNorm(doc=1791)
          0.10881907 = weight(abstract_txt:citation in 1791) [ClassicSimilarity], result of:
            0.10881907 = score(doc=1791,freq=3.0), product of:
              0.16422881 = queryWeight, product of:
                2.2015316 = boost
                4.896717 = idf(docFreq=897, maxDocs=44218)
                0.015234192 = queryNorm
              0.6626064 = fieldWeight in 1791, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.896717 = idf(docFreq=897, maxDocs=44218)
                0.078125 = fieldNorm(doc=1791)
          0.34923276 = weight(abstract_txt:rankings in 1791) [ClassicSimilarity], result of:
            0.34923276 = score(doc=1791,freq=1.0), product of:
              0.6492915 = queryWeight, product of:
                6.190634 = boost
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.015234192 = queryNorm
              0.5378674 = fieldWeight in 1791, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.078125 = fieldNorm(doc=1791)
        0.32 = coord(8/25)
    
  2. Gingras, Y.: Bibliometrics and research evaluation : uses and abuses (2016) 0.20
    0.19644518 = sum of:
      0.19644518 = product of:
        0.70158994 = sum of:
          0.014988463 = weight(abstract_txt:data in 3805) [ClassicSimilarity], result of:
            0.014988463 = score(doc=3805,freq=2.0), product of:
              0.050826564 = queryWeight, product of:
                3.3363478 = idf(docFreq=4274, maxDocs=44218)
                0.015234192 = queryNorm
              0.29489428 = fieldWeight in 3805, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3363478 = idf(docFreq=4274, maxDocs=44218)
                0.0625 = fieldNorm(doc=3805)
          0.0060145175 = weight(abstract_txt:this in 3805) [ClassicSimilarity], result of:
            0.0060145175 = score(doc=3805,freq=1.0), product of:
              0.039880473 = queryWeight, product of:
                1.0848768 = boost
                2.4130175 = idf(docFreq=10762, maxDocs=44218)
                0.015234192 = queryNorm
              0.1508136 = fieldWeight in 3805, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4130175 = idf(docFreq=10762, maxDocs=44218)
                0.0625 = fieldNorm(doc=3805)
          0.05501013 = weight(abstract_txt:yield in 3805) [ClassicSimilarity], result of:
            0.05501013 = score(doc=3805,freq=1.0), product of:
              0.12093383 = queryWeight, product of:
                1.0907207 = boost
                7.2780466 = idf(docFreq=82, maxDocs=44218)
                0.015234192 = queryNorm
              0.4548779 = fieldWeight in 3805, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.2780466 = idf(docFreq=82, maxDocs=44218)
                0.0625 = fieldNorm(doc=3805)
          0.067078985 = weight(abstract_txt:bibliometric in 3805) [ClassicSimilarity], result of:
            0.067078985 = score(doc=3805,freq=1.0), product of:
              0.17390831 = queryWeight, product of:
                1.8497576 = boost
                6.1714344 = idf(docFreq=250, maxDocs=44218)
                0.015234192 = queryNorm
              0.38571465 = fieldWeight in 3805, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1714344 = idf(docFreq=250, maxDocs=44218)
                0.0625 = fieldNorm(doc=3805)
          0.05026138 = weight(abstract_txt:citation in 3805) [ClassicSimilarity], result of:
            0.05026138 = score(doc=3805,freq=1.0), product of:
              0.16422881 = queryWeight, product of:
                2.2015316 = boost
                4.896717 = idf(docFreq=897, maxDocs=44218)
                0.015234192 = queryNorm
              0.30604482 = fieldWeight in 3805, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.896717 = idf(docFreq=897, maxDocs=44218)
                0.0625 = fieldNorm(doc=3805)
          0.1131247 = weight(abstract_txt:scientists in 3805) [ClassicSimilarity], result of:
            0.1131247 = score(doc=3805,freq=1.0), product of:
              0.31043997 = queryWeight, product of:
                3.4950907 = boost
                5.830419 = idf(docFreq=352, maxDocs=44218)
                0.015234192 = queryNorm
              0.3644012 = fieldWeight in 3805, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.830419 = idf(docFreq=352, maxDocs=44218)
                0.0625 = fieldNorm(doc=3805)
          0.39511174 = weight(abstract_txt:rankings in 3805) [ClassicSimilarity], result of:
            0.39511174 = score(doc=3805,freq=2.0), product of:
              0.6492915 = queryWeight, product of:
                6.190634 = boost
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.015234192 = queryNorm
              0.6085275 = fieldWeight in 3805, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.0625 = fieldNorm(doc=3805)
        0.28 = coord(7/25)
    
  3. Bar-Ilan, J.; Levene, M.; Mat-Hassan, M.: Methods for evaluating dynamic changes in search engine rankings : a case study (2006) 0.20
    0.1961933 = sum of:
      0.1961933 = product of:
        0.8174721 = sum of:
          0.009273638 = weight(abstract_txt:data in 616) [ClassicSimilarity], result of:
            0.009273638 = score(doc=616,freq=1.0), product of:
              0.050826564 = queryWeight, product of:
                3.3363478 = idf(docFreq=4274, maxDocs=44218)
                0.015234192 = queryNorm
              0.18245652 = fieldWeight in 616, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3363478 = idf(docFreq=4274, maxDocs=44218)
                0.0546875 = fieldNorm(doc=616)
          0.043796033 = weight(abstract_txt:characterize in 616) [ClassicSimilarity], result of:
            0.043796033 = score(doc=616,freq=1.0), product of:
              0.113554366 = queryWeight, product of:
                1.0569186 = boost
                7.0524964 = idf(docFreq=103, maxDocs=44218)
                0.015234192 = queryNorm
              0.3856834 = fieldWeight in 616, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.0524964 = idf(docFreq=103, maxDocs=44218)
                0.0546875 = fieldNorm(doc=616)
          0.007442586 = weight(abstract_txt:this in 616) [ClassicSimilarity], result of:
            0.007442586 = score(doc=616,freq=2.0), product of:
              0.039880473 = queryWeight, product of:
                1.0848768 = boost
                2.4130175 = idf(docFreq=10762, maxDocs=44218)
                0.015234192 = queryNorm
              0.1866223 = fieldWeight in 616, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4130175 = idf(docFreq=10762, maxDocs=44218)
                0.0546875 = fieldNorm(doc=616)
          0.011032204 = weight(abstract_txt:with in 616) [ClassicSimilarity], result of:
            0.011032204 = score(doc=616,freq=2.0), product of:
              0.057064433 = queryWeight, product of:
                1.498485 = boost
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.015234192 = queryNorm
              0.1933289 = fieldWeight in 616, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.0546875 = fieldNorm(doc=616)
          0.054482188 = weight(abstract_txt:computing in 616) [ClassicSimilarity], result of:
            0.054482188 = score(doc=616,freq=1.0), product of:
              0.16548565 = queryWeight, product of:
                1.8044082 = boost
                6.0201335 = idf(docFreq=291, maxDocs=44218)
                0.015234192 = queryNorm
              0.32922605 = fieldWeight in 616, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.0201335 = idf(docFreq=291, maxDocs=44218)
                0.0546875 = fieldNorm(doc=616)
          0.69144547 = weight(abstract_txt:rankings in 616) [ClassicSimilarity], result of:
            0.69144547 = score(doc=616,freq=8.0), product of:
              0.6492915 = queryWeight, product of:
                6.190634 = boost
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.015234192 = queryNorm
              1.064923 = fieldWeight in 616, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.0546875 = fieldNorm(doc=616)
        0.24 = coord(6/25)
    
  4. Abramo, G.; D'Angelo, C.A.; Viel, F.: Assessing the accuracy of the h- and g-indexes for measuring researchers' productivity (2013) 0.19
    0.1897935 = sum of:
      0.1897935 = product of:
        0.79080623 = sum of:
          0.052999623 = weight(abstract_txt:occur in 957) [ClassicSimilarity], result of:
            0.052999623 = score(doc=957,freq=1.0), product of:
              0.1016626 = queryWeight, product of:
                1.0000466 = boost
                6.6730065 = idf(docFreq=151, maxDocs=44218)
                0.015234192 = queryNorm
              0.5213286 = fieldWeight in 957, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6730065 = idf(docFreq=151, maxDocs=44218)
                0.078125 = fieldNorm(doc=957)
          0.0075181467 = weight(abstract_txt:this in 957) [ClassicSimilarity], result of:
            0.0075181467 = score(doc=957,freq=1.0), product of:
              0.039880473 = queryWeight, product of:
                1.0848768 = boost
                2.4130175 = idf(docFreq=10762, maxDocs=44218)
                0.015234192 = queryNorm
              0.18851699 = fieldWeight in 957, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4130175 = idf(docFreq=10762, maxDocs=44218)
                0.078125 = fieldNorm(doc=957)
          0.011144208 = weight(abstract_txt:with in 957) [ClassicSimilarity], result of:
            0.011144208 = score(doc=957,freq=1.0), product of:
              0.057064433 = queryWeight, product of:
                1.498485 = boost
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.015234192 = queryNorm
              0.19529167 = fieldWeight in 957, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.078125 = fieldNorm(doc=957)
          0.08384873 = weight(abstract_txt:bibliometric in 957) [ClassicSimilarity], result of:
            0.08384873 = score(doc=957,freq=1.0), product of:
              0.17390831 = queryWeight, product of:
                1.8497576 = boost
                6.1714344 = idf(docFreq=250, maxDocs=44218)
                0.015234192 = queryNorm
              0.4821433 = fieldWeight in 957, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1714344 = idf(docFreq=250, maxDocs=44218)
                0.078125 = fieldNorm(doc=957)
          0.14140587 = weight(abstract_txt:scientists in 957) [ClassicSimilarity], result of:
            0.14140587 = score(doc=957,freq=1.0), product of:
              0.31043997 = queryWeight, product of:
                3.4950907 = boost
                5.830419 = idf(docFreq=352, maxDocs=44218)
                0.015234192 = queryNorm
              0.4555015 = fieldWeight in 957, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.830419 = idf(docFreq=352, maxDocs=44218)
                0.078125 = fieldNorm(doc=957)
          0.49388966 = weight(abstract_txt:rankings in 957) [ClassicSimilarity], result of:
            0.49388966 = score(doc=957,freq=2.0), product of:
              0.6492915 = queryWeight, product of:
                6.190634 = boost
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.015234192 = queryNorm
              0.76065934 = fieldWeight in 957, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.078125 = fieldNorm(doc=957)
        0.24 = coord(6/25)
    
  5. Waltman, L.; Eck, N.J. van: ¬The inconsistency of the h-index : the case of web accessibility in Western European countries (2012) 0.17
    0.17149168 = sum of:
      0.17149168 = product of:
        0.7145487 = sum of:
          0.0075181467 = weight(abstract_txt:this in 40) [ClassicSimilarity], result of:
            0.0075181467 = score(doc=40,freq=1.0), product of:
              0.039880473 = queryWeight, product of:
                1.0848768 = boost
                2.4130175 = idf(docFreq=10762, maxDocs=44218)
                0.015234192 = queryNorm
              0.18851699 = fieldWeight in 40, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4130175 = idf(docFreq=10762, maxDocs=44218)
                0.078125 = fieldNorm(doc=40)
          0.011144208 = weight(abstract_txt:with in 40) [ClassicSimilarity], result of:
            0.011144208 = score(doc=40,freq=1.0), product of:
              0.057064433 = queryWeight, product of:
                1.498485 = boost
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.015234192 = queryNorm
              0.19529167 = fieldWeight in 40, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.078125 = fieldNorm(doc=40)
          0.08384873 = weight(abstract_txt:bibliometric in 40) [ClassicSimilarity], result of:
            0.08384873 = score(doc=40,freq=1.0), product of:
              0.17390831 = queryWeight, product of:
                1.8497576 = boost
                6.1714344 = idf(docFreq=250, maxDocs=44218)
                0.015234192 = queryNorm
              0.4821433 = fieldWeight in 40, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1714344 = idf(docFreq=250, maxDocs=44218)
                0.078125 = fieldNorm(doc=40)
          0.06282672 = weight(abstract_txt:citation in 40) [ClassicSimilarity], result of:
            0.06282672 = score(doc=40,freq=1.0), product of:
              0.16422881 = queryWeight, product of:
                2.2015316 = boost
                4.896717 = idf(docFreq=897, maxDocs=44218)
                0.015234192 = queryNorm
              0.38255602 = fieldWeight in 40, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.896717 = idf(docFreq=897, maxDocs=44218)
                0.078125 = fieldNorm(doc=40)
          0.1999781 = weight(abstract_txt:scientists in 40) [ClassicSimilarity], result of:
            0.1999781 = score(doc=40,freq=2.0), product of:
              0.31043997 = queryWeight, product of:
                3.4950907 = boost
                5.830419 = idf(docFreq=352, maxDocs=44218)
                0.015234192 = queryNorm
              0.64417636 = fieldWeight in 40, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.830419 = idf(docFreq=352, maxDocs=44218)
                0.078125 = fieldNorm(doc=40)
          0.34923276 = weight(abstract_txt:rankings in 40) [ClassicSimilarity], result of:
            0.34923276 = score(doc=40,freq=1.0), product of:
              0.6492915 = queryWeight, product of:
                6.190634 = boost
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.015234192 = queryNorm
              0.5378674 = fieldWeight in 40, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.8847027 = idf(docFreq=122, maxDocs=44218)
                0.078125 = fieldNorm(doc=40)
        0.24 = coord(6/25)