Document (#37958)

Author

Abramo, G.
D'Angelo, C.A.
Viel, F.

Title

Assessing the accuracy of the h- and g-indexes for measuring researchers' productivity

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.6, S.1224-1234

Year

2013

Abstract

Bibliometric indicators are increasingly used in support of decisions about recruitment, career advancement, rewards, and selective funding for scientists. Given the importance of the applications, bibliometricians are obligated to carry out empirical testing of the robustness of the indicators, in simulations of real contexts. In this work, we compare the results of national-scale research assessments at the individual level, based on the following three different indexes: the h-index, the g-index, and "fractional scientific strength" (FSS), an indicator previously proposed by the authors. For each index, we construct and compare rankings lists of all Italian academic researchers working in the hard sciences during the period 2001-2005. The analysis quantifies the shifts in ranks that occur when researchers' productivity rankings by simple indicators such as the h- or g-indexes are compared with those by more accurate FSS.

Theme

Informetrie

Object

g-index
h-index
FSS

Similar documents (author)

1. Abramo, G.; D'Angelo, C.A.: ¬A decision support system for public research organizations participating in national research assessment exercises (2009) 6.68

   6.6800256 = sum of:
     6.6800256 = sum of:
       3.2841418 = weight(author_txt:d'angelo in 3123) [ClassicSimilarity], result of:
         3.2841418 = score(doc=3123,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           4.697151 = fieldWeight in 3123, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.5 = fieldNorm(doc=3123)
       3.3958838 = weight(author_txt:abramo in 3123) [ClassicSimilarity], result of:
         3.3958838 = score(doc=3123,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           4.749831 = fieldWeight in 3123, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.5 = fieldNorm(doc=3123)
   

2. Abramo, G.; D'Angelo, C.A.: ¬The VQR, Italy's second national research assessment : methodological failures and ranking distortions (2015) 6.68

   6.6800256 = sum of:
     6.6800256 = sum of:
       3.2841418 = weight(author_txt:d'angelo in 2256) [ClassicSimilarity], result of:
         3.2841418 = score(doc=2256,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           4.697151 = fieldWeight in 2256, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.5 = fieldNorm(doc=2256)
       3.3958838 = weight(author_txt:abramo in 2256) [ClassicSimilarity], result of:
         3.3958838 = score(doc=2256,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           4.749831 = fieldWeight in 2256, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.5 = fieldNorm(doc=2256)
   

3. Abramo, G.; D'Angelo, C.A.; Di Costa, F.: Testing the trade-off between productivity and quality in research activities (2009) 5.01

   5.0100193 = sum of:
     5.0100193 = sum of:
       2.4631064 = weight(author_txt:d'angelo in 3317) [ClassicSimilarity], result of:
         2.4631064 = score(doc=3317,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           3.5228634 = fieldWeight in 3317, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.375 = fieldNorm(doc=3317)
       2.546913 = weight(author_txt:abramo in 3317) [ClassicSimilarity], result of:
         2.546913 = score(doc=3317,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           3.5623734 = fieldWeight in 3317, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.375 = fieldNorm(doc=3317)
   

4. Abramo, G.; D'Angelo, C.A.; Viel, F.: ¬A robust benchmark for the h- and g-indexes (2010) 5.01

   5.0100193 = sum of:
     5.0100193 = sum of:
       2.4631064 = weight(author_txt:d'angelo in 3470) [ClassicSimilarity], result of:
         2.4631064 = score(doc=3470,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           3.5228634 = fieldWeight in 3470, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.375 = fieldNorm(doc=3470)
       2.546913 = weight(author_txt:abramo in 3470) [ClassicSimilarity], result of:
         2.546913 = score(doc=3470,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           3.5623734 = fieldWeight in 3470, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.375 = fieldNorm(doc=3470)
   

5. D'Angelo, C.A.; Giuffrida, C.; Abramo, G.: ¬A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments (2011) 5.01

   5.0100193 = sum of:
     5.0100193 = sum of:
       2.4631064 = weight(author_txt:d'angelo in 4190) [ClassicSimilarity], result of:
         2.4631064 = score(doc=4190,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           3.5228634 = fieldWeight in 4190, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.375 = fieldNorm(doc=4190)
       2.546913 = weight(author_txt:abramo in 4190) [ClassicSimilarity], result of:
         2.546913 = score(doc=4190,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           3.5623734 = fieldWeight in 4190, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.375 = fieldNorm(doc=4190)
   

Similar documents (content)

1. Abramo, G.; D'Angelo, C.A.; Viel, F.: ¬A robust benchmark for the h- and g-indexes (2010) 0.13

   0.13286091 = sum of:
     0.13286091 = product of:
       0.55358714 = sum of:
         0.06514091 = weight(abstract_txt:italian in 3470) [ClassicSimilarity], result of:
           0.06514091 = score(doc=3470,freq=1.0), product of:
             0.14525996 = queryWeight, product of:
               1.0752423 = boost
               7.1750984 = idf(docFreq=91, maxDocs=44218)
               0.018828327 = queryNorm
             0.44844365 = fieldWeight in 3470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1750984 = idf(docFreq=91, maxDocs=44218)
               0.0625 = fieldNorm(doc=3470)
         0.08828512 = weight(abstract_txt:compare in 3470) [ClassicSimilarity], result of:
           0.08828512 = score(doc=3470,freq=2.0), product of:
             0.1778969 = queryWeight, product of:
               1.6828002 = boost
               5.6146684 = idf(docFreq=437, maxDocs=44218)
               0.018828327 = queryNorm
             0.49627125 = fieldWeight in 3470, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6146684 = idf(docFreq=437, maxDocs=44218)
               0.0625 = fieldNorm(doc=3470)
         0.11234114 = weight(abstract_txt:productivity in 3470) [ClassicSimilarity], result of:
           0.11234114 = score(doc=3470,freq=1.0), product of:
             0.263196 = queryWeight, product of:
               2.0468593 = boost
               6.829353 = idf(docFreq=129, maxDocs=44218)
               0.018828327 = queryNorm
             0.42683455 = fieldWeight in 3470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.829353 = idf(docFreq=129, maxDocs=44218)
               0.0625 = fieldNorm(doc=3470)
         0.056661 = weight(abstract_txt:index in 3470) [ClassicSimilarity], result of:
           0.056661 = score(doc=3470,freq=1.0), product of:
             0.1909003 = queryWeight, product of:
               2.1349971 = boost
               4.74895 = idf(docFreq=1040, maxDocs=44218)
               0.018828327 = queryNorm
             0.29680938 = fieldWeight in 3470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.74895 = idf(docFreq=1040, maxDocs=44218)
               0.0625 = fieldNorm(doc=3470)
         0.058700588 = weight(abstract_txt:researchers in 3470) [ClassicSimilarity], result of:
           0.058700588 = score(doc=3470,freq=1.0), product of:
             0.19545439 = queryWeight, product of:
               2.1603131 = boost
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.018828327 = queryNorm
             0.30032882 = fieldWeight in 3470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.0625 = fieldNorm(doc=3470)
         0.1724584 = weight(abstract_txt:indexes in 3470) [ClassicSimilarity], result of:
           0.1724584 = score(doc=3470,freq=3.0), product of:
             0.27799243 = queryWeight, product of:
               2.5763834 = boost
               5.7307405 = idf(docFreq=389, maxDocs=44218)
               0.018828327 = queryNorm
             0.62037086 = fieldWeight in 3470, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7307405 = idf(docFreq=389, maxDocs=44218)
               0.0625 = fieldNorm(doc=3470)
       0.24 = coord(6/25)
   

2. Egghe, L.: Mathematical theory of the h- and g-index in case of fractional counting of authorship (2008) 0.12

   0.12216188 = sum of:
     0.12216188 = product of:
       0.7635118 = sum of:
         0.096232325 = weight(abstract_txt:ranks in 2004) [ClassicSimilarity], result of:
           0.096232325 = score(doc=2004,freq=1.0), product of:
             0.16237433 = queryWeight, product of:
               1.1368209 = boost
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.018828327 = queryNorm
             0.59265727 = fieldWeight in 2004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.078125 = fieldNorm(doc=2004)
         0.32903177 = weight(abstract_txt:fractional in 2004) [ClassicSimilarity], result of:
           0.32903177 = score(doc=2004,freq=6.0), product of:
             0.20280477 = queryWeight, product of:
               1.2704935 = boost
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.018828327 = queryNorm
             1.6224064 = fieldWeight in 2004, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.078125 = fieldNorm(doc=2004)
         0.12267466 = weight(abstract_txt:index in 2004) [ClassicSimilarity], result of:
           0.12267466 = score(doc=2004,freq=3.0), product of:
             0.1909003 = queryWeight, product of:
               2.1349971 = boost
               4.74895 = idf(docFreq=1040, maxDocs=44218)
               0.018828327 = queryNorm
             0.64261115 = fieldWeight in 2004, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.74895 = idf(docFreq=1040, maxDocs=44218)
               0.078125 = fieldNorm(doc=2004)
         0.215573 = weight(abstract_txt:indexes in 2004) [ClassicSimilarity], result of:
           0.215573 = score(doc=2004,freq=3.0), product of:
             0.27799243 = queryWeight, product of:
               2.5763834 = boost
               5.7307405 = idf(docFreq=389, maxDocs=44218)
               0.018828327 = queryNorm
             0.7754636 = fieldWeight in 2004, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7307405 = idf(docFreq=389, maxDocs=44218)
               0.078125 = fieldNorm(doc=2004)
       0.16 = coord(4/25)
   

3. Archambault, E.; Campbell, D; Gingras, Y.; Larivière, V.: Comparing bibliometric statistics obtained from the Web of Science and Scopus (2009) 0.12

   0.11929345 = sum of:
     0.11929345 = product of:
       0.59646726 = sum of:
         0.076985866 = weight(abstract_txt:ranks in 2933) [ClassicSimilarity], result of:
           0.076985866 = score(doc=2933,freq=1.0), product of:
             0.16237433 = queryWeight, product of:
               1.1368209 = boost
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.018828327 = queryNorm
             0.47412583 = fieldWeight in 2933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.0625 = fieldNorm(doc=2933)
         0.15687345 = weight(abstract_txt:bibliometricians in 2933) [ClassicSimilarity], result of:
           0.15687345 = score(doc=2933,freq=1.0), product of:
             0.26098147 = queryWeight, product of:
               1.4412463 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.018828327 = queryNorm
             0.6010904 = fieldWeight in 2933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=2933)
         0.062427007 = weight(abstract_txt:compare in 2933) [ClassicSimilarity], result of:
           0.062427007 = score(doc=2933,freq=1.0), product of:
             0.1778969 = queryWeight, product of:
               1.6828002 = boost
               5.6146684 = idf(docFreq=437, maxDocs=44218)
               0.018828327 = queryNorm
             0.35091677 = fieldWeight in 2933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6146684 = idf(docFreq=437, maxDocs=44218)
               0.0625 = fieldNorm(doc=2933)
         0.0995689 = weight(abstract_txt:indexes in 2933) [ClassicSimilarity], result of:
           0.0995689 = score(doc=2933,freq=1.0), product of:
             0.27799243 = queryWeight, product of:
               2.5763834 = boost
               5.7307405 = idf(docFreq=389, maxDocs=44218)
               0.018828327 = queryNorm
             0.35817128 = fieldWeight in 2933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7307405 = idf(docFreq=389, maxDocs=44218)
               0.0625 = fieldNorm(doc=2933)
         0.20061202 = weight(abstract_txt:indicators in 2933) [ClassicSimilarity], result of:
           0.20061202 = score(doc=2933,freq=3.0), product of:
             0.30747846 = queryWeight, product of:
               2.7095761 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.018828327 = queryNorm
             0.6524425 = fieldWeight in 2933, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.0625 = fieldNorm(doc=2933)
       0.2 = coord(5/25)
   

4. James, J.: Digital preparedness versus the digital divide : a confusion of means and ends (2008) 0.12

   0.11575157 = sum of:
     0.11575157 = product of:
       0.7234473 = sum of:
         0.16851172 = weight(abstract_txt:productivity in 1616) [ClassicSimilarity], result of:
           0.16851172 = score(doc=1616,freq=1.0), product of:
             0.263196 = queryWeight, product of:
               2.0468593 = boost
               6.829353 = idf(docFreq=129, maxDocs=44218)
               0.018828327 = queryNorm
             0.6402518 = fieldWeight in 1616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.829353 = idf(docFreq=129, maxDocs=44218)
               0.09375 = fieldNorm(doc=1616)
         0.169983 = weight(abstract_txt:index in 1616) [ClassicSimilarity], result of:
           0.169983 = score(doc=1616,freq=4.0), product of:
             0.1909003 = queryWeight, product of:
               2.1349971 = boost
               4.74895 = idf(docFreq=1040, maxDocs=44218)
               0.018828327 = queryNorm
             0.8904281 = fieldWeight in 1616, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.74895 = idf(docFreq=1040, maxDocs=44218)
               0.09375 = fieldNorm(doc=1616)
         0.21121754 = weight(abstract_txt:indexes in 1616) [ClassicSimilarity], result of:
           0.21121754 = score(doc=1616,freq=2.0), product of:
             0.27799243 = queryWeight, product of:
               2.5763834 = boost
               5.7307405 = idf(docFreq=389, maxDocs=44218)
               0.018828327 = queryNorm
             0.759796 = fieldWeight in 1616, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7307405 = idf(docFreq=389, maxDocs=44218)
               0.09375 = fieldNorm(doc=1616)
         0.17373511 = weight(abstract_txt:indicators in 1616) [ClassicSimilarity], result of:
           0.17373511 = score(doc=1616,freq=1.0), product of:
             0.30747846 = queryWeight, product of:
               2.7095761 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.018828327 = queryNorm
             0.5650318 = fieldWeight in 1616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.09375 = fieldNorm(doc=1616)
       0.16 = coord(4/25)
   

5. Waltman, L.; Eck, N.J. van: ¬The inconsistency of the h-index : the case of web accessibility in Western European countries (2012) 0.10

   0.100479744 = sum of:
     0.100479744 = product of:
       0.6279984 = sum of:
         0.13902377 = weight(abstract_txt:indicator in 40) [ClassicSimilarity], result of:
           0.13902377 = score(doc=40,freq=4.0), product of:
             0.13072021 = queryWeight, product of:
               1.0200107 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.018828327 = queryNorm
             1.0635216 = fieldWeight in 40, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.078125 = fieldNorm(doc=40)
         0.14386854 = weight(abstract_txt:rankings in 40) [ClassicSimilarity], result of:
           0.14386854 = score(doc=40,freq=1.0), product of:
             0.26747954 = queryWeight, product of:
               2.0634484 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.018828327 = queryNorm
             0.5378674 = fieldWeight in 40, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.078125 = fieldNorm(doc=40)
         0.20032687 = weight(abstract_txt:index in 40) [ClassicSimilarity], result of:
           0.20032687 = score(doc=40,freq=8.0), product of:
             0.1909003 = queryWeight, product of:
               2.1349971 = boost
               4.74895 = idf(docFreq=1040, maxDocs=44218)
               0.018828327 = queryNorm
             1.0493796 = fieldWeight in 40, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.74895 = idf(docFreq=1040, maxDocs=44218)
               0.078125 = fieldNorm(doc=40)
         0.14477926 = weight(abstract_txt:indicators in 40) [ClassicSimilarity], result of:
           0.14477926 = score(doc=40,freq=1.0), product of:
             0.30747846 = queryWeight, product of:
               2.7095761 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.018828327 = queryNorm
             0.47085986 = fieldWeight in 40, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.078125 = fieldNorm(doc=40)
       0.16 = coord(4/25)