Document (#40230)

Author

Frittelli, M.
Mancini, L.
Peri, I.

Title

Scientific research measures

Source

Journal of the Association for Information Science and Technology. 67(2016) no.12, S.3051-3063

Year

2016

Abstract

The evaluation of scientific research is crucial for both the academic community and society as a whole. Numerous bibliometric indices have been proposed for the ranking of research performance, mainly on an ad hoc basis. We introduce the novel class of Scientific Research Measures (SRMs) to rank scientists' research performance and provide a rigorous theoretical foundation for these measures. In contrast to many bibliometric indices, SRMs take into account the whole citation curve of the scientist, offer appealing structural properties, allow a finer ranking of scientists, correspond to specific features of different disciplines, research areas and seniorities, and include several bibliometric indices as special cases. Thus SRMs result in more accurate rankings than ad hoc bibliometric indices. We also introduce the further general class of Dual SRMs that reflect the "value" of journals and permit the ranking of research institutions based on theoretically sound criteria, which has been a central theme in the scientific community over recent decades. An empirical application to the citation curves of 173 finance scholars shows that SRMs can be easily calibrated to actual citation curves and generate different authors' rankings than those produced by seven traditional bibliometric indices.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23530/full.

Theme

Informetrie

Similar documents (content)

1. Bornmann, L.; Mutz, R.; Daniel, H.D.: Do we need the h index and its variants in addition to standard bibliometric measures? (2009) 0.21

   0.21439806 = sum of:
     0.21439806 = product of:
       0.89332527 = sum of:
         0.022088073 = weight(abstract_txt:performance in 2861) [ClassicSimilarity], result of:
           0.022088073 = score(doc=2861,freq=1.0), product of:
             0.08722668 = queryWeight, product of:
               1.2285534 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.015333274 = queryNorm
             0.2532261 = fieldWeight in 2861, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2861)
         0.044095673 = weight(abstract_txt:scientists in 2861) [ClassicSimilarity], result of:
           0.044095673 = score(doc=2861,freq=1.0), product of:
             0.13829552 = queryWeight, product of:
               1.5469397 = boost
               5.830419 = idf(docFreq=352, maxDocs=44218)
               0.015333274 = queryNorm
             0.31885105 = fieldWeight in 2861, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.830419 = idf(docFreq=352, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2861)
         0.055413797 = weight(abstract_txt:citation in 2861) [ClassicSimilarity], result of:
           0.055413797 = score(doc=2861,freq=2.0), product of:
             0.14632207 = queryWeight, product of:
               1.9488119 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.015333274 = queryNorm
             0.37871113 = fieldWeight in 2861, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2861)
         0.053589705 = weight(abstract_txt:measures in 2861) [ClassicSimilarity], result of:
           0.053589705 = score(doc=2861,freq=1.0), product of:
             0.18028605 = queryWeight, product of:
               2.1631968 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.015333274 = queryNorm
             0.2972482 = fieldWeight in 2861, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2861)
         0.18488853 = weight(abstract_txt:bibliometric in 2861) [ClassicSimilarity], result of:
           0.18488853 = score(doc=2861,freq=2.0), product of:
             0.38736537 = queryWeight, product of:
               4.093547 = boost
               6.1714344 = idf(docFreq=250, maxDocs=44218)
               0.015333274 = queryNorm
             0.4772975 = fieldWeight in 2861, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1714344 = idf(docFreq=250, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2861)
         0.5332495 = weight(abstract_txt:indices in 2861) [ClassicSimilarity], result of:
           0.5332495 = score(doc=2861,freq=6.0), product of:
             0.5442027 = queryWeight, product of:
               4.851988 = boost
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.015333274 = queryNorm
             0.97987294 = fieldWeight in 2861, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2861)
       0.24 = coord(6/25)
   

2. Zhao, S.X.; Tan, A.M.; Ye, F.Y.: Distributive h-indices for measuring multilevel impact (2012) 0.21

   0.21268427 = sum of:
     0.21268427 = product of:
       1.0634214 = sum of:
         0.08762767 = weight(abstract_txt:introduce in 460) [ClassicSimilarity], result of:
           0.08762767 = score(doc=460,freq=1.0), product of:
             0.15260994 = queryWeight, product of:
               1.6250278 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.015333274 = queryNorm
             0.5741937 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.09375 = fieldNorm(doc=460)
         0.09499508 = weight(abstract_txt:citation in 460) [ClassicSimilarity], result of:
           0.09499508 = score(doc=460,freq=2.0), product of:
             0.14632207 = queryWeight, product of:
               1.9488119 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.015333274 = queryNorm
             0.6492191 = fieldWeight in 460, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.09375 = fieldNorm(doc=460)
         0.091868065 = weight(abstract_txt:measures in 460) [ClassicSimilarity], result of:
           0.091868065 = score(doc=460,freq=1.0), product of:
             0.18028605 = queryWeight, product of:
               2.1631968 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.015333274 = queryNorm
             0.50956833 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.09375 = fieldNorm(doc=460)
         0.042536773 = weight(abstract_txt:research in 460) [ClassicSimilarity], result of:
           0.042536773 = score(doc=460,freq=1.0), product of:
             0.14311583 = queryWeight, product of:
               2.944064 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.015333274 = queryNorm
             0.2972192 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.09375 = fieldNorm(doc=460)
         0.7463938 = weight(abstract_txt:indices in 460) [ClassicSimilarity], result of:
           0.7463938 = score(doc=460,freq=4.0), product of:
             0.5442027 = queryWeight, product of:
               4.851988 = boost
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.015333274 = queryNorm
             1.3715364 = fieldWeight in 460, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.09375 = fieldNorm(doc=460)
       0.2 = coord(5/25)
   

3. Gingras, Y.: Bibliometrics and research evaluation : uses and abuses (2016) 0.19

   0.18906873 = sum of:
     0.18906873 = product of:
       0.5908398 = sum of:
         0.015025883 = weight(abstract_txt:than in 3805) [ClassicSimilarity], result of:
           0.015025883 = score(doc=3805,freq=1.0), product of:
             0.061722405 = queryWeight, product of:
               1.0334531 = boost
               3.8950868 = idf(docFreq=2444, maxDocs=44218)
               0.015333274 = queryNorm
             0.24344292 = fieldWeight in 3805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8950868 = idf(docFreq=2444, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.05039505 = weight(abstract_txt:scientists in 3805) [ClassicSimilarity], result of:
           0.05039505 = score(doc=3805,freq=1.0), product of:
             0.13829552 = queryWeight, product of:
               1.5469397 = boost
               5.830419 = idf(docFreq=352, maxDocs=44218)
               0.015333274 = queryNorm
             0.3644012 = fieldWeight in 3805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.830419 = idf(docFreq=352, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.11734352 = weight(abstract_txt:rankings in 3805) [ClassicSimilarity], result of:
           0.11734352 = score(doc=3805,freq=2.0), product of:
             0.19283192 = queryWeight, product of:
               1.8266647 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.015333274 = queryNorm
             0.6085275 = fieldWeight in 3805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.04478111 = weight(abstract_txt:citation in 3805) [ClassicSimilarity], result of:
           0.04478111 = score(doc=3805,freq=1.0), product of:
             0.14632207 = queryWeight, product of:
               1.9488119 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.015333274 = queryNorm
             0.30604482 = fieldWeight in 3805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.06693723 = weight(abstract_txt:ranking in 3805) [ClassicSimilarity], result of:
           0.06693723 = score(doc=3805,freq=1.0), product of:
             0.19128978 = queryWeight, product of:
               2.2282345 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.015333274 = queryNorm
             0.34992582 = fieldWeight in 3805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.07191666 = weight(abstract_txt:scientific in 3805) [ClassicSimilarity], result of:
           0.07191666 = score(doc=3805,freq=2.0), product of:
             0.17529486 = queryWeight, product of:
               2.4630258 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.015333274 = queryNorm
             0.4102611 = fieldWeight in 3805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.07502781 = weight(abstract_txt:research in 3805) [ClassicSimilarity], result of:
           0.07502781 = score(doc=3805,freq=7.0), product of:
             0.14311583 = queryWeight, product of:
               2.944064 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.015333274 = queryNorm
             0.5242453 = fieldWeight in 3805, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.1494125 = weight(abstract_txt:bibliometric in 3805) [ClassicSimilarity], result of:
           0.1494125 = score(doc=3805,freq=1.0), product of:
             0.38736537 = queryWeight, product of:
               4.093547 = boost
               6.1714344 = idf(docFreq=250, maxDocs=44218)
               0.015333274 = queryNorm
             0.38571465 = fieldWeight in 3805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1714344 = idf(docFreq=250, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
       0.32 = coord(8/25)
   

4. Song, M.; Kim, S.Y.; Lee, K.: Ensemble analysis of topical journal ranking in bioinformatics (2017) 0.17

   0.1737212 = sum of:
     0.1737212 = product of:
       0.62043285 = sum of:
         0.025243511 = weight(abstract_txt:performance in 3650) [ClassicSimilarity], result of:
           0.025243511 = score(doc=3650,freq=1.0), product of:
             0.08722668 = queryWeight, product of:
               1.2285534 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.015333274 = queryNorm
             0.28940126 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=3650)
         0.11734352 = weight(abstract_txt:rankings in 3650) [ClassicSimilarity], result of:
           0.11734352 = score(doc=3650,freq=2.0), product of:
             0.19283192 = queryWeight, product of:
               1.8266647 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.015333274 = queryNorm
             0.6085275 = fieldWeight in 3650, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=3650)
         0.04478111 = weight(abstract_txt:citation in 3650) [ClassicSimilarity], result of:
           0.04478111 = score(doc=3650,freq=1.0), product of:
             0.14632207 = queryWeight, product of:
               1.9488119 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.015333274 = queryNorm
             0.30604482 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=3650)
         0.061245378 = weight(abstract_txt:measures in 3650) [ClassicSimilarity], result of:
           0.061245378 = score(doc=3650,freq=1.0), product of:
             0.18028605 = queryWeight, product of:
               2.1631968 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.015333274 = queryNorm
             0.33971223 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=3650)
         0.094663545 = weight(abstract_txt:ranking in 3650) [ClassicSimilarity], result of:
           0.094663545 = score(doc=3650,freq=2.0), product of:
             0.19128978 = queryWeight, product of:
               2.2282345 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.015333274 = queryNorm
             0.49486983 = fieldWeight in 3650, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=3650)
         0.028357847 = weight(abstract_txt:research in 3650) [ClassicSimilarity], result of:
           0.028357847 = score(doc=3650,freq=1.0), product of:
             0.14311583 = queryWeight, product of:
               2.944064 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.015333274 = queryNorm
             0.19814612 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=3650)
         0.24879794 = weight(abstract_txt:indices in 3650) [ClassicSimilarity], result of:
           0.24879794 = score(doc=3650,freq=1.0), product of:
             0.5442027 = queryWeight, product of:
               4.851988 = boost
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.015333274 = queryNorm
             0.4571788 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.0625 = fieldNorm(doc=3650)
       0.28 = coord(7/25)
   

5. Kurtz, M.J.; Eichhorn, G.; Accomazzi, A.; Grant, C.; Demleitner, D.; Murray, S.S.; Martimbeau, N.; Elwell, B.: ¬The bibliometric properties of article readership information (2005) 0.17

   0.17049128 = sum of:
     0.17049128 = product of:
       0.53278524 = sum of:
         0.05131344 = weight(abstract_txt:permit in 3307) [ClassicSimilarity], result of:
           0.05131344 = score(doc=3307,freq=1.0), product of:
             0.121438086 = queryWeight, product of:
               1.0250188 = boost
               7.7265954 = idf(docFreq=52, maxDocs=44218)
               0.015333274 = queryNorm
             0.42254817 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7265954 = idf(docFreq=52, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.0131476475 = weight(abstract_txt:than in 3307) [ClassicSimilarity], result of:
           0.0131476475 = score(doc=3307,freq=1.0), product of:
             0.061722405 = queryWeight, product of:
               1.0334531 = boost
               3.8950868 = idf(docFreq=2444, maxDocs=44218)
               0.015333274 = queryNorm
             0.21301256 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8950868 = idf(docFreq=2444, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.051116142 = weight(abstract_txt:introduce in 3307) [ClassicSimilarity], result of:
           0.051116142 = score(doc=3307,freq=1.0), product of:
             0.15260994 = queryWeight, product of:
               1.6250278 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.015333274 = queryNorm
             0.33494633 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.06786776 = weight(abstract_txt:citation in 3307) [ClassicSimilarity], result of:
           0.06786776 = score(doc=3307,freq=3.0), product of:
             0.14632207 = queryWeight, product of:
               1.9488119 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.015333274 = queryNorm
             0.4638245 = fieldWeight in 3307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.053589705 = weight(abstract_txt:measures in 3307) [ClassicSimilarity], result of:
           0.053589705 = score(doc=3307,freq=1.0), product of:
             0.18028605 = queryWeight, product of:
               2.1631968 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.015333274 = queryNorm
             0.2972482 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.044496164 = weight(abstract_txt:scientific in 3307) [ClassicSimilarity], result of:
           0.044496164 = score(doc=3307,freq=1.0), product of:
             0.17529486 = queryWeight, product of:
               2.4630258 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.015333274 = queryNorm
             0.2538361 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.024813116 = weight(abstract_txt:research in 3307) [ClassicSimilarity], result of:
           0.024813116 = score(doc=3307,freq=1.0), product of:
             0.14311583 = queryWeight, product of:
               2.944064 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.015333274 = queryNorm
             0.17337786 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.22644126 = weight(abstract_txt:bibliometric in 3307) [ClassicSimilarity], result of:
           0.22644126 = score(doc=3307,freq=3.0), product of:
             0.38736537 = queryWeight, product of:
               4.093547 = boost
               6.1714344 = idf(docFreq=250, maxDocs=44218)
               0.015333274 = queryNorm
             0.58456767 = fieldWeight in 3307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1714344 = idf(docFreq=250, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
       0.32 = coord(8/25)