Document (#39171)

Author

Rijcke, S. de
Rushforth, A.

Title

To intervene or not to intervene; is that the question? : on the role of scientometrics in research evaluation

Source

Journal of the Association for Information Science and Technology. 66(2015) no.9, S.1954-1958

Year

2015

Series

Opinion paper

Abstract

Recent high-profile statements, criticisms, and boycotts organized against certain quantitative indicators (e.g., the DORA declaration) have brought misuses of performance metrics to the center of attention. A key concern captured in these movements is that the metrics appear to carry authority even where established agents of quality control have explicitly outlined limits to their validity and reliability as measurement tools. This raises a number of challenging questions for those readers of this journal who are implicated in questions of indicator "production" and, by extension, "effects." In this opinion piece we wish to critically engage the question of how producers of indicators can come to terms with their role as (partly) responsible parties in the current age of evaluative bibliometrics. We do so through the illuminating case of the professional scientometrics community.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23382/abstract.

Theme

Informetrie

Similar documents (content)

1. Zhang, L.; Thijs, B.; Glänzel, W.: What does scientometrics share with other "metrics" sciences? (2013) 0.22

   0.21747604 = sum of:
     0.21747604 = product of:
       1.0873802 = sum of:
         0.15540816 = weight(abstract_txt:bibliometrics in 960) [ClassicSimilarity], result of:
           0.15540816 = score(doc=960,freq=1.0), product of:
             0.14122143 = queryWeight, product of:
               1.0143491 = boost
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.019767875 = queryNorm
             1.1004573 = fieldWeight in 960, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.15625 = fieldNorm(doc=960)
         0.026517464 = weight(abstract_txt:this in 960) [ClassicSimilarity], result of:
           0.026517464 = score(doc=960,freq=2.0), product of:
             0.049732063 = queryWeight, product of:
               1.0425959 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.019767875 = queryNorm
             0.5332066 = fieldWeight in 960, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.15625 = fieldNorm(doc=960)
         0.12565438 = weight(abstract_txt:question in 960) [ClassicSimilarity], result of:
           0.12565438 = score(doc=960,freq=1.0), product of:
             0.15442342 = queryWeight, product of:
               1.5000603 = boost
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.019767875 = queryNorm
             0.8137003 = fieldWeight in 960, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.15625 = fieldNorm(doc=960)
         0.36635607 = weight(abstract_txt:metrics in 960) [ClassicSimilarity], result of:
           0.36635607 = score(doc=960,freq=2.0), product of:
             0.25014222 = queryWeight, product of:
               1.9091746 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.019767875 = queryNorm
             1.4645911 = fieldWeight in 960, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.15625 = fieldNorm(doc=960)
         0.41344413 = weight(abstract_txt:scientometrics in 960) [ClassicSimilarity], result of:
           0.41344413 = score(doc=960,freq=1.0), product of:
             0.34161687 = queryWeight, product of:
               2.2311141 = boost
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.019767875 = queryNorm
             1.2102568 = fieldWeight in 960, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.15625 = fieldNorm(doc=960)
       0.2 = coord(5/25)
   

2. Rousseau, R.; Egghe, L.; Guns, R.: Becoming metric-wise : a bibliometric guide for researchers (2018) 0.11

   0.10743202 = sum of:
     0.10743202 = product of:
       0.5371601 = sum of:
         0.08791213 = weight(abstract_txt:bibliometrics in 5226) [ClassicSimilarity], result of:
           0.08791213 = score(doc=5226,freq=2.0), product of:
             0.14122143 = queryWeight, product of:
               1.0143491 = boost
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.019767875 = queryNorm
             0.62251264 = fieldWeight in 5226, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.0075002713 = weight(abstract_txt:this in 5226) [ClassicSimilarity], result of:
           0.0075002713 = score(doc=5226,freq=1.0), product of:
             0.049732063 = queryWeight, product of:
               1.0425959 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.019767875 = queryNorm
             0.1508136 = fieldWeight in 5226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.07483442 = weight(abstract_txt:evaluative in 5226) [ClassicSimilarity], result of:
           0.07483442 = score(doc=5226,freq=1.0), product of:
             0.15981309 = queryWeight, product of:
               1.0790544 = boost
               7.4921947 = idf(docFreq=66, maxDocs=44218)
               0.019767875 = queryNorm
             0.46826217 = fieldWeight in 5226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4921947 = idf(docFreq=66, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.22037084 = weight(abstract_txt:indicators in 5226) [ClassicSimilarity], result of:
           0.22037084 = score(doc=5226,freq=8.0), product of:
             0.20683666 = queryWeight, product of:
               1.7360647 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.019767875 = queryNorm
             1.0654342 = fieldWeight in 5226, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
         0.14654243 = weight(abstract_txt:metrics in 5226) [ClassicSimilarity], result of:
           0.14654243 = score(doc=5226,freq=2.0), product of:
             0.25014222 = queryWeight, product of:
               1.9091746 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.019767875 = queryNorm
             0.58583647 = fieldWeight in 5226, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.0625 = fieldNorm(doc=5226)
       0.2 = coord(5/25)
   

3. Jones, K.M.L.; Rubel, A.; LeClere, E.: ¬A matter of trust : higher education institutions as information fiduciaries in an age of educational data mining and learning analytics (2020) 0.11

   0.105456665 = sum of:
     0.105456665 = product of:
       0.5272833 = sum of:
         0.010606986 = weight(abstract_txt:this in 5968) [ClassicSimilarity], result of:
           0.010606986 = score(doc=5968,freq=2.0), product of:
             0.049732063 = queryWeight, product of:
               1.0425959 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.019767875 = queryNorm
             0.21328263 = fieldWeight in 5968, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=5968)
         0.07439136 = weight(abstract_txt:parties in 5968) [ClassicSimilarity], result of:
           0.07439136 = score(doc=5968,freq=1.0), product of:
             0.15918167 = queryWeight, product of:
               1.0769206 = boost
               7.4773793 = idf(docFreq=67, maxDocs=44218)
               0.019767875 = queryNorm
             0.4673362 = fieldWeight in 5968, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4773793 = idf(docFreq=67, maxDocs=44218)
               0.0625 = fieldNorm(doc=5968)
         0.10550548 = weight(abstract_txt:movements in 5968) [ClassicSimilarity], result of:
           0.10550548 = score(doc=5968,freq=1.0), product of:
             0.20093769 = queryWeight, product of:
               1.2099512 = boost
               8.401051 = idf(docFreq=26, maxDocs=44218)
               0.019767875 = queryNorm
             0.52506566 = fieldWeight in 5968, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.401051 = idf(docFreq=26, maxDocs=44218)
               0.0625 = fieldNorm(doc=5968)
         0.041727975 = weight(abstract_txt:questions in 5968) [ClassicSimilarity], result of:
           0.041727975 = score(doc=5968,freq=1.0), product of:
             0.13640793 = queryWeight, product of:
               1.4098469 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.019767875 = queryNorm
             0.3059058 = fieldWeight in 5968, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.0625 = fieldNorm(doc=5968)
         0.29505154 = weight(abstract_txt:intervene in 5968) [ClassicSimilarity], result of:
           0.29505154 = score(doc=5968,freq=1.0), product of:
             0.50251997 = queryWeight, product of:
               2.7060063 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.019767875 = queryNorm
             0.5871439 = fieldWeight in 5968, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0625 = fieldNorm(doc=5968)
       0.2 = coord(5/25)
   

4. Beyond bibliometrics : harnessing multidimensional indicators of scholarly intent (2014) 0.10

   0.09755803 = sum of:
     0.09755803 = product of:
       0.6097377 = sum of:
         0.1345874 = weight(abstract_txt:bibliometrics in 3026) [ClassicSimilarity], result of:
           0.1345874 = score(doc=3026,freq=3.0), product of:
             0.14122143 = queryWeight, product of:
               1.0143491 = boost
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.019767875 = queryNorm
             0.95302397 = fieldWeight in 3026, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.078125 = fieldNorm(doc=3026)
         0.009375338 = weight(abstract_txt:this in 3026) [ClassicSimilarity], result of:
           0.009375338 = score(doc=3026,freq=1.0), product of:
             0.049732063 = queryWeight, product of:
               1.0425959 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.019767875 = queryNorm
             0.18851699 = fieldWeight in 3026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=3026)
         0.25905287 = weight(abstract_txt:metrics in 3026) [ClassicSimilarity], result of:
           0.25905287 = score(doc=3026,freq=4.0), product of:
             0.25014222 = queryWeight, product of:
               1.9091746 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.019767875 = queryNorm
             1.0356224 = fieldWeight in 3026, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.078125 = fieldNorm(doc=3026)
         0.20672207 = weight(abstract_txt:scientometrics in 3026) [ClassicSimilarity], result of:
           0.20672207 = score(doc=3026,freq=1.0), product of:
             0.34161687 = queryWeight, product of:
               2.2311141 = boost
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.019767875 = queryNorm
             0.6051284 = fieldWeight in 3026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.078125 = fieldNorm(doc=3026)
       0.16 = coord(4/25)
   

5. Thelwall, M.: Web indicators for research evaluation : a practical guide (2016) 0.09

   0.08830204 = sum of:
     0.08830204 = product of:
       0.55188775 = sum of:
         0.01299085 = weight(abstract_txt:this in 3384) [ClassicSimilarity], result of:
           0.01299085 = score(doc=3384,freq=3.0), product of:
             0.049732063 = queryWeight, product of:
               1.0425959 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.019767875 = queryNorm
             0.2612168 = fieldWeight in 3384, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.26989806 = weight(abstract_txt:indicators in 3384) [ClassicSimilarity], result of:
           0.26989806 = score(doc=3384,freq=12.0), product of:
             0.20683666 = queryWeight, product of:
               1.7360647 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.019767875 = queryNorm
             1.304885 = fieldWeight in 3384, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.10362115 = weight(abstract_txt:metrics in 3384) [ClassicSimilarity], result of:
           0.10362115 = score(doc=3384,freq=1.0), product of:
             0.25014222 = queryWeight, product of:
               1.9091746 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.019767875 = queryNorm
             0.41424894 = fieldWeight in 3384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.16537766 = weight(abstract_txt:scientometrics in 3384) [ClassicSimilarity], result of:
           0.16537766 = score(doc=3384,freq=1.0), product of:
             0.34161687 = queryWeight, product of:
               2.2311141 = boost
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.019767875 = queryNorm
             0.48410273 = fieldWeight in 3384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
       0.16 = coord(4/25)