Document (#43249)

Author

Lemke, S.
Mazarakis, A.
Peters, I.

Title

Conjoint analysis of researchers' hidden preferences for bibliometrics, altmetrics, and usage metrics

Source

Journal of the Association for Information Science and Technology. 72(2021) no.6, S.777-792

Year

2021

Abstract

The amount of annually published scholarly articles is growing steadily, as is the number of indicators through which impact of publications is measured. Little is known about how the increasing variety of available metrics affects researchers' processes of selecting literature to read. We conducted ranking experiments embedded into an online survey with 247 participating researchers, most from social sciences. Participants completed series of tasks in which they were asked to rank fictitious publications regarding their expected relevance, based on their scores regarding six prototypical metrics. Through applying logistic regression, cluster analysis, and manual coding of survey answers, we obtained detailed data on how prominent metrics for research impact influence our participants in decisions about which scientific articles to read. Survey answers revealed a combination of qualitative and quantitative characteristics that researchers consult when selecting literature, while regression analysis showed that among quantitative metrics, citation counts tend to be of highest concern, followed by Journal Impact Factors. Our results suggest a comparatively favorable view of many researchers on bibliometrics and widespread skepticism toward altmetrics. The findings underline the importance of equipping researchers with solid knowledge about specific metrics' limitations, as they seem to play significant roles in researchers' everyday relevance assessments.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24445.

Theme

Informetrie

Similar documents (author)

1. Peters, C.M.: CD-ROM: its potential in libraries (1986) 4.76

   4.7620935 = sum of:
     4.7620935 = weight(author_txt:peters in 535) [ClassicSimilarity], result of:
       4.7620935 = fieldWeight in 535, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.61935 = idf(docFreq=58, maxDocs=44218)
         0.625 = fieldNorm(doc=535)
   

2. Peters, T.A.: When smart people fail : an analysis of the transaction log of an online public access catalog (1989) 4.76

   4.7620935 = sum of:
     4.7620935 = weight(author_txt:peters in 2283) [ClassicSimilarity], result of:
       4.7620935 = fieldWeight in 2283, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.61935 = idf(docFreq=58, maxDocs=44218)
         0.625 = fieldNorm(doc=2283)
   

3. Peters, C.M.: CD-ROM and optical technology : the user interface (1988) 4.76

   4.7620935 = sum of:
     4.7620935 = weight(author_txt:peters in 4013) [ClassicSimilarity], result of:
       4.7620935 = fieldWeight in 4013, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.61935 = idf(docFreq=58, maxDocs=44218)
         0.625 = fieldNorm(doc=4013)
   

4. Peters, B.F.: Online searching using speech as a man / machine interface (1989) 4.76

   4.7620935 = sum of:
     4.7620935 = weight(author_txt:peters in 4637) [ClassicSimilarity], result of:
       4.7620935 = fieldWeight in 4637, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.61935 = idf(docFreq=58, maxDocs=44218)
         0.625 = fieldNorm(doc=4637)
   

5. Peters, R.: Katalogisierung mit MIDAS (1991) 4.76

   4.7620935 = sum of:
     4.7620935 = weight(author_txt:peters in 4740) [ClassicSimilarity], result of:
       4.7620935 = fieldWeight in 4740, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.61935 = idf(docFreq=58, maxDocs=44218)
         0.625 = fieldNorm(doc=4740)
   

Similar documents (content)

1. Mohammadi, E.; Thelwall, M.; Kousha, K.: Can Mendeley bookmarks reflect readership? : a survey of user motivations (2016) 0.24

   0.23933342 = sum of:
     0.23933342 = product of:
       0.74791694 = sum of:
         0.048233468 = weight(abstract_txt:articles in 2897) [ClassicSimilarity], result of:
           0.048233468 = score(doc=2897,freq=3.0), product of:
             0.09317171 = queryWeight, product of:
               1.0835443 = boost
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.017980991 = queryNorm
             0.5176836 = fieldWeight in 2897, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.0625 = fieldNorm(doc=2897)
         0.06450716 = weight(abstract_txt:publications in 2897) [ClassicSimilarity], result of:
           0.06450716 = score(doc=2897,freq=3.0), product of:
             0.11309854 = queryWeight, product of:
               1.1938043 = boost
               5.268782 = idf(docFreq=618, maxDocs=44218)
               0.017980991 = queryNorm
             0.5703624 = fieldWeight in 2897, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.268782 = idf(docFreq=618, maxDocs=44218)
               0.0625 = fieldNorm(doc=2897)
         0.023028303 = weight(abstract_txt:about in 2897) [ClassicSimilarity], result of:
           0.023028303 = score(doc=2897,freq=1.0), product of:
             0.09396452 = queryWeight, product of:
               1.3326994 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.017980991 = queryNorm
             0.24507447 = fieldWeight in 2897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.0625 = fieldNorm(doc=2897)
         0.123247564 = weight(abstract_txt:read in 2897) [ClassicSimilarity], result of:
           0.123247564 = score(doc=2897,freq=3.0), product of:
             0.17414218 = queryWeight, product of:
               1.4813464 = boost
               6.537832 = idf(docFreq=173, maxDocs=44218)
               0.017980991 = queryNorm
             0.707741 = fieldWeight in 2897, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.537832 = idf(docFreq=173, maxDocs=44218)
               0.0625 = fieldNorm(doc=2897)
         0.052160695 = weight(abstract_txt:impact in 2897) [ClassicSimilarity], result of:
           0.052160695 = score(doc=2897,freq=2.0), product of:
             0.12862977 = queryWeight, product of:
               1.5592688 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.017980991 = queryNorm
             0.40551028 = fieldWeight in 2897, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0625 = fieldNorm(doc=2897)
         0.046571516 = weight(abstract_txt:survey in 2897) [ClassicSimilarity], result of:
           0.046571516 = score(doc=2897,freq=1.0), product of:
             0.15026903 = queryWeight, product of:
               1.6853303 = boost
               4.9587345 = idf(docFreq=843, maxDocs=44218)
               0.017980991 = queryNorm
             0.3099209 = fieldWeight in 2897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9587345 = idf(docFreq=843, maxDocs=44218)
               0.0625 = fieldNorm(doc=2897)
         0.16774409 = weight(abstract_txt:altmetrics in 2897) [ClassicSimilarity], result of:
           0.16774409 = score(doc=2897,freq=1.0), product of:
             0.30845392 = queryWeight, product of:
               1.9715136 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.017980991 = queryNorm
             0.54382217 = fieldWeight in 2897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0625 = fieldNorm(doc=2897)
         0.22242418 = weight(abstract_txt:metrics in 2897) [ClassicSimilarity], result of:
           0.22242418 = score(doc=2897,freq=1.0), product of:
             0.5369336 = queryWeight, product of:
               4.505319 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.017980991 = queryNorm
             0.41424894 = fieldWeight in 2897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.0625 = fieldNorm(doc=2897)
       0.32 = coord(8/25)
   

2. Moed, H.F.; Halevi, G.: Multidimensional assessment of scholarly research impact (2015) 0.24

   0.23505227 = sum of:
     0.23505227 = product of:
       0.8394724 = sum of:
         0.027847605 = weight(abstract_txt:articles in 2212) [ClassicSimilarity], result of:
           0.027847605 = score(doc=2212,freq=1.0), product of:
             0.09317171 = queryWeight, product of:
               1.0835443 = boost
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.017980991 = queryNorm
             0.29888478 = fieldWeight in 2212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.0625 = fieldNorm(doc=2212)
         0.018627357 = weight(abstract_txt:analysis in 2212) [ClassicSimilarity], result of:
           0.018627357 = score(doc=2212,freq=1.0), product of:
             0.08157493 = queryWeight, product of:
               1.2417341 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.017980991 = queryNorm
             0.22834657 = fieldWeight in 2212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=2212)
         0.044635657 = weight(abstract_txt:regarding in 2212) [ClassicSimilarity], result of:
           0.044635657 = score(doc=2212,freq=1.0), product of:
             0.12760866 = queryWeight, product of:
               1.2680743 = boost
               5.596568 = idf(docFreq=445, maxDocs=44218)
               0.017980991 = queryNorm
             0.3497855 = fieldWeight in 2212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.596568 = idf(docFreq=445, maxDocs=44218)
               0.0625 = fieldNorm(doc=2212)
         0.036883183 = weight(abstract_txt:impact in 2212) [ClassicSimilarity], result of:
           0.036883183 = score(doc=2212,freq=1.0), product of:
             0.12862977 = queryWeight, product of:
               1.5592688 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.017980991 = queryNorm
             0.28673908 = fieldWeight in 2212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0625 = fieldNorm(doc=2212)
         0.16774409 = weight(abstract_txt:altmetrics in 2212) [ClassicSimilarity], result of:
           0.16774409 = score(doc=2212,freq=1.0), product of:
             0.30845392 = queryWeight, product of:
               1.9715136 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.017980991 = queryNorm
             0.54382217 = fieldWeight in 2212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0625 = fieldNorm(doc=2212)
         0.098886184 = weight(abstract_txt:researchers in 2212) [ClassicSimilarity], result of:
           0.098886184 = score(doc=2212,freq=1.0), product of:
             0.32925972 = queryWeight, product of:
               3.810728 = boost
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.017980991 = queryNorm
             0.30032882 = fieldWeight in 2212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.0625 = fieldNorm(doc=2212)
         0.44484836 = weight(abstract_txt:metrics in 2212) [ClassicSimilarity], result of:
           0.44484836 = score(doc=2212,freq=4.0), product of:
             0.5369336 = queryWeight, product of:
               4.505319 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.017980991 = queryNorm
             0.8284979 = fieldWeight in 2212, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.0625 = fieldNorm(doc=2212)
       0.28 = coord(7/25)
   

3. Aung, H.H.; Zheng, H.; Erdt, M.; Aw, A.S.; Sin, S.-C.J.; Theng, Y.-L.: Investigating familiarity and usage of traditional metrics and altmetrics (2019) 0.21

   0.20619765 = sum of:
     0.20619765 = product of:
       1.0309882 = sum of:
         0.03929049 = weight(abstract_txt:participants in 5328) [ClassicSimilarity], result of:
           0.03929049 = score(doc=5328,freq=1.0), product of:
             0.11720617 = queryWeight, product of:
               1.2152898 = boost
               5.3636074 = idf(docFreq=562, maxDocs=44218)
               0.017980991 = queryNorm
             0.33522546 = fieldWeight in 5328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3636074 = idf(docFreq=562, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
         0.036883183 = weight(abstract_txt:impact in 5328) [ClassicSimilarity], result of:
           0.036883183 = score(doc=5328,freq=1.0), product of:
             0.12862977 = queryWeight, product of:
               1.5592688 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.017980991 = queryNorm
             0.28673908 = fieldWeight in 5328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
         0.046571516 = weight(abstract_txt:survey in 5328) [ClassicSimilarity], result of:
           0.046571516 = score(doc=5328,freq=1.0), product of:
             0.15026903 = queryWeight, product of:
               1.6853303 = boost
               4.9587345 = idf(docFreq=843, maxDocs=44218)
               0.017980991 = queryNorm
             0.3099209 = fieldWeight in 5328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9587345 = idf(docFreq=843, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
         0.41088742 = weight(abstract_txt:altmetrics in 5328) [ClassicSimilarity], result of:
           0.41088742 = score(doc=5328,freq=6.0), product of:
             0.30845392 = queryWeight, product of:
               1.9715136 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.017980991 = queryNorm
             1.3320869 = fieldWeight in 5328, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
         0.49735558 = weight(abstract_txt:metrics in 5328) [ClassicSimilarity], result of:
           0.49735558 = score(doc=5328,freq=5.0), product of:
             0.5369336 = queryWeight, product of:
               4.505319 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.017980991 = queryNorm
             0.9262888 = fieldWeight in 5328, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
       0.2 = coord(5/25)
   

4. Thelwall, M.: Web indicators for research evaluation : a practical guide (2016) 0.19

   0.18658264 = sum of:
     0.18658264 = product of:
       0.6663666 = sum of:
         0.027847605 = weight(abstract_txt:articles in 3384) [ClassicSimilarity], result of:
           0.027847605 = score(doc=3384,freq=1.0), product of:
             0.09317171 = queryWeight, product of:
               1.0835443 = boost
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.017980991 = queryNorm
             0.29888478 = fieldWeight in 3384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.052669868 = weight(abstract_txt:publications in 3384) [ClassicSimilarity], result of:
           0.052669868 = score(doc=3384,freq=2.0), product of:
             0.11309854 = queryWeight, product of:
               1.1938043 = boost
               5.268782 = idf(docFreq=618, maxDocs=44218)
               0.017980991 = queryNorm
             0.46569893 = fieldWeight in 3384, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.268782 = idf(docFreq=618, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.023028303 = weight(abstract_txt:about in 3384) [ClassicSimilarity], result of:
           0.023028303 = score(doc=3384,freq=1.0), product of:
             0.09396452 = queryWeight, product of:
               1.3326994 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.017980991 = queryNorm
             0.24507447 = fieldWeight in 3384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.073766366 = weight(abstract_txt:impact in 3384) [ClassicSimilarity], result of:
           0.073766366 = score(doc=3384,freq=4.0), product of:
             0.12862977 = queryWeight, product of:
               1.5592688 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.017980991 = queryNorm
             0.57347816 = fieldWeight in 3384, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.16774409 = weight(abstract_txt:altmetrics in 3384) [ClassicSimilarity], result of:
           0.16774409 = score(doc=3384,freq=1.0), product of:
             0.30845392 = queryWeight, product of:
               1.9715136 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.017980991 = queryNorm
             0.54382217 = fieldWeight in 3384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.098886184 = weight(abstract_txt:researchers in 3384) [ClassicSimilarity], result of:
           0.098886184 = score(doc=3384,freq=1.0), product of:
             0.32925972 = queryWeight, product of:
               3.810728 = boost
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.017980991 = queryNorm
             0.30032882 = fieldWeight in 3384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.22242418 = weight(abstract_txt:metrics in 3384) [ClassicSimilarity], result of:
           0.22242418 = score(doc=3384,freq=1.0), product of:
             0.5369336 = queryWeight, product of:
               4.505319 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.017980991 = queryNorm
             0.41424894 = fieldWeight in 3384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
       0.28 = coord(7/25)
   

5. Beyond bibliometrics : harnessing multidimensional indicators of scholarly intent (2014) 0.16

   0.16376594 = sum of:
     0.16376594 = product of:
       1.0235372 = sum of:
         0.06520087 = weight(abstract_txt:impact in 3026) [ClassicSimilarity], result of:
           0.06520087 = score(doc=3026,freq=2.0), product of:
             0.12862977 = queryWeight, product of:
               1.5592688 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.017980991 = queryNorm
             0.50688785 = fieldWeight in 3026, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.078125 = fieldNorm(doc=3026)
         0.19259575 = weight(abstract_txt:bibliometrics in 3026) [ClassicSimilarity], result of:
           0.19259575 = score(doc=3026,freq=3.0), product of:
             0.20208909 = queryWeight, product of:
               1.5957912 = boost
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.017980991 = queryNorm
             0.95302397 = fieldWeight in 3026, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.078125 = fieldNorm(doc=3026)
         0.20968011 = weight(abstract_txt:altmetrics in 3026) [ClassicSimilarity], result of:
           0.20968011 = score(doc=3026,freq=1.0), product of:
             0.30845392 = queryWeight, product of:
               1.9715136 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.017980991 = queryNorm
             0.67977774 = fieldWeight in 3026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.078125 = fieldNorm(doc=3026)
         0.55606043 = weight(abstract_txt:metrics in 3026) [ClassicSimilarity], result of:
           0.55606043 = score(doc=3026,freq=4.0), product of:
             0.5369336 = queryWeight, product of:
               4.505319 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.017980991 = queryNorm
             1.0356224 = fieldWeight in 3026, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.078125 = fieldNorm(doc=3026)
       0.16 = coord(4/25)