Document (#40126)

Author

Bohlin, L.
Esquivel, A.V.
Lancichinetti, A.
Rosvall, M.

Title

Robustness of journal rankings by network flows with different amounts of memory

Source

Journal of the Association for Information Science and Technology. 67(2016) no.10, S.2527-2535

Year

2016

Abstract

As the number of scientific journals has multiplied, journal rankings have become increasingly important for scientific decisions. From submissions and subscriptions to grants and hirings, researchers, policy makers, and funding agencies make important decisions influenced by journal rankings such as the ISI journal impact factor. Typically, the rankings are derived from the citation network between a selection of journals and unavoidably depend on this selection. However, little is known about how robust rankings are to the selection of included journals. We compare the robustness of three journal rankings based on network flows induced on citation networks. They model pathways of researchers navigating the scholarly literature, stepping between journals and remembering their previous steps to different degrees: zero-step memory as impact factor, one-step memory as Eigenfactor, and two-step memory, corresponding to zero-, first-, and second-order Markov models of citation flow between journals. We conclude that higher-order Markov models perform better and are more robust to the selection of journals. Whereas our analysis indicates that higher-order models perform better, the performance gain for higher-order Markov models comes at the cost of requiring more citation data over a longer time period.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23582/full.

Theme

Informetrie

Similar documents (content)

1. Aledo, J.A.; Gámez, J.A.; Molina, D.; Rosete, A.: Consensus-based journal rankings : a complementary tool for bibliometric evaluation (2018) 0.19

   0.19476421 = sum of:
     0.19476421 = product of:
       0.81151754 = sum of:
         0.018016424 = weight(abstract_txt:between in 4364) [ClassicSimilarity], result of:
           0.018016424 = score(doc=4364,freq=2.0), product of:
             0.05885358 = queryWeight, product of:
               1.0803442 = boost
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.015729325 = queryNorm
             0.3061228 = fieldWeight in 4364, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
         0.03993947 = weight(abstract_txt:factor in 4364) [ClassicSimilarity], result of:
           0.03993947 = score(doc=4364,freq=1.0), product of:
             0.110130675 = queryWeight, product of:
               1.2066581 = boost
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.015729325 = queryNorm
             0.36265528 = fieldWeight in 4364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
         0.04800709 = weight(abstract_txt:citation in 4364) [ClassicSimilarity], result of:
           0.04800709 = score(doc=4364,freq=1.0), product of:
             0.15686294 = queryWeight, product of:
               2.0365977 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.015729325 = queryNorm
             0.30604482 = fieldWeight in 4364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
         0.13951313 = weight(abstract_txt:journal in 4364) [ClassicSimilarity], result of:
           0.13951313 = score(doc=4364,freq=4.0), product of:
             0.21677549 = queryWeight, product of:
               2.6767337 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.015729325 = queryNorm
             0.64358354 = fieldWeight in 4364, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
         0.16575843 = weight(abstract_txt:journals in 4364) [ClassicSimilarity], result of:
           0.16575843 = score(doc=4364,freq=4.0), product of:
             0.25841096 = queryWeight, product of:
               3.201446 = boost
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.015729325 = queryNorm
             0.6414528 = fieldWeight in 4364, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
         0.40028298 = weight(abstract_txt:rankings in 4364) [ClassicSimilarity], result of:
           0.40028298 = score(doc=4364,freq=4.0), product of:
             0.4651274 = queryWeight, product of:
               4.2951336 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.015729325 = queryNorm
             0.86058784 = fieldWeight in 4364, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
       0.24 = coord(6/25)
   

2. Kulczycki, E.; Huang, Y.; Zuccala, A.A.; Engels, T.C.E.; Ferrara, A.; Guns, R.; Pölönen, J.; Sivertsen, G.; Taskin, Z.; Zhang, L.: Uses of the Journal Impact Factor in national journal rankings in China and Europe (2022) 0.19

   0.19246154 = sum of:
     0.19246154 = product of:
       0.9623077 = sum of:
         0.03982612 = weight(abstract_txt:decisions in 769) [ClassicSimilarity], result of:
           0.03982612 = score(doc=769,freq=1.0), product of:
             0.10992221 = queryWeight, product of:
               1.2055155 = boost
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.015729325 = queryNorm
             0.36231187 = fieldWeight in 769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.0625 = fieldNorm(doc=769)
         0.06917719 = weight(abstract_txt:factor in 769) [ClassicSimilarity], result of:
           0.06917719 = score(doc=769,freq=3.0), product of:
             0.110130675 = queryWeight, product of:
               1.2066581 = boost
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.015729325 = queryNorm
             0.62813735 = fieldWeight in 769, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.0625 = fieldNorm(doc=769)
         0.19730136 = weight(abstract_txt:journal in 769) [ClassicSimilarity], result of:
           0.19730136 = score(doc=769,freq=8.0), product of:
             0.21677549 = queryWeight, product of:
               2.6767337 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.015729325 = queryNorm
             0.91016454 = fieldWeight in 769, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=769)
         0.16575843 = weight(abstract_txt:journals in 769) [ClassicSimilarity], result of:
           0.16575843 = score(doc=769,freq=4.0), product of:
             0.25841096 = queryWeight, product of:
               3.201446 = boost
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.015729325 = queryNorm
             0.6414528 = fieldWeight in 769, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.0625 = fieldNorm(doc=769)
         0.49024457 = weight(abstract_txt:rankings in 769) [ClassicSimilarity], result of:
           0.49024457 = score(doc=769,freq=6.0), product of:
             0.4651274 = queryWeight, product of:
               4.2951336 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.015729325 = queryNorm
             1.0540006 = fieldWeight in 769, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=769)
       0.2 = coord(5/25)
   

3. Franceschet, M.: ¬The large-scale structure of journal citation networks (2012) 0.18

   0.18387811 = sum of:
     0.18387811 = product of:
       0.7661588 = sum of:
         0.09335343 = weight(abstract_txt:robust in 60) [ClassicSimilarity], result of:
           0.09335343 = score(doc=60,freq=1.0), product of:
             0.14802422 = queryWeight, product of:
               1.3989315 = boost
               6.727074 = idf(docFreq=143, maxDocs=44218)
               0.015729325 = queryNorm
             0.6306632 = fieldWeight in 60, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.727074 = idf(docFreq=143, maxDocs=44218)
               0.09375 = fieldNorm(doc=60)
         0.07874975 = weight(abstract_txt:network in 60) [ClassicSimilarity], result of:
           0.07874975 = score(doc=60,freq=3.0), product of:
             0.10489032 = queryWeight, product of:
               1.4422596 = boost
               4.6236176 = idf(docFreq=1179, maxDocs=44218)
               0.015729325 = queryNorm
             0.75078195 = fieldWeight in 60, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6236176 = idf(docFreq=1179, maxDocs=44218)
               0.09375 = fieldNorm(doc=60)
         0.16377784 = weight(abstract_txt:robustness in 60) [ClassicSimilarity], result of:
           0.16377784 = score(doc=60,freq=1.0), product of:
             0.21531917 = queryWeight, product of:
               1.6872189 = boost
               8.113368 = idf(docFreq=35, maxDocs=44218)
               0.015729325 = queryNorm
             0.7606282 = fieldWeight in 60, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.113368 = idf(docFreq=35, maxDocs=44218)
               0.09375 = fieldNorm(doc=60)
         0.12472608 = weight(abstract_txt:citation in 60) [ClassicSimilarity], result of:
           0.12472608 = score(doc=60,freq=3.0), product of:
             0.15686294 = queryWeight, product of:
               2.0365977 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.015729325 = queryNorm
             0.79512775 = fieldWeight in 60, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.09375 = fieldNorm(doc=60)
         0.18123288 = weight(abstract_txt:journal in 60) [ClassicSimilarity], result of:
           0.18123288 = score(doc=60,freq=3.0), product of:
             0.21677549 = queryWeight, product of:
               2.6767337 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.015729325 = queryNorm
             0.83603954 = fieldWeight in 60, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.09375 = fieldNorm(doc=60)
         0.12431882 = weight(abstract_txt:journals in 60) [ClassicSimilarity], result of:
           0.12431882 = score(doc=60,freq=1.0), product of:
             0.25841096 = queryWeight, product of:
               3.201446 = boost
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.015729325 = queryNorm
             0.4810896 = fieldWeight in 60, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.09375 = fieldNorm(doc=60)
       0.24 = coord(6/25)
   

4. Zhang, C.; Liu, X.; Xu, Y.(C.); Wang, Y.: Quality-structure index : a new metric to measure scientific journal influence (2011) 0.18

   0.17940043 = sum of:
     0.17940043 = product of:
       0.64071584 = sum of:
         0.09093051 = weight(abstract_txt:eigenfactor in 4366) [ClassicSimilarity], result of:
           0.09093051 = score(doc=4366,freq=1.0), product of:
             0.15127593 = queryWeight, product of:
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.015729325 = queryNorm
             0.6010904 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.012739535 = weight(abstract_txt:between in 4366) [ClassicSimilarity], result of:
           0.012739535 = score(doc=4366,freq=1.0), product of:
             0.05885358 = queryWeight, product of:
               1.0803442 = boost
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.015729325 = queryNorm
             0.21646151 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.03993947 = weight(abstract_txt:factor in 4366) [ClassicSimilarity], result of:
           0.03993947 = score(doc=4366,freq=1.0), product of:
             0.110130675 = queryWeight, product of:
               1.2066581 = boost
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.015729325 = queryNorm
             0.36265528 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.042865936 = weight(abstract_txt:network in 4366) [ClassicSimilarity], result of:
           0.042865936 = score(doc=4366,freq=2.0), product of:
             0.10489032 = queryWeight, product of:
               1.4422596 = boost
               4.6236176 = idf(docFreq=1179, maxDocs=44218)
               0.015729325 = queryNorm
             0.4086739 = fieldWeight in 4366, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6236176 = idf(docFreq=1179, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.067892276 = weight(abstract_txt:citation in 4366) [ClassicSimilarity], result of:
           0.067892276 = score(doc=4366,freq=2.0), product of:
             0.15686294 = queryWeight, product of:
               2.0365977 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.015729325 = queryNorm
             0.43281272 = fieldWeight in 4366, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.22058964 = weight(abstract_txt:journal in 4366) [ClassicSimilarity], result of:
           0.22058964 = score(doc=4366,freq=10.0), product of:
             0.21677549 = queryWeight, product of:
               2.6767337 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.015729325 = queryNorm
             1.0175949 = fieldWeight in 4366, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.16575843 = weight(abstract_txt:journals in 4366) [ClassicSimilarity], result of:
           0.16575843 = score(doc=4366,freq=4.0), product of:
             0.25841096 = queryWeight, product of:
               3.201446 = boost
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.015729325 = queryNorm
             0.6414528 = fieldWeight in 4366, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
       0.28 = coord(7/25)
   

5. Yan, E.: Disciplinary knowledge production and diffusion in science (2016) 0.16

   0.16104084 = sum of:
     0.16104084 = product of:
       0.57514584 = sum of:
         0.012739535 = weight(abstract_txt:between in 3092) [ClassicSimilarity], result of:
           0.012739535 = score(doc=3092,freq=1.0), product of:
             0.05885358 = queryWeight, product of:
               1.0803442 = boost
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.015729325 = queryNorm
             0.21646151 = fieldWeight in 3092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.0625 = fieldNorm(doc=3092)
         0.105985485 = weight(abstract_txt:flows in 3092) [ClassicSimilarity], result of:
           0.105985485 = score(doc=3092,freq=1.0), product of:
             0.21109164 = queryWeight, product of:
               1.6705735 = boost
               8.033325 = idf(docFreq=38, maxDocs=44218)
               0.015729325 = queryNorm
             0.5020828 = fieldWeight in 3092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.033325 = idf(docFreq=38, maxDocs=44218)
               0.0625 = fieldNorm(doc=3092)
         0.047841735 = weight(abstract_txt:higher in 3092) [ClassicSimilarity], result of:
           0.047841735 = score(doc=3092,freq=1.0), product of:
             0.14219199 = queryWeight, product of:
               1.6792419 = boost
               5.3833394 = idf(docFreq=551, maxDocs=44218)
               0.015729325 = queryNorm
             0.3364587 = fieldWeight in 3092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3833394 = idf(docFreq=551, maxDocs=44218)
               0.0625 = fieldNorm(doc=3092)
         0.13835037 = weight(abstract_txt:step in 3092) [ClassicSimilarity], result of:
           0.13835037 = score(doc=3092,freq=4.0), product of:
             0.18181822 = queryWeight, product of:
               1.8988664 = boost
               6.087415 = idf(docFreq=272, maxDocs=44218)
               0.015729325 = queryNorm
             0.7609269 = fieldWeight in 3092, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.087415 = idf(docFreq=272, maxDocs=44218)
               0.0625 = fieldNorm(doc=3092)
         0.117592886 = weight(abstract_txt:citation in 3092) [ClassicSimilarity], result of:
           0.117592886 = score(doc=3092,freq=6.0), product of:
             0.15686294 = queryWeight, product of:
               2.0365977 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.015729325 = queryNorm
             0.7496537 = fieldWeight in 3092, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=3092)
         0.06975657 = weight(abstract_txt:journal in 3092) [ClassicSimilarity], result of:
           0.06975657 = score(doc=3092,freq=1.0), product of:
             0.21677549 = queryWeight, product of:
               2.6767337 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.015729325 = queryNorm
             0.32179177 = fieldWeight in 3092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=3092)
         0.082879215 = weight(abstract_txt:journals in 3092) [ClassicSimilarity], result of:
           0.082879215 = score(doc=3092,freq=1.0), product of:
             0.25841096 = queryWeight, product of:
               3.201446 = boost
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.015729325 = queryNorm
             0.3207264 = fieldWeight in 3092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.0625 = fieldNorm(doc=3092)
       0.28 = coord(7/25)