Document (#38761)

Author
Egghe, L.
Bornmann, L.
Title
Fallout and miss in journal peer review
Source
Journal of documentation. 69(2013) no.3, S.411-416
Year
2013
Abstract
Purpose - The authors exploit the analogy between journal peer review and information retrieval in order to quantify some imperfections of journal peer review. Design/methodology/approach - The authors define fallout rate and missing rate in order to describe quantitatively the weak papers that were accepted and the strong papers that were missed, respectively. To assess the quality of manuscripts the authors use bibliometric measures. Findings - Fallout rate and missing rate are put in relation with the hitting rate and success rate. Conclusions are drawn on what fraction of weak papers will be accepted in order to have a certain fraction of strong accepted papers. Originality/value - The paper illustrates that these curves are new in peer review research when interpreted in the information retrieval terminology.

Similar documents (author)

  1. Egghe, L.: Little science, big science and beyond (1994) 1.67
    1.6701136 = sum of:
      1.6701136 = product of:
        3.3402271 = sum of:
          3.3402271 = weight(author_txt:egghe in 6883) [ClassicSimilarity], result of:
            3.3402271 = score(doc=6883,freq=1.0), product of:
              0.70863134 = queryWeight, product of:
                1.0021607 = boost
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.09375779 = queryNorm
              4.7136316 = fieldWeight in 6883, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.625 = fieldNorm(doc=6883)
        0.5 = coord(1/2)
    
  2. Egghe, L.: Expansion of the field of informetrics : the second special issue (2006) 1.67
    1.6701136 = sum of:
      1.6701136 = product of:
        3.3402271 = sum of:
          3.3402271 = weight(author_txt:egghe in 7119) [ClassicSimilarity], result of:
            3.3402271 = score(doc=7119,freq=1.0), product of:
              0.70863134 = queryWeight, product of:
                1.0021607 = boost
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.09375779 = queryNorm
              4.7136316 = fieldWeight in 7119, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.625 = fieldNorm(doc=7119)
        0.5 = coord(1/2)
    
  3. Egghe, L.: Expansion of the field of informetrics : origins and consequences (2005) 1.67
    1.6701136 = sum of:
      1.6701136 = product of:
        3.3402271 = sum of:
          3.3402271 = weight(author_txt:egghe in 1979) [ClassicSimilarity], result of:
            3.3402271 = score(doc=1979,freq=1.0), product of:
              0.70863134 = queryWeight, product of:
                1.0021607 = boost
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.09375779 = queryNorm
              4.7136316 = fieldWeight in 1979, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.625 = fieldNorm(doc=1979)
        0.5 = coord(1/2)
    
  4. Egghe, L.: ¬The amount of actions needed for shelving and reshelving (1996) 1.67
    1.6701136 = sum of:
      1.6701136 = product of:
        3.3402271 = sum of:
          3.3402271 = weight(author_txt:egghe in 4463) [ClassicSimilarity], result of:
            3.3402271 = score(doc=4463,freq=1.0), product of:
              0.70863134 = queryWeight, product of:
                1.0021607 = boost
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.09375779 = queryNorm
              4.7136316 = fieldWeight in 4463, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.625 = fieldNorm(doc=4463)
        0.5 = coord(1/2)
    
  5. Egghe, L.: Special features of the author - publication relationship and a new explanation of Lotka's law based on convolution theory (1994) 1.67
    1.6701136 = sum of:
      1.6701136 = product of:
        3.3402271 = sum of:
          3.3402271 = weight(author_txt:egghe in 5137) [ClassicSimilarity], result of:
            3.3402271 = score(doc=5137,freq=1.0), product of:
              0.70863134 = queryWeight, product of:
                1.0021607 = boost
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.09375779 = queryNorm
              4.7136316 = fieldWeight in 5137, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.5418105 = idf(docFreq=60, maxDocs=42306)
                0.625 = fieldNorm(doc=5137)
        0.5 = coord(1/2)
    

Similar documents (content)

  1. Mulligan, A.; Hall, L.; Raphael, E.: Peer review in a changing world : an international study measuring the attitudes of researchers (2013) 0.27
    0.26649842 = sum of:
      0.26649842 = product of:
        0.9517801 = sum of:
          0.010761532 = weight(abstract_txt:that in 2529) [ClassicSimilarity], result of:
            0.010761532 = score(doc=2529,freq=5.0), product of:
              0.03201991 = queryWeight, product of:
                1.0508906 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.012669913 = queryNorm
              0.33608878 = fieldWeight in 2529, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=2529)
          0.01654989 = weight(abstract_txt:were in 2529) [ClassicSimilarity], result of:
            0.01654989 = score(doc=2529,freq=2.0), product of:
              0.05058057 = queryWeight, product of:
                1.0784342 = boost
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.012669913 = queryNorm
              0.3271986 = fieldWeight in 2529, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0625 = fieldNorm(doc=2529)
          0.05046789 = weight(abstract_txt:authors in 2529) [ClassicSimilarity], result of:
            0.05046789 = score(doc=2529,freq=2.0), product of:
              0.12175706 = queryWeight, product of:
                2.049248 = boost
                4.689494 = idf(docFreq=1056, maxDocs=42306)
                0.012669913 = queryNorm
              0.41449663 = fieldWeight in 2529, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.689494 = idf(docFreq=1056, maxDocs=42306)
                0.0625 = fieldNorm(doc=2529)
          0.18098262 = weight(abstract_txt:review in 2529) [ClassicSimilarity], result of:
            0.18098262 = score(doc=2529,freq=11.0), product of:
              0.17786916 = queryWeight, product of:
                2.8600073 = boost
                4.908625 = idf(docFreq=848, maxDocs=42306)
                0.012669913 = queryNorm
              1.0175042 = fieldWeight in 2529, product of:
                3.3166249 = tf(freq=11.0), with freq of:
                  11.0 = termFreq=11.0
                4.908625 = idf(docFreq=848, maxDocs=42306)
                0.0625 = fieldNorm(doc=2529)
          0.06889529 = weight(abstract_txt:papers in 2529) [ClassicSimilarity], result of:
            0.06889529 = score(doc=2529,freq=1.0), product of:
              0.2077782 = queryWeight, product of:
                3.0911267 = boost
                5.305295 = idf(docFreq=570, maxDocs=42306)
                0.012669913 = queryNorm
              0.33158094 = fieldWeight in 2529, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.305295 = idf(docFreq=570, maxDocs=42306)
                0.0625 = fieldNorm(doc=2529)
          0.46554 = weight(abstract_txt:peer in 2529) [ClassicSimilarity], result of:
            0.46554 = score(doc=2529,freq=12.0), product of:
              0.32437786 = queryWeight, product of:
                3.8622682 = boost
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.012669913 = queryNorm
              1.435178 = fieldWeight in 2529, product of:
                3.4641016 = tf(freq=12.0), with freq of:
                  12.0 = termFreq=12.0
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.0625 = fieldNorm(doc=2529)
          0.15858285 = weight(abstract_txt:rate in 2529) [ClassicSimilarity], result of:
            0.15858285 = score(doc=2529,freq=1.0), product of:
              0.4146435 = queryWeight, product of:
                5.3481045 = boost
                6.1192946 = idf(docFreq=252, maxDocs=42306)
                0.012669913 = queryNorm
              0.38245592 = fieldWeight in 2529, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1192946 = idf(docFreq=252, maxDocs=42306)
                0.0625 = fieldNorm(doc=2529)
        0.28 = coord(7/25)
    
  2. Egghe, L.: ¬The measures precision, recall, fallout and miss as a function of the number of retrieved documents and their mutual interrelations (2008) 0.21
    0.20945258 = sum of:
      0.20945258 = product of:
        1.0472629 = sum of:
          0.02708854 = weight(abstract_txt:retrieval in 4068) [ClassicSimilarity], result of:
            0.02708854 = score(doc=4068,freq=8.0), product of:
              0.044254493 = queryWeight, product of:
                1.0087429 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.012669913 = queryNorm
              0.61210823 = fieldWeight in 4068, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
          0.0068061906 = weight(abstract_txt:that in 4068) [ClassicSimilarity], result of:
            0.0068061906 = score(doc=4068,freq=2.0), product of:
              0.03201991 = queryWeight, product of:
                1.0508906 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.012669913 = queryNorm
              0.2125612 = fieldWeight in 4068, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
          0.11659744 = weight(abstract_txt:curves in 4068) [ClassicSimilarity], result of:
            0.11659744 = score(doc=4068,freq=3.0), product of:
              0.12888604 = queryWeight, product of:
                1.217278 = boost
                8.356848 = idf(docFreq=26, maxDocs=42306)
                0.012669913 = queryNorm
              0.9046553 = fieldWeight in 4068, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.356848 = idf(docFreq=26, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
          0.18022202 = weight(abstract_txt:miss in 4068) [ClassicSimilarity], result of:
            0.18022202 = score(doc=4068,freq=6.0), product of:
              0.13675454 = queryWeight, product of:
                1.253885 = boost
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.012669913 = queryNorm
              1.3178504 = fieldWeight in 4068, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
          0.7165488 = weight(abstract_txt:fallout in 4068) [ClassicSimilarity], result of:
            0.7165488 = score(doc=4068,freq=6.0), product of:
              0.49500257 = queryWeight, product of:
                4.131913 = boost
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.012669913 = queryNorm
              1.4475658 = fieldWeight in 4068, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
        0.2 = coord(5/25)
    
  3. Egghe, L.: Existence theorem of the quadruple (P, R, F, M) : precision, recall, fallout and miss (2007) 0.19
    0.18617873 = sum of:
      0.18617873 = product of:
        0.77574474 = sum of:
          0.009577245 = weight(abstract_txt:retrieval in 4012) [ClassicSimilarity], result of:
            0.009577245 = score(doc=4012,freq=1.0), product of:
              0.044254493 = queryWeight, product of:
                1.0087429 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.012669913 = queryNorm
              0.21641295 = fieldWeight in 4012, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.009625407 = weight(abstract_txt:that in 4012) [ClassicSimilarity], result of:
            0.009625407 = score(doc=4012,freq=4.0), product of:
              0.03201991 = queryWeight, product of:
                1.0508906 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.012669913 = queryNorm
              0.30060694 = fieldWeight in 4012, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.1274362 = weight(abstract_txt:miss in 4012) [ClassicSimilarity], result of:
            0.1274362 = score(doc=4012,freq=3.0), product of:
              0.13675454 = queryWeight, product of:
                1.253885 = boost
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.012669913 = queryNorm
              0.93186086 = fieldWeight in 4012, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.030881532 = weight(abstract_txt:order in 4012) [ClassicSimilarity], result of:
            0.030881532 = score(doc=4012,freq=1.0), product of:
              0.11056727 = queryWeight, product of:
                1.9528135 = boost
                4.4688134 = idf(docFreq=1317, maxDocs=42306)
                0.012669913 = queryNorm
              0.27930084 = fieldWeight in 4012, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4688134 = idf(docFreq=1317, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.09154784 = weight(abstract_txt:missing in 4012) [ClassicSimilarity], result of:
            0.09154784 = score(doc=4012,freq=1.0), product of:
              0.19932526 = queryWeight, product of:
                2.140834 = boost
                7.348619 = idf(docFreq=73, maxDocs=42306)
                0.012669913 = queryNorm
              0.4592887 = fieldWeight in 4012, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.348619 = idf(docFreq=73, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.5066765 = weight(abstract_txt:fallout in 4012) [ClassicSimilarity], result of:
            0.5066765 = score(doc=4012,freq=3.0), product of:
              0.49500257 = queryWeight, product of:
                4.131913 = boost
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.012669913 = queryNorm
              1.0235835 = fieldWeight in 4012, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
        0.24 = coord(6/25)
    
  4. Bornmann, L.; Daniel, H.-D.: Selecting manuscripts for a high-impact journal through peer review : a citation analysis of communications that were accepted by Angewandte Chemie International Edition, or rejected but published elsewhere (2008) 0.17
    0.17401615 = sum of:
      0.17401615 = product of:
        0.7250673 = sum of:
          0.010761532 = weight(abstract_txt:that in 201) [ClassicSimilarity], result of:
            0.010761532 = score(doc=201,freq=5.0), product of:
              0.03201991 = queryWeight, product of:
                1.0508906 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.012669913 = queryNorm
              0.33608878 = fieldWeight in 201, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=201)
          0.01654989 = weight(abstract_txt:were in 201) [ClassicSimilarity], result of:
            0.01654989 = score(doc=201,freq=2.0), product of:
              0.05058057 = queryWeight, product of:
                1.0784342 = boost
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.012669913 = queryNorm
              0.3271986 = fieldWeight in 201, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0625 = fieldNorm(doc=201)
          0.0836964 = weight(abstract_txt:journal in 201) [ClassicSimilarity], result of:
            0.0836964 = score(doc=201,freq=3.0), product of:
              0.14902467 = queryWeight, product of:
                2.2671306 = boost
                5.188096 = idf(docFreq=641, maxDocs=42306)
                0.012669913 = queryNorm
              0.56162786 = fieldWeight in 201, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.188096 = idf(docFreq=641, maxDocs=42306)
                0.0625 = fieldNorm(doc=201)
          0.109136626 = weight(abstract_txt:review in 201) [ClassicSimilarity], result of:
            0.109136626 = score(doc=201,freq=4.0), product of:
              0.17786916 = queryWeight, product of:
                2.8600073 = boost
                4.908625 = idf(docFreq=848, maxDocs=42306)
                0.012669913 = queryNorm
              0.61357814 = fieldWeight in 201, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.908625 = idf(docFreq=848, maxDocs=42306)
                0.0625 = fieldNorm(doc=201)
          0.23614325 = weight(abstract_txt:accepted in 201) [ClassicSimilarity], result of:
            0.23614325 = score(doc=201,freq=5.0), product of:
              0.25096956 = queryWeight, product of:
                2.9421039 = boost
                6.732703 = idf(docFreq=136, maxDocs=42306)
                0.012669913 = queryNorm
              0.94092387 = fieldWeight in 201, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                6.732703 = idf(docFreq=136, maxDocs=42306)
                0.0625 = fieldNorm(doc=201)
          0.26877964 = weight(abstract_txt:peer in 201) [ClassicSimilarity], result of:
            0.26877964 = score(doc=201,freq=4.0), product of:
              0.32437786 = queryWeight, product of:
                3.8622682 = boost
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.012669913 = queryNorm
              0.82860047 = fieldWeight in 201, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.0625 = fieldNorm(doc=201)
        0.24 = coord(6/25)
    
  5. Bornmann, L.: Interrater reliability and convergent validity of F1000Prime peer review (2015) 0.17
    0.170038 = sum of:
      0.170038 = product of:
        0.85019 = sum of:
          0.0060158796 = weight(abstract_txt:that in 4329) [ClassicSimilarity], result of:
            0.0060158796 = score(doc=4329,freq=1.0), product of:
              0.03201991 = queryWeight, product of:
                1.0508906 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.012669913 = queryNorm
              0.18787934 = fieldWeight in 4329, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.078125 = fieldNorm(doc=4329)
          0.060402676 = weight(abstract_txt:journal in 4329) [ClassicSimilarity], result of:
            0.060402676 = score(doc=4329,freq=1.0), product of:
              0.14902467 = queryWeight, product of:
                2.2671306 = boost
                5.188096 = idf(docFreq=641, maxDocs=42306)
                0.012669913 = queryNorm
              0.40532 = fieldWeight in 4329, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.188096 = idf(docFreq=641, maxDocs=42306)
                0.078125 = fieldNorm(doc=4329)
          0.16708066 = weight(abstract_txt:review in 4329) [ClassicSimilarity], result of:
            0.16708066 = score(doc=4329,freq=6.0), product of:
              0.17786916 = queryWeight, product of:
                2.8600073 = boost
                4.908625 = idf(docFreq=848, maxDocs=42306)
                0.012669913 = queryNorm
              0.9393459 = fieldWeight in 4329, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.908625 = idf(docFreq=848, maxDocs=42306)
                0.078125 = fieldNorm(doc=4329)
          0.17223822 = weight(abstract_txt:papers in 4329) [ClassicSimilarity], result of:
            0.17223822 = score(doc=4329,freq=4.0), product of:
              0.2077782 = queryWeight, product of:
                3.0911267 = boost
                5.305295 = idf(docFreq=570, maxDocs=42306)
                0.012669913 = queryNorm
              0.8289523 = fieldWeight in 4329, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.305295 = idf(docFreq=570, maxDocs=42306)
                0.078125 = fieldNorm(doc=4329)
          0.44445255 = weight(abstract_txt:peer in 4329) [ClassicSimilarity], result of:
            0.44445255 = score(doc=4329,freq=7.0), product of:
              0.32437786 = queryWeight, product of:
                3.8622682 = boost
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.012669913 = queryNorm
              1.3701692 = fieldWeight in 4329, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.078125 = fieldNorm(doc=4329)
        0.2 = coord(5/25)