Document (#39330)

Author
Bornmann, L.
Title
Interrater reliability and convergent validity of F1000Prime peer review
Source
Journal of the Association for Information Science and Technology. 66(2015) no.12, S.2415-2426
Year
2015
Abstract
Peer review is the backbone of modern science. F1000Prime is a postpublication peer review system of the biomedical literature (papers from medical and biological journals). This study is concerned with the interrater reliability and convergent validity of the peer recommendations formulated in the F1000Prime peer review system. The study is based on about 100,000 papers with recommendations from faculty members. Even if intersubjectivity plays a fundamental role in science, the analyses of the reliability of the F1000Prime peer review system show a rather low level of agreement between faculty members. This result is in agreement with most other studies that have been published on the journal peer review system. Logistic regression models are used to investigate the convergent validity of the F1000Prime peer review system. As the results show, the proportion of highly cited papers among those selected by the faculty members is significantly higher than expected. In addition, better recommendation scores are also associated with higher performing papers.
Content
Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23334/abstract.
Theme
Informetrie

Similar documents (author)

  1. Bornmann, L.: Complex tasks and simple solutions : the use of heuristics in the evaluation of research (2015) 4.71
    4.7098475 = sum of:
      4.7098475 = weight(author_txt:bornmann in 911) [ClassicSimilarity], result of:
        4.7098475 = fieldWeight in 911, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.535756 = idf(docFreq=61, maxDocs=42740)
          0.625 = fieldNorm(doc=911)
    
  2. Bornmann, L.: What is societal impact of research and how can it be assessed? : a literature survey (2013) 4.71
    4.7098475 = sum of:
      4.7098475 = weight(author_txt:bornmann in 2607) [ClassicSimilarity], result of:
        4.7098475 = fieldWeight in 2607, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.535756 = idf(docFreq=61, maxDocs=42740)
          0.625 = fieldNorm(doc=2607)
    
  3. Bornmann, L.: How to analyze percentile citation impact data meaningfully in bibliometrics : the statistical analysis of distributions, percentile rank classes, and top-cited papers (2013) 4.71
    4.7098475 = sum of:
      4.7098475 = weight(author_txt:bornmann in 2657) [ClassicSimilarity], result of:
        4.7098475 = fieldWeight in 2657, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.535756 = idf(docFreq=61, maxDocs=42740)
          0.625 = fieldNorm(doc=2657)
    
  4. Bornmann, L.: Lässt sich die Qualität von Forschung messen? (2013) 4.71
    4.7098475 = sum of:
      4.7098475 = weight(author_txt:bornmann in 2929) [ClassicSimilarity], result of:
        4.7098475 = fieldWeight in 2929, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.535756 = idf(docFreq=61, maxDocs=42740)
          0.625 = fieldNorm(doc=2929)
    
  5. Bornmann, L.: On the function of university rankings (2014) 4.71
    4.7098475 = sum of:
      4.7098475 = weight(author_txt:bornmann in 3189) [ClassicSimilarity], result of:
        4.7098475 = fieldWeight in 3189, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.535756 = idf(docFreq=61, maxDocs=42740)
          0.625 = fieldNorm(doc=3189)
    

Similar documents (content)

  1. Cabanac, G.; Preuss, T.: Capitalizing on order effects in the bids of peer-reviewed conferences to secure reviews by expert referees (2013) 0.40
    0.3996073 = sum of:
      0.3996073 = product of:
        0.99901825 = sum of:
          0.008754558 = weight(abstract_txt:study in 2620) [ClassicSimilarity], result of:
            0.008754558 = score(doc=2620,freq=1.0), product of:
              0.040356677 = queryWeight, product of:
                1.0034387 = boost
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0115873935 = queryNorm
              0.2169296 = fieldWeight in 2620, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
          0.017625771 = weight(abstract_txt:science in 2620) [ClassicSimilarity], result of:
            0.017625771 = score(doc=2620,freq=2.0), product of:
              0.051071823 = queryWeight, product of:
                1.1288177 = boost
                3.904557 = idf(docFreq=2340, maxDocs=42740)
                0.0115873935 = queryNorm
              0.34511733 = fieldWeight in 2620, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.904557 = idf(docFreq=2340, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
          0.01850348 = weight(abstract_txt:show in 2620) [ClassicSimilarity], result of:
            0.01850348 = score(doc=2620,freq=1.0), product of:
              0.06646528 = queryWeight, product of:
                1.2877471 = boost
                4.4542904 = idf(docFreq=1350, maxDocs=42740)
                0.0115873935 = queryNorm
              0.27839315 = fieldWeight in 2620, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4542904 = idf(docFreq=1350, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
          0.009450059 = weight(abstract_txt:with in 2620) [ClassicSimilarity], result of:
            0.009450059 = score(doc=2620,freq=2.0), product of:
              0.04246674 = queryWeight, product of:
                1.4557024 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0115873935 = queryNorm
              0.22252847 = fieldWeight in 2620, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
          0.033749346 = weight(abstract_txt:higher in 2620) [ClassicSimilarity], result of:
            0.033749346 = score(doc=2620,freq=1.0), product of:
              0.09922083 = queryWeight, product of:
                1.5733835 = boost
                5.4423003 = idf(docFreq=502, maxDocs=42740)
                0.0115873935 = queryNorm
              0.34014377 = fieldWeight in 2620, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4423003 = idf(docFreq=502, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
          0.0407157 = weight(abstract_txt:recommendations in 2620) [ClassicSimilarity], result of:
            0.0407157 = score(doc=2620,freq=1.0), product of:
              0.11244337 = queryWeight, product of:
                1.6749432 = boost
                5.7935934 = idf(docFreq=353, maxDocs=42740)
                0.0115873935 = queryNorm
              0.3620996 = fieldWeight in 2620, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.7935934 = idf(docFreq=353, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
          0.0995668 = weight(abstract_txt:validity in 2620) [ClassicSimilarity], result of:
            0.0995668 = score(doc=2620,freq=1.0), product of:
              0.23363222 = queryWeight, product of:
                2.956958 = boost
                6.8187037 = idf(docFreq=126, maxDocs=42740)
                0.0115873935 = queryNorm
              0.42616898 = fieldWeight in 2620, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.8187037 = idf(docFreq=126, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
          0.1392525 = weight(abstract_txt:papers in 2620) [ClassicSimilarity], result of:
            0.1392525 = score(doc=2620,freq=5.0), product of:
              0.18806785 = queryWeight, product of:
                3.0634122 = boost
                5.2981396 = idf(docFreq=580, maxDocs=42740)
                0.0115873935 = queryNorm
              0.7404375 = fieldWeight in 2620, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.2981396 = idf(docFreq=580, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
          0.1483961 = weight(abstract_txt:review in 2620) [ClassicSimilarity], result of:
            0.1483961 = score(doc=2620,freq=3.0), product of:
              0.2803431 = queryWeight, product of:
                4.9477997 = boost
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.0115873935 = queryNorm
              0.52933747 = fieldWeight in 2620, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
          0.4830039 = weight(abstract_txt:peer in 2620) [ClassicSimilarity], result of:
            0.4830039 = score(doc=2620,freq=4.0), product of:
              0.58487046 = queryWeight, product of:
                7.6399937 = boost
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.0115873935 = queryNorm
              0.8258306 = fieldWeight in 2620, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.0625 = fieldNorm(doc=2620)
        0.4 = coord(10/25)
    
  2. Daniel, H.-D.: Guardians of science : fairness and reliabiblity of peer review (1993) 0.38
    0.38480234 = sum of:
      0.38480234 = product of:
        1.2025074 = sum of:
          0.015579129 = weight(abstract_txt:science in 3714) [ClassicSimilarity], result of:
            0.015579129 = score(doc=3714,freq=1.0), product of:
              0.051071823 = queryWeight, product of:
                1.1288177 = boost
                3.904557 = idf(docFreq=2340, maxDocs=42740)
                0.0115873935 = queryNorm
              0.30504352 = fieldWeight in 3714, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.904557 = idf(docFreq=2340, maxDocs=42740)
                0.078125 = fieldNorm(doc=3714)
          0.011812574 = weight(abstract_txt:with in 3714) [ClassicSimilarity], result of:
            0.011812574 = score(doc=3714,freq=2.0), product of:
              0.04246674 = queryWeight, product of:
                1.4557024 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0115873935 = queryNorm
              0.2781606 = fieldWeight in 3714, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.078125 = fieldNorm(doc=3714)
          0.024893522 = weight(abstract_txt:system in 3714) [ClassicSimilarity], result of:
            0.024893522 = score(doc=3714,freq=1.0), product of:
              0.09473784 = queryWeight, product of:
                2.4308877 = boost
                3.3633559 = idf(docFreq=4021, maxDocs=42740)
                0.0115873935 = queryNorm
              0.2627622 = fieldWeight in 3714, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3633559 = idf(docFreq=4021, maxDocs=42740)
                0.078125 = fieldNorm(doc=3714)
          0.12445851 = weight(abstract_txt:validity in 3714) [ClassicSimilarity], result of:
            0.12445851 = score(doc=3714,freq=1.0), product of:
              0.23363222 = queryWeight, product of:
                2.956958 = boost
                6.8187037 = idf(docFreq=126, maxDocs=42740)
                0.0115873935 = queryNorm
              0.5327112 = fieldWeight in 3714, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.8187037 = idf(docFreq=126, maxDocs=42740)
                0.078125 = fieldNorm(doc=3714)
          0.12997293 = weight(abstract_txt:reliability in 3714) [ClassicSimilarity], result of:
            0.12997293 = score(doc=3714,freq=1.0), product of:
              0.24048333 = queryWeight, product of:
                3.0000002 = boost
                6.9179583 = idf(docFreq=114, maxDocs=42740)
                0.0115873935 = queryNorm
              0.5404655 = fieldWeight in 3714, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9179583 = idf(docFreq=114, maxDocs=42740)
                0.078125 = fieldNorm(doc=3714)
          0.07784451 = weight(abstract_txt:papers in 3714) [ClassicSimilarity], result of:
            0.07784451 = score(doc=3714,freq=1.0), product of:
              0.18806785 = queryWeight, product of:
                3.0634122 = boost
                5.2981396 = idf(docFreq=580, maxDocs=42740)
                0.0115873935 = queryNorm
              0.41391715 = fieldWeight in 3714, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2981396 = idf(docFreq=580, maxDocs=42740)
                0.078125 = fieldNorm(doc=3714)
          0.21419132 = weight(abstract_txt:review in 3714) [ClassicSimilarity], result of:
            0.21419132 = score(doc=3714,freq=4.0), product of:
              0.2803431 = queryWeight, product of:
                4.9477997 = boost
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.0115873935 = queryNorm
              0.76403284 = fieldWeight in 3714, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.078125 = fieldNorm(doc=3714)
          0.6037549 = weight(abstract_txt:peer in 3714) [ClassicSimilarity], result of:
            0.6037549 = score(doc=3714,freq=4.0), product of:
              0.58487046 = queryWeight, product of:
                7.6399937 = boost
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.0115873935 = queryNorm
              1.0322882 = fieldWeight in 3714, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.078125 = fieldNorm(doc=3714)
        0.32 = coord(8/25)
    
  3. Meho, L.I.; Sonnenwald, D.H.: Citation ranking versus peer evaluation of senior faculty research performance : a case study of Kurdish scholarship (2000) 0.24
    0.23921064 = sum of:
      0.23921064 = product of:
        0.996711 = sum of:
          0.018954175 = weight(abstract_txt:study in 5383) [ClassicSimilarity], result of:
            0.018954175 = score(doc=5383,freq=3.0), product of:
              0.040356677 = queryWeight, product of:
                1.0034387 = boost
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0115873935 = queryNorm
              0.46966636 = fieldWeight in 5383, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.078125 = fieldNorm(doc=5383)
          0.008352751 = weight(abstract_txt:with in 5383) [ClassicSimilarity], result of:
            0.008352751 = score(doc=5383,freq=1.0), product of:
              0.04246674 = queryWeight, product of:
                1.4557024 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0115873935 = queryNorm
              0.19668923 = fieldWeight in 5383, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.078125 = fieldNorm(doc=5383)
          0.08157663 = weight(abstract_txt:members in 5383) [ClassicSimilarity], result of:
            0.08157663 = score(doc=5383,freq=1.0), product of:
              0.17628966 = queryWeight, product of:
                2.5685747 = boost
                5.9230976 = idf(docFreq=310, maxDocs=42740)
                0.0115873935 = queryNorm
              0.462742 = fieldWeight in 5383, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.9230976 = idf(docFreq=310, maxDocs=42740)
                0.078125 = fieldNorm(doc=5383)
          0.17697693 = weight(abstract_txt:faculty in 5383) [ClassicSimilarity], result of:
            0.17697693 = score(doc=5383,freq=3.0), product of:
              0.20484264 = queryWeight, product of:
                2.7687833 = boost
                6.3847756 = idf(docFreq=195, maxDocs=42740)
                0.0115873935 = queryNorm
              0.8639653 = fieldWeight in 5383, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.3847756 = idf(docFreq=195, maxDocs=42740)
                0.078125 = fieldNorm(doc=5383)
          0.10709566 = weight(abstract_txt:review in 5383) [ClassicSimilarity], result of:
            0.10709566 = score(doc=5383,freq=1.0), product of:
              0.2803431 = queryWeight, product of:
                4.9477997 = boost
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.0115873935 = queryNorm
              0.38201642 = fieldWeight in 5383, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.078125 = fieldNorm(doc=5383)
          0.6037549 = weight(abstract_txt:peer in 5383) [ClassicSimilarity], result of:
            0.6037549 = score(doc=5383,freq=4.0), product of:
              0.58487046 = queryWeight, product of:
                7.6399937 = boost
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.0115873935 = queryNorm
              1.0322882 = fieldWeight in 5383, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.078125 = fieldNorm(doc=5383)
        0.24 = coord(6/25)
    
  4. Wood, D.J.: Peer review and the Web : the implications of electronic peer review for biomedical authors, referees and learned society publishers (1998) 0.22
    0.21502465 = sum of:
      0.21502465 = product of:
        0.8959361 = sum of:
          0.067592695 = weight(abstract_txt:biomedical in 718) [ClassicSimilarity], result of:
            0.067592695 = score(doc=718,freq=3.0), product of:
              0.08675783 = queryWeight, product of:
                1.0403333 = boost
                7.1969824 = idf(docFreq=86, maxDocs=42740)
                0.0115873935 = queryNorm
              0.7790962 = fieldWeight in 718, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                7.1969824 = idf(docFreq=86, maxDocs=42740)
                0.0625 = fieldNorm(doc=718)
          0.011573911 = weight(abstract_txt:with in 718) [ClassicSimilarity], result of:
            0.011573911 = score(doc=718,freq=3.0), product of:
              0.04246674 = queryWeight, product of:
                1.4557024 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0115873935 = queryNorm
              0.2725406 = fieldWeight in 718, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0625 = fieldNorm(doc=718)
          0.019914817 = weight(abstract_txt:system in 718) [ClassicSimilarity], result of:
            0.019914817 = score(doc=718,freq=1.0), product of:
              0.09473784 = queryWeight, product of:
                2.4308877 = boost
                3.3633559 = idf(docFreq=4021, maxDocs=42740)
                0.0115873935 = queryNorm
              0.21020974 = fieldWeight in 718, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3633559 = idf(docFreq=4021, maxDocs=42740)
                0.0625 = fieldNorm(doc=718)
          0.065261304 = weight(abstract_txt:members in 718) [ClassicSimilarity], result of:
            0.065261304 = score(doc=718,freq=1.0), product of:
              0.17628966 = queryWeight, product of:
                2.5685747 = boost
                5.9230976 = idf(docFreq=310, maxDocs=42740)
                0.0115873935 = queryNorm
              0.3701936 = fieldWeight in 718, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.9230976 = idf(docFreq=310, maxDocs=42740)
                0.0625 = fieldNorm(doc=718)
          0.19157854 = weight(abstract_txt:review in 718) [ClassicSimilarity], result of:
            0.19157854 = score(doc=718,freq=5.0), product of:
              0.2803431 = queryWeight, product of:
                4.9477997 = boost
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.0115873935 = queryNorm
              0.6833717 = fieldWeight in 718, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.0625 = fieldNorm(doc=718)
          0.5400148 = weight(abstract_txt:peer in 718) [ClassicSimilarity], result of:
            0.5400148 = score(doc=718,freq=5.0), product of:
              0.58487046 = queryWeight, product of:
                7.6399937 = boost
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.0115873935 = queryNorm
              0.92330664 = fieldWeight in 718, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.0625 = fieldNorm(doc=718)
        0.24 = coord(6/25)
    
  5. Bornmann, L.; Schier, H.; Marx, W.; Daniel, H.-D.: Is interactive open access publishing able to identify high-impact submissions? : a study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes (2011) 0.21
    0.21163289 = sum of:
      0.21163289 = product of:
        0.6613528 = sum of:
          0.008754558 = weight(abstract_txt:study in 1133) [ClassicSimilarity], result of:
            0.008754558 = score(doc=1133,freq=1.0), product of:
              0.040356677 = queryWeight, product of:
                1.0034387 = boost
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0115873935 = queryNorm
              0.2169296 = fieldWeight in 1133, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0625 = fieldNorm(doc=1133)
          0.01850348 = weight(abstract_txt:show in 1133) [ClassicSimilarity], result of:
            0.01850348 = score(doc=1133,freq=1.0), product of:
              0.06646528 = queryWeight, product of:
                1.2877471 = boost
                4.4542904 = idf(docFreq=1350, maxDocs=42740)
                0.0115873935 = queryNorm
              0.27839315 = fieldWeight in 1133, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4542904 = idf(docFreq=1350, maxDocs=42740)
                0.0625 = fieldNorm(doc=1133)
          0.006682201 = weight(abstract_txt:with in 1133) [ClassicSimilarity], result of:
            0.006682201 = score(doc=1133,freq=1.0), product of:
              0.04246674 = queryWeight, product of:
                1.4557024 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0115873935 = queryNorm
              0.15735139 = fieldWeight in 1133, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0625 = fieldNorm(doc=1133)
          0.019914817 = weight(abstract_txt:system in 1133) [ClassicSimilarity], result of:
            0.019914817 = score(doc=1133,freq=1.0), product of:
              0.09473784 = queryWeight, product of:
                2.4308877 = boost
                3.3633559 = idf(docFreq=4021, maxDocs=42740)
                0.0115873935 = queryNorm
              0.21020974 = fieldWeight in 1133, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3633559 = idf(docFreq=4021, maxDocs=42740)
                0.0625 = fieldNorm(doc=1133)
          0.17245476 = weight(abstract_txt:validity in 1133) [ClassicSimilarity], result of:
            0.17245476 = score(doc=1133,freq=3.0), product of:
              0.23363222 = queryWeight, product of:
                2.956958 = boost
                6.8187037 = idf(docFreq=126, maxDocs=42740)
                0.0115873935 = queryNorm
              0.7381463 = fieldWeight in 1133, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.8187037 = idf(docFreq=126, maxDocs=42740)
                0.0625 = fieldNorm(doc=1133)
          0.10786452 = weight(abstract_txt:papers in 1133) [ClassicSimilarity], result of:
            0.10786452 = score(doc=1133,freq=3.0), product of:
              0.18806785 = queryWeight, product of:
                3.0634122 = boost
                5.2981396 = idf(docFreq=580, maxDocs=42740)
                0.0115873935 = queryNorm
              0.57354045 = fieldWeight in 1133, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.2981396 = idf(docFreq=580, maxDocs=42740)
                0.0625 = fieldNorm(doc=1133)
          0.08567653 = weight(abstract_txt:review in 1133) [ClassicSimilarity], result of:
            0.08567653 = score(doc=1133,freq=1.0), product of:
              0.2803431 = queryWeight, product of:
                4.9477997 = boost
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.0115873935 = queryNorm
              0.30561313 = fieldWeight in 1133, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.88981 = idf(docFreq=873, maxDocs=42740)
                0.0625 = fieldNorm(doc=1133)
          0.24150196 = weight(abstract_txt:peer in 1133) [ClassicSimilarity], result of:
            0.24150196 = score(doc=1133,freq=1.0), product of:
              0.58487046 = queryWeight, product of:
                7.6399937 = boost
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.0115873935 = queryNorm
              0.4129153 = fieldWeight in 1133, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6066446 = idf(docFreq=156, maxDocs=42740)
                0.0625 = fieldNorm(doc=1133)
        0.32 = coord(8/25)