Document (#30227)

Author
Kekäläinen, J.
Järvelin, K.
Title
Using graded relevance assessments in IR evaluation
Source
Journal of the American Society for Information Science and technology. 53(2002) no.13, S.1120-xxxx
Year
2002
Abstract
Kekalainen and Jarvelin use what they term generalized, nonbinary recall and precision measures where recall is the sum of the relevance scores of the retrieved documents divided by the sum of relevance scores of all documents in the data base, and precision is the sum of the relevance scores of the retrieved documents divided by the number of documents where the relevance scores are real numbers between zero and one. Using the In-Query system and a text data base of 53,893 newspaper articles with 30 queries selected from those for which four relevance categories to provide recall measures were available, search results were evaluated by four judges. Searches were done by average key term weight, Boolean expression, and by average term weight where the terms are grouped by a synonym operator, and for each case with and without expansion of the original terms. Use of higher standards of relevance appears to increase the superiority of the best method. Some methods do a better job of getting the highly relevant documents but do not increase retrieval of marginal ones. There is evidence that generalized precision provides more equitable results, while binary precision provides undeserved merit to some methods. Generally graded relevance measures seem to provide additional insight into IR evaluation.
Theme
Retrievalstudien

Similar documents (author)

  1. Järvelin, K.: ¬An analysis of two approaches in information retrieval : from frameworks to study designs (2007) 5.00
    5.0043335 = sum of:
      5.0043335 = weight(author_txt:järvelin in 2327) [ClassicSimilarity], result of:
        5.0043335 = fieldWeight in 2327, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.006933 = idf(docFreq=37, maxDocs=41962)
          0.625 = fieldNorm(doc=2327)
    
  2. Järvelin, K.: Evaluation (2011) 5.00
    5.0043335 = sum of:
      5.0043335 = weight(author_txt:järvelin in 2549) [ClassicSimilarity], result of:
        5.0043335 = fieldWeight in 2549, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.006933 = idf(docFreq=37, maxDocs=41962)
          0.625 = fieldNorm(doc=2549)
    
  3. Järvelin, K.; Vakkari, P.: ¬The evolution of library and information science 1965-1985 : a content analysis of journal titles (1993) 4.00
    4.0034666 = sum of:
      4.0034666 = weight(author_txt:järvelin in 4649) [ClassicSimilarity], result of:
        4.0034666 = fieldWeight in 4649, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.006933 = idf(docFreq=37, maxDocs=41962)
          0.5 = fieldNorm(doc=4649)
    
  4. Kristensen, J.; Järvelin, K.: ¬The effectiveness of a searching thesaurus in free-text searching in a full-text database (1990) 4.00
    4.0034666 = sum of:
      4.0034666 = weight(author_txt:järvelin in 2112) [ClassicSimilarity], result of:
        4.0034666 = fieldWeight in 2112, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.006933 = idf(docFreq=37, maxDocs=41962)
          0.5 = fieldNorm(doc=2112)
    
  5. Pirkola, A.; Järvelin, K.: Employing the resolution power of search keys (2001) 4.00
    4.0034666 = sum of:
      4.0034666 = weight(author_txt:järvelin in 403) [ClassicSimilarity], result of:
        4.0034666 = fieldWeight in 403, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.006933 = idf(docFreq=37, maxDocs=41962)
          0.5 = fieldNorm(doc=403)
    

Similar documents (content)

  1. Talvensaari, T.; Juhola, M.; Laurikkala, J.; Järvelin, K.: Corpus-based cross-language information retrieval in retrieval of highly relevant documents (2007) 0.49
    0.48909417 = sum of:
      0.48909417 = product of:
        1.1115776 = sum of:
          0.027675508 = weight(abstract_txt:methods in 2140) [ClassicSimilarity], result of:
            0.027675508 = score(doc=2140,freq=2.0), product of:
              0.07462874 = queryWeight, product of:
                1.0050937 = boost
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.017697223 = queryNorm
              0.3708425 = fieldWeight in 2140, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.045396592 = weight(abstract_txt:were in 2140) [ClassicSimilarity], result of:
            0.045396592 = score(doc=2140,freq=5.0), product of:
              0.08754707 = queryWeight, product of:
                1.3332756 = boost
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.017697223 = queryNorm
              0.51853925 = fieldWeight in 2140, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.049251225 = weight(abstract_txt:retrieved in 2140) [ClassicSimilarity], result of:
            0.049251225 = score(doc=2140,freq=1.0), product of:
              0.13807988 = queryWeight, product of:
                1.3671579 = boost
                5.7069836 = idf(docFreq=378, maxDocs=41962)
                0.017697223 = queryNorm
              0.35668647 = fieldWeight in 2140, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.7069836 = idf(docFreq=378, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.055368166 = weight(abstract_txt:average in 2140) [ClassicSimilarity], result of:
            0.055368166 = score(doc=2140,freq=1.0), product of:
              0.14928831 = queryWeight, product of:
                1.4215639 = boost
                5.9340925 = idf(docFreq=301, maxDocs=41962)
                0.017697223 = queryNorm
              0.37088078 = fieldWeight in 2140, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.9340925 = idf(docFreq=301, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.09363112 = weight(abstract_txt:generalized in 2140) [ClassicSimilarity], result of:
            0.09363112 = score(doc=2140,freq=1.0), product of:
              0.21190076 = queryWeight, product of:
                1.6936346 = boost
                7.069809 = idf(docFreq=96, maxDocs=41962)
                0.017697223 = queryNorm
              0.44186306 = fieldWeight in 2140, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.069809 = idf(docFreq=96, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.11045416 = weight(abstract_txt:weight in 2140) [ClassicSimilarity], result of:
            0.11045416 = score(doc=2140,freq=1.0), product of:
              0.23657767 = queryWeight, product of:
                1.7895356 = boost
                7.4701324 = idf(docFreq=64, maxDocs=41962)
                0.017697223 = queryNorm
              0.46688327 = fieldWeight in 2140, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4701324 = idf(docFreq=64, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.074603185 = weight(abstract_txt:recall in 2140) [ClassicSimilarity], result of:
            0.074603185 = score(doc=2140,freq=1.0), product of:
              0.20847519 = queryWeight, product of:
                2.0574358 = boost
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.017697223 = queryNorm
              0.35785162 = fieldWeight in 2140, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.1685358 = weight(abstract_txt:graded in 2140) [ClassicSimilarity], result of:
            0.1685358 = score(doc=2140,freq=1.0), product of:
              0.31355506 = queryWeight, product of:
                2.0602047 = boost
                8.5999975 = idf(docFreq=20, maxDocs=41962)
                0.017697223 = queryNorm
              0.53749985 = fieldWeight in 2140, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.5999975 = idf(docFreq=20, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.103585914 = weight(abstract_txt:documents in 2140) [ClassicSimilarity], result of:
            0.103585914 = score(doc=2140,freq=5.0), product of:
              0.17990483 = queryWeight, product of:
                2.4674304 = boost
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.017697223 = queryNorm
              0.5757817 = fieldWeight in 2140, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.1255959 = weight(abstract_txt:precision in 2140) [ClassicSimilarity], result of:
            0.1255959 = score(doc=2140,freq=2.0), product of:
              0.2577326 = queryWeight, product of:
                2.6415155 = boost
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.017697223 = queryNorm
              0.4873109 = fieldWeight in 2140, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
          0.25748017 = weight(abstract_txt:relevance in 2140) [ClassicSimilarity], result of:
            0.25748017 = score(doc=2140,freq=4.0), product of:
              0.4159249 = queryWeight, product of:
                4.745598 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.017697223 = queryNorm
              0.6190545 = fieldWeight in 2140, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0625 = fieldNorm(doc=2140)
        0.44 = coord(11/25)
    
  2. Yang, L.; Ji, D.; Leong, M.: Document reranking by term distribution and maximal marginal relevance for chinese information retrieval (2007) 0.41
    0.41081166 = sum of:
      0.41081166 = product of:
        1.0270292 = sum of:
          0.09636759 = weight(abstract_txt:marginal in 2908) [ClassicSimilarity], result of:
            0.09636759 = score(doc=2908,freq=1.0), product of:
              0.14774849 = queryWeight, product of:
                8.348682 = idf(docFreq=26, maxDocs=41962)
                0.017697223 = queryNorm
              0.6522408 = fieldWeight in 2908, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.348682 = idf(docFreq=26, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
          0.024461925 = weight(abstract_txt:methods in 2908) [ClassicSimilarity], result of:
            0.024461925 = score(doc=2908,freq=1.0), product of:
              0.07462874 = queryWeight, product of:
                1.0050937 = boost
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.017697223 = queryNorm
              0.32778156 = fieldWeight in 2908, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
          0.08706468 = weight(abstract_txt:retrieved in 2908) [ClassicSimilarity], result of:
            0.08706468 = score(doc=2908,freq=2.0), product of:
              0.13807988 = queryWeight, product of:
                1.3671579 = boost
                5.7069836 = idf(docFreq=378, maxDocs=41962)
                0.017697223 = queryNorm
              0.6305385 = fieldWeight in 2908, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.7069836 = idf(docFreq=378, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
          0.06921021 = weight(abstract_txt:average in 2908) [ClassicSimilarity], result of:
            0.06921021 = score(doc=2908,freq=1.0), product of:
              0.14928831 = queryWeight, product of:
                1.4215639 = boost
                5.9340925 = idf(docFreq=301, maxDocs=41962)
                0.017697223 = queryNorm
              0.463601 = fieldWeight in 2908, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.9340925 = idf(docFreq=301, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
          0.07971179 = weight(abstract_txt:term in 2908) [ClassicSimilarity], result of:
            0.07971179 = score(doc=2908,freq=2.0), product of:
              0.14903256 = queryWeight, product of:
                1.7395611 = boost
                4.8410144 = idf(docFreq=900, maxDocs=41962)
                0.017697223 = queryNorm
              0.53486156 = fieldWeight in 2908, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.8410144 = idf(docFreq=900, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
          0.1380677 = weight(abstract_txt:weight in 2908) [ClassicSimilarity], result of:
            0.1380677 = score(doc=2908,freq=1.0), product of:
              0.23657767 = queryWeight, product of:
                1.7895356 = boost
                7.4701324 = idf(docFreq=64, maxDocs=41962)
                0.017697223 = queryNorm
              0.5836041 = fieldWeight in 2908, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4701324 = idf(docFreq=64, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
          0.09325398 = weight(abstract_txt:recall in 2908) [ClassicSimilarity], result of:
            0.09325398 = score(doc=2908,freq=1.0), product of:
              0.20847519 = queryWeight, product of:
                2.0574358 = boost
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.017697223 = queryNorm
              0.44731453 = fieldWeight in 2908, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
          0.100296624 = weight(abstract_txt:documents in 2908) [ClassicSimilarity], result of:
            0.100296624 = score(doc=2908,freq=3.0), product of:
              0.17990483 = queryWeight, product of:
                2.4674304 = boost
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.017697223 = queryNorm
              0.5574982 = fieldWeight in 2908, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
          0.111012146 = weight(abstract_txt:precision in 2908) [ClassicSimilarity], result of:
            0.111012146 = score(doc=2908,freq=1.0), product of:
              0.2577326 = queryWeight, product of:
                2.6415155 = boost
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.017697223 = queryNorm
              0.43072605 = fieldWeight in 2908, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
          0.22758247 = weight(abstract_txt:relevance in 2908) [ClassicSimilarity], result of:
            0.22758247 = score(doc=2908,freq=2.0), product of:
              0.4159249 = queryWeight, product of:
                4.745598 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.017697223 = queryNorm
              0.547172 = fieldWeight in 2908, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.078125 = fieldNorm(doc=2908)
        0.4 = coord(10/25)
    
  3. Huuskonen, S.; Vakkari, P.: Students' search process and outcome in Medline in writing an essay for a class on evidence-based medicine (2008) 0.38
    0.37999806 = sum of:
      0.37999806 = product of:
        0.94999516 = sum of:
          0.017782938 = weight(abstract_txt:provides in 3892) [ClassicSimilarity], result of:
            0.017782938 = score(doc=3892,freq=1.0), product of:
              0.07653311 = queryWeight, product of:
                1.0178368 = boost
                4.248798 = idf(docFreq=1628, maxDocs=41962)
                0.017697223 = queryNorm
              0.23235613 = fieldWeight in 3892, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.248798 = idf(docFreq=1628, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
          0.029864958 = weight(abstract_txt:evaluation in 3892) [ClassicSimilarity], result of:
            0.029864958 = score(doc=3892,freq=2.0), product of:
              0.085824564 = queryWeight, product of:
                1.0778524 = boost
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.017697223 = queryNorm
              0.3479768 = fieldWeight in 3892, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
          0.058701865 = weight(abstract_txt:four in 3892) [ClassicSimilarity], result of:
            0.058701865 = score(doc=3892,freq=3.0), product of:
              0.117645286 = queryWeight, product of:
                1.2619458 = boost
                5.2677927 = idf(docFreq=587, maxDocs=41962)
                0.017697223 = queryNorm
              0.49897337 = fieldWeight in 3892, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.2677927 = idf(docFreq=587, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
          0.03552845 = weight(abstract_txt:were in 3892) [ClassicSimilarity], result of:
            0.03552845 = score(doc=3892,freq=4.0), product of:
              0.08754707 = queryWeight, product of:
                1.3332756 = boost
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.017697223 = queryNorm
              0.4058211 = fieldWeight in 3892, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
          0.07464242 = weight(abstract_txt:retrieved in 3892) [ClassicSimilarity], result of:
            0.07464242 = score(doc=3892,freq=3.0), product of:
              0.13807988 = queryWeight, product of:
                1.3671579 = boost
                5.7069836 = idf(docFreq=378, maxDocs=41962)
                0.017697223 = queryNorm
              0.5405742 = fieldWeight in 3892, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.7069836 = idf(docFreq=378, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
          0.07926534 = weight(abstract_txt:measures in 3892) [ClassicSimilarity], result of:
            0.07926534 = score(doc=3892,freq=2.0), product of:
              0.18833151 = queryWeight, product of:
                1.9555125 = boost
                5.441984 = idf(docFreq=493, maxDocs=41962)
                0.017697223 = queryNorm
              0.420882 = fieldWeight in 3892, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.441984 = idf(docFreq=493, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
          0.15989727 = weight(abstract_txt:recall in 3892) [ClassicSimilarity], result of:
            0.15989727 = score(doc=3892,freq=6.0), product of:
              0.20847519 = queryWeight, product of:
                2.0574358 = boost
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.017697223 = queryNorm
              0.76698464 = fieldWeight in 3892, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
          0.057324298 = weight(abstract_txt:documents in 3892) [ClassicSimilarity], result of:
            0.057324298 = score(doc=3892,freq=2.0), product of:
              0.17990483 = queryWeight, product of:
                2.4674304 = boost
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.017697223 = queryNorm
              0.31863678 = fieldWeight in 3892, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
          0.19034618 = weight(abstract_txt:precision in 3892) [ClassicSimilarity], result of:
            0.19034618 = score(doc=3892,freq=6.0), product of:
              0.2577326 = queryWeight, product of:
                2.6415155 = boost
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.017697223 = queryNorm
              0.73854136 = fieldWeight in 3892, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
          0.24664149 = weight(abstract_txt:scores in 3892) [ClassicSimilarity], result of:
            0.24664149 = score(doc=3892,freq=3.0), product of:
              0.38594672 = queryWeight, product of:
                3.2324524 = boost
                6.74668 = idf(docFreq=133, maxDocs=41962)
                0.017697223 = queryNorm
              0.6390558 = fieldWeight in 3892, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.74668 = idf(docFreq=133, maxDocs=41962)
                0.0546875 = fieldNorm(doc=3892)
        0.4 = coord(10/25)
    
  4. Su, L.T.; Chen, H.L.: Evaluation of Web search engines by undergraduate students (1999) 0.35
    0.34926707 = sum of:
      0.34926707 = product of:
        0.87316763 = sum of:
          0.036576953 = weight(abstract_txt:evaluation in 547) [ClassicSimilarity], result of:
            0.036576953 = score(doc=547,freq=3.0), product of:
              0.085824564 = queryWeight, product of:
                1.0778524 = boost
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.017697223 = queryNorm
              0.42618278 = fieldWeight in 547, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
          0.06778308 = weight(abstract_txt:four in 547) [ClassicSimilarity], result of:
            0.06778308 = score(doc=547,freq=4.0), product of:
              0.117645286 = queryWeight, product of:
                1.2619458 = boost
                5.2677927 = idf(docFreq=587, maxDocs=41962)
                0.017697223 = queryNorm
              0.57616484 = fieldWeight in 547, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.2677927 = idf(docFreq=587, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
          0.03076854 = weight(abstract_txt:were in 547) [ClassicSimilarity], result of:
            0.03076854 = score(doc=547,freq=3.0), product of:
              0.08754707 = queryWeight, product of:
                1.3332756 = boost
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.017697223 = queryNorm
              0.3514514 = fieldWeight in 547, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
          0.06094528 = weight(abstract_txt:retrieved in 547) [ClassicSimilarity], result of:
            0.06094528 = score(doc=547,freq=2.0), product of:
              0.13807988 = queryWeight, product of:
                1.3671579 = boost
                5.7069836 = idf(docFreq=378, maxDocs=41962)
                0.017697223 = queryNorm
              0.44137698 = fieldWeight in 547, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.7069836 = idf(docFreq=378, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
          0.09707981 = weight(abstract_txt:measures in 547) [ClassicSimilarity], result of:
            0.09707981 = score(doc=547,freq=3.0), product of:
              0.18833151 = queryWeight, product of:
                1.9555125 = boost
                5.441984 = idf(docFreq=493, maxDocs=41962)
                0.017697223 = queryNorm
              0.515473 = fieldWeight in 547, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.441984 = idf(docFreq=493, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
          0.06527779 = weight(abstract_txt:recall in 547) [ClassicSimilarity], result of:
            0.06527779 = score(doc=547,freq=1.0), product of:
              0.20847519 = queryWeight, product of:
                2.0574358 = boost
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.017697223 = queryNorm
              0.3131202 = fieldWeight in 547, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
          0.0405344 = weight(abstract_txt:documents in 547) [ClassicSimilarity], result of:
            0.0405344 = score(doc=547,freq=1.0), product of:
              0.17990483 = queryWeight, product of:
                2.4674304 = boost
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.017697223 = queryNorm
              0.22531022 = fieldWeight in 547, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
          0.0777085 = weight(abstract_txt:precision in 547) [ClassicSimilarity], result of:
            0.0777085 = score(doc=547,freq=1.0), product of:
              0.2577326 = queryWeight, product of:
                2.6415155 = boost
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.017697223 = queryNorm
              0.30150822 = fieldWeight in 547, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
          0.20138194 = weight(abstract_txt:scores in 547) [ClassicSimilarity], result of:
            0.20138194 = score(doc=547,freq=2.0), product of:
              0.38594672 = queryWeight, product of:
                3.2324524 = boost
                6.74668 = idf(docFreq=133, maxDocs=41962)
                0.017697223 = queryNorm
              0.52178687 = fieldWeight in 547, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.74668 = idf(docFreq=133, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
          0.19511133 = weight(abstract_txt:relevance in 547) [ClassicSimilarity], result of:
            0.19511133 = score(doc=547,freq=3.0), product of:
              0.4159249 = queryWeight, product of:
                4.745598 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.017697223 = queryNorm
              0.4691023 = fieldWeight in 547, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0546875 = fieldNorm(doc=547)
        0.4 = coord(10/25)
    
  5. Kim, W.; Wilbur, W.J.: Corpus-based statistical screening for content-bearing terms (2001) 0.33
    0.32587126 = sum of:
      0.32587126 = product of:
        0.7406165 = sum of:
          0.025421577 = weight(abstract_txt:methods in 189) [ClassicSimilarity], result of:
            0.025421577 = score(doc=189,freq=3.0), product of:
              0.07462874 = queryWeight, product of:
                1.0050937 = boost
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.017697223 = queryNorm
              0.34064057 = fieldWeight in 189, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.02904989 = weight(abstract_txt:four in 189) [ClassicSimilarity], result of:
            0.02904989 = score(doc=189,freq=1.0), product of:
              0.117645286 = queryWeight, product of:
                1.2619458 = boost
                5.2677927 = idf(docFreq=587, maxDocs=41962)
                0.017697223 = queryNorm
              0.24692778 = fieldWeight in 189, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2677927 = idf(docFreq=587, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.01522648 = weight(abstract_txt:were in 189) [ClassicSimilarity], result of:
            0.01522648 = score(doc=189,freq=1.0), product of:
              0.08754707 = queryWeight, product of:
                1.3332756 = boost
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.017697223 = queryNorm
              0.17392334 = fieldWeight in 189, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.08305225 = weight(abstract_txt:average in 189) [ClassicSimilarity], result of:
            0.08305225 = score(doc=189,freq=4.0), product of:
              0.14928831 = queryWeight, product of:
                1.4215639 = boost
                5.9340925 = idf(docFreq=301, maxDocs=41962)
                0.017697223 = queryNorm
              0.55632114 = fieldWeight in 189, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.9340925 = idf(docFreq=301, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.05857596 = weight(abstract_txt:term in 189) [ClassicSimilarity], result of:
            0.05857596 = score(doc=189,freq=3.0), product of:
              0.14903256 = queryWeight, product of:
                1.7395611 = boost
                4.8410144 = idf(docFreq=900, maxDocs=41962)
                0.017697223 = queryNorm
              0.39304137 = fieldWeight in 189, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.8410144 = idf(docFreq=900, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.082840614 = weight(abstract_txt:weight in 189) [ClassicSimilarity], result of:
            0.082840614 = score(doc=189,freq=1.0), product of:
              0.23657767 = queryWeight, product of:
                1.7895356 = boost
                7.4701324 = idf(docFreq=64, maxDocs=41962)
                0.017697223 = queryNorm
              0.35016245 = fieldWeight in 189, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4701324 = idf(docFreq=64, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.05595239 = weight(abstract_txt:recall in 189) [ClassicSimilarity], result of:
            0.05595239 = score(doc=189,freq=1.0), product of:
              0.20847519 = queryWeight, product of:
                2.0574358 = boost
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.017697223 = queryNorm
              0.26838872 = fieldWeight in 189, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.725626 = idf(docFreq=371, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.07768943 = weight(abstract_txt:documents in 189) [ClassicSimilarity], result of:
            0.07768943 = score(doc=189,freq=5.0), product of:
              0.17990483 = queryWeight, product of:
                2.4674304 = boost
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.017697223 = queryNorm
              0.43183628 = fieldWeight in 189, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.09419692 = weight(abstract_txt:precision in 189) [ClassicSimilarity], result of:
            0.09419692 = score(doc=189,freq=2.0), product of:
              0.2577326 = queryWeight, product of:
                2.6415155 = boost
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.017697223 = queryNorm
              0.36548316 = fieldWeight in 189, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.5132933 = idf(docFreq=459, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.12205589 = weight(abstract_txt:scores in 189) [ClassicSimilarity], result of:
            0.12205589 = score(doc=189,freq=1.0), product of:
              0.38594672 = queryWeight, product of:
                3.2324524 = boost
                6.74668 = idf(docFreq=133, maxDocs=41962)
                0.017697223 = queryNorm
              0.31625062 = fieldWeight in 189, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.74668 = idf(docFreq=133, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
          0.09655507 = weight(abstract_txt:relevance in 189) [ClassicSimilarity], result of:
            0.09655507 = score(doc=189,freq=1.0), product of:
              0.4159249 = queryWeight, product of:
                4.745598 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.017697223 = queryNorm
              0.23214543 = fieldWeight in 189, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.046875 = fieldNorm(doc=189)
        0.44 = coord(11/25)