Document (#30226)

Author

Kekäläinen, J.
Järvelin, K.

Title

Using graded relevance assessments in IR evaluation

Source

Journal of the American Society for Information Science and technology. 53(2002) no.13, S.1120-xxxx

Year

2002

Abstract

Kekalainen and Jarvelin use what they term generalized, nonbinary recall and precision measures where recall is the sum of the relevance scores of the retrieved documents divided by the sum of relevance scores of all documents in the data base, and precision is the sum of the relevance scores of the retrieved documents divided by the number of documents where the relevance scores are real numbers between zero and one. Using the In-Query system and a text data base of 53,893 newspaper articles with 30 queries selected from those for which four relevance categories to provide recall measures were available, search results were evaluated by four judges. Searches were done by average key term weight, Boolean expression, and by average term weight where the terms are grouped by a synonym operator, and for each case with and without expansion of the original terms. Use of higher standards of relevance appears to increase the superiority of the best method. Some methods do a better job of getting the highly relevant documents but do not increase retrieval of marginal ones. There is evidence that generalized precision provides more equitable results, while binary precision provides undeserved merit to some methods. Generally graded relevance measures seem to provide additional insight into IR evaluation.

Theme

Retrievalstudien

Similar documents (author)

1. Järvelin, K.: ¬An analysis of two approaches in information retrieval : from frameworks to study designs (2007) 4.99

   4.989572 = sum of:
     4.989572 = weight(author_txt:järvelin in 326) [ClassicSimilarity], result of:
       4.989572 = fieldWeight in 326, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.625 = fieldNorm(doc=326)
   

2. Järvelin, K.: Evaluation (2011) 4.99

   4.989572 = sum of:
     4.989572 = weight(author_txt:järvelin in 548) [ClassicSimilarity], result of:
       4.989572 = fieldWeight in 548, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.625 = fieldNorm(doc=548)
   

3. Järvelin, K.; Vakkari, P.: ¬The evolution of library and information science 1965-1985 : a content analysis of journal titles (1993) 3.99

   3.9916575 = sum of:
     3.9916575 = weight(author_txt:järvelin in 4649) [ClassicSimilarity], result of:
       3.9916575 = fieldWeight in 4649, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.5 = fieldNorm(doc=4649)
   

4. Kristensen, J.; Järvelin, K.: ¬The effectiveness of a searching thesaurus in free-text searching in a full-text database (1990) 3.99

   3.9916575 = sum of:
     3.9916575 = weight(author_txt:järvelin in 2043) [ClassicSimilarity], result of:
       3.9916575 = fieldWeight in 2043, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.5 = fieldNorm(doc=2043)
   

5. Pirkola, A.; Järvelin, K.: Employing the resolution power of search keys (2001) 3.99

   3.9916575 = sum of:
     3.9916575 = weight(author_txt:järvelin in 5907) [ClassicSimilarity], result of:
       3.9916575 = fieldWeight in 5907, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.5 = fieldNorm(doc=5907)
   

Similar documents (content)

1. Talvensaari, T.; Juhola, M.; Laurikkala, J.; Järvelin, K.: Corpus-based cross-language information retrieval in retrieval of highly relevant documents (2007) 0.49

   0.49169055 = sum of:
     0.49169055 = product of:
       1.1174785 = sum of:
         0.02697466 = weight(abstract_txt:methods in 139) [ClassicSimilarity], result of:
           0.02697466 = score(doc=139,freq=2.0), product of:
             0.07359578 = queryWeight, product of:
               1.0075752 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.017614381 = queryNorm
             0.36652455 = fieldWeight in 139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.044352073 = weight(abstract_txt:were in 139) [ClassicSimilarity], result of:
           0.044352073 = score(doc=139,freq=5.0), product of:
             0.08647195 = queryWeight, product of:
               1.3376247 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.017614381 = queryNorm
             0.512907 = fieldWeight in 139, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.049745265 = weight(abstract_txt:retrieved in 139) [ClassicSimilarity], result of:
           0.049745265 = score(doc=139,freq=1.0), product of:
             0.13944194 = queryWeight, product of:
               1.3869082 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.017614381 = queryNorm
             0.35674536 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.05521753 = weight(abstract_txt:average in 139) [ClassicSimilarity], result of:
           0.05521753 = score(doc=139,freq=1.0), product of:
             0.14948934 = queryWeight, product of:
               1.4360056 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.017614381 = queryNorm
             0.36937436 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.09460797 = weight(abstract_txt:generalized in 139) [ClassicSimilarity], result of:
           0.09460797 = score(doc=139,freq=1.0), product of:
             0.21404779 = queryWeight, product of:
               1.7183292 = boost
               7.071914 = idf(docFreq=101, maxDocs=44218)
               0.017614381 = queryNorm
             0.44199464 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.071914 = idf(docFreq=101, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.108080566 = weight(abstract_txt:weight in 139) [ClassicSimilarity], result of:
           0.108080566 = score(doc=139,freq=1.0), product of:
             0.2339146 = queryWeight, product of:
               1.7963033 = boost
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.017614381 = queryNorm
             0.4620514 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.0762345 = weight(abstract_txt:recall in 139) [ClassicSimilarity], result of:
           0.0762345 = score(doc=139,freq=1.0), product of:
             0.21217312 = queryWeight, product of:
               2.0952787 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017614381 = queryNorm
             0.35930327 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.17326917 = weight(abstract_txt:graded in 139) [ClassicSimilarity], result of:
           0.17326917 = score(doc=139,freq=1.0), product of:
             0.32041028 = queryWeight, product of:
               2.1023462 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.017614381 = queryNorm
             0.5407728 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.104675576 = weight(abstract_txt:documents in 139) [ClassicSimilarity], result of:
           0.104675576 = score(doc=139,freq=5.0), product of:
             0.18173803 = queryWeight, product of:
               2.5034788 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.017614381 = queryNorm
             0.5759696 = fieldWeight in 139, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.12761526 = weight(abstract_txt:precision in 139) [ClassicSimilarity], result of:
           0.12761526 = score(doc=139,freq=2.0), product of:
             0.26131278 = queryWeight, product of:
               2.6850126 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017614381 = queryNorm
             0.4883621 = fieldWeight in 139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.2567059 = weight(abstract_txt:relevance in 139) [ClassicSimilarity], result of:
           0.2567059 = score(doc=139,freq=4.0), product of:
             0.4164052 = queryWeight, product of:
               4.7933493 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.017614381 = queryNorm
             0.616481 = fieldWeight in 139, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
       0.44 = coord(11/25)
   

2. Huuskonen, S.; Vakkari, P.: Students' search process and outcome in Medline in writing an essay for a class on evidence-based medicine (2008) 0.38

   0.37872595 = sum of:
     0.37872595 = product of:
       0.94681484 = sum of:
         0.017538574 = weight(abstract_txt:provides in 1891) [ClassicSimilarity], result of:
           0.017538574 = score(doc=1891,freq=1.0), product of:
             0.07607052 = queryWeight, product of:
               1.0243756 = boost
               4.215895 = idf(docFreq=1773, maxDocs=44218)
               0.017614381 = queryNorm
             0.23055677 = fieldWeight in 1891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.215895 = idf(docFreq=1773, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.029883921 = weight(abstract_txt:evaluation in 1891) [ClassicSimilarity], result of:
           0.029883921 = score(doc=1891,freq=2.0), product of:
             0.08613281 = queryWeight, product of:
               1.0900221 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.017614381 = queryNorm
             0.34695166 = fieldWeight in 1891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.056710627 = weight(abstract_txt:four in 1891) [ClassicSimilarity], result of:
           0.056710627 = score(doc=1891,freq=3.0), product of:
             0.11533367 = queryWeight, product of:
               1.261331 = boost
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.017614381 = queryNorm
             0.4917092 = fieldWeight in 1891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.034710985 = weight(abstract_txt:were in 1891) [ClassicSimilarity], result of:
           0.034710985 = score(doc=1891,freq=4.0), product of:
             0.08647195 = queryWeight, product of:
               1.3376247 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.017614381 = queryNorm
             0.40141323 = fieldWeight in 1891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.075391166 = weight(abstract_txt:retrieved in 1891) [ClassicSimilarity], result of:
           0.075391166 = score(doc=1891,freq=3.0), product of:
             0.13944194 = queryWeight, product of:
               1.3869082 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.017614381 = queryNorm
             0.5406635 = fieldWeight in 1891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.07973052 = weight(abstract_txt:measures in 1891) [ClassicSimilarity], result of:
           0.07973052 = score(doc=1891,freq=2.0), product of:
             0.18966639 = queryWeight, product of:
               1.9810334 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.017614381 = queryNorm
             0.42037243 = fieldWeight in 1891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.16339366 = weight(abstract_txt:recall in 1891) [ClassicSimilarity], result of:
           0.16339366 = score(doc=1891,freq=6.0), product of:
             0.21217312 = queryWeight, product of:
               2.0952787 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017614381 = queryNorm
             0.77009594 = fieldWeight in 1891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.057927314 = weight(abstract_txt:documents in 1891) [ClassicSimilarity], result of:
           0.057927314 = score(doc=1891,freq=2.0), product of:
             0.18173803 = queryWeight, product of:
               2.5034788 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.017614381 = queryNorm
             0.31874073 = fieldWeight in 1891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.1934066 = weight(abstract_txt:precision in 1891) [ClassicSimilarity], result of:
           0.1934066 = score(doc=1891,freq=6.0), product of:
             0.26131278 = queryWeight, product of:
               2.6850126 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017614381 = queryNorm
             0.7401345 = fieldWeight in 1891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.23812152 = weight(abstract_txt:scores in 1891) [ClassicSimilarity], result of:
           0.23812152 = score(doc=1891,freq=3.0), product of:
             0.37820062 = queryWeight, product of:
               3.230183 = boost
               6.6470313 = idf(docFreq=155, maxDocs=44218)
               0.017614381 = queryNorm
             0.629617 = fieldWeight in 1891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.6470313 = idf(docFreq=155, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
       0.4 = coord(10/25)
   

3. Su, L.T.; Chen, H.L.: Evaluation of Web search engines by undergraduate students (1999) 0.35

   0.34676984 = sum of:
     0.34676984 = product of:
       0.8669246 = sum of:
         0.03660018 = weight(abstract_txt:evaluation in 6546) [ClassicSimilarity], result of:
           0.03660018 = score(doc=6546,freq=3.0), product of:
             0.08613281 = queryWeight, product of:
               1.0900221 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.017614381 = queryNorm
             0.42492726 = fieldWeight in 6546, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
         0.06548379 = weight(abstract_txt:four in 6546) [ClassicSimilarity], result of:
           0.06548379 = score(doc=6546,freq=4.0), product of:
             0.11533367 = queryWeight, product of:
               1.261331 = boost
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.017614381 = queryNorm
             0.5677769 = fieldWeight in 6546, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
         0.030060595 = weight(abstract_txt:were in 6546) [ClassicSimilarity], result of:
           0.030060595 = score(doc=6546,freq=3.0), product of:
             0.08647195 = queryWeight, product of:
               1.3376247 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.017614381 = queryNorm
             0.34763405 = fieldWeight in 6546, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
         0.06155662 = weight(abstract_txt:retrieved in 6546) [ClassicSimilarity], result of:
           0.06155662 = score(doc=6546,freq=2.0), product of:
             0.13944194 = queryWeight, product of:
               1.3869082 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.017614381 = queryNorm
             0.44144982 = fieldWeight in 6546, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
         0.097649544 = weight(abstract_txt:measures in 6546) [ClassicSimilarity], result of:
           0.097649544 = score(doc=6546,freq=3.0), product of:
             0.18966639 = queryWeight, product of:
               1.9810334 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.017614381 = queryNorm
             0.51484895 = fieldWeight in 6546, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
         0.06670518 = weight(abstract_txt:recall in 6546) [ClassicSimilarity], result of:
           0.06670518 = score(doc=6546,freq=1.0), product of:
             0.21217312 = queryWeight, product of:
               2.0952787 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017614381 = queryNorm
             0.31439036 = fieldWeight in 6546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
         0.040960796 = weight(abstract_txt:documents in 6546) [ClassicSimilarity], result of:
           0.040960796 = score(doc=6546,freq=1.0), product of:
             0.18173803 = queryWeight, product of:
               2.5034788 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.017614381 = queryNorm
             0.22538373 = fieldWeight in 6546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
         0.078957915 = weight(abstract_txt:precision in 6546) [ClassicSimilarity], result of:
           0.078957915 = score(doc=6546,freq=1.0), product of:
             0.26131278 = queryWeight, product of:
               2.6850126 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017614381 = queryNorm
             0.30215865 = fieldWeight in 6546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
         0.19442542 = weight(abstract_txt:scores in 6546) [ClassicSimilarity], result of:
           0.19442542 = score(doc=6546,freq=2.0), product of:
             0.37820062 = queryWeight, product of:
               3.230183 = boost
               6.6470313 = idf(docFreq=155, maxDocs=44218)
               0.017614381 = queryNorm
             0.5140801 = fieldWeight in 6546, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6470313 = idf(docFreq=155, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
         0.1945246 = weight(abstract_txt:relevance in 6546) [ClassicSimilarity], result of:
           0.1945246 = score(doc=6546,freq=3.0), product of:
             0.4164052 = queryWeight, product of:
               4.7933493 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.017614381 = queryNorm
             0.46715218 = fieldWeight in 6546, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6546)
       0.4 = coord(10/25)
   

4. Yang, L.; Ji, D.; Leong, M.: Document reranking by term distribution and maximal marginal relevance for chinese information retrieval (2007) 0.34

   0.33506843 = sum of:
     0.33506843 = product of:
       0.9307456 = sum of:
         0.023842454 = weight(abstract_txt:methods in 907) [ClassicSimilarity], result of:
           0.023842454 = score(doc=907,freq=1.0), product of:
             0.07359578 = queryWeight, product of:
               1.0075752 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.017614381 = queryNorm
             0.32396498 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.08793803 = weight(abstract_txt:retrieved in 907) [ClassicSimilarity], result of:
           0.08793803 = score(doc=907,freq=2.0), product of:
             0.13944194 = queryWeight, product of:
               1.3869082 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.017614381 = queryNorm
             0.63064265 = fieldWeight in 907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.06902192 = weight(abstract_txt:average in 907) [ClassicSimilarity], result of:
           0.06902192 = score(doc=907,freq=1.0), product of:
             0.14948934 = queryWeight, product of:
               1.4360056 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.017614381 = queryNorm
             0.46171796 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.07850254 = weight(abstract_txt:term in 907) [ClassicSimilarity], result of:
           0.07850254 = score(doc=907,freq=2.0), product of:
             0.14798868 = queryWeight, product of:
               1.7498906 = boost
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.017614381 = queryNorm
             0.53046316 = fieldWeight in 907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.1351007 = weight(abstract_txt:weight in 907) [ClassicSimilarity], result of:
           0.1351007 = score(doc=907,freq=1.0), product of:
             0.2339146 = queryWeight, product of:
               1.7963033 = boost
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.017614381 = queryNorm
             0.57756424 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.09529312 = weight(abstract_txt:recall in 907) [ClassicSimilarity], result of:
           0.09529312 = score(doc=907,freq=1.0), product of:
             0.21217312 = queryWeight, product of:
               2.0952787 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017614381 = queryNorm
             0.44912907 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.10135168 = weight(abstract_txt:documents in 907) [ClassicSimilarity], result of:
           0.10135168 = score(doc=907,freq=3.0), product of:
             0.18173803 = queryWeight, product of:
               2.5034788 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.017614381 = queryNorm
             0.5576801 = fieldWeight in 907, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.11279702 = weight(abstract_txt:precision in 907) [ClassicSimilarity], result of:
           0.11279702 = score(doc=907,freq=1.0), product of:
             0.26131278 = queryWeight, product of:
               2.6850126 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017614381 = queryNorm
             0.4316552 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.2268981 = weight(abstract_txt:relevance in 907) [ClassicSimilarity], result of:
           0.2268981 = score(doc=907,freq=2.0), product of:
             0.4164052 = queryWeight, product of:
               4.7933493 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.017614381 = queryNorm
             0.5448974 = fieldWeight in 907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
       0.36 = coord(9/25)
   

5. Kim, W.; Wilbur, W.J.: Corpus-based statistical screening for content-bearing terms (2001) 0.32

   0.32330796 = sum of:
     0.32330796 = product of:
       0.7347908 = sum of:
         0.024777807 = weight(abstract_txt:methods in 5188) [ClassicSimilarity], result of:
           0.024777807 = score(doc=5188,freq=3.0), product of:
             0.07359578 = queryWeight, product of:
               1.0075752 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.017614381 = queryNorm
             0.3366743 = fieldWeight in 5188, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.028064482 = weight(abstract_txt:four in 5188) [ClassicSimilarity], result of:
           0.028064482 = score(doc=5188,freq=1.0), product of:
             0.11533367 = queryWeight, product of:
               1.261331 = boost
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.017614381 = queryNorm
             0.24333295 = fieldWeight in 5188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.014876137 = weight(abstract_txt:were in 5188) [ClassicSimilarity], result of:
           0.014876137 = score(doc=5188,freq=1.0), product of:
             0.08647195 = queryWeight, product of:
               1.3376247 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.017614381 = queryNorm
             0.17203423 = fieldWeight in 5188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.082826294 = weight(abstract_txt:average in 5188) [ClassicSimilarity], result of:
           0.082826294 = score(doc=5188,freq=4.0), product of:
             0.14948934 = queryWeight, product of:
               1.4360056 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.017614381 = queryNorm
             0.55406153 = fieldWeight in 5188, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.057687357 = weight(abstract_txt:term in 5188) [ClassicSimilarity], result of:
           0.057687357 = score(doc=5188,freq=3.0), product of:
             0.14798868 = queryWeight, product of:
               1.7498906 = boost
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.017614381 = queryNorm
             0.38980925 = fieldWeight in 5188, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.081060424 = weight(abstract_txt:weight in 5188) [ClassicSimilarity], result of:
           0.081060424 = score(doc=5188,freq=1.0), product of:
             0.2339146 = queryWeight, product of:
               1.7963033 = boost
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.017614381 = queryNorm
             0.34653854 = fieldWeight in 5188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.05717587 = weight(abstract_txt:recall in 5188) [ClassicSimilarity], result of:
           0.05717587 = score(doc=5188,freq=1.0), product of:
             0.21217312 = queryWeight, product of:
               2.0952787 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017614381 = queryNorm
             0.26947746 = fieldWeight in 5188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.078506686 = weight(abstract_txt:documents in 5188) [ClassicSimilarity], result of:
           0.078506686 = score(doc=5188,freq=5.0), product of:
             0.18173803 = queryWeight, product of:
               2.5034788 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.017614381 = queryNorm
             0.43197718 = fieldWeight in 5188, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.09571145 = weight(abstract_txt:precision in 5188) [ClassicSimilarity], result of:
           0.09571145 = score(doc=5188,freq=2.0), product of:
             0.26131278 = queryWeight, product of:
               2.6850126 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017614381 = queryNorm
             0.3662716 = fieldWeight in 5188, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.11783959 = weight(abstract_txt:scores in 5188) [ClassicSimilarity], result of:
           0.11783959 = score(doc=5188,freq=1.0), product of:
             0.37820062 = queryWeight, product of:
               3.230183 = boost
               6.6470313 = idf(docFreq=155, maxDocs=44218)
               0.017614381 = queryNorm
             0.31157959 = fieldWeight in 5188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6470313 = idf(docFreq=155, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
         0.096264705 = weight(abstract_txt:relevance in 5188) [ClassicSimilarity], result of:
           0.096264705 = score(doc=5188,freq=1.0), product of:
             0.4164052 = queryWeight, product of:
               4.7933493 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.017614381 = queryNorm
             0.23118037 = fieldWeight in 5188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.046875 = fieldNorm(doc=5188)
       0.44 = coord(11/25)