Document (#33037)

Author

Kekäläinen, J.

Title

Binary and graded relevance in IR evaluations : comparison of the effects on ranking of IR systems

Source

Information processing and management. 41(2005) no.5, S.1019-1034

Year

2005

Abstract

In this study the rankings of IR systems based on binary and graded relevance in TREC 7 and 8 data are compared. Relevance of a sample TREC results is reassessed using a relevance scale with four levels: non-relevant, marginally relevant, fairly relevant, highly relevant. Twenty-one topics and 90 systems from TREC 7 and 20 topics and 121 systems from TREC 8 form the data. Binary precision, and cumulated gain, discounted cumulated gain and normalised discounted cumulated gain are the measures compared. Different weighting schemes for relevance levels are tested with cumulated gain measures. Kendall's rank correlations are computed to determine to what extent the rankings produced by different measures are similar. Weighting schemes from binary to emphasising highly relevant documents form a continuum, where the measures correlate strongly in the binary end, and less in the heavily weighted end. The results show the different character of the measures.

Theme

Retrievalalgorithmen

Similar documents (content)

1. Sakai, T.: On the reliability of information retrieval metrics based on graded relevance (2007) 0.48

   0.4763349 = sum of:
     0.4763349 = product of:
       1.3231524 = sum of:
         0.0076843747 = weight(abstract_txt:from in 910) [ClassicSimilarity], result of:
           0.0076843747 = score(doc=910,freq=1.0), product of:
             0.035587616 = queryWeight, product of:
               1.0757332 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.011969465 = queryNorm
             0.21592833 = fieldWeight in 910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.078125 = fieldNorm(doc=910)
         0.10792145 = weight(abstract_txt:normalised in 910) [ClassicSimilarity], result of:
           0.10792145 = score(doc=910,freq=1.0), product of:
             0.14363424 = queryWeight, product of:
               1.2477382 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.011969465 = queryNorm
             0.751363 = fieldWeight in 910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.078125 = fieldNorm(doc=910)
         0.0393788 = weight(abstract_txt:highly in 910) [ClassicSimilarity], result of:
           0.0393788 = score(doc=910,freq=1.0), product of:
             0.092406906 = queryWeight, product of:
               1.415343 = boost
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.011969465 = queryNorm
             0.4261456 = fieldWeight in 910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.078125 = fieldNorm(doc=910)
         0.07917975 = weight(abstract_txt:rankings in 910) [ClassicSimilarity], result of:
           0.07917975 = score(doc=910,freq=1.0), product of:
             0.14721052 = queryWeight, product of:
               1.7864009 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.011969465 = queryNorm
             0.5378674 = fieldWeight in 910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.078125 = fieldNorm(doc=910)
         0.31433517 = weight(abstract_txt:graded in 910) [ClassicSimilarity], result of:
           0.31433517 = score(doc=910,freq=4.0), product of:
             0.23250811 = queryWeight, product of:
               2.245063 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.011969465 = queryNorm
             1.351932 = fieldWeight in 910, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.078125 = fieldNorm(doc=910)
         0.18031463 = weight(abstract_txt:discounted in 910) [ClassicSimilarity], result of:
           0.18031463 = score(doc=910,freq=1.0), product of:
             0.25481018 = queryWeight, product of:
               2.3502707 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.011969465 = queryNorm
             0.707643 = fieldWeight in 910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.078125 = fieldNorm(doc=910)
         0.16270937 = weight(abstract_txt:relevance in 910) [ClassicSimilarity], result of:
           0.16270937 = score(doc=910,freq=5.0), product of:
             0.18885472 = queryWeight, product of:
               3.1992152 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011969465 = queryNorm
             0.8615584 = fieldWeight in 910, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=910)
         0.19541684 = weight(abstract_txt:gain in 910) [ClassicSimilarity], result of:
           0.19541684 = score(doc=910,freq=2.0), product of:
             0.26884633 = queryWeight, product of:
               3.4141026 = boost
               6.578893 = idf(docFreq=166, maxDocs=44218)
               0.011969465 = queryNorm
             0.72687185 = fieldWeight in 910, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.578893 = idf(docFreq=166, maxDocs=44218)
               0.078125 = fieldNorm(doc=910)
         0.23621213 = weight(abstract_txt:binary in 910) [ClassicSimilarity], result of:
           0.23621213 = score(doc=910,freq=1.0), product of:
             0.41404188 = queryWeight, product of:
               4.736981 = boost
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.011969465 = queryNorm
             0.570503 = fieldWeight in 910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.078125 = fieldNorm(doc=910)
       0.36 = coord(9/25)
   

2. Della Mea, V.; Mizzaro, S.: Measuring retrieval effectiveness : a new proposal and a first experimental validation (2004) 0.25

   0.25049615 = sum of:
     0.25049615 = product of:
       0.89462906 = sum of:
         0.009221249 = weight(abstract_txt:from in 2263) [ClassicSimilarity], result of:
           0.009221249 = score(doc=2263,freq=1.0), product of:
             0.035587616 = queryWeight, product of:
               1.0757332 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.011969465 = queryNorm
             0.259114 = fieldWeight in 2263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.032708857 = weight(abstract_txt:systems in 2263) [ClassicSimilarity], result of:
           0.032708857 = score(doc=2263,freq=2.0), product of:
             0.07230787 = queryWeight, product of:
               1.770587 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.011969465 = queryNorm
             0.45235544 = fieldWeight in 2263, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.07250774 = weight(abstract_txt:relevant in 2263) [ClassicSimilarity], result of:
           0.07250774 = score(doc=2263,freq=1.0), product of:
             0.16684437 = queryWeight, product of:
               3.0070128 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.011969465 = queryNorm
             0.43458307 = fieldWeight in 2263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.08731901 = weight(abstract_txt:relevance in 2263) [ClassicSimilarity], result of:
           0.08731901 = score(doc=2263,freq=1.0), product of:
             0.18885472 = queryWeight, product of:
               3.1992152 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011969465 = queryNorm
             0.46236074 = fieldWeight in 2263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.17511806 = weight(abstract_txt:trec in 2263) [ClassicSimilarity], result of:
           0.17511806 = score(doc=2263,freq=1.0), product of:
             0.27880844 = queryWeight, product of:
               3.476782 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.011969465 = queryNorm
             0.62809455 = fieldWeight in 2263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.116888896 = weight(abstract_txt:measures in 2263) [ClassicSimilarity], result of:
           0.116888896 = score(doc=2263,freq=1.0), product of:
             0.22938807 = queryWeight, product of:
               3.5258589 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.011969465 = queryNorm
             0.50956833 = fieldWeight in 2263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.40086526 = weight(abstract_txt:binary in 2263) [ClassicSimilarity], result of:
           0.40086526 = score(doc=2263,freq=2.0), product of:
             0.41404188 = queryWeight, product of:
               4.736981 = boost
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.011969465 = queryNorm
             0.96817565 = fieldWeight in 2263, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
       0.28 = coord(7/25)
   

3. Ferro, N.; Silvello, G.; Keskustalo, H.; Pirkola, A.; Järvelin, K.: ¬The twist measure for IR evaluation : taking user's effort into account (2016) 0.24

   0.24496418 = sum of:
     0.24496418 = product of:
       0.68045604 = sum of:
         0.008693878 = weight(abstract_txt:from in 2771) [ClassicSimilarity], result of:
           0.008693878 = score(doc=2771,freq=2.0), product of:
             0.035587616 = queryWeight, product of:
               1.0757332 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.011969465 = queryNorm
             0.24429502 = fieldWeight in 2771, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=2771)
         0.014339701 = weight(abstract_txt:different in 2771) [ClassicSimilarity], result of:
           0.014339701 = score(doc=2771,freq=1.0), product of:
             0.062593125 = queryWeight, product of:
               1.4266533 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.011969465 = queryNorm
             0.22909386 = fieldWeight in 2771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=2771)
         0.015419103 = weight(abstract_txt:systems in 2771) [ClassicSimilarity], result of:
           0.015419103 = score(doc=2771,freq=1.0), product of:
             0.07230787 = queryWeight, product of:
               1.770587 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.011969465 = queryNorm
             0.2132424 = fieldWeight in 2771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=2771)
         0.12573406 = weight(abstract_txt:graded in 2771) [ClassicSimilarity], result of:
           0.12573406 = score(doc=2771,freq=1.0), product of:
             0.23250811 = queryWeight, product of:
               2.245063 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.011969465 = queryNorm
             0.5407728 = fieldWeight in 2771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=2771)
         0.04833849 = weight(abstract_txt:relevant in 2771) [ClassicSimilarity], result of:
           0.04833849 = score(doc=2771,freq=1.0), product of:
             0.16684437 = queryWeight, product of:
               3.0070128 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.011969465 = queryNorm
             0.28972206 = fieldWeight in 2771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=2771)
         0.058212675 = weight(abstract_txt:relevance in 2771) [ClassicSimilarity], result of:
           0.058212675 = score(doc=2771,freq=1.0), product of:
             0.18885472 = queryWeight, product of:
               3.1992152 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011969465 = queryNorm
             0.3082405 = fieldWeight in 2771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=2771)
         0.11054446 = weight(abstract_txt:gain in 2771) [ClassicSimilarity], result of:
           0.11054446 = score(doc=2771,freq=1.0), product of:
             0.26884633 = queryWeight, product of:
               3.4141026 = boost
               6.578893 = idf(docFreq=166, maxDocs=44218)
               0.011969465 = queryNorm
             0.41118082 = fieldWeight in 2771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.578893 = idf(docFreq=166, maxDocs=44218)
               0.0625 = fieldNorm(doc=2771)
         0.11020391 = weight(abstract_txt:measures in 2771) [ClassicSimilarity], result of:
           0.11020391 = score(doc=2771,freq=2.0), product of:
             0.22938807 = queryWeight, product of:
               3.5258589 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.011969465 = queryNorm
             0.48042563 = fieldWeight in 2771, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=2771)
         0.1889697 = weight(abstract_txt:binary in 2771) [ClassicSimilarity], result of:
           0.1889697 = score(doc=2771,freq=1.0), product of:
             0.41404188 = queryWeight, product of:
               4.736981 = boost
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.011969465 = queryNorm
             0.4564024 = fieldWeight in 2771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.0625 = fieldNorm(doc=2771)
       0.36 = coord(9/25)
   

4. Talvensaari, T.; Juhola, M.; Laurikkala, J.; Järvelin, K.: Corpus-based cross-language information retrieval in retrieval of highly relevant documents (2007) 0.22

   0.2212795 = sum of:
     0.2212795 = product of:
       0.55319875 = sum of:
         0.0061474997 = weight(abstract_txt:from in 139) [ClassicSimilarity], result of:
           0.0061474997 = score(doc=139,freq=1.0), product of:
             0.035587616 = queryWeight, product of:
               1.0757332 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.011969465 = queryNorm
             0.17274266 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.024497941 = weight(abstract_txt:compared in 139) [ClassicSimilarity], result of:
           0.024497941 = score(doc=139,freq=1.0), product of:
             0.078142844 = queryWeight, product of:
               1.3015298 = boost
               5.0160327 = idf(docFreq=796, maxDocs=44218)
               0.011969465 = queryNorm
             0.31350204 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0160327 = idf(docFreq=796, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.027608244 = weight(abstract_txt:levels in 139) [ClassicSimilarity], result of:
           0.027608244 = score(doc=139,freq=1.0), product of:
             0.08462435 = queryWeight, product of:
               1.3544319 = boost
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.011969465 = queryNorm
             0.32624468 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.06300607 = weight(abstract_txt:highly in 139) [ClassicSimilarity], result of:
           0.06300607 = score(doc=139,freq=4.0), product of:
             0.092406906 = queryWeight, product of:
               1.415343 = boost
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.011969465 = queryNorm
             0.68183297 = fieldWeight in 139, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.014339701 = weight(abstract_txt:different in 139) [ClassicSimilarity], result of:
           0.014339701 = score(doc=139,freq=1.0), product of:
             0.062593125 = queryWeight, product of:
               1.4266533 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.011969465 = queryNorm
             0.22909386 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.015419103 = weight(abstract_txt:systems in 139) [ClassicSimilarity], result of:
           0.015419103 = score(doc=139,freq=1.0), product of:
             0.07230787 = queryWeight, product of:
               1.770587 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.011969465 = queryNorm
             0.2132424 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.06334379 = weight(abstract_txt:rankings in 139) [ClassicSimilarity], result of:
           0.06334379 = score(doc=139,freq=1.0), product of:
             0.14721052 = queryWeight, product of:
               1.7864009 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.011969465 = queryNorm
             0.43029392 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.12573406 = weight(abstract_txt:graded in 139) [ClassicSimilarity], result of:
           0.12573406 = score(doc=139,freq=1.0), product of:
             0.23250811 = queryWeight, product of:
               2.245063 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.011969465 = queryNorm
             0.5407728 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.09667698 = weight(abstract_txt:relevant in 139) [ClassicSimilarity], result of:
           0.09667698 = score(doc=139,freq=4.0), product of:
             0.16684437 = queryWeight, product of:
               3.0070128 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.011969465 = queryNorm
             0.5794441 = fieldWeight in 139, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.11642535 = weight(abstract_txt:relevance in 139) [ClassicSimilarity], result of:
           0.11642535 = score(doc=139,freq=4.0), product of:
             0.18885472 = queryWeight, product of:
               3.1992152 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011969465 = queryNorm
             0.616481 = fieldWeight in 139, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
       0.4 = coord(10/25)
   

5. Kekäläinen, J.; Järvelin, K.: Using graded relevance assessments in IR evaluation (2002) 0.19

   0.1931106 = sum of:
     0.1931106 = product of:
       0.6896807 = sum of:
         0.0061474997 = weight(abstract_txt:from in 5225) [ClassicSimilarity], result of:
           0.0061474997 = score(doc=5225,freq=1.0), product of:
             0.035587616 = queryWeight, product of:
               1.0757332 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.011969465 = queryNorm
             0.17274266 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.031503037 = weight(abstract_txt:highly in 5225) [ClassicSimilarity], result of:
           0.031503037 = score(doc=5225,freq=1.0), product of:
             0.092406906 = queryWeight, product of:
               1.415343 = boost
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.011969465 = queryNorm
             0.34091648 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.12573406 = weight(abstract_txt:graded in 5225) [ClassicSimilarity], result of:
           0.12573406 = score(doc=5225,freq=1.0), product of:
             0.23250811 = queryWeight, product of:
               2.245063 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.011969465 = queryNorm
             0.5407728 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.04833849 = weight(abstract_txt:relevant in 5225) [ClassicSimilarity], result of:
           0.04833849 = score(doc=5225,freq=1.0), product of:
             0.16684437 = queryWeight, product of:
               3.0070128 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.011969465 = queryNorm
             0.28972206 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.15401626 = weight(abstract_txt:relevance in 5225) [ClassicSimilarity], result of:
           0.15401626 = score(doc=5225,freq=7.0), product of:
             0.18885472 = queryWeight, product of:
               3.1992152 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011969465 = queryNorm
             0.8155277 = fieldWeight in 5225, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.13497166 = weight(abstract_txt:measures in 5225) [ClassicSimilarity], result of:
           0.13497166 = score(doc=5225,freq=3.0), product of:
             0.22938807 = queryWeight, product of:
               3.5258589 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.011969465 = queryNorm
             0.5883988 = fieldWeight in 5225, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.1889697 = weight(abstract_txt:binary in 5225) [ClassicSimilarity], result of:
           0.1889697 = score(doc=5225,freq=1.0), product of:
             0.41404188 = queryWeight, product of:
               4.736981 = boost
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.011969465 = queryNorm
             0.4564024 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
       0.28 = coord(7/25)