Document (#27559)

Author

Egghe, L.

Title

¬A universal method of information retrieval evaluation : the "missing" link M and the universal IR surface

Source

Information processing and management. 40(2004) no.1, S.21-30

Year

2004

Abstract

The paper shows that the present evaluation methods in information retrieval (basically recall R and precision P and in some cases fallout F ) lack universal comparability in the sense that their values depend on the generality of the IR problem. A solution is given by using all "parts" of the database, including the non-relevant documents and also the not-retrieved documents. It turns out that the solution is given by introducing the measure M being the fraction of the not-retrieved documents that are relevant (hence the "miss" measure). We prove that - independent of the IR problem or of the IR action - the quadruple (P,R,F,M) belongs to a universal IR surface, being the same for all IR-activities. This universality is then exploited by defining a new measure for evaluation in IR allowing for unbiased comparisons of all IR results. We also show that only using one, two or even three measures from the set {P,R,F,M} necessary leads to evaluation measures that are non-universal and hence not capable of comparing different IR situations.

Similar documents (author)

1. Egghe, L.: Little science, big science and beyond (1994) 4.74

   4.741258 = sum of:
     4.741258 = weight(author_txt:egghe in 6883) [ClassicSimilarity], result of:
       4.741258 = fieldWeight in 6883, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5860133 = idf(docFreq=60, maxDocs=44218)
         0.625 = fieldNorm(doc=6883)
   

2. Egghe, L.: Expansion of the field of informetrics : the second special issue (2006) 4.74

   4.741258 = sum of:
     4.741258 = weight(author_txt:egghe in 7119) [ClassicSimilarity], result of:
       4.741258 = fieldWeight in 7119, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5860133 = idf(docFreq=60, maxDocs=44218)
         0.625 = fieldNorm(doc=7119)
   

3. Egghe, L.: Expansion of the field of informetrics : origins and consequences (2005) 4.74

   4.741258 = sum of:
     4.741258 = weight(author_txt:egghe in 1910) [ClassicSimilarity], result of:
       4.741258 = fieldWeight in 1910, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5860133 = idf(docFreq=60, maxDocs=44218)
         0.625 = fieldNorm(doc=1910)
   

4. Egghe, L.: ¬The amount of actions needed for shelving and reshelving (1996) 4.74

   4.741258 = sum of:
     4.741258 = weight(author_txt:egghe in 4394) [ClassicSimilarity], result of:
       4.741258 = fieldWeight in 4394, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5860133 = idf(docFreq=60, maxDocs=44218)
         0.625 = fieldNorm(doc=4394)
   

5. Egghe, L.: Special features of the author - publication relationship and a new explanation of Lotka's law based on convolution theory (1994) 4.74

   4.741258 = sum of:
     4.741258 = weight(author_txt:egghe in 5068) [ClassicSimilarity], result of:
       4.741258 = fieldWeight in 5068, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5860133 = idf(docFreq=60, maxDocs=44218)
         0.625 = fieldNorm(doc=5068)
   

Similar documents (content)

1. Egghe, L.: Existence theorem of the quadruple (P, R, F, M) : precision, recall, fallout and miss (2007) 0.32

   0.31518108 = sum of:
     0.31518108 = product of:
       0.9849409 = sum of:
         0.17946103 = weight(abstract_txt:miss in 2011) [ClassicSimilarity], result of:
           0.17946103 = score(doc=2011,freq=3.0), product of:
             0.19263537 = queryWeight, product of:
               1.1640811 = boost
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.019229116 = queryNorm
             0.93161 = fieldWeight in 2011, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.047772538 = weight(abstract_txt:given in 2011) [ClassicSimilarity], result of:
           0.047772538 = score(doc=2011,freq=2.0), product of:
             0.1149693 = queryWeight, product of:
               1.2718068 = boost
               4.701121 = idf(docFreq=1091, maxDocs=44218)
               0.019229116 = queryNorm
             0.4155243 = fieldWeight in 2011, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.701121 = idf(docFreq=1091, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.24138719 = weight(abstract_txt:fallout in 2011) [ClassicSimilarity], result of:
           0.24138719 = score(doc=2011,freq=3.0), product of:
             0.23472828 = queryWeight, product of:
               1.2849846 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.019229116 = queryNorm
             1.0283686 = fieldWeight in 2011, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.052209865 = weight(abstract_txt:measures in 2011) [ClassicSimilarity], result of:
           0.052209865 = score(doc=2011,freq=1.0), product of:
             0.1536885 = queryWeight, product of:
               1.4704522 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.019229116 = queryNorm
             0.33971223 = fieldWeight in 2011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.14286824 = weight(abstract_txt:surface in 2011) [ClassicSimilarity], result of:
           0.14286824 = score(doc=2011,freq=1.0), product of:
             0.30067462 = queryWeight, product of:
               2.0567362 = boost
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.019229116 = queryNorm
             0.47515893 = fieldWeight in 2011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.030277051 = weight(abstract_txt:that in 2011) [ClassicSimilarity], result of:
           0.030277051 = score(doc=2011,freq=4.0), product of:
             0.10222366 = queryWeight, product of:
               2.2435718 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.019229116 = queryNorm
             0.2961844 = fieldWeight in 2011, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.058706585 = weight(abstract_txt:evaluation in 2011) [ClassicSimilarity], result of:
           0.058706585 = score(doc=2011,freq=1.0), product of:
             0.20938274 = queryWeight, product of:
               2.4272563 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.019229116 = queryNorm
             0.2803793 = fieldWeight in 2011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.23225835 = weight(abstract_txt:universal in 2011) [ClassicSimilarity], result of:
           0.23225835 = score(doc=2011,freq=2.0), product of:
             0.4478067 = queryWeight, product of:
               3.9686747 = boost
               5.8679414 = idf(docFreq=339, maxDocs=44218)
               0.019229116 = queryNorm
             0.5186576 = fieldWeight in 2011, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8679414 = idf(docFreq=339, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
       0.32 = coord(8/25)
   

2. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.28

   0.2810272 = sum of:
     0.2810272 = product of:
       0.78063107 = sum of:
         0.13386583 = weight(abstract_txt:generality in 5515) [ClassicSimilarity], result of:
           0.13386583 = score(doc=5515,freq=1.0), product of:
             0.1969259 = queryWeight, product of:
               1.1769733 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.019229116 = queryNorm
             0.67977774 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.04048309 = weight(abstract_txt:relevant in 5515) [ClassicSimilarity], result of:
           0.04048309 = score(doc=5515,freq=1.0), product of:
             0.11178463 = queryWeight, product of:
               1.2540685 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.019229116 = queryNorm
             0.36215258 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.042225357 = weight(abstract_txt:given in 5515) [ClassicSimilarity], result of:
           0.042225357 = score(doc=5515,freq=1.0), product of:
             0.1149693 = queryWeight, product of:
               1.2718068 = boost
               4.701121 = idf(docFreq=1091, maxDocs=44218)
               0.019229116 = queryNorm
             0.36727506 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.701121 = idf(docFreq=1091, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.17420621 = weight(abstract_txt:fallout in 5515) [ClassicSimilarity], result of:
           0.17420621 = score(doc=5515,freq=1.0), product of:
             0.23472828 = queryWeight, product of:
               1.2849846 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.019229116 = queryNorm
             0.74216115 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.06526233 = weight(abstract_txt:measures in 5515) [ClassicSimilarity], result of:
           0.06526233 = score(doc=5515,freq=1.0), product of:
             0.1536885 = queryWeight, product of:
               1.4704522 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.019229116 = queryNorm
             0.4246403 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.0755795 = weight(abstract_txt:retrieved in 5515) [ClassicSimilarity], result of:
           0.0755795 = score(doc=5515,freq=1.0), product of:
             0.16948672 = queryWeight, product of:
               1.5441804 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.019229116 = queryNorm
             0.4459317 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.060350217 = weight(abstract_txt:documents in 5515) [ClassicSimilarity], result of:
           0.060350217 = score(doc=5515,freq=2.0), product of:
             0.13253766 = queryWeight, product of:
               1.6724205 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019229116 = queryNorm
             0.4553439 = fieldWeight in 5515, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.16973534 = weight(abstract_txt:measure in 5515) [ClassicSimilarity], result of:
           0.16973534 = score(doc=5515,freq=3.0), product of:
             0.23069483 = queryWeight, product of:
               2.2064536 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.019229116 = queryNorm
             0.73575705 = fieldWeight in 5515, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.018923158 = weight(abstract_txt:that in 5515) [ClassicSimilarity], result of:
           0.018923158 = score(doc=5515,freq=1.0), product of:
             0.10222366 = queryWeight, product of:
               2.2435718 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.019229116 = queryNorm
             0.18511525 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
       0.36 = coord(9/25)
   

3. Egghe, L.: ¬The measures precision, recall, fallout and miss as a function of the number of retrieved documents and their mutual interrelations (2008) 0.19

   0.19441485 = sum of:
     0.19441485 = product of:
       0.81006193 = sum of:
         0.25379625 = weight(abstract_txt:miss in 2067) [ClassicSimilarity], result of:
           0.25379625 = score(doc=2067,freq=6.0), product of:
             0.19263537 = queryWeight, product of:
               1.1640811 = boost
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.019229116 = queryNorm
             1.3174956 = fieldWeight in 2067, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
         0.34137306 = weight(abstract_txt:fallout in 2067) [ClassicSimilarity], result of:
           0.34137306 = score(doc=2067,freq=6.0), product of:
             0.23472828 = queryWeight, product of:
               1.2849846 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.019229116 = queryNorm
             1.454333 = fieldWeight in 2067, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
         0.073835894 = weight(abstract_txt:measures in 2067) [ClassicSimilarity], result of:
           0.073835894 = score(doc=2067,freq=2.0), product of:
             0.1536885 = queryWeight, product of:
               1.4704522 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.019229116 = queryNorm
             0.48042563 = fieldWeight in 2067, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
         0.085508436 = weight(abstract_txt:retrieved in 2067) [ClassicSimilarity], result of:
           0.085508436 = score(doc=2067,freq=2.0), product of:
             0.16948672 = queryWeight, product of:
               1.5441804 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.019229116 = queryNorm
             0.5045141 = fieldWeight in 2067, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
         0.03413924 = weight(abstract_txt:documents in 2067) [ClassicSimilarity], result of:
           0.03413924 = score(doc=2067,freq=1.0), product of:
             0.13253766 = queryWeight, product of:
               1.6724205 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019229116 = queryNorm
             0.2575814 = fieldWeight in 2067, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
         0.021409107 = weight(abstract_txt:that in 2067) [ClassicSimilarity], result of:
           0.021409107 = score(doc=2067,freq=2.0), product of:
             0.10222366 = queryWeight, product of:
               2.2435718 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.019229116 = queryNorm
             0.20943399 = fieldWeight in 2067, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
       0.24 = coord(6/25)
   

4. Robertson, S.E.: ¬The parametric description of retrieval tests : Part II: Overall measures (1969) 0.19

   0.19364882 = sum of:
     0.19364882 = product of:
       0.8068701 = sum of:
         0.101552986 = weight(abstract_txt:turns in 4156) [ClassicSimilarity], result of:
           0.101552986 = score(doc=4156,freq=1.0), product of:
             0.1638016 = queryWeight, product of:
               1.0734314 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.019229116 = queryNorm
             0.61997557 = fieldWeight in 4156, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.13386583 = weight(abstract_txt:generality in 4156) [ClassicSimilarity], result of:
           0.13386583 = score(doc=4156,freq=1.0), product of:
             0.1969259 = queryWeight, product of:
               1.1769733 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.019229116 = queryNorm
             0.67977774 = fieldWeight in 4156, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.24636479 = weight(abstract_txt:fallout in 4156) [ClassicSimilarity], result of:
           0.24636479 = score(doc=4156,freq=2.0), product of:
             0.23472828 = queryWeight, product of:
               1.2849846 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.019229116 = queryNorm
             1.0495744 = fieldWeight in 4156, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.113037676 = weight(abstract_txt:measures in 4156) [ClassicSimilarity], result of:
           0.113037676 = score(doc=4156,freq=3.0), product of:
             0.1536885 = queryWeight, product of:
               1.4704522 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.019229116 = queryNorm
             0.73549855 = fieldWeight in 4156, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.16973534 = weight(abstract_txt:measure in 4156) [ClassicSimilarity], result of:
           0.16973534 = score(doc=4156,freq=3.0), product of:
             0.23069483 = queryWeight, product of:
               2.2064536 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.019229116 = queryNorm
             0.73575705 = fieldWeight in 4156, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.042313464 = weight(abstract_txt:that in 4156) [ClassicSimilarity], result of:
           0.042313464 = score(doc=4156,freq=5.0), product of:
             0.10222366 = queryWeight, product of:
               2.2435718 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.019229116 = queryNorm
             0.41393027 = fieldWeight in 4156, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
       0.24 = coord(6/25)
   

5. Fricke, M.: Measuring recall (1998) 0.18

   0.18099542 = sum of:
     0.18099542 = product of:
       0.6464122 = sum of:
         0.05667633 = weight(abstract_txt:relevant in 3802) [ClassicSimilarity], result of:
           0.05667633 = score(doc=3802,freq=1.0), product of:
             0.11178463 = queryWeight, product of:
               1.2540685 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.019229116 = queryNorm
             0.5070136 = fieldWeight in 3802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.109375 = fieldNorm(doc=3802)
         0.105811305 = weight(abstract_txt:retrieved in 3802) [ClassicSimilarity], result of:
           0.105811305 = score(doc=3802,freq=1.0), product of:
             0.16948672 = queryWeight, product of:
               1.5441804 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.019229116 = queryNorm
             0.6243044 = fieldWeight in 3802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.109375 = fieldNorm(doc=3802)
         0.059743665 = weight(abstract_txt:documents in 3802) [ClassicSimilarity], result of:
           0.059743665 = score(doc=3802,freq=1.0), product of:
             0.13253766 = queryWeight, product of:
               1.6724205 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019229116 = queryNorm
             0.45076746 = fieldWeight in 3802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.109375 = fieldNorm(doc=3802)
         0.1577565 = weight(abstract_txt:hence in 3802) [ClassicSimilarity], result of:
           0.1577565 = score(doc=3802,freq=1.0), product of:
             0.22119357 = queryWeight, product of:
               1.7640727 = boost
               6.5207376 = idf(docFreq=176, maxDocs=44218)
               0.019229116 = queryNorm
             0.7132057 = fieldWeight in 3802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5207376 = idf(docFreq=176, maxDocs=44218)
               0.109375 = fieldNorm(doc=3802)
         0.13719545 = weight(abstract_txt:measure in 3802) [ClassicSimilarity], result of:
           0.13719545 = score(doc=3802,freq=1.0), product of:
             0.23069483 = queryWeight, product of:
               2.2064536 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.019229116 = queryNorm
             0.59470534 = fieldWeight in 3802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.109375 = fieldNorm(doc=3802)
         0.02649242 = weight(abstract_txt:that in 3802) [ClassicSimilarity], result of:
           0.02649242 = score(doc=3802,freq=1.0), product of:
             0.10222366 = queryWeight, product of:
               2.2435718 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.019229116 = queryNorm
             0.25916135 = fieldWeight in 3802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.109375 = fieldNorm(doc=3802)
         0.102736525 = weight(abstract_txt:evaluation in 3802) [ClassicSimilarity], result of:
           0.102736525 = score(doc=3802,freq=1.0), product of:
             0.20938274 = queryWeight, product of:
               2.4272563 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.019229116 = queryNorm
             0.49066377 = fieldWeight in 3802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.109375 = fieldNorm(doc=3802)
       0.28 = coord(7/25)