Document (#27560)

Author
Egghe, L.
Title
¬A universal method of information retrieval evaluation : the "missing" link M and the universal IR surface
Source
Information processing and management. 40(2004) no.1, S.21-30
Year
2004
Abstract
The paper shows that the present evaluation methods in information retrieval (basically recall R and precision P and in some cases fallout F ) lack universal comparability in the sense that their values depend on the generality of the IR problem. A solution is given by using all "parts" of the database, including the non-relevant documents and also the not-retrieved documents. It turns out that the solution is given by introducing the measure M being the fraction of the not-retrieved documents that are relevant (hence the "miss" measure). We prove that - independent of the IR problem or of the IR action - the quadruple (P,R,F,M) belongs to a universal IR surface, being the same for all IR-activities. This universality is then exploited by defining a new measure for evaluation in IR allowing for unbiased comparisons of all IR results. We also show that only using one, two or even three measures from the set {P,R,F,M} necessary leads to evaluation measures that are non-universal and hence not capable of comparing different IR situations.

Similar documents (author)

  1. Egghe, L.: Little science, big science and beyond (1994) 4.71
    4.7136316 = sum of:
      4.7136316 = weight(author_txt:egghe in 6883) [ClassicSimilarity], result of:
        4.7136316 = fieldWeight in 6883, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.5418105 = idf(docFreq=60, maxDocs=42306)
          0.625 = fieldNorm(doc=6883)
    
  2. Egghe, L.: Expansion of the field of informetrics : the second special issue (2006) 4.71
    4.7136316 = sum of:
      4.7136316 = weight(author_txt:egghe in 7119) [ClassicSimilarity], result of:
        4.7136316 = fieldWeight in 7119, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.5418105 = idf(docFreq=60, maxDocs=42306)
          0.625 = fieldNorm(doc=7119)
    
  3. Egghe, L.: Expansion of the field of informetrics : origins and consequences (2005) 4.71
    4.7136316 = sum of:
      4.7136316 = weight(author_txt:egghe in 1979) [ClassicSimilarity], result of:
        4.7136316 = fieldWeight in 1979, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.5418105 = idf(docFreq=60, maxDocs=42306)
          0.625 = fieldNorm(doc=1979)
    
  4. Egghe, L.: ¬The amount of actions needed for shelving and reshelving (1996) 4.71
    4.7136316 = sum of:
      4.7136316 = weight(author_txt:egghe in 4463) [ClassicSimilarity], result of:
        4.7136316 = fieldWeight in 4463, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.5418105 = idf(docFreq=60, maxDocs=42306)
          0.625 = fieldNorm(doc=4463)
    
  5. Egghe, L.: Special features of the author - publication relationship and a new explanation of Lotka's law based on convolution theory (1994) 4.71
    4.7136316 = sum of:
      4.7136316 = weight(author_txt:egghe in 5137) [ClassicSimilarity], result of:
        4.7136316 = fieldWeight in 5137, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.5418105 = idf(docFreq=60, maxDocs=42306)
          0.625 = fieldNorm(doc=5137)
    

Similar documents (content)

  1. Egghe, L.: Existence theorem of the quadruple (P, R, F, M) : precision, recall, fallout and miss (2007) 0.31
    0.3145946 = sum of:
      0.3145946 = product of:
        0.98310816 = sum of:
          0.17890134 = weight(abstract_txt:miss in 4012) [ClassicSimilarity], result of:
            0.17890134 = score(doc=4012,freq=3.0), product of:
              0.1919829 = queryWeight, product of:
                1.162607 = boost
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.019183118 = queryNorm
              0.93186086 = fieldWeight in 4012, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.04798947 = weight(abstract_txt:given in 4012) [ClassicSimilarity], result of:
            0.04798947 = score(doc=4012,freq=2.0), product of:
              0.11516606 = queryWeight, product of:
                1.2734412 = boost
                4.7144 = idf(docFreq=1030, maxDocs=42306)
                0.019183118 = queryNorm
              0.416698 = fieldWeight in 4012, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.7144 = idf(docFreq=1030, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.2370993 = weight(abstract_txt:fallout in 4012) [ClassicSimilarity], result of:
            0.2370993 = score(doc=4012,freq=3.0), product of:
              0.2316365 = queryWeight, product of:
                1.2770419 = boost
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.019183118 = queryNorm
              1.0235835 = fieldWeight in 4012, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.052197237 = weight(abstract_txt:measures in 4012) [ClassicSimilarity], result of:
            0.052197237 = score(doc=4012,freq=1.0), product of:
              0.15346248 = queryWeight, product of:
                1.4700015 = boost
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.019183118 = queryNorm
              0.34013027 = fieldWeight in 4012, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.1437043 = weight(abstract_txt:surface in 4012) [ClassicSimilarity], result of:
            0.1437043 = score(doc=4012,freq=1.0), product of:
              0.3014512 = queryWeight, product of:
                2.0602748 = boost
                7.6273327 = idf(docFreq=55, maxDocs=42306)
                0.019183118 = queryNorm
              0.4767083 = fieldWeight in 4012, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.6273327 = idf(docFreq=55, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.03152947 = weight(abstract_txt:that in 4012) [ClassicSimilarity], result of:
            0.03152947 = score(doc=4012,freq=4.0), product of:
              0.10488604 = queryWeight, product of:
                2.2735763 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.019183118 = queryNorm
              0.30060694 = fieldWeight in 4012, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.058763105 = weight(abstract_txt:evaluation in 4012) [ClassicSimilarity], result of:
            0.058763105 = score(doc=4012,freq=1.0), product of:
              0.20924273 = queryWeight, product of:
                2.4274867 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.019183118 = queryNorm
              0.28083703 = fieldWeight in 4012, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
          0.23292394 = weight(abstract_txt:universal in 4012) [ClassicSimilarity], result of:
            0.23292394 = score(doc=4012,freq=2.0), product of:
              0.44807422 = queryWeight, product of:
                3.9715645 = boost
                5.881243 = idf(docFreq=320, maxDocs=42306)
                0.019183118 = queryNorm
              0.5198334 = fieldWeight in 4012, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.881243 = idf(docFreq=320, maxDocs=42306)
                0.0625 = fieldNorm(doc=4012)
        0.32 = coord(8/25)
    
  2. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.28
    0.2798441 = sum of:
      0.2798441 = product of:
        0.7773447 = sum of:
          0.13366683 = weight(abstract_txt:generality in 5515) [ClassicSimilarity], result of:
            0.13366683 = score(doc=5515,freq=1.0), product of:
              0.19647305 = queryWeight, product of:
                1.1761241 = boost
                8.708245 = idf(docFreq=18, maxDocs=42306)
                0.019183118 = queryNorm
              0.68033165 = fieldWeight in 5515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.708245 = idf(docFreq=18, maxDocs=42306)
                0.078125 = fieldNorm(doc=5515)
          0.041029677 = weight(abstract_txt:relevant in 5515) [ClassicSimilarity], result of:
            0.041029677 = score(doc=5515,freq=1.0), product of:
              0.11264086 = queryWeight, product of:
                1.2594028 = boost
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.019183118 = queryNorm
              0.36425218 = fieldWeight in 5515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.078125 = fieldNorm(doc=5515)
          0.042417098 = weight(abstract_txt:given in 5515) [ClassicSimilarity], result of:
            0.042417098 = score(doc=5515,freq=1.0), product of:
              0.11516606 = queryWeight, product of:
                1.2734412 = boost
                4.7144 = idf(docFreq=1030, maxDocs=42306)
                0.019183118 = queryNorm
              0.36831248 = fieldWeight in 5515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.7144 = idf(docFreq=1030, maxDocs=42306)
                0.078125 = fieldNorm(doc=5515)
          0.17111169 = weight(abstract_txt:fallout in 5515) [ClassicSimilarity], result of:
            0.17111169 = score(doc=5515,freq=1.0), product of:
              0.2316365 = queryWeight, product of:
                1.2770419 = boost
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.019183118 = queryNorm
              0.7387078 = fieldWeight in 5515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.078125 = fieldNorm(doc=5515)
          0.065246545 = weight(abstract_txt:measures in 5515) [ClassicSimilarity], result of:
            0.065246545 = score(doc=5515,freq=1.0), product of:
              0.15346248 = queryWeight, product of:
                1.4700015 = boost
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.019183118 = queryNorm
              0.42516285 = fieldWeight in 5515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.078125 = fieldNorm(doc=5515)
          0.07515337 = weight(abstract_txt:retrieved in 5515) [ClassicSimilarity], result of:
            0.07515337 = score(doc=5515,freq=1.0), product of:
              0.16862793 = queryWeight, product of:
                1.5409247 = boost
                5.704649 = idf(docFreq=382, maxDocs=42306)
                0.019183118 = queryNorm
              0.4456757 = fieldWeight in 5515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.704649 = idf(docFreq=382, maxDocs=42306)
                0.078125 = fieldNorm(doc=5515)
          0.059872396 = weight(abstract_txt:documents in 5515) [ClassicSimilarity], result of:
            0.059872396 = score(doc=5515,freq=2.0), product of:
              0.1316645 = queryWeight, product of:
                1.6676182 = boost
                4.115787 = idf(docFreq=1875, maxDocs=42306)
                0.019183118 = queryNorm
              0.45473453 = fieldWeight in 5515, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.115787 = idf(docFreq=1875, maxDocs=42306)
                0.078125 = fieldNorm(doc=5515)
          0.1691412 = weight(abstract_txt:measure in 5515) [ClassicSimilarity], result of:
            0.1691412 = score(doc=5515,freq=3.0), product of:
              0.22985476 = queryWeight, product of:
                2.2033782 = boost
                5.438076 = idf(docFreq=499, maxDocs=42306)
                0.019183118 = queryNorm
              0.7358612 = fieldWeight in 5515, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.438076 = idf(docFreq=499, maxDocs=42306)
                0.078125 = fieldNorm(doc=5515)
          0.01970592 = weight(abstract_txt:that in 5515) [ClassicSimilarity], result of:
            0.01970592 = score(doc=5515,freq=1.0), product of:
              0.10488604 = queryWeight, product of:
                2.2735763 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.019183118 = queryNorm
              0.18787934 = fieldWeight in 5515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.078125 = fieldNorm(doc=5515)
        0.36 = coord(9/25)
    
  3. Robertson, S.E.: ¬The parametric description of retrieval tests : Part II: Overall measures (1969) 0.19
    0.19321975 = sum of:
      0.19321975 = product of:
        0.8050823 = sum of:
          0.1032117 = weight(abstract_txt:turns in 4225) [ClassicSimilarity], result of:
            0.1032117 = score(doc=4225,freq=1.0), product of:
              0.16536358 = queryWeight, product of:
                1.0790004 = boost
                7.9891224 = idf(docFreq=38, maxDocs=42306)
                0.019183118 = queryNorm
              0.62415016 = fieldWeight in 4225, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.9891224 = idf(docFreq=38, maxDocs=42306)
                0.078125 = fieldNorm(doc=4225)
          0.13366683 = weight(abstract_txt:generality in 4225) [ClassicSimilarity], result of:
            0.13366683 = score(doc=4225,freq=1.0), product of:
              0.19647305 = queryWeight, product of:
                1.1761241 = boost
                8.708245 = idf(docFreq=18, maxDocs=42306)
                0.019183118 = queryNorm
              0.68033165 = fieldWeight in 4225, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.708245 = idf(docFreq=18, maxDocs=42306)
                0.078125 = fieldNorm(doc=4225)
          0.24198844 = weight(abstract_txt:fallout in 4225) [ClassicSimilarity], result of:
            0.24198844 = score(doc=4225,freq=2.0), product of:
              0.2316365 = queryWeight, product of:
                1.2770419 = boost
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.019183118 = queryNorm
              1.0446905 = fieldWeight in 4225, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.078125 = fieldNorm(doc=4225)
          0.113010325 = weight(abstract_txt:measures in 4225) [ClassicSimilarity], result of:
            0.113010325 = score(doc=4225,freq=3.0), product of:
              0.15346248 = queryWeight, product of:
                1.4700015 = boost
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.019183118 = queryNorm
              0.7364036 = fieldWeight in 4225, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.078125 = fieldNorm(doc=4225)
          0.1691412 = weight(abstract_txt:measure in 4225) [ClassicSimilarity], result of:
            0.1691412 = score(doc=4225,freq=3.0), product of:
              0.22985476 = queryWeight, product of:
                2.2033782 = boost
                5.438076 = idf(docFreq=499, maxDocs=42306)
                0.019183118 = queryNorm
              0.7358612 = fieldWeight in 4225, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.438076 = idf(docFreq=499, maxDocs=42306)
                0.078125 = fieldNorm(doc=4225)
          0.044063777 = weight(abstract_txt:that in 4225) [ClassicSimilarity], result of:
            0.044063777 = score(doc=4225,freq=5.0), product of:
              0.10488604 = queryWeight, product of:
                2.2735763 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.019183118 = queryNorm
              0.42011097 = fieldWeight in 4225, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.078125 = fieldNorm(doc=4225)
        0.24 = coord(6/25)
    
  4. Egghe, L.: ¬The measures precision, recall, fallout and miss as a function of the number of retrieved documents and their mutual interrelations (2008) 0.19
    0.19279723 = sum of:
      0.19279723 = product of:
        0.8033218 = sum of:
          0.25300473 = weight(abstract_txt:miss in 4068) [ClassicSimilarity], result of:
            0.25300473 = score(doc=4068,freq=6.0), product of:
              0.1919829 = queryWeight, product of:
                1.162607 = boost
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.019183118 = queryNorm
              1.3178504 = fieldWeight in 4068, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
          0.33530906 = weight(abstract_txt:fallout in 4068) [ClassicSimilarity], result of:
            0.33530906 = score(doc=4068,freq=6.0), product of:
              0.2316365 = queryWeight, product of:
                1.2770419 = boost
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.019183118 = queryNorm
              1.4475658 = fieldWeight in 4068, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                9.45546 = idf(docFreq=8, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
          0.07381804 = weight(abstract_txt:measures in 4068) [ClassicSimilarity], result of:
            0.07381804 = score(doc=4068,freq=2.0), product of:
              0.15346248 = queryWeight, product of:
                1.4700015 = boost
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.019183118 = queryNorm
              0.48101684 = fieldWeight in 4068, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
          0.08502633 = weight(abstract_txt:retrieved in 4068) [ClassicSimilarity], result of:
            0.08502633 = score(doc=4068,freq=2.0), product of:
              0.16862793 = queryWeight, product of:
                1.5409247 = boost
                5.704649 = idf(docFreq=382, maxDocs=42306)
                0.019183118 = queryNorm
              0.5042245 = fieldWeight in 4068, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.704649 = idf(docFreq=382, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
          0.03386894 = weight(abstract_txt:documents in 4068) [ClassicSimilarity], result of:
            0.03386894 = score(doc=4068,freq=1.0), product of:
              0.1316645 = queryWeight, product of:
                1.6676182 = boost
                4.115787 = idf(docFreq=1875, maxDocs=42306)
                0.019183118 = queryNorm
              0.2572367 = fieldWeight in 4068, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.115787 = idf(docFreq=1875, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
          0.022294704 = weight(abstract_txt:that in 4068) [ClassicSimilarity], result of:
            0.022294704 = score(doc=4068,freq=2.0), product of:
              0.10488604 = queryWeight, product of:
                2.2735763 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.019183118 = queryNorm
              0.2125612 = fieldWeight in 4068, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=4068)
        0.24 = coord(6/25)
    
  5. Fricke, M.: Measuring recall (1998) 0.18
    0.18171467 = sum of:
      0.18171467 = product of:
        0.648981 = sum of:
          0.057441548 = weight(abstract_txt:relevant in 4803) [ClassicSimilarity], result of:
            0.057441548 = score(doc=4803,freq=1.0), product of:
              0.11264086 = queryWeight, product of:
                1.2594028 = boost
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.019183118 = queryNorm
              0.509953 = fieldWeight in 4803, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.662428 = idf(docFreq=1085, maxDocs=42306)
                0.109375 = fieldNorm(doc=4803)
          0.105214715 = weight(abstract_txt:retrieved in 4803) [ClassicSimilarity], result of:
            0.105214715 = score(doc=4803,freq=1.0), product of:
              0.16862793 = queryWeight, product of:
                1.5409247 = boost
                5.704649 = idf(docFreq=382, maxDocs=42306)
                0.019183118 = queryNorm
              0.62394595 = fieldWeight in 4803, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.704649 = idf(docFreq=382, maxDocs=42306)
                0.109375 = fieldNorm(doc=4803)
          0.059270643 = weight(abstract_txt:documents in 4803) [ClassicSimilarity], result of:
            0.059270643 = score(doc=4803,freq=1.0), product of:
              0.1316645 = queryWeight, product of:
                1.6676182 = boost
                4.115787 = idf(docFreq=1875, maxDocs=42306)
                0.019183118 = queryNorm
              0.4501642 = fieldWeight in 4803, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.115787 = idf(docFreq=1875, maxDocs=42306)
                0.109375 = fieldNorm(doc=4803)
          0.15991515 = weight(abstract_txt:hence in 4803) [ClassicSimilarity], result of:
            0.15991515 = score(doc=4803,freq=1.0), product of:
              0.22291447 = queryWeight, product of:
                1.771682 = boost
                6.558934 = idf(docFreq=162, maxDocs=42306)
                0.019183118 = queryNorm
              0.71738344 = fieldWeight in 4803, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.558934 = idf(docFreq=162, maxDocs=42306)
                0.109375 = fieldNorm(doc=4803)
          0.13671522 = weight(abstract_txt:measure in 4803) [ClassicSimilarity], result of:
            0.13671522 = score(doc=4803,freq=1.0), product of:
              0.22985476 = queryWeight, product of:
                2.2033782 = boost
                5.438076 = idf(docFreq=499, maxDocs=42306)
                0.019183118 = queryNorm
              0.59478956 = fieldWeight in 4803, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.438076 = idf(docFreq=499, maxDocs=42306)
                0.109375 = fieldNorm(doc=4803)
          0.027588287 = weight(abstract_txt:that in 4803) [ClassicSimilarity], result of:
            0.027588287 = score(doc=4803,freq=1.0), product of:
              0.10488604 = queryWeight, product of:
                2.2735763 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.019183118 = queryNorm
              0.26303107 = fieldWeight in 4803, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.109375 = fieldNorm(doc=4803)
          0.10283544 = weight(abstract_txt:evaluation in 4803) [ClassicSimilarity], result of:
            0.10283544 = score(doc=4803,freq=1.0), product of:
              0.20924273 = queryWeight, product of:
                2.4274867 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.019183118 = queryNorm
              0.4914648 = fieldWeight in 4803, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.109375 = fieldNorm(doc=4803)
        0.28 = coord(7/25)