Document (#34066)

Author

Baillie, M.
Azzopardi, L.
Ruthven, I.

Title

Evaluating epistemic uncertainty under incomplete assessments

Source

Information processing and management. 44(2008) no.2, S.811-837

Year

2008

Abstract

The thesis of this study is to propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new methodology aims to identify potential uncertainty during system comparison that may result from incompleteness. The adoption of this methodology is advantageous, because the detection of epistemic uncertainty - the amount of knowledge (or ignorance) we have about the estimate of a system's performance - during the evaluation process can guide and direct researchers when evaluating new systems over existing and future test collections. Across a series of experiments we demonstrate how this methodology can lead towards a finer grained analysis of systems. In particular, we show through experimentation how the current practice in Information Retrieval evaluation of using a measurement depth larger than the pooling depth increases uncertainty during system comparison.

Theme

Retrievalstudien

Similar documents (author)

1. Ruthven, I.; Baillie, M.; Azzopardi, L.; Bierig, R.; Nicol, E.; Sweeney, S.; Yaciki, M.: Contextual factors affecting the utility of surrogates within exploratory search (2008) 4.00

   4.0047026 = sum of:
     4.0047026 = sum of:
       0.92594117 = weight(author_txt:ruthven in 2042) [ClassicSimilarity], result of:
         0.92594117 = score(doc=2042,freq=1.0), product of:
           0.4499692 = queryWeight, product of:
             8.231152 = idf(docFreq=31, maxDocs=44218)
             0.054666616 = queryNorm
           2.057788 = fieldWeight in 2042, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.231152 = idf(docFreq=31, maxDocs=44218)
             0.25 = fieldNorm(doc=2042)
       1.5393808 = weight(author_txt:azzopardi in 2042) [ClassicSimilarity], result of:
         1.5393808 = score(doc=2042,freq=1.0), product of:
           0.63147753 = queryWeight, product of:
             1.1846431 = boost
             9.7509775 = idf(docFreq=6, maxDocs=44218)
             0.054666616 = queryNorm
           2.4377444 = fieldWeight in 2042, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.7509775 = idf(docFreq=6, maxDocs=44218)
             0.25 = fieldNorm(doc=2042)
       1.5393808 = weight(author_txt:baillie in 2042) [ClassicSimilarity], result of:
         1.5393808 = score(doc=2042,freq=1.0), product of:
           0.63147753 = queryWeight, product of:
             1.1846431 = boost
             9.7509775 = idf(docFreq=6, maxDocs=44218)
             0.054666616 = queryNorm
           2.4377444 = fieldWeight in 2042, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.7509775 = idf(docFreq=6, maxDocs=44218)
             0.25 = fieldNorm(doc=2042)
   

2. Ruthven, I.; Baillie, M.; Elsweiler, D.: ¬The relative effects of knowledge, interest and confidence in assessing relevance (2007) 2.47

   2.465322 = sum of:
     2.465322 = product of:
       3.697983 = sum of:
         1.3889117 = weight(author_txt:ruthven in 835) [ClassicSimilarity], result of:
           1.3889117 = score(doc=835,freq=1.0), product of:
             0.4499692 = queryWeight, product of:
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.054666616 = queryNorm
             3.0866818 = fieldWeight in 835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.375 = fieldNorm(doc=835)
         2.3090713 = weight(author_txt:baillie in 835) [ClassicSimilarity], result of:
           2.3090713 = score(doc=835,freq=1.0), product of:
             0.63147753 = queryWeight, product of:
               1.1846431 = boost
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.054666616 = queryNorm
             3.6566167 = fieldWeight in 835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.375 = fieldNorm(doc=835)
       0.6666667 = coord(2/3)
   

3. Ruthven, R.: Interactive information retrieval (2008) 0.77

   0.77161765 = sum of:
     0.77161765 = product of:
       2.314853 = sum of:
         2.314853 = weight(author_txt:ruthven in 2839) [ClassicSimilarity], result of:
           2.314853 = score(doc=2839,freq=1.0), product of:
             0.4499692 = queryWeight, product of:
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.054666616 = queryNorm
             5.1444697 = fieldWeight in 2839, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.625 = fieldNorm(doc=2839)
       0.33333334 = coord(1/3)
   

4. Ruthven, I.: Integrating approaches to relevance (2005) 0.77

   0.77161765 = sum of:
     0.77161765 = product of:
       2.314853 = sum of:
         2.314853 = weight(author_txt:ruthven in 638) [ClassicSimilarity], result of:
           2.314853 = score(doc=638,freq=1.0), product of:
             0.4499692 = queryWeight, product of:
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.054666616 = queryNorm
             5.1444697 = fieldWeight in 638, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.625 = fieldNorm(doc=638)
       0.33333334 = coord(1/3)
   

5. Ruthven, I.: Relevance behaviour in TREC (2014) 0.77

   0.77161765 = sum of:
     0.77161765 = product of:
       2.314853 = sum of:
         2.314853 = weight(author_txt:ruthven in 1785) [ClassicSimilarity], result of:
           2.314853 = score(doc=1785,freq=1.0), product of:
             0.4499692 = queryWeight, product of:
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.054666616 = queryNorm
             5.1444697 = fieldWeight in 1785, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.625 = fieldNorm(doc=1785)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Pal, S.; Mitra, M.; Kamps, J.: Evaluation effort, reliability and reusability in XML retrieval (2011) 0.20

   0.20169519 = sum of:
     0.20169519 = product of:
       0.6302975 = sum of:
         0.02259428 = weight(abstract_txt:retrieval in 4197) [ClassicSimilarity], result of:
           0.02259428 = score(doc=4197,freq=4.0), product of:
             0.05944403 = queryWeight, product of:
               1.003476 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017046256 = queryNorm
             0.38009337 = fieldWeight in 4197, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4197)
         0.18745203 = weight(abstract_txt:pooling in 4197) [ClassicSimilarity], result of:
           0.18745203 = score(doc=4197,freq=3.0), product of:
             0.21281663 = queryWeight, product of:
               1.3425815 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.017046256 = queryNorm
             0.8808148 = fieldWeight in 4197, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4197)
         0.010697402 = weight(abstract_txt:this in 4197) [ClassicSimilarity], result of:
           0.010697402 = score(doc=4197,freq=2.0), product of:
             0.05732113 = queryWeight, product of:
               1.3935587 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.017046256 = queryNorm
             0.1866223 = fieldWeight in 4197, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4197)
         0.036893893 = weight(abstract_txt:under in 4197) [ClassicSimilarity], result of:
           0.036893893 = score(doc=4197,freq=1.0), product of:
             0.13084753 = queryWeight, product of:
               1.4887977 = boost
               5.155857 = idf(docFreq=692, maxDocs=44218)
               0.017046256 = queryNorm
             0.28196093 = fieldWeight in 4197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.155857 = idf(docFreq=692, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4197)
         0.07611871 = weight(abstract_txt:evaluating in 4197) [ClassicSimilarity], result of:
           0.07611871 = score(doc=4197,freq=2.0), product of:
             0.16831139 = queryWeight, product of:
               1.6885334 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.017046256 = queryNorm
             0.45224932 = fieldWeight in 4197, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4197)
         0.03645364 = weight(abstract_txt:evaluation in 4197) [ClassicSimilarity], result of:
           0.03645364 = score(doc=4197,freq=1.0), product of:
             0.14858907 = queryWeight, product of:
               1.9430858 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.017046256 = queryNorm
             0.24533188 = fieldWeight in 4197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4197)
         0.096007705 = weight(abstract_txt:assessments in 4197) [ClassicSimilarity], result of:
           0.096007705 = score(doc=4197,freq=1.0), product of:
             0.2475521 = queryWeight, product of:
               2.0477936 = boost
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.017046256 = queryNorm
             0.3878283 = fieldWeight in 4197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4197)
         0.1640798 = weight(abstract_txt:incomplete in 4197) [ClassicSimilarity], result of:
           0.1640798 = score(doc=4197,freq=2.0), product of:
             0.28085962 = queryWeight, product of:
               2.1812103 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.017046256 = queryNorm
             0.58420575 = fieldWeight in 4197, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4197)
       0.32 = coord(8/25)
   

2. Golub, K.; Soergel, D.; Buchanan, G.; Tudhope, D.; Lykke, M.; Hiom, D.: ¬A framework for evaluating automatic indexing or classification in the context of retrieval (2016) 0.12

   0.12301702 = sum of:
     0.12301702 = product of:
       0.4393465 = sum of:
         0.018258935 = weight(abstract_txt:retrieval in 3311) [ClassicSimilarity], result of:
           0.018258935 = score(doc=3311,freq=2.0), product of:
             0.05944403 = queryWeight, product of:
               1.003476 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017046256 = queryNorm
             0.3071618 = fieldWeight in 3311, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.05267918 = weight(abstract_txt:laboratory in 3311) [ClassicSimilarity], result of:
           0.05267918 = score(doc=3311,freq=1.0), product of:
             0.120471396 = queryWeight, product of:
               1.010136 = boost
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.017046256 = queryNorm
             0.43727544 = fieldWeight in 3311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.008644806 = weight(abstract_txt:this in 3311) [ClassicSimilarity], result of:
           0.008644806 = score(doc=3311,freq=1.0), product of:
             0.05732113 = queryWeight, product of:
               1.3935587 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.017046256 = queryNorm
             0.1508136 = fieldWeight in 3311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.05485459 = weight(abstract_txt:comparison in 3311) [ClassicSimilarity], result of:
           0.05485459 = score(doc=3311,freq=1.0), product of:
             0.15593487 = queryWeight, product of:
               1.6252663 = boost
               5.628462 = idf(docFreq=431, maxDocs=44218)
               0.017046256 = queryNorm
             0.35177886 = fieldWeight in 3311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.628462 = idf(docFreq=431, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.123026416 = weight(abstract_txt:evaluating in 3311) [ClassicSimilarity], result of:
           0.123026416 = score(doc=3311,freq=4.0), product of:
             0.16831139 = queryWeight, product of:
               1.6885334 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.017046256 = queryNorm
             0.7309453 = fieldWeight in 3311, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.072159484 = weight(abstract_txt:evaluation in 3311) [ClassicSimilarity], result of:
           0.072159484 = score(doc=3311,freq=3.0), product of:
             0.14858907 = queryWeight, product of:
               1.9430858 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.017046256 = queryNorm
             0.48563117 = fieldWeight in 3311, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.10972309 = weight(abstract_txt:assessments in 3311) [ClassicSimilarity], result of:
           0.10972309 = score(doc=3311,freq=1.0), product of:
             0.2475521 = queryWeight, product of:
               2.0477936 = boost
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.017046256 = queryNorm
             0.44323233 = fieldWeight in 3311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
       0.28 = coord(7/25)
   

3. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.11

   0.11064703 = sum of:
     0.11064703 = product of:
       0.4610293 = sum of:
         0.07227938 = weight(abstract_txt:measurement in 3004) [ClassicSimilarity], result of:
           0.07227938 = score(doc=3004,freq=2.0), product of:
             0.11806583 = queryWeight, product of:
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.017046256 = queryNorm
             0.6121956 = fieldWeight in 3004, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.028869914 = weight(abstract_txt:retrieval in 3004) [ClassicSimilarity], result of:
           0.028869914 = score(doc=3004,freq=5.0), product of:
             0.05944403 = queryWeight, product of:
               1.003476 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017046256 = queryNorm
             0.4856655 = fieldWeight in 3004, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.008644806 = weight(abstract_txt:this in 3004) [ClassicSimilarity], result of:
           0.008644806 = score(doc=3004,freq=1.0), product of:
             0.05732113 = queryWeight, product of:
               1.3935587 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.017046256 = queryNorm
             0.1508136 = fieldWeight in 3004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.059629533 = weight(abstract_txt:under in 3004) [ClassicSimilarity], result of:
           0.059629533 = score(doc=3004,freq=2.0), product of:
             0.13084753 = queryWeight, product of:
               1.4887977 = boost
               5.155857 = idf(docFreq=692, maxDocs=44218)
               0.017046256 = queryNorm
             0.45571768 = fieldWeight in 3004, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.155857 = idf(docFreq=692, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.072159484 = weight(abstract_txt:evaluation in 3004) [ClassicSimilarity], result of:
           0.072159484 = score(doc=3004,freq=3.0), product of:
             0.14858907 = queryWeight, product of:
               1.9430858 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.017046256 = queryNorm
             0.48563117 = fieldWeight in 3004, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.21944618 = weight(abstract_txt:assessments in 3004) [ClassicSimilarity], result of:
           0.21944618 = score(doc=3004,freq=4.0), product of:
             0.2475521 = queryWeight, product of:
               2.0477936 = boost
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.017046256 = queryNorm
             0.88646466 = fieldWeight in 3004, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
       0.24 = coord(6/25)
   

4. Rubin, V.L.: Epistemic modality : from uncertainty to certainty in the context of information seeking as interactions with texts (2010) 0.11

   0.107327305 = sum of:
     0.107327305 = product of:
       0.6707957 = sum of:
         0.014973242 = weight(abstract_txt:this in 4241) [ClassicSimilarity], result of:
           0.014973242 = score(doc=4241,freq=3.0), product of:
             0.05732113 = queryWeight, product of:
               1.3935587 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.017046256 = queryNorm
             0.2612168 = fieldWeight in 4241, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=4241)
         0.0416613 = weight(abstract_txt:evaluation in 4241) [ClassicSimilarity], result of:
           0.0416613 = score(doc=4241,freq=1.0), product of:
             0.14858907 = queryWeight, product of:
               1.9430858 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.017046256 = queryNorm
             0.2803793 = fieldWeight in 4241, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=4241)
         0.2574377 = weight(abstract_txt:epistemic in 4241) [ClassicSimilarity], result of:
           0.2574377 = score(doc=4241,freq=3.0), product of:
             0.30306953 = queryWeight, product of:
               2.2658129 = boost
               7.84674 = idf(docFreq=46, maxDocs=44218)
               0.017046256 = queryNorm
             0.8494345 = fieldWeight in 4241, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.84674 = idf(docFreq=46, maxDocs=44218)
               0.0625 = fieldNorm(doc=4241)
         0.35672346 = weight(abstract_txt:uncertainty in 4241) [ClassicSimilarity], result of:
           0.35672346 = score(doc=4241,freq=3.0), product of:
             0.4745973 = queryWeight, product of:
               4.009872 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017046256 = queryNorm
             0.75163394 = fieldWeight in 4241, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0625 = fieldNorm(doc=4241)
       0.16 = coord(4/25)
   

5. Egghe, L.: Sampling and concentration values of incomplete bibliographies (2002) 0.10

   0.10132623 = sum of:
     0.10132623 = product of:
       0.6332889 = sum of:
         0.07666386 = weight(abstract_txt:measurement in 450) [ClassicSimilarity], result of:
           0.07666386 = score(doc=450,freq=1.0), product of:
             0.11806583 = queryWeight, product of:
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.017046256 = queryNorm
             0.6493315 = fieldWeight in 450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.09375 = fieldNorm(doc=450)
         0.2623782 = weight(abstract_txt:incompleteness in 450) [ClassicSimilarity], result of:
           0.2623782 = score(doc=450,freq=2.0), product of:
             0.21281663 = queryWeight, product of:
               1.3425815 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.017046256 = queryNorm
             1.2328838 = fieldWeight in 450, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.09375 = fieldNorm(doc=450)
         0.012967209 = weight(abstract_txt:this in 450) [ClassicSimilarity], result of:
           0.012967209 = score(doc=450,freq=1.0), product of:
             0.05732113 = queryWeight, product of:
               1.3935587 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.017046256 = queryNorm
             0.2262204 = fieldWeight in 450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.09375 = fieldNorm(doc=450)
         0.28127968 = weight(abstract_txt:incomplete in 450) [ClassicSimilarity], result of:
           0.28127968 = score(doc=450,freq=2.0), product of:
             0.28085962 = queryWeight, product of:
               2.1812103 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.017046256 = queryNorm
             1.0014956 = fieldWeight in 450, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.09375 = fieldNorm(doc=450)
       0.16 = coord(4/25)