Document (#34067)

Author

Baillie, M.
Azzopardi, L.
Ruthven, I.

Title

Evaluating epistemic uncertainty under incomplete assessments

Source

Information processing and management. 44(2008) no.2, S.811-837

Year

2008

Abstract

The thesis of this study is to propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new methodology aims to identify potential uncertainty during system comparison that may result from incompleteness. The adoption of this methodology is advantageous, because the detection of epistemic uncertainty - the amount of knowledge (or ignorance) we have about the estimate of a system's performance - during the evaluation process can guide and direct researchers when evaluating new systems over existing and future test collections. Across a series of experiments we demonstrate how this methodology can lead towards a finer grained analysis of systems. In particular, we show through experimentation how the current practice in Information Retrieval evaluation of using a measurement depth larger than the pooling depth increases uncertainty during system comparison.

Theme

Retrievalstudien

Similar documents (author)

1. Ruthven, I.; Baillie, M.; Azzopardi, L.; Bierig, R.; Nicol, E.; Sweeney, S.; Yaciki, M.: Contextual factors affecting the utility of surrogates within exploratory search (2008) 4.01

   4.0087996 = sum of:
     4.0087996 = sum of:
       0.96046394 = weight(author_txt:ruthven in 4043) [ClassicSimilarity], result of:
         0.96046394 = score(doc=4043,freq=1.0), product of:
           0.4611692 = queryWeight, product of:
             8.330686 = idf(docFreq=27, maxDocs=42740)
             0.055357896 = queryNorm
           2.0826714 = fieldWeight in 4043, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.330686 = idf(docFreq=27, maxDocs=42740)
             0.25 = fieldNorm(doc=4043)
       1.5241678 = weight(author_txt:baillie in 4043) [ClassicSimilarity], result of:
         1.5241678 = score(doc=4043,freq=1.0), product of:
           0.6274245 = queryWeight, product of:
             1.1664082 = boost
             9.71698 = idf(docFreq=6, maxDocs=42740)
             0.055357896 = queryNorm
           2.429245 = fieldWeight in 4043, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.71698 = idf(docFreq=6, maxDocs=42740)
             0.25 = fieldNorm(doc=4043)
       1.5241678 = weight(author_txt:azzopardi in 4043) [ClassicSimilarity], result of:
         1.5241678 = score(doc=4043,freq=1.0), product of:
           0.6274245 = queryWeight, product of:
             1.1664082 = boost
             9.71698 = idf(docFreq=6, maxDocs=42740)
             0.055357896 = queryNorm
           2.429245 = fieldWeight in 4043, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.71698 = idf(docFreq=6, maxDocs=42740)
             0.25 = fieldNorm(doc=4043)
   

2. Ruthven, I.; Baillie, M.; Elsweiler, D.: ¬The relative effects of knowledge, interest and confidence in assessing relevance (2007) 2.48

   2.4846318 = sum of:
     2.4846318 = product of:
       3.7269475 = sum of:
         1.440696 = weight(author_txt:ruthven in 2836) [ClassicSimilarity], result of:
           1.440696 = score(doc=2836,freq=1.0), product of:
             0.4611692 = queryWeight, product of:
               8.330686 = idf(docFreq=27, maxDocs=42740)
               0.055357896 = queryNorm
             3.1240072 = fieldWeight in 2836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.330686 = idf(docFreq=27, maxDocs=42740)
               0.375 = fieldNorm(doc=2836)
         2.2862515 = weight(author_txt:baillie in 2836) [ClassicSimilarity], result of:
           2.2862515 = score(doc=2836,freq=1.0), product of:
             0.6274245 = queryWeight, product of:
               1.1664082 = boost
               9.71698 = idf(docFreq=6, maxDocs=42740)
               0.055357896 = queryNorm
             3.6438675 = fieldWeight in 2836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.71698 = idf(docFreq=6, maxDocs=42740)
               0.375 = fieldNorm(doc=2836)
       0.6666667 = coord(2/3)
   

3. Ruthven, R.: Interactive information retrieval (2008) 0.80

   0.8003866 = sum of:
     0.8003866 = product of:
       2.4011598 = sum of:
         2.4011598 = weight(author_txt:ruthven in 2839) [ClassicSimilarity], result of:
           2.4011598 = score(doc=2839,freq=1.0), product of:
             0.4611692 = queryWeight, product of:
               8.330686 = idf(docFreq=27, maxDocs=42740)
               0.055357896 = queryNorm
             5.2066784 = fieldWeight in 2839, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.330686 = idf(docFreq=27, maxDocs=42740)
               0.625 = fieldNorm(doc=2839)
       0.33333334 = coord(1/3)
   

4. Ruthven, I.: Integrating approaches to relevance (2005) 0.80

   0.8003866 = sum of:
     0.8003866 = product of:
       2.4011598 = sum of:
         2.4011598 = weight(author_txt:ruthven in 1764) [ClassicSimilarity], result of:
           2.4011598 = score(doc=1764,freq=1.0), product of:
             0.4611692 = queryWeight, product of:
               8.330686 = idf(docFreq=27, maxDocs=42740)
               0.055357896 = queryNorm
             5.2066784 = fieldWeight in 1764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.330686 = idf(docFreq=27, maxDocs=42740)
               0.625 = fieldNorm(doc=1764)
       0.33333334 = coord(1/3)
   

5. Ruthven, I.: Relevance behaviour in TREC (2014) 0.80

   0.8003866 = sum of:
     0.8003866 = product of:
       2.4011598 = sum of:
         2.4011598 = weight(author_txt:ruthven in 3786) [ClassicSimilarity], result of:
           2.4011598 = score(doc=3786,freq=1.0), product of:
             0.4611692 = queryWeight, product of:
               8.330686 = idf(docFreq=27, maxDocs=42740)
               0.055357896 = queryNorm
             5.2066784 = fieldWeight in 3786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.330686 = idf(docFreq=27, maxDocs=42740)
               0.625 = fieldNorm(doc=3786)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Pal, S.; Mitra, M.; Kamps, J.: Evaluation effort, reliability and reusability in XML retrieval (2011) 0.20

   0.19969743 = sum of:
     0.19969743 = product of:
       0.6240545 = sum of:
         0.022146488 = weight(abstract_txt:retrieval in 1198) [ClassicSimilarity], result of:
           0.022146488 = score(doc=1198,freq=4.0), product of:
             0.058439765 = queryWeight, product of:
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0168667 = queryNorm
             0.37896264 = fieldWeight in 1198, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1198)
         0.18336067 = weight(abstract_txt:pooling in 1198) [ClassicSimilarity], result of:
           0.18336067 = score(doc=1198,freq=3.0), product of:
             0.2089355 = queryWeight, product of:
               1.3370168 = boost
               9.264996 = idf(docFreq=10, maxDocs=42740)
               0.0168667 = queryNorm
             0.8775946 = fieldWeight in 1198, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.264996 = idf(docFreq=10, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1198)
         0.0109787565 = weight(abstract_txt:this in 1198) [ClassicSimilarity], result of:
           0.0109787565 = score(doc=1198,freq=2.0), product of:
             0.058106847 = queryWeight, product of:
               1.4101796 = boost
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.0168667 = queryNorm
             0.18894084 = fieldWeight in 1198, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1198)
         0.037129313 = weight(abstract_txt:under in 1198) [ClassicSimilarity], result of:
           0.037129313 = score(doc=1198,freq=1.0), product of:
             0.13091914 = queryWeight, product of:
               1.4967433 = boost
               5.1859183 = idf(docFreq=649, maxDocs=42740)
               0.0168667 = queryNorm
             0.28360492 = fieldWeight in 1198, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1859183 = idf(docFreq=649, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1198)
         0.07555784 = weight(abstract_txt:evaluating in 1198) [ClassicSimilarity], result of:
           0.07555784 = score(doc=1198,freq=2.0), product of:
             0.16686615 = queryWeight, product of:
               1.6897789 = boost
               5.8547482 = idf(docFreq=332, maxDocs=42740)
               0.0168667 = queryNorm
             0.45280507 = fieldWeight in 1198, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8547482 = idf(docFreq=332, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1198)
         0.036213793 = weight(abstract_txt:evaluation in 1198) [ClassicSimilarity], result of:
           0.036213793 = score(doc=1198,freq=1.0), product of:
             0.14739123 = queryWeight, product of:
               1.9450341 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0168667 = queryNorm
             0.24569842 = fieldWeight in 1198, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1198)
         0.09650763 = weight(abstract_txt:assessments in 1198) [ClassicSimilarity], result of:
           0.09650763 = score(doc=1198,freq=1.0), product of:
             0.24749495 = queryWeight, product of:
               2.0579221 = boost
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.0168667 = queryNorm
             0.3899378 = fieldWeight in 1198, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1198)
         0.16216 = weight(abstract_txt:incomplete in 1198) [ClassicSimilarity], result of:
           0.16216 = score(doc=1198,freq=2.0), product of:
             0.2776372 = queryWeight, product of:
               2.179639 = boost
               7.5520167 = idf(docFreq=60, maxDocs=42740)
               0.0168667 = queryNorm
             0.5840715 = fieldWeight in 1198, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5520167 = idf(docFreq=60, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1198)
       0.32 = coord(8/25)
   

2. Golub, K.; Soergel, D.; Buchanan, G.; Tudhope, D.; Lykke, M.; Hiom, D.: ¬A framework for evaluating automatic indexing or classification in the context of retrieval (2016) 0.12

   0.12272914 = sum of:
     0.12272914 = product of:
       0.43831834 = sum of:
         0.017897066 = weight(abstract_txt:retrieval in 5312) [ClassicSimilarity], result of:
           0.017897066 = score(doc=5312,freq=2.0), product of:
             0.058439765 = queryWeight, product of:
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0168667 = queryNorm
             0.30624807 = fieldWeight in 5312, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.052811317 = weight(abstract_txt:laboratory in 5312) [ClassicSimilarity], result of:
           0.052811317 = score(doc=5312,freq=1.0), product of:
             0.120227896 = queryWeight, product of:
               1.0142229 = boost
               7.0281615 = idf(docFreq=102, maxDocs=42740)
               0.0168667 = queryNorm
             0.4392601 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0281615 = idf(docFreq=102, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.008872175 = weight(abstract_txt:this in 5312) [ClassicSimilarity], result of:
           0.008872175 = score(doc=5312,freq=1.0), product of:
             0.058106847 = queryWeight, product of:
               1.4101796 = boost
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.0168667 = queryNorm
             0.15268725 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.054638702 = weight(abstract_txt:comparison in 5312) [ClassicSimilarity], result of:
           0.054638702 = score(doc=5312,freq=1.0), product of:
             0.15495211 = queryWeight, product of:
               1.6283379 = boost
               5.641867 = idf(docFreq=411, maxDocs=42740)
               0.0168667 = queryNorm
             0.3526167 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.641867 = idf(docFreq=411, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.12211992 = weight(abstract_txt:evaluating in 5312) [ClassicSimilarity], result of:
           0.12211992 = score(doc=5312,freq=4.0), product of:
             0.16686615 = queryWeight, product of:
               1.6897789 = boost
               5.8547482 = idf(docFreq=332, maxDocs=42740)
               0.0168667 = queryNorm
             0.73184353 = fieldWeight in 5312, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.8547482 = idf(docFreq=332, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.07168472 = weight(abstract_txt:evaluation in 5312) [ClassicSimilarity], result of:
           0.07168472 = score(doc=5312,freq=3.0), product of:
             0.14739123 = queryWeight, product of:
               1.9450341 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0168667 = queryNorm
             0.48635674 = fieldWeight in 5312, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.11029444 = weight(abstract_txt:assessments in 5312) [ClassicSimilarity], result of:
           0.11029444 = score(doc=5312,freq=1.0), product of:
             0.24749495 = queryWeight, product of:
               2.0579221 = boost
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.0168667 = queryNorm
             0.4456432 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
       0.28 = coord(7/25)
   

3. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.11

   0.11103335 = sum of:
     0.11103335 = product of:
       0.46263897 = sum of:
         0.028297745 = weight(abstract_txt:retrieval in 3073) [ClassicSimilarity], result of:
           0.028297745 = score(doc=3073,freq=5.0), product of:
             0.058439765 = queryWeight, product of:
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0168667 = queryNorm
             0.4842207 = fieldWeight in 3073, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.07318545 = weight(abstract_txt:measurement in 3073) [ClassicSimilarity], result of:
           0.07318545 = score(doc=3073,freq=2.0), product of:
             0.11861158 = queryWeight, product of:
               1.0073823 = boost
               6.980759 = idf(docFreq=107, maxDocs=42740)
               0.0168667 = queryNorm
             0.61701775 = fieldWeight in 3073, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.980759 = idf(docFreq=107, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.008872175 = weight(abstract_txt:this in 3073) [ClassicSimilarity], result of:
           0.008872175 = score(doc=3073,freq=1.0), product of:
             0.058106847 = queryWeight, product of:
               1.4101796 = boost
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.0168667 = queryNorm
             0.15268725 = fieldWeight in 3073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.060010027 = weight(abstract_txt:under in 3073) [ClassicSimilarity], result of:
           0.060010027 = score(doc=3073,freq=2.0), product of:
             0.13091914 = queryWeight, product of:
               1.4967433 = boost
               5.1859183 = idf(docFreq=649, maxDocs=42740)
               0.0168667 = queryNorm
             0.45837474 = fieldWeight in 3073, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1859183 = idf(docFreq=649, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.07168472 = weight(abstract_txt:evaluation in 3073) [ClassicSimilarity], result of:
           0.07168472 = score(doc=3073,freq=3.0), product of:
             0.14739123 = queryWeight, product of:
               1.9450341 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0168667 = queryNorm
             0.48635674 = fieldWeight in 3073, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.22058888 = weight(abstract_txt:assessments in 3073) [ClassicSimilarity], result of:
           0.22058888 = score(doc=3073,freq=4.0), product of:
             0.24749495 = queryWeight, product of:
               2.0579221 = boost
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.0168667 = queryNorm
             0.8912864 = fieldWeight in 3073, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
       0.24 = coord(6/25)
   

4. Rubin, V.L.: Epistemic modality : from uncertainty to certainty in the context of information seeking as interactions with texts (2010) 0.11

   0.10965885 = sum of:
     0.10965885 = product of:
       0.6853678 = sum of:
         0.015367058 = weight(abstract_txt:this in 1242) [ClassicSimilarity], result of:
           0.015367058 = score(doc=1242,freq=3.0), product of:
             0.058106847 = queryWeight, product of:
               1.4101796 = boost
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.0168667 = queryNorm
             0.26446208 = fieldWeight in 1242, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.0625 = fieldNorm(doc=1242)
         0.041387193 = weight(abstract_txt:evaluation in 1242) [ClassicSimilarity], result of:
           0.041387193 = score(doc=1242,freq=1.0), product of:
             0.14739123 = queryWeight, product of:
               1.9450341 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0168667 = queryNorm
             0.2807982 = fieldWeight in 1242, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0625 = fieldNorm(doc=1242)
         0.26719168 = weight(abstract_txt:epistemic in 1242) [ClassicSimilarity], result of:
           0.26719168 = score(doc=1242,freq=3.0), product of:
             0.30953193 = queryWeight, product of:
               2.3014338 = boost
               7.974011 = idf(docFreq=39, maxDocs=42740)
               0.0168667 = queryNorm
             0.863212 = fieldWeight in 1242, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.974011 = idf(docFreq=39, maxDocs=42740)
               0.0625 = fieldNorm(doc=1242)
         0.3614219 = weight(abstract_txt:uncertainty in 1242) [ClassicSimilarity], result of:
           0.3614219 = score(doc=1242,freq=3.0), product of:
             0.4769906 = queryWeight, product of:
               4.040319 = boost
               6.9994516 = idf(docFreq=105, maxDocs=42740)
               0.0168667 = queryNorm
             0.75771284 = fieldWeight in 1242, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.9994516 = idf(docFreq=105, maxDocs=42740)
               0.0625 = fieldNorm(doc=1242)
       0.16 = coord(4/25)
   

5. Egghe, L.: Sampling and concentration values of incomplete bibliographies (2002) 0.10

   0.10137208 = sum of:
     0.10137208 = product of:
       0.6335755 = sum of:
         0.077624895 = weight(abstract_txt:measurement in 1451) [ClassicSimilarity], result of:
           0.077624895 = score(doc=1451,freq=1.0), product of:
             0.11861158 = queryWeight, product of:
               1.0073823 = boost
               6.980759 = idf(docFreq=107, maxDocs=42740)
               0.0168667 = queryNorm
             0.6544462 = fieldWeight in 1451, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.980759 = idf(docFreq=107, maxDocs=42740)
               0.09375 = fieldNorm(doc=1451)
         0.26465383 = weight(abstract_txt:incompleteness in 1451) [ClassicSimilarity], result of:
           0.26465383 = score(doc=1451,freq=2.0), product of:
             0.21325631 = queryWeight, product of:
               1.350771 = boost
               9.360306 = idf(docFreq=9, maxDocs=42740)
               0.0168667 = queryNorm
             1.2410129 = fieldWeight in 1451, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.360306 = idf(docFreq=9, maxDocs=42740)
               0.09375 = fieldNorm(doc=1451)
         0.013308262 = weight(abstract_txt:this in 1451) [ClassicSimilarity], result of:
           0.013308262 = score(doc=1451,freq=1.0), product of:
             0.058106847 = queryWeight, product of:
               1.4101796 = boost
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.0168667 = queryNorm
             0.22903088 = fieldWeight in 1451, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.442996 = idf(docFreq=10095, maxDocs=42740)
               0.09375 = fieldNorm(doc=1451)
         0.27798852 = weight(abstract_txt:incomplete in 1451) [ClassicSimilarity], result of:
           0.27798852 = score(doc=1451,freq=2.0), product of:
             0.2776372 = queryWeight, product of:
               2.179639 = boost
               7.5520167 = idf(docFreq=60, maxDocs=42740)
               0.0168667 = queryNorm
             1.0012654 = fieldWeight in 1451, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5520167 = idf(docFreq=60, maxDocs=42740)
               0.09375 = fieldNorm(doc=1451)
       0.16 = coord(4/25)