Document (#34087)

Author
Bodoff, D.
Title
Test theory for evaluating reliability of IR test collections
Source
Information processing and management. 44(2008) no.3, S.1117-1145
Year
2008
Abstract
Classical test theory offers theoretically derived reliability measures such as Cronbach's alpha, which can be applied to measure the reliability of a set of Information Retrieval test results. The theory also supports item analysis, which identifies queries that are hampering the test's reliability, and which may be candidates for refinement or removal. A generalization of Classical Test Theory, called Generalizability Theory, provides an even richer set of tools. It allows us to estimate the reliability of a test as a function of the number of queries, assessors (relevance judges), and other aspects of the test's design. One novel aspect of Generalizability Theory is that it allows this estimation of reliability even before the test collection exists, based purely on the numbers of queries and assessors that it will contain. These calculations can help test designers in advance, by allowing them to compare the reliability of test designs with various numbers of queries and relevance assessors, and to spend their limited budgets on a design that maximizes reliability. Empirical analysis shows that in cases for which our data is representative, having more queries is more helpful for reliability than having more assessors. It also suggests that reliability may be improved with a per-document performance measure, as opposed to a document-set based performance measure, where appropriate. The theory also clarifies the implicit debate in IR literature regarding the nature of error in relevance judgments.

Similar documents (author)

  1. Bodoff, D.: ¬A re-unification of two competing models for document retrieval (1999) 5.69
    5.6862135 = sum of:
      5.6862135 = weight(author_txt:bodoff in 3952) [ClassicSimilarity], result of:
        5.6862135 = fieldWeight in 3952, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.097941 = idf(docFreq=12, maxDocs=42740)
          0.625 = fieldNorm(doc=3952)
    
  2. Bodoff, D.: Relevance for browsing, relevance for searching (2006) 5.69
    5.6862135 = sum of:
      5.6862135 = weight(author_txt:bodoff in 910) [ClassicSimilarity], result of:
        5.6862135 = fieldWeight in 910, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.097941 = idf(docFreq=12, maxDocs=42740)
          0.625 = fieldNorm(doc=910)
    
  3. Bodoff, D.: Emergence of terminological conventions as a searcher-indexer coordination game (2009) 5.69
    5.6862135 = sum of:
      5.6862135 = weight(author_txt:bodoff in 300) [ClassicSimilarity], result of:
        5.6862135 = fieldWeight in 300, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.097941 = idf(docFreq=12, maxDocs=42740)
          0.625 = fieldNorm(doc=300)
    
  4. Bodoff, D.; Kambil, A.: Partial coordination : I. The best of pre-coordination and post-coordination (1998) 4.55
    4.5489707 = sum of:
      4.5489707 = weight(author_txt:bodoff in 3323) [ClassicSimilarity], result of:
        4.5489707 = fieldWeight in 3323, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.097941 = idf(docFreq=12, maxDocs=42740)
          0.5 = fieldNorm(doc=3323)
    
  5. Bodoff, D.; Kambil, A.: Partial coordination : II. A preliminary evaluation and failure analysis (1998) 4.55
    4.5489707 = sum of:
      4.5489707 = weight(author_txt:bodoff in 3324) [ClassicSimilarity], result of:
        4.5489707 = fieldWeight in 3324, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.097941 = idf(docFreq=12, maxDocs=42740)
          0.5 = fieldNorm(doc=3324)
    

Similar documents (content)

  1. Bodoff, D.; Wu, B.; Wong, K.Y.M.: Relevance data for language models using maximum likelihood (2003) 0.22
    0.22016829 = sum of:
      0.22016829 = product of:
        0.7863153 = sum of:
          0.028980538 = weight(abstract_txt:document in 2823) [ClassicSimilarity], result of:
            0.028980538 = score(doc=2823,freq=2.0), product of:
              0.0510621 = queryWeight, product of:
                1.059678 = boost
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.011256497 = queryNorm
              0.5675548 = fieldWeight in 2823, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.09375 = fieldNorm(doc=2823)
          0.026141994 = weight(abstract_txt:performance in 2823) [ClassicSimilarity], result of:
            0.026141994 = score(doc=2823,freq=1.0), product of:
              0.060061593 = queryWeight, product of:
                1.1492724 = boost
                4.6426997 = idf(docFreq=1118, maxDocs=42740)
                0.011256497 = queryNorm
              0.43525308 = fieldWeight in 2823, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6426997 = idf(docFreq=1118, maxDocs=42740)
                0.09375 = fieldNorm(doc=2823)
          0.015833456 = weight(abstract_txt:also in 2823) [ClassicSimilarity], result of:
            0.015833456 = score(doc=2823,freq=1.0), product of:
              0.04921739 = queryWeight, product of:
                1.2741762 = boost
                3.4315145 = idf(docFreq=3756, maxDocs=42740)
                0.011256497 = queryNorm
              0.32170448 = fieldWeight in 2823, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4315145 = idf(docFreq=3756, maxDocs=42740)
                0.09375 = fieldNorm(doc=2823)
          0.066573255 = weight(abstract_txt:relevance in 2823) [ClassicSimilarity], result of:
            0.066573255 = score(doc=2823,freq=2.0), product of:
              0.10176334 = queryWeight, product of:
                1.8321705 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.011256497 = queryNorm
              0.65419686 = fieldWeight in 2823, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.09375 = fieldNorm(doc=2823)
          0.08608317 = weight(abstract_txt:queries in 2823) [ClassicSimilarity], result of:
            0.08608317 = score(doc=2823,freq=1.0), product of:
              0.18042493 = queryWeight, product of:
                3.149509 = boost
                5.0892105 = idf(docFreq=715, maxDocs=42740)
                0.011256497 = queryNorm
              0.4771135 = fieldWeight in 2823, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0892105 = idf(docFreq=715, maxDocs=42740)
                0.09375 = fieldNorm(doc=2823)
          0.34623823 = weight(abstract_txt:assessors in 2823) [ClassicSimilarity], result of:
            0.34623823 = score(doc=2823,freq=1.0), product of:
              0.42360824 = queryWeight, product of:
                4.316401 = boost
                8.7184515 = idf(docFreq=18, maxDocs=42740)
                0.011256497 = queryNorm
              0.8173548 = fieldWeight in 2823, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.7184515 = idf(docFreq=18, maxDocs=42740)
                0.09375 = fieldNorm(doc=2823)
          0.21646464 = weight(abstract_txt:test in 2823) [ClassicSimilarity], result of:
            0.21646464 = score(doc=2823,freq=2.0), product of:
              0.3221241 = queryWeight, product of:
                5.6460204 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.011256497 = queryNorm
              0.67199147 = fieldWeight in 2823, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.09375 = fieldNorm(doc=2823)
        0.28 = coord(7/25)
    
  2. Verberne, S.; Heijden, M. van der; Hinne, M.; Sappelli, M.; Koldijk, S.; Hoenkamp, E.; Kraaij, W.: Reliability and validity of query intent assessments (2013) 0.22
    0.21646243 = sum of:
      0.21646243 = product of:
        0.9019268 = sum of:
          0.012426487 = weight(abstract_txt:that in 3105) [ClassicSimilarity], result of:
            0.012426487 = score(doc=3105,freq=3.0), product of:
              0.047936257 = queryWeight, product of:
                1.7783501 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.011256497 = queryNorm
              0.2592294 = fieldWeight in 3105, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.041971076 = weight(abstract_txt:measure in 3105) [ClassicSimilarity], result of:
            0.041971076 = score(doc=3105,freq=1.0), product of:
              0.12352714 = queryWeight, product of:
                2.0186052 = boost
                5.4363537 = idf(docFreq=505, maxDocs=42740)
                0.011256497 = queryNorm
              0.3397721 = fieldWeight in 3105, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4363537 = idf(docFreq=505, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.05738878 = weight(abstract_txt:queries in 3105) [ClassicSimilarity], result of:
            0.05738878 = score(doc=3105,freq=1.0), product of:
              0.18042493 = queryWeight, product of:
                3.149509 = boost
                5.0892105 = idf(docFreq=715, maxDocs=42740)
                0.011256497 = queryNorm
              0.31807566 = fieldWeight in 3105, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0892105 = idf(docFreq=715, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.39980146 = weight(abstract_txt:assessors in 3105) [ClassicSimilarity], result of:
            0.39980146 = score(doc=3105,freq=3.0), product of:
              0.42360824 = queryWeight, product of:
                4.316401 = boost
                8.7184515 = idf(docFreq=18, maxDocs=42740)
                0.011256497 = queryNorm
              0.94380003 = fieldWeight in 3105, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.7184515 = idf(docFreq=18, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.102042414 = weight(abstract_txt:test in 3105) [ClassicSimilarity], result of:
            0.102042414 = score(doc=3105,freq=1.0), product of:
              0.3221241 = queryWeight, product of:
                5.6460204 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.011256497 = queryNorm
              0.31677982 = fieldWeight in 3105, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
          0.28829658 = weight(abstract_txt:reliability in 3105) [ClassicSimilarity], result of:
            0.28829658 = score(doc=3105,freq=1.0), product of:
              0.66677845 = queryWeight, product of:
                8.562495 = boost
                6.9179583 = idf(docFreq=114, maxDocs=42740)
                0.011256497 = queryNorm
              0.4323724 = fieldWeight in 3105, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9179583 = idf(docFreq=114, maxDocs=42740)
                0.0625 = fieldNorm(doc=3105)
        0.24 = coord(6/25)
    
  3. Xu, Y.: Relevance judgment in epistemic and hedonic information searches (2007) 0.18
    0.17698045 = sum of:
      0.17698045 = product of:
        0.7374186 = sum of:
          0.017076945 = weight(abstract_txt:document in 2065) [ClassicSimilarity], result of:
            0.017076945 = score(doc=2065,freq=1.0), product of:
              0.0510621 = queryWeight, product of:
                1.059678 = boost
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.011256497 = queryNorm
              0.33443484 = fieldWeight in 2065, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.078125 = fieldNorm(doc=2065)
          0.010990844 = weight(abstract_txt:which in 2065) [ClassicSimilarity], result of:
            0.010990844 = score(doc=2065,freq=1.0), product of:
              0.04795743 = queryWeight, product of:
                1.4523374 = boost
                2.9334934 = idf(docFreq=6181, maxDocs=42740)
                0.011256497 = queryNorm
              0.22917917 = fieldWeight in 2065, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.9334934 = idf(docFreq=6181, maxDocs=42740)
                0.078125 = fieldNorm(doc=2065)
          0.008968045 = weight(abstract_txt:that in 2065) [ClassicSimilarity], result of:
            0.008968045 = score(doc=2065,freq=1.0), product of:
              0.047936257 = queryWeight, product of:
                1.7783501 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.011256497 = queryNorm
              0.18708271 = fieldWeight in 2065, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.078125 = fieldNorm(doc=2065)
          0.11768601 = weight(abstract_txt:relevance in 2065) [ClassicSimilarity], result of:
            0.11768601 = score(doc=2065,freq=9.0), product of:
              0.10176334 = queryWeight, product of:
                1.8321705 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.011256497 = queryNorm
              1.1564677 = fieldWeight in 2065, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.078125 = fieldNorm(doc=2065)
          0.07305559 = weight(abstract_txt:theory in 2065) [ClassicSimilarity], result of:
            0.07305559 = score(doc=2065,freq=1.0), product of:
              0.20430714 = queryWeight, product of:
                3.965522 = boost
                4.576989 = idf(docFreq=1194, maxDocs=42740)
                0.011256497 = queryNorm
              0.35757726 = fieldWeight in 2065, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.576989 = idf(docFreq=1194, maxDocs=42740)
                0.078125 = fieldNorm(doc=2065)
          0.5096412 = weight(abstract_txt:reliability in 2065) [ClassicSimilarity], result of:
            0.5096412 = score(doc=2065,freq=2.0), product of:
              0.66677845 = queryWeight, product of:
                8.562495 = boost
                6.9179583 = idf(docFreq=114, maxDocs=42740)
                0.011256497 = queryNorm
              0.7643336 = fieldWeight in 2065, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.9179583 = idf(docFreq=114, maxDocs=42740)
                0.078125 = fieldNorm(doc=2065)
        0.24 = coord(6/25)
    
  4. Bodoff, D.; Wong, S.P.-S.: Documents and queries as random variables : history and implications (2006) 0.17
    0.16874741 = sum of:
      0.16874741 = product of:
        0.4687428 = sum of:
          0.017076945 = weight(abstract_txt:document in 1319) [ClassicSimilarity], result of:
            0.017076945 = score(doc=1319,freq=1.0), product of:
              0.0510621 = queryWeight, product of:
                1.059678 = boost
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.011256497 = queryNorm
              0.33443484 = fieldWeight in 1319, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.078125 = fieldNorm(doc=1319)
          0.029274954 = weight(abstract_txt:even in 1319) [ClassicSimilarity], result of:
            0.029274954 = score(doc=1319,freq=1.0), product of:
              0.07314018 = queryWeight, product of:
                1.2682433 = boost
                5.1233044 = idf(docFreq=691, maxDocs=42740)
                0.011256497 = queryNorm
              0.40025815 = fieldWeight in 1319, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1233044 = idf(docFreq=691, maxDocs=42740)
                0.078125 = fieldNorm(doc=1319)
          0.013127312 = weight(abstract_txt:more in 1319) [ClassicSimilarity], result of:
            0.013127312 = score(doc=1319,freq=1.0), product of:
              0.049050055 = queryWeight, product of:
                1.2720083 = boost
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.011256497 = queryNorm
              0.26763093 = fieldWeight in 1319, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.078125 = fieldNorm(doc=1319)
          0.010990844 = weight(abstract_txt:which in 1319) [ClassicSimilarity], result of:
            0.010990844 = score(doc=1319,freq=1.0), product of:
              0.04795743 = queryWeight, product of:
                1.4523374 = boost
                2.9334934 = idf(docFreq=6181, maxDocs=42740)
                0.011256497 = queryNorm
              0.22917917 = fieldWeight in 1319, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.9334934 = idf(docFreq=6181, maxDocs=42740)
                0.078125 = fieldNorm(doc=1319)
          0.01793609 = weight(abstract_txt:that in 1319) [ClassicSimilarity], result of:
            0.01793609 = score(doc=1319,freq=4.0), product of:
              0.047936257 = queryWeight, product of:
                1.7783501 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.011256497 = queryNorm
              0.37416542 = fieldWeight in 1319, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.078125 = fieldNorm(doc=1319)
          0.055477712 = weight(abstract_txt:relevance in 1319) [ClassicSimilarity], result of:
            0.055477712 = score(doc=1319,freq=2.0), product of:
              0.10176334 = queryWeight, product of:
                1.8321705 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.011256497 = queryNorm
              0.54516405 = fieldWeight in 1319, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.078125 = fieldNorm(doc=1319)
          0.12425034 = weight(abstract_txt:queries in 1319) [ClassicSimilarity], result of:
            0.12425034 = score(doc=1319,freq=3.0), product of:
              0.18042493 = queryWeight, product of:
                3.149509 = boost
                5.0892105 = idf(docFreq=715, maxDocs=42740)
                0.011256497 = queryNorm
              0.68865395 = fieldWeight in 1319, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.0892105 = idf(docFreq=715, maxDocs=42740)
                0.078125 = fieldNorm(doc=1319)
          0.07305559 = weight(abstract_txt:theory in 1319) [ClassicSimilarity], result of:
            0.07305559 = score(doc=1319,freq=1.0), product of:
              0.20430714 = queryWeight, product of:
                3.965522 = boost
                4.576989 = idf(docFreq=1194, maxDocs=42740)
                0.011256497 = queryNorm
              0.35757726 = fieldWeight in 1319, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.576989 = idf(docFreq=1194, maxDocs=42740)
                0.078125 = fieldNorm(doc=1319)
          0.12755302 = weight(abstract_txt:test in 1319) [ClassicSimilarity], result of:
            0.12755302 = score(doc=1319,freq=1.0), product of:
              0.3221241 = queryWeight, product of:
                5.6460204 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.011256497 = queryNorm
              0.39597479 = fieldWeight in 1319, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.078125 = fieldNorm(doc=1319)
        0.36 = coord(9/25)
    
  5. Bounhas, I.; Elayeb, B.; Evrard, F.; Slimani, Y.: Toward a computer study of the reliability of Arabic stories (2010) 0.17
    0.16684532 = sum of:
      0.16684532 = product of:
        0.8342266 = sum of:
          0.010555637 = weight(abstract_txt:also in 710) [ClassicSimilarity], result of:
            0.010555637 = score(doc=710,freq=1.0), product of:
              0.04921739 = queryWeight, product of:
                1.2741762 = boost
                3.4315145 = idf(docFreq=3756, maxDocs=42740)
                0.011256497 = queryNorm
              0.21446966 = fieldWeight in 710, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4315145 = idf(docFreq=3756, maxDocs=42740)
                0.0625 = fieldNorm(doc=710)
          0.008792675 = weight(abstract_txt:which in 710) [ClassicSimilarity], result of:
            0.008792675 = score(doc=710,freq=1.0), product of:
              0.04795743 = queryWeight, product of:
                1.4523374 = boost
                2.9334934 = idf(docFreq=6181, maxDocs=42740)
                0.011256497 = queryNorm
              0.18334334 = fieldWeight in 710, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.9334934 = idf(docFreq=6181, maxDocs=42740)
                0.0625 = fieldNorm(doc=710)
          0.010146184 = weight(abstract_txt:that in 710) [ClassicSimilarity], result of:
            0.010146184 = score(doc=710,freq=2.0), product of:
              0.047936257 = queryWeight, product of:
                1.7783501 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.011256497 = queryNorm
              0.21165991 = fieldWeight in 710, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.0625 = fieldNorm(doc=710)
          0.041971076 = weight(abstract_txt:measure in 710) [ClassicSimilarity], result of:
            0.041971076 = score(doc=710,freq=1.0), product of:
              0.12352714 = queryWeight, product of:
                2.0186052 = boost
                5.4363537 = idf(docFreq=505, maxDocs=42740)
                0.011256497 = queryNorm
              0.3397721 = fieldWeight in 710, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4363537 = idf(docFreq=505, maxDocs=42740)
                0.0625 = fieldNorm(doc=710)
          0.76276106 = weight(abstract_txt:reliability in 710) [ClassicSimilarity], result of:
            0.76276106 = score(doc=710,freq=7.0), product of:
              0.66677845 = queryWeight, product of:
                8.562495 = boost
                6.9179583 = idf(docFreq=114, maxDocs=42740)
                0.011256497 = queryNorm
              1.1439497 = fieldWeight in 710, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                6.9179583 = idf(docFreq=114, maxDocs=42740)
                0.0625 = fieldNorm(doc=710)
        0.2 = coord(5/25)