Document (#34446)

Author
Voorhees, E.M.
Title
On test collections for adaptive information retrieval
Source
Information processing and management. 44(2008) no.6, S.1879-1885
Year
2008
Abstract
Traditional Cranfield test collections represent an abstraction of a retrieval task that Sparck Jones calls the "core competency" of retrieval: a task that is necessary, but not sufficient, for user retrieval tasks. The abstraction facilitates research by controlling for (some) sources of variability, thus increasing the power of experiments that compare system effectiveness while reducing their cost. However, even within the highly-abstracted case of the Cranfield paradigm, meta-analysis demonstrates that the user/topic effect is greater than the system effect, so experiments must include a relatively large number of topics to distinguish systems' effectiveness. The evidence further suggests that changing the abstraction slightly to include just a bit more characterization of the user will result in a dramatic loss of power or increase in cost of retrieval experiments. Defining a new, feasible abstraction for supporting adaptive IR research will require winnowing the list of all possible factors that can affect retrieval behavior to a minimum number of essential factors.
Footnote
Beitrag in einem Themenheft "Adaptive information retrieval"
Theme
Retrievalstudien

Similar documents (author)

  1. Voorhees, E.M.: Implementing agglomerative hierarchic clustering algorithms for use in document retrieval (1986) 5.53
    5.52602 = sum of:
      5.52602 = weight(author_txt:voorhees in 402) [ClassicSimilarity], result of:
        5.52602 = fieldWeight in 402, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.841632 = idf(docFreq=16, maxDocs=43254)
          0.625 = fieldNorm(doc=402)
    
  2. Voorhees, E.M.: Question answering in TREC (2005) 5.53
    5.52602 = sum of:
      5.52602 = weight(author_txt:voorhees in 6487) [ClassicSimilarity], result of:
        5.52602 = fieldWeight in 6487, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.841632 = idf(docFreq=16, maxDocs=43254)
          0.625 = fieldNorm(doc=6487)
    
  3. Voorhees, E.M.: Variations in relevance judgements and the measurement of retrieval effectiveness (2000) 5.53
    5.52602 = sum of:
      5.52602 = weight(author_txt:voorhees in 710) [ClassicSimilarity], result of:
        5.52602 = fieldWeight in 710, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.841632 = idf(docFreq=16, maxDocs=43254)
          0.625 = fieldNorm(doc=710)
    
  4. Voorhees, E.M.: Using WordNet to disambiguate word senses for text retrieval (1993) 5.53
    5.52602 = sum of:
      5.52602 = weight(author_txt:voorhees in 799) [ClassicSimilarity], result of:
        5.52602 = fieldWeight in 799, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.841632 = idf(docFreq=16, maxDocs=43254)
          0.625 = fieldNorm(doc=799)
    
  5. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 5.53
    5.52602 = sum of:
      5.52602 = weight(author_txt:voorhees in 355) [ClassicSimilarity], result of:
        5.52602 = fieldWeight in 355, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.841632 = idf(docFreq=16, maxDocs=43254)
          0.625 = fieldNorm(doc=355)
    

Similar documents (content)

  1. Kutlu, M.; Elsayed, T.; Lease, M.: Intelligent topic selection for low-cost information retrieval evaluation : a new perspective on deep vs. shallow judging (2018) 0.21
    0.20705025 = sum of:
      0.20705025 = product of:
        0.51762563 = sum of:
          0.016643401 = weight(abstract_txt:number in 93) [ClassicSimilarity], result of:
            0.016643401 = score(doc=93,freq=1.0), product of:
              0.08605906 = queryWeight, product of:
                1.0689507 = boost
                4.1257625 = idf(docFreq=1898, maxDocs=43254)
                0.01951348 = queryNorm
              0.19339511 = fieldWeight in 93, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1257625 = idf(docFreq=1898, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.04922146 = weight(abstract_txt:collections in 93) [ClassicSimilarity], result of:
            0.04922146 = score(doc=93,freq=4.0), product of:
              0.11169958 = queryWeight, product of:
                1.2178257 = boost
                4.700366 = idf(docFreq=1068, maxDocs=43254)
                0.01951348 = queryNorm
              0.4406593 = fieldWeight in 93, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.700366 = idf(docFreq=1068, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.029296473 = weight(abstract_txt:factors in 93) [ClassicSimilarity], result of:
            0.029296473 = score(doc=93,freq=1.0), product of:
              0.12546197 = queryWeight, product of:
                1.2906705 = boost
                4.981521 = idf(docFreq=806, maxDocs=43254)
                0.01951348 = queryNorm
              0.2335088 = fieldWeight in 93, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.981521 = idf(docFreq=806, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.05309857 = weight(abstract_txt:test in 93) [ClassicSimilarity], result of:
            0.05309857 = score(doc=93,freq=3.0), product of:
              0.12931533 = queryWeight, product of:
                1.3103411 = boost
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.01951348 = queryNorm
              0.41061312 = fieldWeight in 93, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.038707856 = weight(abstract_txt:effect in 93) [ClassicSimilarity], result of:
            0.038707856 = score(doc=93,freq=1.0), product of:
              0.15106642 = queryWeight, product of:
                1.4162611 = boost
                5.466255 = idf(docFreq=496, maxDocs=43254)
                0.01951348 = queryNorm
              0.2562307 = fieldWeight in 93, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.466255 = idf(docFreq=496, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.08976047 = weight(abstract_txt:cost in 93) [ClassicSimilarity], result of:
            0.08976047 = score(doc=93,freq=4.0), product of:
              0.16672674 = queryWeight, product of:
                1.4878597 = boost
                5.7426 = idf(docFreq=376, maxDocs=43254)
                0.01951348 = queryNorm
              0.53836876 = fieldWeight in 93, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.7426 = idf(docFreq=376, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.019300709 = weight(abstract_txt:that in 93) [ClassicSimilarity], result of:
            0.019300709 = score(doc=93,freq=4.0), product of:
              0.086305365 = queryWeight, product of:
                1.8541244 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.01951348 = queryNorm
              0.22363278 = fieldWeight in 93, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.054286793 = weight(abstract_txt:experiments in 93) [ClassicSimilarity], result of:
            0.054286793 = score(doc=93,freq=1.0), product of:
              0.21666814 = queryWeight, product of:
                2.0773158 = boost
                5.3451242 = idf(docFreq=560, maxDocs=43254)
                0.01951348 = queryNorm
              0.2505527 = fieldWeight in 93, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3451242 = idf(docFreq=560, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.13760687 = weight(abstract_txt:cranfield in 93) [ClassicSimilarity], result of:
            0.13760687 = score(doc=93,freq=1.0), product of:
              0.35188055 = queryWeight, product of:
                2.1615086 = boost
                8.342641 = idf(docFreq=27, maxDocs=43254)
                0.01951348 = queryNorm
              0.3910613 = fieldWeight in 93, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.342641 = idf(docFreq=27, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.029703083 = weight(abstract_txt:retrieval in 93) [ClassicSimilarity], result of:
            0.029703083 = score(doc=93,freq=1.0), product of:
              0.18261789 = queryWeight, product of:
                2.6970663 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.01951348 = queryNorm
              0.16265155 = fieldWeight in 93, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
        0.4 = coord(10/25)
    
  2. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1985) 0.20
    0.19506598 = sum of:
      0.19506598 = product of:
        0.6966642 = sum of:
          0.029296473 = weight(abstract_txt:factors in 5644) [ClassicSimilarity], result of:
            0.029296473 = score(doc=5644,freq=1.0), product of:
              0.12546197 = queryWeight, product of:
                1.2906705 = boost
                4.981521 = idf(docFreq=806, maxDocs=43254)
                0.01951348 = queryNorm
              0.2335088 = fieldWeight in 5644, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.981521 = idf(docFreq=806, maxDocs=43254)
                0.046875 = fieldNorm(doc=5644)
          0.030656477 = weight(abstract_txt:test in 5644) [ClassicSimilarity], result of:
            0.030656477 = score(doc=5644,freq=1.0), product of:
              0.12931533 = queryWeight, product of:
                1.3103411 = boost
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.01951348 = queryNorm
              0.23706761 = fieldWeight in 5644, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.046875 = fieldNorm(doc=5644)
          0.030664932 = weight(abstract_txt:user in 5644) [ClassicSimilarity], result of:
            0.030664932 = score(doc=5644,freq=3.0), product of:
              0.10265652 = queryWeight, product of:
                1.4298756 = boost
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.01951348 = queryNorm
              0.29871392 = fieldWeight in 5644, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.046875 = fieldNorm(doc=5644)
          0.028951062 = weight(abstract_txt:that in 5644) [ClassicSimilarity], result of:
            0.028951062 = score(doc=5644,freq=9.0), product of:
              0.086305365 = queryWeight, product of:
                1.8541244 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.01951348 = queryNorm
              0.33544916 = fieldWeight in 5644, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.046875 = fieldNorm(doc=5644)
          0.054286793 = weight(abstract_txt:experiments in 5644) [ClassicSimilarity], result of:
            0.054286793 = score(doc=5644,freq=1.0), product of:
              0.21666814 = queryWeight, product of:
                2.0773158 = boost
                5.3451242 = idf(docFreq=560, maxDocs=43254)
                0.01951348 = queryNorm
              0.2505527 = fieldWeight in 5644, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3451242 = idf(docFreq=560, maxDocs=43254)
                0.046875 = fieldNorm(doc=5644)
          0.45639035 = weight(abstract_txt:cranfield in 5644) [ClassicSimilarity], result of:
            0.45639035 = score(doc=5644,freq=11.0), product of:
              0.35188055 = queryWeight, product of:
                2.1615086 = boost
                8.342641 = idf(docFreq=27, maxDocs=43254)
                0.01951348 = queryNorm
              1.2970036 = fieldWeight in 5644, product of:
                3.3166249 = tf(freq=11.0), with freq of:
                  11.0 = termFreq=11.0
                8.342641 = idf(docFreq=27, maxDocs=43254)
                0.046875 = fieldNorm(doc=5644)
          0.06641812 = weight(abstract_txt:retrieval in 5644) [ClassicSimilarity], result of:
            0.06641812 = score(doc=5644,freq=5.0), product of:
              0.18261789 = queryWeight, product of:
                2.6970663 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.01951348 = queryNorm
              0.36369994 = fieldWeight in 5644, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.046875 = fieldNorm(doc=5644)
        0.28 = coord(7/25)
    
  3. Vakkari, P.; Sormunen, E.: ¬The influence of relevance levels an the effectiveness of interactive information retrieval (2004) 0.14
    0.1427881 = sum of:
      0.1427881 = product of:
        0.44621283 = sum of:
          0.027739005 = weight(abstract_txt:number in 4885) [ClassicSimilarity], result of:
            0.027739005 = score(doc=4885,freq=1.0), product of:
              0.08605906 = queryWeight, product of:
                1.0689507 = boost
                4.1257625 = idf(docFreq=1898, maxDocs=43254)
                0.01951348 = queryNorm
              0.3223252 = fieldWeight in 4885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1257625 = idf(docFreq=1898, maxDocs=43254)
                0.078125 = fieldNorm(doc=4885)
          0.051094126 = weight(abstract_txt:test in 4885) [ClassicSimilarity], result of:
            0.051094126 = score(doc=4885,freq=1.0), product of:
              0.12931533 = queryWeight, product of:
                1.3103411 = boost
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.01951348 = queryNorm
              0.39511266 = fieldWeight in 4885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.078125 = fieldNorm(doc=4885)
          0.052647147 = weight(abstract_txt:effectiveness in 4885) [ClassicSimilarity], result of:
            0.052647147 = score(doc=4885,freq=1.0), product of:
              0.13192262 = queryWeight, product of:
                1.3234849 = boost
                5.1081724 = idf(docFreq=710, maxDocs=43254)
                0.01951348 = queryNorm
              0.39907598 = fieldWeight in 4885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1081724 = idf(docFreq=710, maxDocs=43254)
                0.078125 = fieldNorm(doc=4885)
          0.064513095 = weight(abstract_txt:effect in 4885) [ClassicSimilarity], result of:
            0.064513095 = score(doc=4885,freq=1.0), product of:
              0.15106642 = queryWeight, product of:
                1.4162611 = boost
                5.466255 = idf(docFreq=496, maxDocs=43254)
                0.01951348 = queryNorm
              0.4270512 = fieldWeight in 4885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.466255 = idf(docFreq=496, maxDocs=43254)
                0.078125 = fieldNorm(doc=4885)
          0.029507346 = weight(abstract_txt:user in 4885) [ClassicSimilarity], result of:
            0.029507346 = score(doc=4885,freq=1.0), product of:
              0.10265652 = queryWeight, product of:
                1.4298756 = boost
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.01951348 = queryNorm
              0.28743762 = fieldWeight in 4885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.078125 = fieldNorm(doc=4885)
          0.022746101 = weight(abstract_txt:that in 4885) [ClassicSimilarity], result of:
            0.022746101 = score(doc=4885,freq=2.0), product of:
              0.086305365 = queryWeight, product of:
                1.8541244 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.01951348 = queryNorm
              0.26355374 = fieldWeight in 4885, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.078125 = fieldNorm(doc=4885)
          0.12795518 = weight(abstract_txt:experiments in 4885) [ClassicSimilarity], result of:
            0.12795518 = score(doc=4885,freq=2.0), product of:
              0.21666814 = queryWeight, product of:
                2.0773158 = boost
                5.3451242 = idf(docFreq=560, maxDocs=43254)
                0.01951348 = queryNorm
              0.59055835 = fieldWeight in 4885, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.3451242 = idf(docFreq=560, maxDocs=43254)
                0.078125 = fieldNorm(doc=4885)
          0.07001083 = weight(abstract_txt:retrieval in 4885) [ClassicSimilarity], result of:
            0.07001083 = score(doc=4885,freq=2.0), product of:
              0.18261789 = queryWeight, product of:
                2.6970663 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.01951348 = queryNorm
              0.38337338 = fieldWeight in 4885, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.078125 = fieldNorm(doc=4885)
        0.32 = coord(8/25)
    
  4. Burgin, R.: ¬The retrieval effectiveness of 5 clustering algorithms as a function of indexing exhaustivity (1995) 0.14
    0.14004585 = sum of:
      0.14004585 = product of:
        0.50016373 = sum of:
          0.022191204 = weight(abstract_txt:number in 4434) [ClassicSimilarity], result of:
            0.022191204 = score(doc=4434,freq=1.0), product of:
              0.08605906 = queryWeight, product of:
                1.0689507 = boost
                4.1257625 = idf(docFreq=1898, maxDocs=43254)
                0.01951348 = queryNorm
              0.25786015 = fieldWeight in 4434, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1257625 = idf(docFreq=1898, maxDocs=43254)
                0.0625 = fieldNorm(doc=4434)
          0.046406437 = weight(abstract_txt:collections in 4434) [ClassicSimilarity], result of:
            0.046406437 = score(doc=4434,freq=2.0), product of:
              0.11169958 = queryWeight, product of:
                1.2178257 = boost
                4.700366 = idf(docFreq=1068, maxDocs=43254)
                0.01951348 = queryNorm
              0.41545758 = fieldWeight in 4434, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.700366 = idf(docFreq=1068, maxDocs=43254)
                0.0625 = fieldNorm(doc=4434)
          0.0408753 = weight(abstract_txt:test in 4434) [ClassicSimilarity], result of:
            0.0408753 = score(doc=4434,freq=1.0), product of:
              0.12931533 = queryWeight, product of:
                1.3103411 = boost
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.01951348 = queryNorm
              0.31609014 = fieldWeight in 4434, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.057442 = idf(docFreq=747, maxDocs=43254)
                0.0625 = fieldNorm(doc=4434)
          0.08423544 = weight(abstract_txt:effectiveness in 4434) [ClassicSimilarity], result of:
            0.08423544 = score(doc=4434,freq=4.0), product of:
              0.13192262 = queryWeight, product of:
                1.3234849 = boost
                5.1081724 = idf(docFreq=710, maxDocs=43254)
                0.01951348 = queryNorm
              0.63852155 = fieldWeight in 4434, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.1081724 = idf(docFreq=710, maxDocs=43254)
                0.0625 = fieldNorm(doc=4434)
          0.018196883 = weight(abstract_txt:that in 4434) [ClassicSimilarity], result of:
            0.018196883 = score(doc=4434,freq=2.0), product of:
              0.086305365 = queryWeight, product of:
                1.8541244 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.01951348 = queryNorm
              0.210843 = fieldWeight in 4434, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.0625 = fieldNorm(doc=4434)
          0.18347582 = weight(abstract_txt:cranfield in 4434) [ClassicSimilarity], result of:
            0.18347582 = score(doc=4434,freq=1.0), product of:
              0.35188055 = queryWeight, product of:
                2.1615086 = boost
                8.342641 = idf(docFreq=27, maxDocs=43254)
                0.01951348 = queryNorm
              0.52141505 = fieldWeight in 4434, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.342641 = idf(docFreq=27, maxDocs=43254)
                0.0625 = fieldNorm(doc=4434)
          0.10478263 = weight(abstract_txt:retrieval in 4434) [ClassicSimilarity], result of:
            0.10478263 = score(doc=4434,freq=7.0), product of:
              0.18261789 = queryWeight, product of:
                2.6970663 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.01951348 = queryNorm
              0.5737808 = fieldWeight in 4434, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.0625 = fieldNorm(doc=4434)
        0.28 = coord(7/25)
    
  5. Albertson, D.: Analyzing user interaction with the ViewFinder video retrieval system (2010) 0.14
    0.13608554 = sum of:
      0.13608554 = product of:
        0.42526734 = sum of:
          0.022191204 = weight(abstract_txt:number in 329) [ClassicSimilarity], result of:
            0.022191204 = score(doc=329,freq=1.0), product of:
              0.08605906 = queryWeight, product of:
                1.0689507 = boost
                4.1257625 = idf(docFreq=1898, maxDocs=43254)
                0.01951348 = queryNorm
              0.25786015 = fieldWeight in 329, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1257625 = idf(docFreq=1898, maxDocs=43254)
                0.0625 = fieldNorm(doc=329)
          0.053380065 = weight(abstract_txt:task in 329) [ClassicSimilarity], result of:
            0.053380065 = score(doc=329,freq=2.0), product of:
              0.12262681 = queryWeight, product of:
                1.2760041 = boost
                4.924914 = idf(docFreq=853, maxDocs=43254)
                0.01951348 = queryNorm
              0.435305 = fieldWeight in 329, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.924914 = idf(docFreq=853, maxDocs=43254)
                0.0625 = fieldNorm(doc=329)
          0.039061964 = weight(abstract_txt:factors in 329) [ClassicSimilarity], result of:
            0.039061964 = score(doc=329,freq=1.0), product of:
              0.12546197 = queryWeight, product of:
                1.2906705 = boost
                4.981521 = idf(docFreq=806, maxDocs=43254)
                0.01951348 = queryNorm
              0.31134507 = fieldWeight in 329, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.981521 = idf(docFreq=806, maxDocs=43254)
                0.0625 = fieldNorm(doc=329)
          0.059563447 = weight(abstract_txt:effectiveness in 329) [ClassicSimilarity], result of:
            0.059563447 = score(doc=329,freq=2.0), product of:
              0.13192262 = queryWeight, product of:
                1.3234849 = boost
                5.1081724 = idf(docFreq=710, maxDocs=43254)
                0.01951348 = queryNorm
              0.45150292 = fieldWeight in 329, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.1081724 = idf(docFreq=710, maxDocs=43254)
                0.0625 = fieldNorm(doc=329)
          0.04721175 = weight(abstract_txt:user in 329) [ClassicSimilarity], result of:
            0.04721175 = score(doc=329,freq=4.0), product of:
              0.10265652 = queryWeight, product of:
                1.4298756 = boost
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.01951348 = queryNorm
              0.45990017 = fieldWeight in 329, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.0625 = fieldNorm(doc=329)
          0.022286536 = weight(abstract_txt:that in 329) [ClassicSimilarity], result of:
            0.022286536 = score(doc=329,freq=3.0), product of:
              0.086305365 = queryWeight, product of:
                1.8541244 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.01951348 = queryNorm
              0.25822887 = fieldWeight in 329, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.0625 = fieldNorm(doc=329)
          0.102364145 = weight(abstract_txt:experiments in 329) [ClassicSimilarity], result of:
            0.102364145 = score(doc=329,freq=2.0), product of:
              0.21666814 = queryWeight, product of:
                2.0773158 = boost
                5.3451242 = idf(docFreq=560, maxDocs=43254)
                0.01951348 = queryNorm
              0.47244668 = fieldWeight in 329, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.3451242 = idf(docFreq=560, maxDocs=43254)
                0.0625 = fieldNorm(doc=329)
          0.079208225 = weight(abstract_txt:retrieval in 329) [ClassicSimilarity], result of:
            0.079208225 = score(doc=329,freq=4.0), product of:
              0.18261789 = queryWeight, product of:
                2.6970663 = boost
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.01951348 = queryNorm
              0.4337375 = fieldWeight in 329, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.4699 = idf(docFreq=3658, maxDocs=43254)
                0.0625 = fieldNorm(doc=329)
        0.32 = coord(8/25)