Document (#34445)

Author
Voorhees, E.M.
Title
On test collections for adaptive information retrieval
Source
Information processing and management. 44(2008) no.6, S.1879-1885
Year
2008
Abstract
Traditional Cranfield test collections represent an abstraction of a retrieval task that Sparck Jones calls the "core competency" of retrieval: a task that is necessary, but not sufficient, for user retrieval tasks. The abstraction facilitates research by controlling for (some) sources of variability, thus increasing the power of experiments that compare system effectiveness while reducing their cost. However, even within the highly-abstracted case of the Cranfield paradigm, meta-analysis demonstrates that the user/topic effect is greater than the system effect, so experiments must include a relatively large number of topics to distinguish systems' effectiveness. The evidence further suggests that changing the abstraction slightly to include just a bit more characterization of the user will result in a dramatic loss of power or increase in cost of retrieval experiments. Defining a new, feasible abstraction for supporting adaptive IR research will require winnowing the list of all possible factors that can affect retrieval behavior to a minimum number of essential factors.
Footnote
Beitrag in einem Themenheft "Adaptive information retrieval"
Theme
Retrievalstudien

Similar documents (author)

  1. Voorhees, E.M.: Implementing agglomerative hierarchic clustering algorithms for use in document retrieval (1986) 5.54 
    5.5397964 = sum of:
  5.5397964 = weight(author_txt:voorhees in 402) [ClassicSimilarity], result of:
    5.5397964 = fieldWeight in 402, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.863674 = idf(docFreq=16, maxDocs=44218)
      0.625 = fieldNorm(doc=402)
  2. Voorhees, E.M.: Question answering in TREC (2005) 5.54 
    5.5397964 = sum of:
  5.5397964 = weight(author_txt:voorhees in 6487) [ClassicSimilarity], result of:
    5.5397964 = fieldWeight in 6487, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.863674 = idf(docFreq=16, maxDocs=44218)
      0.625 = fieldNorm(doc=6487)
  3. Voorhees, E.M.: Variations in relevance judgements and the measurement of retrieval effectiveness (2000) 5.54 
    5.5397964 = sum of:
  5.5397964 = weight(author_txt:voorhees in 8710) [ClassicSimilarity], result of:
    5.5397964 = fieldWeight in 8710, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.863674 = idf(docFreq=16, maxDocs=44218)
      0.625 = fieldNorm(doc=8710)
  4. Voorhees, E.M.: Using WordNet to disambiguate word senses for text retrieval (1993) 5.54 
    5.5397964 = sum of:
  5.5397964 = weight(author_txt:voorhees in 8799) [ClassicSimilarity], result of:
    5.5397964 = fieldWeight in 8799, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.863674 = idf(docFreq=16, maxDocs=44218)
      0.625 = fieldNorm(doc=8799)
  5. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 5.54 
    5.5397964 = sum of:
  5.5397964 = weight(author_txt:voorhees in 3890) [ClassicSimilarity], result of:
    5.5397964 = fieldWeight in 3890, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.863674 = idf(docFreq=16, maxDocs=44218)
      0.625 = fieldNorm(doc=3890)

Similar documents (content)

  1. Kutlu, M.; Elsayed, T.; Lease, M.: Intelligent topic selection for low-cost information retrieval evaluation : a new perspective on deep vs. shallow judging (2018) 0.21 
    0.20570944 = sum of:
  0.20570944 = product of:
    0.5142736 = sum of:
      0.016814321 = weight(abstract_txt:number in 5092) [ClassicSimilarity], result of:
        0.016814321 = score(doc=5092,freq=1.0), product of:
          0.08679796 = queryWeight, product of:
            1.0702718 = boost
            4.132649 = idf(docFreq=1927, maxDocs=44218)
            0.01962397 = queryNorm
          0.19371793 = fieldWeight in 5092, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.132649 = idf(docFreq=1927, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
      0.049272384 = weight(abstract_txt:collections in 5092) [ClassicSimilarity], result of:
        0.049272384 = score(doc=5092,freq=4.0), product of:
          0.111971036 = queryWeight, product of:
            1.2156042 = boost
            4.693822 = idf(docFreq=1099, maxDocs=44218)
            0.01962397 = queryNorm
          0.4400458 = fieldWeight in 5092, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.693822 = idf(docFreq=1099, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
      0.029089052 = weight(abstract_txt:factors in 5092) [ClassicSimilarity], result of:
        0.029089052 = score(doc=5092,freq=1.0), product of:
          0.12508628 = queryWeight, product of:
            1.2848256 = boost
            4.9611073 = idf(docFreq=841, maxDocs=44218)
            0.01962397 = queryNorm
          0.2325519 = fieldWeight in 5092, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9611073 = idf(docFreq=841, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
      0.053033836 = weight(abstract_txt:test in 5092) [ClassicSimilarity], result of:
        0.053033836 = score(doc=5092,freq=3.0), product of:
          0.12943496 = queryWeight, product of:
            1.3069686 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.01962397 = queryNorm
          0.40973347 = fieldWeight in 5092, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
      0.038134493 = weight(abstract_txt:effect in 5092) [ClassicSimilarity], result of:
        0.038134493 = score(doc=5092,freq=1.0), product of:
          0.1498311 = queryWeight, product of:
            1.4061781 = boost
            5.4296865 = idf(docFreq=526, maxDocs=44218)
            0.01962397 = queryNorm
          0.25451654 = fieldWeight in 5092, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.4296865 = idf(docFreq=526, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
      0.090401605 = weight(abstract_txt:cost in 5092) [ClassicSimilarity], result of:
        0.090401605 = score(doc=5092,freq=4.0), product of:
          0.16781111 = queryWeight, product of:
            1.4881603 = boost
            5.746245 = idf(docFreq=383, maxDocs=44218)
            0.01962397 = queryNorm
          0.5387105 = fieldWeight in 5092, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.746245 = idf(docFreq=383, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
      0.019015223 = weight(abstract_txt:that in 5092) [ClassicSimilarity], result of:
        0.019015223 = score(doc=5092,freq=4.0), product of:
          0.08560084 = queryWeight, product of:
            1.8409371 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.01962397 = queryNorm
          0.22213829 = fieldWeight in 5092, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
      0.05412133 = weight(abstract_txt:experiments in 5092) [ClassicSimilarity], result of:
        0.05412133 = score(doc=5092,freq=1.0), product of:
          0.21660377 = queryWeight, product of:
            2.0707037 = boost
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.01962397 = queryNorm
          0.24986328 = fieldWeight in 5092, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
      0.13439752 = weight(abstract_txt:cranfield in 5092) [ClassicSimilarity], result of:
        0.13439752 = score(doc=5092,freq=1.0), product of:
          0.3469904 = queryWeight, product of:
            2.1399226 = boost
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.01962397 = queryNorm
          0.38732344 = fieldWeight in 5092, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
      0.029993812 = weight(abstract_txt:retrieval in 5092) [ClassicSimilarity], result of:
        0.029993812 = score(doc=5092,freq=1.0), product of:
          0.18412729 = queryWeight, product of:
            2.6999707 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.01962397 = queryNorm
          0.16289715 = fieldWeight in 5092, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.046875 = fieldNorm(doc=5092)
    0.4 = coord(10/25)
  2. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1985) 0.19 
    0.19210835 = sum of:
  0.19210835 = product of:
    0.68610126 = sum of:
      0.029089052 = weight(abstract_txt:factors in 3643) [ClassicSimilarity], result of:
        0.029089052 = score(doc=3643,freq=1.0), product of:
          0.12508628 = queryWeight, product of:
            1.2848256 = boost
            4.9611073 = idf(docFreq=841, maxDocs=44218)
            0.01962397 = queryNorm
          0.2325519 = fieldWeight in 3643, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9611073 = idf(docFreq=841, maxDocs=44218)
            0.046875 = fieldNorm(doc=3643)
      0.030619102 = weight(abstract_txt:test in 3643) [ClassicSimilarity], result of:
        0.030619102 = score(doc=3643,freq=1.0), product of:
          0.12943496 = queryWeight, product of:
            1.3069686 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.01962397 = queryNorm
          0.23655975 = fieldWeight in 3643, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.046875 = fieldNorm(doc=3643)
      0.030934509 = weight(abstract_txt:user in 3643) [ClassicSimilarity], result of:
        0.030934509 = score(doc=3643,freq=3.0), product of:
          0.10343689 = queryWeight, product of:
            1.4309442 = boost
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.01962397 = queryNorm
          0.2990665 = fieldWeight in 3643, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.046875 = fieldNorm(doc=3643)
      0.028522836 = weight(abstract_txt:that in 3643) [ClassicSimilarity], result of:
        0.028522836 = score(doc=3643,freq=9.0), product of:
          0.08560084 = queryWeight, product of:
            1.8409371 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.01962397 = queryNorm
          0.33320743 = fieldWeight in 3643, product of:
            3.0 = tf(freq=9.0), with freq of:
              9.0 = termFreq=9.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.046875 = fieldNorm(doc=3643)
      0.05412133 = weight(abstract_txt:experiments in 3643) [ClassicSimilarity], result of:
        0.05412133 = score(doc=3643,freq=1.0), product of:
          0.21660377 = queryWeight, product of:
            2.0707037 = boost
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.01962397 = queryNorm
          0.24986328 = fieldWeight in 3643, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.046875 = fieldNorm(doc=3643)
      0.4457462 = weight(abstract_txt:cranfield in 3643) [ClassicSimilarity], result of:
        0.4457462 = score(doc=3643,freq=11.0), product of:
          0.3469904 = queryWeight, product of:
            2.1399226 = boost
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.01962397 = queryNorm
          1.2846067 = fieldWeight in 3643, product of:
            3.3166249 = tf(freq=11.0), with freq of:
              11.0 = termFreq=11.0
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.046875 = fieldNorm(doc=3643)
      0.0670682 = weight(abstract_txt:retrieval in 3643) [ClassicSimilarity], result of:
        0.0670682 = score(doc=3643,freq=5.0), product of:
          0.18412729 = queryWeight, product of:
            2.6999707 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.01962397 = queryNorm
          0.3642491 = fieldWeight in 3643, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.046875 = fieldNorm(doc=3643)
    0.28 = coord(7/25)
  3. Vakkari, P.; Sormunen, E.: ¬The influence of relevance levels an the effectiveness of interactive information retrieval (2004) 0.14 
    0.1426142 = sum of:
  0.1426142 = product of:
    0.44566938 = sum of:
      0.028023867 = weight(abstract_txt:number in 2884) [ClassicSimilarity], result of:
        0.028023867 = score(doc=2884,freq=1.0), product of:
          0.08679796 = queryWeight, product of:
            1.0702718 = boost
            4.132649 = idf(docFreq=1927, maxDocs=44218)
            0.01962397 = queryNorm
          0.3228632 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.132649 = idf(docFreq=1927, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.051031835 = weight(abstract_txt:test in 2884) [ClassicSimilarity], result of:
        0.051031835 = score(doc=2884,freq=1.0), product of:
          0.12943496 = queryWeight, product of:
            1.3069686 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.01962397 = queryNorm
          0.39426625 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.052618515 = weight(abstract_txt:effectiveness in 2884) [ClassicSimilarity], result of:
        0.052618515 = score(doc=2884,freq=1.0), product of:
          0.13210417 = queryWeight, product of:
            1.320376 = boost
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.01962397 = queryNorm
          0.39831078 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.0635575 = weight(abstract_txt:effect in 2884) [ClassicSimilarity], result of:
        0.0635575 = score(doc=2884,freq=1.0), product of:
          0.1498311 = queryWeight, product of:
            1.4061781 = boost
            5.4296865 = idf(docFreq=526, maxDocs=44218)
            0.01962397 = queryNorm
          0.42419428 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.4296865 = idf(docFreq=526, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.029766746 = weight(abstract_txt:user in 2884) [ClassicSimilarity], result of:
        0.029766746 = score(doc=2884,freq=1.0), product of:
          0.10343689 = queryWeight, product of:
            1.4309442 = boost
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.01962397 = queryNorm
          0.2877769 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.022409655 = weight(abstract_txt:that in 2884) [ClassicSimilarity], result of:
        0.022409655 = score(doc=2884,freq=2.0), product of:
          0.08560084 = queryWeight, product of:
            1.8409371 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.01962397 = queryNorm
          0.26179248 = fieldWeight in 2884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.12756519 = weight(abstract_txt:experiments in 2884) [ClassicSimilarity], result of:
        0.12756519 = score(doc=2884,freq=2.0), product of:
          0.21660377 = queryWeight, product of:
            2.0707037 = boost
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.01962397 = queryNorm
          0.58893335 = fieldWeight in 2884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.070696086 = weight(abstract_txt:retrieval in 2884) [ClassicSimilarity], result of:
        0.070696086 = score(doc=2884,freq=2.0), product of:
          0.18412729 = queryWeight, product of:
            2.6999707 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.01962397 = queryNorm
          0.38395226 = fieldWeight in 2884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
    0.32 = coord(8/25)
  4. Burgin, R.: ¬The retrieval effectiveness of 5 clustering algorithms as a function of indexing exhaustivity (1995) 0.14 
    0.13910995 = sum of:
  0.13910995 = product of:
    0.49682128 = sum of:
      0.022419093 = weight(abstract_txt:number in 3365) [ClassicSimilarity], result of:
        0.022419093 = score(doc=3365,freq=1.0), product of:
          0.08679796 = queryWeight, product of:
            1.0702718 = boost
            4.132649 = idf(docFreq=1927, maxDocs=44218)
            0.01962397 = queryNorm
          0.25829056 = fieldWeight in 3365, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.132649 = idf(docFreq=1927, maxDocs=44218)
            0.0625 = fieldNorm(doc=3365)
      0.04645445 = weight(abstract_txt:collections in 3365) [ClassicSimilarity], result of:
        0.04645445 = score(doc=3365,freq=2.0), product of:
          0.111971036 = queryWeight, product of:
            1.2156042 = boost
            4.693822 = idf(docFreq=1099, maxDocs=44218)
            0.01962397 = queryNorm
          0.41487914 = fieldWeight in 3365, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.693822 = idf(docFreq=1099, maxDocs=44218)
            0.0625 = fieldNorm(doc=3365)
      0.040825468 = weight(abstract_txt:test in 3365) [ClassicSimilarity], result of:
        0.040825468 = score(doc=3365,freq=1.0), product of:
          0.12943496 = queryWeight, product of:
            1.3069686 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.01962397 = queryNorm
          0.315413 = fieldWeight in 3365, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.0625 = fieldNorm(doc=3365)
      0.08418963 = weight(abstract_txt:effectiveness in 3365) [ClassicSimilarity], result of:
        0.08418963 = score(doc=3365,freq=4.0), product of:
          0.13210417 = queryWeight, product of:
            1.320376 = boost
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.01962397 = queryNorm
          0.6372973 = fieldWeight in 3365, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.0625 = fieldNorm(doc=3365)
      0.017927725 = weight(abstract_txt:that in 3365) [ClassicSimilarity], result of:
        0.017927725 = score(doc=3365,freq=2.0), product of:
          0.08560084 = queryWeight, product of:
            1.8409371 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.01962397 = queryNorm
          0.20943399 = fieldWeight in 3365, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0625 = fieldNorm(doc=3365)
      0.1791967 = weight(abstract_txt:cranfield in 3365) [ClassicSimilarity], result of:
        0.1791967 = score(doc=3365,freq=1.0), product of:
          0.3469904 = queryWeight, product of:
            2.1399226 = boost
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.01962397 = queryNorm
          0.5164313 = fieldWeight in 3365, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.0625 = fieldNorm(doc=3365)
      0.10580821 = weight(abstract_txt:retrieval in 3365) [ClassicSimilarity], result of:
        0.10580821 = score(doc=3365,freq=7.0), product of:
          0.18412729 = queryWeight, product of:
            2.6999707 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.01962397 = queryNorm
          0.5746471 = fieldWeight in 3365, product of:
            2.6457512 = tf(freq=7.0), with freq of:
              7.0 = termFreq=7.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0625 = fieldNorm(doc=3365)
    0.28 = coord(7/25)
  5. Albertson, D.: Analyzing user interaction with the ViewFinder video retrieval system (2010) 0.14 
    0.13618247 = sum of:
  0.13618247 = product of:
    0.42557022 = sum of:
      0.022419093 = weight(abstract_txt:number in 3328) [ClassicSimilarity], result of:
        0.022419093 = score(doc=3328,freq=1.0), product of:
          0.08679796 = queryWeight, product of:
            1.0702718 = boost
            4.132649 = idf(docFreq=1927, maxDocs=44218)
            0.01962397 = queryNorm
          0.25829056 = fieldWeight in 3328, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.132649 = idf(docFreq=1927, maxDocs=44218)
            0.0625 = fieldNorm(doc=3328)
      0.053215336 = weight(abstract_txt:task in 3328) [ClassicSimilarity], result of:
        0.053215336 = score(doc=3328,freq=2.0), product of:
          0.12258726 = queryWeight, product of:
            1.2719265 = boost
            4.9112997 = idf(docFreq=884, maxDocs=44218)
            0.01962397 = queryNorm
          0.43410167 = fieldWeight in 3328, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.9112997 = idf(docFreq=884, maxDocs=44218)
            0.0625 = fieldNorm(doc=3328)
      0.0387854 = weight(abstract_txt:factors in 3328) [ClassicSimilarity], result of:
        0.0387854 = score(doc=3328,freq=1.0), product of:
          0.12508628 = queryWeight, product of:
            1.2848256 = boost
            4.9611073 = idf(docFreq=841, maxDocs=44218)
            0.01962397 = queryNorm
          0.3100692 = fieldWeight in 3328, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9611073 = idf(docFreq=841, maxDocs=44218)
            0.0625 = fieldNorm(doc=3328)
      0.05953106 = weight(abstract_txt:effectiveness in 3328) [ClassicSimilarity], result of:
        0.05953106 = score(doc=3328,freq=2.0), product of:
          0.13210417 = queryWeight, product of:
            1.320376 = boost
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.01962397 = queryNorm
          0.45063722 = fieldWeight in 3328, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.0625 = fieldNorm(doc=3328)
      0.047626793 = weight(abstract_txt:user in 3328) [ClassicSimilarity], result of:
        0.047626793 = score(doc=3328,freq=4.0), product of:
          0.10343689 = queryWeight, product of:
            1.4309442 = boost
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.01962397 = queryNorm
          0.46044302 = fieldWeight in 3328, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.0625 = fieldNorm(doc=3328)
      0.021956889 = weight(abstract_txt:that in 3328) [ClassicSimilarity], result of:
        0.021956889 = score(doc=3328,freq=3.0), product of:
          0.08560084 = queryWeight, product of:
            1.8409371 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.01962397 = queryNorm
          0.2565032 = fieldWeight in 3328, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0625 = fieldNorm(doc=3328)
      0.10205215 = weight(abstract_txt:experiments in 3328) [ClassicSimilarity], result of:
        0.10205215 = score(doc=3328,freq=2.0), product of:
          0.21660377 = queryWeight, product of:
            2.0707037 = boost
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.01962397 = queryNorm
          0.4711467 = fieldWeight in 3328, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.0625 = fieldNorm(doc=3328)
      0.079983495 = weight(abstract_txt:retrieval in 3328) [ClassicSimilarity], result of:
        0.079983495 = score(doc=3328,freq=4.0), product of:
          0.18412729 = queryWeight, product of:
            2.6999707 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.01962397 = queryNorm
          0.43439242 = fieldWeight in 3328, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0625 = fieldNorm(doc=3328)
    0.32 = coord(8/25)