Document (#34446)

Author
Voorhees, E.M.
Title
On test collections for adaptive information retrieval
Source
Information processing and management. 44(2008) no.6, S.1879-1885
Year
2008
Abstract
Traditional Cranfield test collections represent an abstraction of a retrieval task that Sparck Jones calls the "core competency" of retrieval: a task that is necessary, but not sufficient, for user retrieval tasks. The abstraction facilitates research by controlling for (some) sources of variability, thus increasing the power of experiments that compare system effectiveness while reducing their cost. However, even within the highly-abstracted case of the Cranfield paradigm, meta-analysis demonstrates that the user/topic effect is greater than the system effect, so experiments must include a relatively large number of topics to distinguish systems' effectiveness. The evidence further suggests that changing the abstraction slightly to include just a bit more characterization of the user will result in a dramatic loss of power or increase in cost of retrieval experiments. Defining a new, feasible abstraction for supporting adaptive IR research will require winnowing the list of all possible factors that can affect retrieval behavior to a minimum number of essential factors.
Footnote
Beitrag in einem Themenheft "Adaptive information retrieval"
Theme
Retrievalstudien

Similar documents (author)

  1. Voorhees, E.M.: Implementing agglomerative hierarchic clustering algorithms for use in document retrieval (1986) 5.52
    5.5185485 = sum of:
      5.5185485 = weight(author_txt:voorhees in 402) [ClassicSimilarity], result of:
        5.5185485 = fieldWeight in 402, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.829678 = idf(docFreq=16, maxDocs=42740)
          0.625 = fieldNorm(doc=402)
    
  2. Voorhees, E.M.: Question answering in TREC (2005) 5.52
    5.5185485 = sum of:
      5.5185485 = weight(author_txt:voorhees in 6487) [ClassicSimilarity], result of:
        5.5185485 = fieldWeight in 6487, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.829678 = idf(docFreq=16, maxDocs=42740)
          0.625 = fieldNorm(doc=6487)
    
  3. Voorhees, E.M.: Variations in relevance judgements and the measurement of retrieval effectiveness (2000) 5.52
    5.5185485 = sum of:
      5.5185485 = weight(author_txt:voorhees in 710) [ClassicSimilarity], result of:
        5.5185485 = fieldWeight in 710, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.829678 = idf(docFreq=16, maxDocs=42740)
          0.625 = fieldNorm(doc=710)
    
  4. Voorhees, E.M.: Using WordNet to disambiguate word senses for text retrieval (1993) 5.52
    5.5185485 = sum of:
      5.5185485 = weight(author_txt:voorhees in 799) [ClassicSimilarity], result of:
        5.5185485 = fieldWeight in 799, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.829678 = idf(docFreq=16, maxDocs=42740)
          0.625 = fieldNorm(doc=799)
    
  5. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 5.52
    5.5185485 = sum of:
      5.5185485 = weight(author_txt:voorhees in 891) [ClassicSimilarity], result of:
        5.5185485 = fieldWeight in 891, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.829678 = idf(docFreq=16, maxDocs=42740)
          0.625 = fieldNorm(doc=891)
    

Similar documents (content)

  1. Kutlu, M.; Elsayed, T.; Lease, M.: Intelligent topic selection for low-cost information retrieval evaluation : a new perspective on deep vs. shallow judging (2018) 0.21
    0.20741706 = sum of:
      0.20741706 = product of:
        0.51854265 = sum of:
          0.01663701 = weight(abstract_txt:number in 1093) [ClassicSimilarity], result of:
            0.01663701 = score(doc=1093,freq=1.0), product of:
              0.0860212 = queryWeight, product of:
                1.0674753 = boost
                4.1259933 = idf(docFreq=1875, maxDocs=42740)
                0.01953076 = queryNorm
              0.19340593 = fieldWeight in 1093, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1259933 = idf(docFreq=1875, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
          0.049203116 = weight(abstract_txt:collections in 1093) [ClassicSimilarity], result of:
            0.049203116 = score(doc=1093,freq=4.0), product of:
              0.11165129 = queryWeight, product of:
                1.2161494 = boost
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.01953076 = queryNorm
              0.44068563 = fieldWeight in 1093, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
          0.029762862 = weight(abstract_txt:factors in 1093) [ClassicSimilarity], result of:
            0.029762862 = score(doc=1093,freq=1.0), product of:
              0.12676667 = queryWeight, product of:
                1.2958586 = boost
                5.008738 = idf(docFreq=775, maxDocs=42740)
                0.01953076 = queryNorm
              0.2347846 = fieldWeight in 1093, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.008738 = idf(docFreq=775, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
          0.05341741 = weight(abstract_txt:test in 1093) [ClassicSimilarity], result of:
            0.05341741 = score(doc=1093,freq=3.0), product of:
              0.12980859 = queryWeight, product of:
                1.3113143 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.01953076 = queryNorm
              0.41150907 = fieldWeight in 1093, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
          0.039040424 = weight(abstract_txt:effect in 1093) [ClassicSimilarity], result of:
            0.039040424 = score(doc=1093,freq=1.0), product of:
              0.15190253 = queryWeight, product of:
                1.4185269 = boost
                5.482874 = idf(docFreq=482, maxDocs=42740)
                0.01953076 = queryNorm
              0.2570097 = fieldWeight in 1093, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.482874 = idf(docFreq=482, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
          0.08952524 = weight(abstract_txt:cost in 1093) [ClassicSimilarity], result of:
            0.08952524 = score(doc=1093,freq=4.0), product of:
              0.16640471 = queryWeight, product of:
                1.4846972 = boost
                5.7386346 = idf(docFreq=373, maxDocs=42740)
                0.01953076 = queryNorm
              0.537997 = fieldWeight in 1093, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.7386346 = idf(docFreq=373, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
          0.019515146 = weight(abstract_txt:that in 1093) [ClassicSimilarity], result of:
            0.019515146 = score(doc=1093,freq=4.0), product of:
              0.086927444 = queryWeight, product of:
                1.8586352 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.01953076 = queryNorm
              0.22449924 = fieldWeight in 1093, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
          0.054944906 = weight(abstract_txt:experiments in 1093) [ClassicSimilarity], result of:
            0.054944906 = score(doc=1093,freq=1.0), product of:
              0.21837555 = queryWeight, product of:
                2.0830646 = boost
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.01953076 = queryNorm
              0.25160742 = fieldWeight in 1093, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
          0.13694052 = weight(abstract_txt:cranfield in 1093) [ClassicSimilarity], result of:
            0.13694052 = score(doc=1093,freq=1.0), product of:
              0.35067916 = queryWeight, product of:
                2.1553116 = boost
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.01953076 = queryNorm
              0.3905009 = fieldWeight in 1093, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
          0.029556017 = weight(abstract_txt:retrieval in 1093) [ClassicSimilarity], result of:
            0.029556017 = score(doc=1093,freq=1.0), product of:
              0.18198112 = queryWeight, product of:
                2.6892357 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.01953076 = queryNorm
              0.16241255 = fieldWeight in 1093, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.046875 = fieldNorm(doc=1093)
        0.4 = coord(10/25)
    
  2. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1985) 0.19
    0.19481096 = sum of:
      0.19481096 = product of:
        0.6957534 = sum of:
          0.029762862 = weight(abstract_txt:factors in 4644) [ClassicSimilarity], result of:
            0.029762862 = score(doc=4644,freq=1.0), product of:
              0.12676667 = queryWeight, product of:
                1.2958586 = boost
                5.008738 = idf(docFreq=775, maxDocs=42740)
                0.01953076 = queryNorm
              0.2347846 = fieldWeight in 4644, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.008738 = idf(docFreq=775, maxDocs=42740)
                0.046875 = fieldNorm(doc=4644)
          0.030840555 = weight(abstract_txt:test in 4644) [ClassicSimilarity], result of:
            0.030840555 = score(doc=4644,freq=1.0), product of:
              0.12980859 = queryWeight, product of:
                1.3113143 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.01953076 = queryNorm
              0.23758486 = fieldWeight in 4644, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.046875 = fieldNorm(doc=4644)
          0.030662766 = weight(abstract_txt:user in 4644) [ClassicSimilarity], result of:
            0.030662766 = score(doc=4644,freq=3.0), product of:
              0.102632806 = queryWeight, product of:
                1.4280514 = boost
                3.6797917 = idf(docFreq=2930, maxDocs=42740)
                0.01953076 = queryNorm
              0.29876184 = fieldWeight in 4644, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.6797917 = idf(docFreq=2930, maxDocs=42740)
                0.046875 = fieldNorm(doc=4644)
          0.029272718 = weight(abstract_txt:that in 4644) [ClassicSimilarity], result of:
            0.029272718 = score(doc=4644,freq=9.0), product of:
              0.086927444 = queryWeight, product of:
                1.8586352 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.01953076 = queryNorm
              0.33674887 = fieldWeight in 4644, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.046875 = fieldNorm(doc=4644)
          0.054944906 = weight(abstract_txt:experiments in 4644) [ClassicSimilarity], result of:
            0.054944906 = score(doc=4644,freq=1.0), product of:
              0.21837555 = queryWeight, product of:
                2.0830646 = boost
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.01953076 = queryNorm
              0.25160742 = fieldWeight in 4644, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.046875 = fieldNorm(doc=4644)
          0.45418033 = weight(abstract_txt:cranfield in 4644) [ClassicSimilarity], result of:
            0.45418033 = score(doc=4644,freq=11.0), product of:
              0.35067916 = queryWeight, product of:
                2.1553116 = boost
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.01953076 = queryNorm
              1.2951449 = fieldWeight in 4644, product of:
                3.3166249 = tf(freq=11.0), with freq of:
                  11.0 = termFreq=11.0
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.046875 = fieldNorm(doc=4644)
          0.066089265 = weight(abstract_txt:retrieval in 4644) [ClassicSimilarity], result of:
            0.066089265 = score(doc=4644,freq=5.0), product of:
              0.18198112 = queryWeight, product of:
                2.6892357 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.01953076 = queryNorm
              0.36316553 = fieldWeight in 4644, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.046875 = fieldNorm(doc=4644)
        0.28 = coord(7/25)
    
  3. Vakkari, P.; Sormunen, E.: ¬The influence of relevance levels an the effectiveness of interactive information retrieval (2004) 0.14
    0.14360942 = sum of:
      0.14360942 = product of:
        0.44877943 = sum of:
          0.02772835 = weight(abstract_txt:number in 3885) [ClassicSimilarity], result of:
            0.02772835 = score(doc=3885,freq=1.0), product of:
              0.0860212 = queryWeight, product of:
                1.0674753 = boost
                4.1259933 = idf(docFreq=1875, maxDocs=42740)
                0.01953076 = queryNorm
              0.32234323 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1259933 = idf(docFreq=1875, maxDocs=42740)
                0.078125 = fieldNorm(doc=3885)
          0.05140093 = weight(abstract_txt:test in 3885) [ClassicSimilarity], result of:
            0.05140093 = score(doc=3885,freq=1.0), product of:
              0.12980859 = queryWeight, product of:
                1.3113143 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.01953076 = queryNorm
              0.39597479 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.078125 = fieldNorm(doc=3885)
          0.052908137 = weight(abstract_txt:effectiveness in 3885) [ClassicSimilarity], result of:
            0.052908137 = score(doc=3885,freq=1.0), product of:
              0.1323339 = queryWeight, product of:
                1.3240081 = boost
                5.117541 = idf(docFreq=695, maxDocs=42740)
                0.01953076 = queryNorm
              0.39980787 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.117541 = idf(docFreq=695, maxDocs=42740)
                0.078125 = fieldNorm(doc=3885)
          0.06506737 = weight(abstract_txt:effect in 3885) [ClassicSimilarity], result of:
            0.06506737 = score(doc=3885,freq=1.0), product of:
              0.15190253 = queryWeight, product of:
                1.4185269 = boost
                5.482874 = idf(docFreq=482, maxDocs=42740)
                0.01953076 = queryNorm
              0.42834952 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.482874 = idf(docFreq=482, maxDocs=42740)
                0.078125 = fieldNorm(doc=3885)
          0.02950526 = weight(abstract_txt:user in 3885) [ClassicSimilarity], result of:
            0.02950526 = score(doc=3885,freq=1.0), product of:
              0.102632806 = queryWeight, product of:
                1.4280514 = boost
                3.6797917 = idf(docFreq=2930, maxDocs=42740)
                0.01953076 = queryNorm
              0.28748372 = fieldWeight in 3885, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6797917 = idf(docFreq=2930, maxDocs=42740)
                0.078125 = fieldNorm(doc=3885)
          0.02299882 = weight(abstract_txt:that in 3885) [ClassicSimilarity], result of:
            0.02299882 = score(doc=3885,freq=2.0), product of:
              0.086927444 = queryWeight, product of:
                1.8586352 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.01953076 = queryNorm
              0.2645749 = fieldWeight in 3885, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.078125 = fieldNorm(doc=3885)
          0.12950638 = weight(abstract_txt:experiments in 3885) [ClassicSimilarity], result of:
            0.12950638 = score(doc=3885,freq=2.0), product of:
              0.21837555 = queryWeight, product of:
                2.0830646 = boost
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.01953076 = queryNorm
              0.59304434 = fieldWeight in 3885, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.078125 = fieldNorm(doc=3885)
          0.06966421 = weight(abstract_txt:retrieval in 3885) [ClassicSimilarity], result of:
            0.06966421 = score(doc=3885,freq=2.0), product of:
              0.18198112 = queryWeight, product of:
                2.6892357 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.01953076 = queryNorm
              0.3828101 = fieldWeight in 3885, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.078125 = fieldNorm(doc=3885)
        0.32 = coord(8/25)
    
  4. Burgin, R.: ¬The retrieval effectiveness of 5 clustering algorithms as a function of indexing exhaustivity (1995) 0.14
    0.13988684 = sum of:
      0.13988684 = product of:
        0.49959585 = sum of:
          0.02218268 = weight(abstract_txt:number in 3434) [ClassicSimilarity], result of:
            0.02218268 = score(doc=3434,freq=1.0), product of:
              0.0860212 = queryWeight, product of:
                1.0674753 = boost
                4.1259933 = idf(docFreq=1875, maxDocs=42740)
                0.01953076 = queryNorm
              0.25787458 = fieldWeight in 3434, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1259933 = idf(docFreq=1875, maxDocs=42740)
                0.0625 = fieldNorm(doc=3434)
          0.046389144 = weight(abstract_txt:collections in 3434) [ClassicSimilarity], result of:
            0.046389144 = score(doc=3434,freq=2.0), product of:
              0.11165129 = queryWeight, product of:
                1.2161494 = boost
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.01953076 = queryNorm
              0.4154824 = fieldWeight in 3434, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.0625 = fieldNorm(doc=3434)
          0.04112074 = weight(abstract_txt:test in 3434) [ClassicSimilarity], result of:
            0.04112074 = score(doc=3434,freq=1.0), product of:
              0.12980859 = queryWeight, product of:
                1.3113143 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.01953076 = queryNorm
              0.31677982 = fieldWeight in 3434, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.0625 = fieldNorm(doc=3434)
          0.08465302 = weight(abstract_txt:effectiveness in 3434) [ClassicSimilarity], result of:
            0.08465302 = score(doc=3434,freq=4.0), product of:
              0.1323339 = queryWeight, product of:
                1.3240081 = boost
                5.117541 = idf(docFreq=695, maxDocs=42740)
                0.01953076 = queryNorm
              0.6396926 = fieldWeight in 3434, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.117541 = idf(docFreq=695, maxDocs=42740)
                0.0625 = fieldNorm(doc=3434)
          0.018399054 = weight(abstract_txt:that in 3434) [ClassicSimilarity], result of:
            0.018399054 = score(doc=3434,freq=2.0), product of:
              0.086927444 = queryWeight, product of:
                1.8586352 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.01953076 = queryNorm
              0.21165991 = fieldWeight in 3434, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.0625 = fieldNorm(doc=3434)
          0.18258737 = weight(abstract_txt:cranfield in 3434) [ClassicSimilarity], result of:
            0.18258737 = score(doc=3434,freq=1.0), product of:
              0.35067916 = queryWeight, product of:
                2.1553116 = boost
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.01953076 = queryNorm
              0.52066785 = fieldWeight in 3434, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.0625 = fieldNorm(doc=3434)
          0.104263835 = weight(abstract_txt:retrieval in 3434) [ClassicSimilarity], result of:
            0.104263835 = score(doc=3434,freq=7.0), product of:
              0.18198112 = queryWeight, product of:
                2.6892357 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.01953076 = queryNorm
              0.57293767 = fieldWeight in 3434, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.0625 = fieldNorm(doc=3434)
        0.28 = coord(7/25)
    
  5. Albertson, D.: Analyzing user interaction with the ViewFinder video retrieval system (2010) 0.14
    0.13683906 = sum of:
      0.13683906 = product of:
        0.42762208 = sum of:
          0.02218268 = weight(abstract_txt:number in 329) [ClassicSimilarity], result of:
            0.02218268 = score(doc=329,freq=1.0), product of:
              0.0860212 = queryWeight, product of:
                1.0674753 = boost
                4.1259933 = idf(docFreq=1875, maxDocs=42740)
                0.01953076 = queryNorm
              0.25787458 = fieldWeight in 329, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1259933 = idf(docFreq=1875, maxDocs=42740)
                0.0625 = fieldNorm(doc=329)
          0.053733155 = weight(abstract_txt:task in 329) [ClassicSimilarity], result of:
            0.053733155 = score(doc=329,freq=2.0), product of:
              0.12314431 = queryWeight, product of:
                1.2772099 = boost
                4.936657 = idf(docFreq=833, maxDocs=42740)
                0.01953076 = queryNorm
              0.43634295 = fieldWeight in 329, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.936657 = idf(docFreq=833, maxDocs=42740)
                0.0625 = fieldNorm(doc=329)
          0.039683815 = weight(abstract_txt:factors in 329) [ClassicSimilarity], result of:
            0.039683815 = score(doc=329,freq=1.0), product of:
              0.12676667 = queryWeight, product of:
                1.2958586 = boost
                5.008738 = idf(docFreq=775, maxDocs=42740)
                0.01953076 = queryNorm
              0.31304613 = fieldWeight in 329, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.008738 = idf(docFreq=775, maxDocs=42740)
                0.0625 = fieldNorm(doc=329)
          0.059858724 = weight(abstract_txt:effectiveness in 329) [ClassicSimilarity], result of:
            0.059858724 = score(doc=329,freq=2.0), product of:
              0.1323339 = queryWeight, product of:
                1.3240081 = boost
                5.117541 = idf(docFreq=695, maxDocs=42740)
                0.01953076 = queryNorm
              0.45233098 = fieldWeight in 329, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.117541 = idf(docFreq=695, maxDocs=42740)
                0.0625 = fieldNorm(doc=329)
          0.047208417 = weight(abstract_txt:user in 329) [ClassicSimilarity], result of:
            0.047208417 = score(doc=329,freq=4.0), product of:
              0.102632806 = queryWeight, product of:
                1.4280514 = boost
                3.6797917 = idf(docFreq=2930, maxDocs=42740)
                0.01953076 = queryNorm
              0.45997396 = fieldWeight in 329, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.6797917 = idf(docFreq=2930, maxDocs=42740)
                0.0625 = fieldNorm(doc=329)
          0.022534149 = weight(abstract_txt:that in 329) [ClassicSimilarity], result of:
            0.022534149 = score(doc=329,freq=3.0), product of:
              0.086927444 = queryWeight, product of:
                1.8586352 = boost
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.01953076 = queryNorm
              0.2592294 = fieldWeight in 329, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.3946586 = idf(docFreq=10595, maxDocs=42740)
                0.0625 = fieldNorm(doc=329)
          0.10360511 = weight(abstract_txt:experiments in 329) [ClassicSimilarity], result of:
            0.10360511 = score(doc=329,freq=2.0), product of:
              0.21837555 = queryWeight, product of:
                2.0830646 = boost
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.01953076 = queryNorm
              0.47443548 = fieldWeight in 329, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.0625 = fieldNorm(doc=329)
          0.07881605 = weight(abstract_txt:retrieval in 329) [ClassicSimilarity], result of:
            0.07881605 = score(doc=329,freq=4.0), product of:
              0.18198112 = queryWeight, product of:
                2.6892357 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.01953076 = queryNorm
              0.43310016 = fieldWeight in 329, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.0625 = fieldNorm(doc=329)
        0.32 = coord(8/25)