Document (#35655)

Author
Robertson, S.
Title
On the history of evaluation in IR
Source
Information science in transition, Ed.: A. Gilchrist
Imprint
London : Facet Publ.
Year
2009
Pages
S.63-93
Abstract
This paper is a personal take on the history of evaluation experiments in information retrieval. It describes some of the early experiments that were formative in our understanding, and goes on to discuss the current dominance of TREC (the Text REtrieval Conference) and to assess its impact.
Theme
Retrievalstudien
Object
TREC

Similar documents (author)

  1. Robertson, M.A.: Windows 3.0 for the online searcher (1991) 4.55
    4.552023 = sum of:
      4.552023 = weight(author_txt:robertson in 592) [ClassicSimilarity], result of:
        4.552023 = fieldWeight in 592, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.2832365 = idf(docFreq=78, maxDocs=42306)
          0.625 = fieldNorm(doc=592)
    
  2. Robertson, S.E.: Some recent theories and models in information retrieval (1980) 4.55
    4.552023 = sum of:
      4.552023 = weight(author_txt:robertson in 1326) [ClassicSimilarity], result of:
        4.552023 = fieldWeight in 1326, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.2832365 = idf(docFreq=78, maxDocs=42306)
          0.625 = fieldNorm(doc=1326)
    
  3. Robertson, S.E.: Theories and models in information retrieval (1977) 4.55
    4.552023 = sum of:
      4.552023 = weight(author_txt:robertson in 1844) [ClassicSimilarity], result of:
        4.552023 = fieldWeight in 1844, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.2832365 = idf(docFreq=78, maxDocs=42306)
          0.625 = fieldNorm(doc=1844)
    
  4. Robertson, S.E.: On term selection for query expansion (1990) 4.55
    4.552023 = sum of:
      4.552023 = weight(author_txt:robertson in 2650) [ClassicSimilarity], result of:
        4.552023 = fieldWeight in 2650, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.2832365 = idf(docFreq=78, maxDocs=42306)
          0.625 = fieldNorm(doc=2650)
    
  5. Robertson, S.E.: On relevance weight estimation and query expansion (1986) 4.55
    4.552023 = sum of:
      4.552023 = weight(author_txt:robertson in 3875) [ClassicSimilarity], result of:
        4.552023 = fieldWeight in 3875, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.2832365 = idf(docFreq=78, maxDocs=42306)
          0.625 = fieldNorm(doc=3875)
    

Similar documents (content)

  1. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 0.39
    0.39361256 = sum of:
      0.39361256 = product of:
        1.0933682 = sum of:
          0.012727018 = weight(abstract_txt:information in 891) [ClassicSimilarity], result of:
            0.012727018 = score(doc=891,freq=1.0), product of:
              0.03343901 = queryWeight, product of:
                1.0128945 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.013553018 = queryNorm
              0.3806039 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.013020027 = weight(abstract_txt:this in 891) [ClassicSimilarity], result of:
            0.013020027 = score(doc=891,freq=1.0), product of:
              0.0339503 = queryWeight, product of:
                1.0206088 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.013553018 = queryNorm
              0.38350257 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.058574036 = weight(abstract_txt:text in 891) [ClassicSimilarity], result of:
            0.058574036 = score(doc=891,freq=1.0), product of:
              0.09252074 = queryWeight, product of:
                1.6848338 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.013553018 = queryNorm
              0.63309085 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.0873893 = weight(abstract_txt:impact in 891) [ClassicSimilarity], result of:
            0.0873893 = score(doc=891,freq=1.0), product of:
              0.120802104 = queryWeight, product of:
                1.9251951 = boost
                4.629816 = idf(docFreq=1121, maxDocs=42306)
                0.013553018 = queryNorm
              0.72340876 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.629816 = idf(docFreq=1121, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.14964479 = weight(abstract_txt:conference in 891) [ClassicSimilarity], result of:
            0.14964479 = score(doc=891,freq=1.0), product of:
              0.172906 = queryWeight, product of:
                2.3032577 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.013553018 = queryNorm
              0.86546904 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.26200306 = weight(abstract_txt:trec in 891) [ClassicSimilarity], result of:
            0.26200306 = score(doc=891,freq=1.0), product of:
              0.25117317 = queryWeight, product of:
                2.7760298 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.013553018 = queryNorm
              1.0431173 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.12663895 = weight(abstract_txt:retrieval in 891) [ClassicSimilarity], result of:
            0.12663895 = score(doc=891,freq=3.0), product of:
              0.13513985 = queryWeight, product of:
                2.87968 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.013553018 = queryNorm
              0.9370955 = fieldWeight in 891, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.15977916 = weight(abstract_txt:evaluation in 891) [ClassicSimilarity], result of:
            0.15977916 = score(doc=891,freq=1.0), product of:
              0.22757563 = queryWeight, product of:
                3.7369335 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.013553018 = queryNorm
              0.7020926 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.22359177 = weight(abstract_txt:history in 891) [ClassicSimilarity], result of:
            0.22359177 = score(doc=891,freq=1.0), product of:
              0.28471884 = queryWeight, product of:
                4.179849 = boost
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.013553018 = queryNorm
              0.7853073 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
        0.36 = coord(9/25)
    
  2. Voorhees, E.M.; Harman, D.K.: ¬The Text REtrieval Conference (2005) 0.38
    0.37832728 = sum of:
      0.37832728 = product of:
        0.7275525 = sum of:
          0.0061235605 = weight(abstract_txt:that in 83) [ClassicSimilarity], result of:
            0.0061235605 = score(doc=83,freq=4.0), product of:
              0.03259305 = queryWeight, product of:
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.013553018 = queryNorm
              0.18787934 = fieldWeight in 83, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.0071146195 = weight(abstract_txt:information in 83) [ClassicSimilarity], result of:
            0.0071146195 = score(doc=83,freq=5.0), product of:
              0.03343901 = queryWeight, product of:
                1.0128945 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.013553018 = queryNorm
              0.21276405 = fieldWeight in 83, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.0065100137 = weight(abstract_txt:this in 83) [ClassicSimilarity], result of:
            0.0065100137 = score(doc=83,freq=4.0), product of:
              0.0339503 = queryWeight, product of:
                1.0206088 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.013553018 = queryNorm
              0.19175129 = fieldWeight in 83, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.011022623 = weight(abstract_txt:some in 83) [ClassicSimilarity], result of:
            0.011022623 = score(doc=83,freq=1.0), product of:
              0.07655948 = queryWeight, product of:
                1.5326288 = boost
                3.6857507 = idf(docFreq=2883, maxDocs=42306)
                0.013553018 = queryNorm
              0.14397463 = fieldWeight in 83, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6857507 = idf(docFreq=2883, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.012041424 = weight(abstract_txt:describes in 83) [ClassicSimilarity], result of:
            0.012041424 = score(doc=83,freq=1.0), product of:
              0.08120714 = queryWeight, product of:
                1.5784638 = boost
                3.7959774 = idf(docFreq=2582, maxDocs=42306)
                0.013553018 = queryNorm
              0.14828037 = fieldWeight in 83, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7959774 = idf(docFreq=2582, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.025363304 = weight(abstract_txt:text in 83) [ClassicSimilarity], result of:
            0.025363304 = score(doc=83,freq=3.0), product of:
              0.09252074 = queryWeight, product of:
                1.6848338 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.013553018 = queryNorm
              0.2741364 = fieldWeight in 83, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.021847324 = weight(abstract_txt:impact in 83) [ClassicSimilarity], result of:
            0.021847324 = score(doc=83,freq=1.0), product of:
              0.120802104 = queryWeight, product of:
                1.9251951 = boost
                4.629816 = idf(docFreq=1121, maxDocs=42306)
                0.013553018 = queryNorm
              0.18085219 = fieldWeight in 83, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.629816 = idf(docFreq=1121, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.064798094 = weight(abstract_txt:conference in 83) [ClassicSimilarity], result of:
            0.064798094 = score(doc=83,freq=3.0), product of:
              0.172906 = queryWeight, product of:
                2.3032577 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.013553018 = queryNorm
              0.3747591 = fieldWeight in 83, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.27006656 = weight(abstract_txt:trec in 83) [ClassicSimilarity], result of:
            0.27006656 = score(doc=83,freq=17.0), product of:
              0.25117317 = queryWeight, product of:
                2.7760298 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.013553018 = queryNorm
              1.0752206 = fieldWeight in 83, product of:
                4.1231055 = tf(freq=17.0), with freq of:
                  17.0 = termFreq=17.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.06839285 = weight(abstract_txt:retrieval in 83) [ClassicSimilarity], result of:
            0.06839285 = score(doc=83,freq=14.0), product of:
              0.13513985 = queryWeight, product of:
                2.87968 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.013553018 = queryNorm
              0.50608945 = fieldWeight in 83, product of:
                3.7416575 = tf(freq=14.0), with freq of:
                  14.0 = termFreq=14.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.069186404 = weight(abstract_txt:evaluation in 83) [ClassicSimilarity], result of:
            0.069186404 = score(doc=83,freq=3.0), product of:
              0.22757563 = queryWeight, product of:
                3.7369335 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.013553018 = queryNorm
              0.304015 = fieldWeight in 83, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.09681808 = weight(abstract_txt:history in 83) [ClassicSimilarity], result of:
            0.09681808 = score(doc=83,freq=3.0), product of:
              0.28471884 = queryWeight, product of:
                4.179849 = boost
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.013553018 = queryNorm
              0.34004804 = fieldWeight in 83, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
          0.06826766 = weight(abstract_txt:experiments in 83) [ClassicSimilarity], result of:
            0.06826766 = score(doc=83,freq=1.0), product of:
              0.32530868 = queryWeight, product of:
                4.467868 = boost
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.013553018 = queryNorm
              0.209855 = fieldWeight in 83, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.0390625 = fieldNorm(doc=83)
        0.52 = coord(13/25)
    
  3. TREC: experiment and evaluation in information retrieval (2005) 0.33
    0.3335015 = sum of:
      0.3335015 = product of:
        0.75795794 = sum of:
          0.0048988485 = weight(abstract_txt:that in 1762) [ClassicSimilarity], result of:
            0.0048988485 = score(doc=1762,freq=1.0), product of:
              0.03259305 = queryWeight, product of:
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.013553018 = queryNorm
              0.15030347 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.007199488 = weight(abstract_txt:information in 1762) [ClassicSimilarity], result of:
            0.007199488 = score(doc=1762,freq=2.0), product of:
              0.03343901 = queryWeight, product of:
                1.0128945 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.013553018 = queryNorm
              0.21530207 = fieldWeight in 1762, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.00736524 = weight(abstract_txt:this in 1762) [ClassicSimilarity], result of:
            0.00736524 = score(doc=1762,freq=2.0), product of:
              0.0339503 = queryWeight, product of:
                1.0206088 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.013553018 = queryNorm
              0.21694182 = fieldWeight in 1762, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.01926628 = weight(abstract_txt:describes in 1762) [ClassicSimilarity], result of:
            0.01926628 = score(doc=1762,freq=1.0), product of:
              0.08120714 = queryWeight, product of:
                1.5784638 = boost
                3.7959774 = idf(docFreq=2582, maxDocs=42306)
                0.013553018 = queryNorm
              0.23724858 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7959774 = idf(docFreq=2582, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.04685923 = weight(abstract_txt:text in 1762) [ClassicSimilarity], result of:
            0.04685923 = score(doc=1762,freq=4.0), product of:
              0.09252074 = queryWeight, product of:
                1.6848338 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.013553018 = queryNorm
              0.5064727 = fieldWeight in 1762, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.03495572 = weight(abstract_txt:impact in 1762) [ClassicSimilarity], result of:
            0.03495572 = score(doc=1762,freq=1.0), product of:
              0.120802104 = queryWeight, product of:
                1.9251951 = boost
                4.629816 = idf(docFreq=1121, maxDocs=42306)
                0.013553018 = queryNorm
              0.2893635 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.629816 = idf(docFreq=1121, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.059857916 = weight(abstract_txt:conference in 1762) [ClassicSimilarity], result of:
            0.059857916 = score(doc=1762,freq=1.0), product of:
              0.172906 = queryWeight, product of:
                2.3032577 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.013553018 = queryNorm
              0.34618762 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.29642263 = weight(abstract_txt:trec in 1762) [ClassicSimilarity], result of:
            0.29642263 = score(doc=1762,freq=8.0), product of:
              0.25117317 = queryWeight, product of:
                2.7760298 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.013553018 = queryNorm
              1.1801524 = fieldWeight in 1762, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.10131116 = weight(abstract_txt:retrieval in 1762) [ClassicSimilarity], result of:
            0.10131116 = score(doc=1762,freq=12.0), product of:
              0.13513985 = queryWeight, product of:
                2.87968 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.013553018 = queryNorm
              0.7496764 = fieldWeight in 1762, product of:
                3.4641016 = tf(freq=12.0), with freq of:
                  12.0 = termFreq=12.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.090384744 = weight(abstract_txt:evaluation in 1762) [ClassicSimilarity], result of:
            0.090384744 = score(doc=1762,freq=2.0), product of:
              0.22757563 = queryWeight, product of:
                3.7369335 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.013553018 = queryNorm
              0.39716354 = fieldWeight in 1762, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.08943671 = weight(abstract_txt:history in 1762) [ClassicSimilarity], result of:
            0.08943671 = score(doc=1762,freq=1.0), product of:
              0.28471884 = queryWeight, product of:
                4.179849 = boost
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.013553018 = queryNorm
              0.31412292 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
        0.44 = coord(11/25)
    
  4. Ruthven, I.; Baillie, M.; Elsweiler, D.: ¬The relative effects of knowledge, interest and confidence in assessing relevance (2007) 0.30
    0.30365545 = sum of:
      0.30365545 = product of:
        0.5839528 = sum of:
          0.009584889 = weight(abstract_txt:that in 2836) [ClassicSimilarity], result of:
            0.009584889 = score(doc=2836,freq=5.0), product of:
              0.03259305 = queryWeight, product of:
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.013553018 = queryNorm
              0.2940777 = fieldWeight in 2836, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.0062995516 = weight(abstract_txt:information in 2836) [ClassicSimilarity], result of:
            0.0062995516 = score(doc=2836,freq=2.0), product of:
              0.03343901 = queryWeight, product of:
                1.0128945 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.013553018 = queryNorm
              0.1883893 = fieldWeight in 2836, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.007892972 = weight(abstract_txt:this in 2836) [ClassicSimilarity], result of:
            0.007892972 = score(doc=2836,freq=3.0), product of:
              0.0339503 = queryWeight, product of:
                1.0206088 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.013553018 = queryNorm
              0.23248607 = fieldWeight in 2836, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.01334809 = weight(abstract_txt:paper in 2836) [ClassicSimilarity], result of:
            0.01334809 = score(doc=2836,freq=1.0), product of:
              0.06950292 = queryWeight, product of:
                1.4602897 = boost
                3.5117857 = idf(docFreq=3431, maxDocs=42306)
                0.013553018 = queryNorm
              0.19205078 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.5117857 = idf(docFreq=3431, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.027079768 = weight(abstract_txt:were in 2836) [ClassicSimilarity], result of:
            0.027079768 = score(doc=2836,freq=3.0), product of:
              0.077228904 = queryWeight, product of:
                1.5393147 = boost
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.013553018 = queryNorm
              0.35064292 = fieldWeight in 2836, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.020500915 = weight(abstract_txt:text in 2836) [ClassicSimilarity], result of:
            0.020500915 = score(doc=2836,freq=1.0), product of:
              0.09252074 = queryWeight, product of:
                1.6848338 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.013553018 = queryNorm
              0.22158182 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.0651492 = weight(abstract_txt:personal in 2836) [ClassicSimilarity], result of:
            0.0651492 = score(doc=2836,freq=2.0), product of:
              0.15872781 = queryWeight, product of:
                2.2068052 = boost
                5.307048 = idf(docFreq=569, maxDocs=42306)
                0.013553018 = queryNorm
              0.41044605 = fieldWeight in 2836, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.307048 = idf(docFreq=569, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.05034511 = weight(abstract_txt:take in 2836) [ClassicSimilarity], result of:
            0.05034511 = score(doc=2836,freq=1.0), product of:
              0.16840766 = queryWeight, product of:
                2.2730994 = boost
                5.4664755 = idf(docFreq=485, maxDocs=42306)
                0.013553018 = queryNorm
              0.29894787 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4664755 = idf(docFreq=485, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.052375678 = weight(abstract_txt:conference in 2836) [ClassicSimilarity], result of:
            0.052375678 = score(doc=2836,freq=1.0), product of:
              0.172906 = queryWeight, product of:
                2.3032577 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.013553018 = queryNorm
              0.30291417 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.06646153 = weight(abstract_txt:assess in 2836) [ClassicSimilarity], result of:
            0.06646153 = score(doc=2836,freq=1.0), product of:
              0.20266117 = queryWeight, product of:
                2.493577 = boost
                5.996692 = idf(docFreq=285, maxDocs=42306)
                0.013553018 = queryNorm
              0.3279441 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.996692 = idf(docFreq=285, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.18340215 = weight(abstract_txt:trec in 2836) [ClassicSimilarity], result of:
            0.18340215 = score(doc=2836,freq=4.0), product of:
              0.25117317 = queryWeight, product of:
                2.7760298 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.013553018 = queryNorm
              0.7301821 = fieldWeight in 2836, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.025590263 = weight(abstract_txt:retrieval in 2836) [ClassicSimilarity], result of:
            0.025590263 = score(doc=2836,freq=1.0), product of:
              0.13513985 = queryWeight, product of:
                2.87968 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.013553018 = queryNorm
              0.18936133 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.055922706 = weight(abstract_txt:evaluation in 2836) [ClassicSimilarity], result of:
            0.055922706 = score(doc=2836,freq=1.0), product of:
              0.22757563 = queryWeight, product of:
                3.7369335 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.013553018 = queryNorm
              0.2457324 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
        0.52 = coord(13/25)
    
  5. Gillman, P.: Text retrieval (1998) 0.28
    0.28197128 = sum of:
      0.28197128 = product of:
        0.78325355 = sum of:
          0.0085729845 = weight(abstract_txt:that in 2503) [ClassicSimilarity], result of:
            0.0085729845 = score(doc=2503,freq=1.0), product of:
              0.03259305 = queryWeight, product of:
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.013553018 = queryNorm
              0.26303107 = fieldWeight in 2503, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.109375 = fieldNorm(doc=2503)
          0.008908912 = weight(abstract_txt:information in 2503) [ClassicSimilarity], result of:
            0.008908912 = score(doc=2503,freq=1.0), product of:
              0.03343901 = queryWeight, product of:
                1.0128945 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.013553018 = queryNorm
              0.26642272 = fieldWeight in 2503, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.109375 = fieldNorm(doc=2503)
          0.030863345 = weight(abstract_txt:some in 2503) [ClassicSimilarity], result of:
            0.030863345 = score(doc=2503,freq=1.0), product of:
              0.07655948 = queryWeight, product of:
                1.5326288 = boost
                3.6857507 = idf(docFreq=2883, maxDocs=42306)
                0.013553018 = queryNorm
              0.40312898 = fieldWeight in 2503, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6857507 = idf(docFreq=2883, maxDocs=42306)
                0.109375 = fieldNorm(doc=2503)
          0.05798534 = weight(abstract_txt:text in 2503) [ClassicSimilarity], result of:
            0.05798534 = score(doc=2503,freq=2.0), product of:
              0.09252074 = queryWeight, product of:
                1.6848338 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.013553018 = queryNorm
              0.626728 = fieldWeight in 2503, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.109375 = fieldNorm(doc=2503)
          0.104751356 = weight(abstract_txt:conference in 2503) [ClassicSimilarity], result of:
            0.104751356 = score(doc=2503,freq=1.0), product of:
              0.172906 = queryWeight, product of:
                2.3032577 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.013553018 = queryNorm
              0.60582834 = fieldWeight in 2503, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.109375 = fieldNorm(doc=2503)
          0.10897272 = weight(abstract_txt:early in 2503) [ClassicSimilarity], result of:
            0.10897272 = score(doc=2503,freq=1.0), product of:
              0.17752063 = queryWeight, product of:
                2.3337908 = boost
                5.6124296 = idf(docFreq=419, maxDocs=42306)
                0.013553018 = queryNorm
              0.6138595 = fieldWeight in 2503, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6124296 = idf(docFreq=419, maxDocs=42306)
                0.109375 = fieldNorm(doc=2503)
          0.18340215 = weight(abstract_txt:trec in 2503) [ClassicSimilarity], result of:
            0.18340215 = score(doc=2503,freq=1.0), product of:
              0.25117317 = queryWeight, product of:
                2.7760298 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.013553018 = queryNorm
              0.7301821 = fieldWeight in 2503, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.109375 = fieldNorm(doc=2503)
          0.08864727 = weight(abstract_txt:retrieval in 2503) [ClassicSimilarity], result of:
            0.08864727 = score(doc=2503,freq=3.0), product of:
              0.13513985 = queryWeight, product of:
                2.87968 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.013553018 = queryNorm
              0.6559669 = fieldWeight in 2503, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.109375 = fieldNorm(doc=2503)
          0.19114944 = weight(abstract_txt:experiments in 2503) [ClassicSimilarity], result of:
            0.19114944 = score(doc=2503,freq=1.0), product of:
              0.32530868 = queryWeight, product of:
                4.467868 = boost
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.013553018 = queryNorm
              0.58759403 = fieldWeight in 2503, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.372288 = idf(docFreq=533, maxDocs=42306)
                0.109375 = fieldNorm(doc=2503)
        0.36 = coord(9/25)