Document (#18581)

Author

Sparck Jones, K.

Title

Reflections on TREC

Source

From classification to 'knowledge organization': Dorking revisited or 'past is prelude'. A collection of reprints to commemorate the firty year span between the Dorking Conference (First International Study Conference on Classification Research 1957) and the Sixth International Study Conference on Classification Research (London 1997). Ed.: A. Gilchrist

Imprint

The Hague : International Federation for Information and Documentation (FID)

Year

1997

Pages

S.101-125

Series

FID publication; no.714)(FIC occasional paper; no.14

Abstract

This paper discusses the Text REtrieval Conferences (TREC) programme as a major enterprise in information retrieval research. It reviews its structure as an evaluation exercise, characterises the methods of indexing and retrieval being tested within its terms of the approaches to system performance factors these represent; analyses the test results for solid, overall conclusions that can be drawn from them; and, in the light of the particular features of the test data, assesses TREC both for generally applicable findings that emerge from it and for directions it offers for future research

Footnote

Wiederabdruck aus: Information processing and management 31(1995) no.3, S.192-314

Theme

Retrievalstudien

Object

TREC

Similar documents (author)

1. Sparck Jones, K.: Fashionable trends and feasible strategies in information management (1988) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 817) [ClassicSimilarity], result of:
         2.0544336 = score(doc=817,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 817, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=817)
       3.2568877 = weight(author_txt:sparck in 817) [ClassicSimilarity], result of:
         3.2568877 = score(doc=817,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 817, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=817)
   

2. Sparck Jones, K.: Automatic classification (1976) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 2908) [ClassicSimilarity], result of:
         2.0544336 = score(doc=2908,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 2908, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=2908)
       3.2568877 = weight(author_txt:sparck in 2908) [ClassicSimilarity], result of:
         3.2568877 = score(doc=2908,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 2908, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=2908)
   

3. Sparck Jones, K.: ¬The role of artificial intelligence in information retrieval (1991) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 4811) [ClassicSimilarity], result of:
         2.0544336 = score(doc=4811,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 4811, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=4811)
       3.2568877 = weight(author_txt:sparck in 4811) [ClassicSimilarity], result of:
         3.2568877 = score(doc=4811,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 4811, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=4811)
   

4. Sparck Jones, K.: Automatic keyword classification for information retrieval (1971) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 5176) [ClassicSimilarity], result of:
         2.0544336 = score(doc=5176,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 5176, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=5176)
       3.2568877 = weight(author_txt:sparck in 5176) [ClassicSimilarity], result of:
         3.2568877 = score(doc=5176,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 5176, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=5176)
   

5. Sparck Jones, K.: ¬A statistical interpretation of term specifity and its application in retrieval (1972) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 5187) [ClassicSimilarity], result of:
         2.0544336 = score(doc=5187,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 5187, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=5187)
       3.2568877 = weight(author_txt:sparck in 5187) [ClassicSimilarity], result of:
         3.2568877 = score(doc=5187,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 5187, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=5187)
   

Similar documents (content)

1. Sparck Jones, K.: Reflections on TREC : TREC-2 (1995) 3.30

   3.2989974 = sum of:
     3.2989974 = product of:
       3.4364557 = sum of:
         0.050129477 = weight(abstract_txt:offers in 1916) [ClassicSimilarity], result of:
           0.050129477 = score(doc=1916,freq=1.0), product of:
             0.10388379 = queryWeight, product of:
               5.1472363 = idf(docFreq=698, maxDocs=44218)
               0.02018244 = queryNorm
             0.48255342 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1472363 = idf(docFreq=698, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.06043733 = weight(abstract_txt:overall in 1916) [ClassicSimilarity], result of:
           0.06043733 = score(doc=1916,freq=1.0), product of:
             0.11767635 = queryWeight, product of:
               1.0643163 = boost
               5.478287 = idf(docFreq=501, maxDocs=44218)
               0.02018244 = queryNorm
             0.51358944 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.478287 = idf(docFreq=501, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.061862696 = weight(abstract_txt:represent in 1916) [ClassicSimilarity], result of:
           0.061862696 = score(doc=1916,freq=1.0), product of:
             0.11951935 = queryWeight, product of:
               1.0726184 = boost
               5.52102 = idf(docFreq=480, maxDocs=44218)
               0.02018244 = queryNorm
             0.51759565 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.52102 = idf(docFreq=480, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.021952027 = weight(abstract_txt:from in 1916) [ClassicSimilarity], result of:
           0.021952027 = score(doc=1916,freq=2.0), product of:
             0.059905786 = queryWeight, product of:
               1.0739288 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.02018244 = queryNorm
             0.36644253 = fieldWeight in 1916, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.06845079 = weight(abstract_txt:analyses in 1916) [ClassicSimilarity], result of:
           0.06845079 = score(doc=1916,freq=1.0), product of:
             0.12786098 = queryWeight, product of:
               1.1094178 = boost
               5.7104354 = idf(docFreq=397, maxDocs=44218)
               0.02018244 = queryNorm
             0.5353533 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7104354 = idf(docFreq=397, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.071610786 = weight(abstract_txt:generally in 1916) [ClassicSimilarity], result of:
           0.071610786 = score(doc=1916,freq=1.0), product of:
             0.13176638 = queryWeight, product of:
               1.1262335 = boost
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.02018244 = queryNorm
             0.5434678 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.07296322 = weight(abstract_txt:tested in 1916) [ClassicSimilarity], result of:
           0.07296322 = score(doc=1916,freq=1.0), product of:
             0.13342023 = queryWeight, product of:
               1.1332793 = boost
               5.8332562 = idf(docFreq=351, maxDocs=44218)
               0.02018244 = queryNorm
             0.5468678 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8332562 = idf(docFreq=351, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.075411886 = weight(abstract_txt:programme in 1916) [ClassicSimilarity], result of:
           0.075411886 = score(doc=1916,freq=1.0), product of:
             0.13638885 = queryWeight, product of:
               1.1458178 = boost
               5.8977947 = idf(docFreq=329, maxDocs=44218)
               0.02018244 = queryNorm
             0.55291826 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8977947 = idf(docFreq=329, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.076719806 = weight(abstract_txt:light in 1916) [ClassicSimilarity], result of:
           0.076719806 = score(doc=1916,freq=1.0), product of:
             0.13796131 = queryWeight, product of:
               1.1524041 = boost
               5.931696 = idf(docFreq=318, maxDocs=44218)
               0.02018244 = queryNorm
             0.5560965 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.931696 = idf(docFreq=318, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.08901718 = weight(abstract_txt:drawn in 1916) [ClassicSimilarity], result of:
           0.08901718 = score(doc=1916,freq=1.0), product of:
             0.15233566 = queryWeight, product of:
               1.2109519 = boost
               6.2330556 = idf(docFreq=235, maxDocs=44218)
               0.02018244 = queryNorm
             0.584349 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2330556 = idf(docFreq=235, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.08938231 = weight(abstract_txt:directions in 1916) [ClassicSimilarity], result of:
           0.08938231 = score(doc=1916,freq=1.0), product of:
             0.15275194 = queryWeight, product of:
               1.2126054 = boost
               6.241566 = idf(docFreq=233, maxDocs=44218)
               0.02018244 = queryNorm
             0.58514684 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.241566 = idf(docFreq=233, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.033130843 = weight(abstract_txt:research in 1916) [ClassicSimilarity], result of:
           0.033130843 = score(doc=1916,freq=2.0), product of:
             0.07882077 = queryWeight, product of:
               1.2318603 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.02018244 = queryNorm
             0.4203314 = fieldWeight in 1916, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.09540718 = weight(abstract_txt:conclusions in 1916) [ClassicSimilarity], result of:
           0.09540718 = score(doc=1916,freq=1.0), product of:
             0.15954126 = queryWeight, product of:
               1.2392606 = boost
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.02018244 = queryNorm
             0.5980094 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.10642789 = weight(abstract_txt:applicable in 1916) [ClassicSimilarity], result of:
           0.10642789 = score(doc=1916,freq=1.0), product of:
             0.17160212 = queryWeight, product of:
               1.2852495 = boost
               6.615483 = idf(docFreq=160, maxDocs=44218)
               0.02018244 = queryNorm
             0.6202015 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.615483 = idf(docFreq=160, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.12397308 = weight(abstract_txt:emerge in 1916) [ClassicSimilarity], result of:
           0.12397308 = score(doc=1916,freq=1.0), product of:
             0.18997827 = queryWeight, product of:
               1.3523157 = boost
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.02018244 = queryNorm
             0.6525645 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.12790152 = weight(abstract_txt:assesses in 1916) [ClassicSimilarity], result of:
           0.12790152 = score(doc=1916,freq=1.0), product of:
             0.1939707 = queryWeight, product of:
               1.3664514 = boost
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.02018244 = queryNorm
             0.6593858 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.1289435 = weight(abstract_txt:enterprise in 1916) [ClassicSimilarity], result of:
           0.1289435 = score(doc=1916,freq=1.0), product of:
             0.19502276 = queryWeight, product of:
               1.370152 = boost
               7.0524964 = idf(docFreq=103, maxDocs=44218)
               0.02018244 = queryNorm
             0.66117156 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0524964 = idf(docFreq=103, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.14242408 = weight(abstract_txt:exercise in 1916) [ClassicSimilarity], result of:
           0.14242408 = score(doc=1916,freq=1.0), product of:
             0.20838892 = queryWeight, product of:
               1.4163266 = boost
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.02018244 = queryNorm
             0.6834532 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.7913017 = weight(title_txt:reflections in 1916) [ClassicSimilarity], result of:
           0.7913017 = score(doc=1916,freq=1.0), product of:
             0.23408625 = queryWeight, product of:
               1.5011153 = boost
               7.7265954 = idf(docFreq=52, maxDocs=44218)
               0.02018244 = queryNorm
             3.3803854 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7265954 = idf(docFreq=52, maxDocs=44218)
               0.4375 = fieldNorm(doc=1916)
         0.18534546 = weight(abstract_txt:solid in 1916) [ClassicSimilarity], result of:
           0.18534546 = score(doc=1916,freq=1.0), product of:
             0.24839354 = queryWeight, product of:
               1.5463089 = boost
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.02018244 = queryNorm
             0.74617666 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.29558235 = weight(abstract_txt:characterises in 1916) [ClassicSimilarity], result of:
           0.29558235 = score(doc=1916,freq=1.0), product of:
             0.33905593 = queryWeight, product of:
               1.806599 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.02018244 = queryNorm
             0.8717805 = fieldWeight in 1916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.13363326 = weight(abstract_txt:test in 1916) [ClassicSimilarity], result of:
           0.13363326 = score(doc=1916,freq=2.0), product of:
             0.19972329 = queryWeight, product of:
               1.9609001 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.02018244 = queryNorm
             0.669092 = fieldWeight in 1916, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.06545213 = weight(abstract_txt:retrieval in 1916) [ClassicSimilarity], result of:
           0.06545213 = score(doc=1916,freq=2.0), product of:
             0.14205787 = queryWeight, product of:
               2.02544 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.02018244 = queryNorm
             0.4607427 = fieldWeight in 1916, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
         0.4689951 = weight(abstract_txt:trec in 1916) [ClassicSimilarity], result of:
           0.4689951 = score(doc=1916,freq=2.0), product of:
             0.52799314 = queryWeight, product of:
               3.9048188 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.02018244 = queryNorm
             0.8882598 = fieldWeight in 1916, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.09375 = fieldNorm(doc=1916)
       0.96 = coord(24/25)
   

2. Keenan, S.; Smeaton, A.F.; Keogh, G.: ¬The effect of pool depth on system evaluation in TREC (2001) 0.24

   0.23874165 = sum of:
     0.23874165 = product of:
       0.85264874 = sum of:
         0.010348286 = weight(abstract_txt:from in 5908) [ClassicSimilarity], result of:
           0.010348286 = score(doc=5908,freq=1.0), product of:
             0.059905786 = queryWeight, product of:
               1.0739288 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.02018244 = queryNorm
             0.17274266 = fieldWeight in 5908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=5908)
         0.045633867 = weight(abstract_txt:analyses in 5908) [ClassicSimilarity], result of:
           0.045633867 = score(doc=5908,freq=1.0), product of:
             0.12786098 = queryWeight, product of:
               1.1094178 = boost
               5.7104354 = idf(docFreq=397, maxDocs=44218)
               0.02018244 = queryNorm
             0.3569022 = fieldWeight in 5908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7104354 = idf(docFreq=397, maxDocs=44218)
               0.0625 = fieldNorm(doc=5908)
         0.082648724 = weight(abstract_txt:emerge in 5908) [ClassicSimilarity], result of:
           0.082648724 = score(doc=5908,freq=1.0), product of:
             0.18997827 = queryWeight, product of:
               1.3523157 = boost
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.02018244 = queryNorm
             0.43504304 = fieldWeight in 5908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.0625 = fieldNorm(doc=5908)
         0.09494939 = weight(abstract_txt:exercise in 5908) [ClassicSimilarity], result of:
           0.09494939 = score(doc=5908,freq=1.0), product of:
             0.20838892 = queryWeight, product of:
               1.4163266 = boost
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.02018244 = queryNorm
             0.4556355 = fieldWeight in 5908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.0625 = fieldNorm(doc=5908)
         0.06299532 = weight(abstract_txt:test in 5908) [ClassicSimilarity], result of:
           0.06299532 = score(doc=5908,freq=1.0), product of:
             0.19972329 = queryWeight, product of:
               1.9609001 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.02018244 = queryNorm
             0.315413 = fieldWeight in 5908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=5908)
         0.06170886 = weight(abstract_txt:retrieval in 5908) [ClassicSimilarity], result of:
           0.06170886 = score(doc=5908,freq=4.0), product of:
             0.14205787 = queryWeight, product of:
               2.02544 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.02018244 = queryNorm
             0.43439242 = fieldWeight in 5908, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=5908)
         0.49436426 = weight(abstract_txt:trec in 5908) [ClassicSimilarity], result of:
           0.49436426 = score(doc=5908,freq=5.0), product of:
             0.52799314 = queryWeight, product of:
               3.9048188 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.02018244 = queryNorm
             0.9363081 = fieldWeight in 5908, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=5908)
       0.28 = coord(7/25)
   

3. TREC: experiment and evaluation in information retrieval (2005) 0.22

   0.2208028 = sum of:
     0.2208028 = product of:
       0.9200117 = sum of:
         0.03341965 = weight(abstract_txt:offers in 636) [ClassicSimilarity], result of:
           0.03341965 = score(doc=636,freq=1.0), product of:
             0.10388379 = queryWeight, product of:
               5.1472363 = idf(docFreq=698, maxDocs=44218)
               0.02018244 = queryNorm
             0.32170227 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1472363 = idf(docFreq=698, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.010348286 = weight(abstract_txt:from in 636) [ClassicSimilarity], result of:
           0.010348286 = score(doc=636,freq=1.0), product of:
             0.059905786 = queryWeight, product of:
               1.0739288 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.02018244 = queryNorm
             0.17274266 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.03492298 = weight(abstract_txt:research in 636) [ClassicSimilarity], result of:
           0.03492298 = score(doc=636,freq=5.0), product of:
             0.07882077 = queryWeight, product of:
               1.2318603 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.02018244 = queryNorm
             0.4430682 = fieldWeight in 636, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.10911109 = weight(abstract_txt:test in 636) [ClassicSimilarity], result of:
           0.10911109 = score(doc=636,freq=3.0), product of:
             0.19972329 = queryWeight, product of:
               1.9609001 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.02018244 = queryNorm
             0.5463113 = fieldWeight in 636, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.10688288 = weight(abstract_txt:retrieval in 636) [ClassicSimilarity], result of:
           0.10688288 = score(doc=636,freq=12.0), product of:
             0.14205787 = queryWeight, product of:
               2.02544 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.02018244 = queryNorm
             0.7523897 = fieldWeight in 636, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.6253268 = weight(abstract_txt:trec in 636) [ClassicSimilarity], result of:
           0.6253268 = score(doc=636,freq=8.0), product of:
             0.52799314 = queryWeight, product of:
               3.9048188 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.02018244 = queryNorm
             1.1843464 = fieldWeight in 636, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
       0.24 = coord(6/25)
   

4. Harman, D.: ¬The Text REtrieval Conferences (TRECs) : providing a test-bed for information retrieval systems (1998) 0.22

   0.22065634 = sum of:
     0.22065634 = product of:
       0.9194014 = sum of:
         0.015522428 = weight(abstract_txt:from in 1314) [ClassicSimilarity], result of:
           0.015522428 = score(doc=1314,freq=1.0), product of:
             0.059905786 = queryWeight, product of:
               1.0739288 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.02018244 = queryNorm
             0.259114 = fieldWeight in 1314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.033130843 = weight(abstract_txt:research in 1314) [ClassicSimilarity], result of:
           0.033130843 = score(doc=1314,freq=2.0), product of:
             0.07882077 = queryWeight, product of:
               1.2318603 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.02018244 = queryNorm
             0.4203314 = fieldWeight in 1314, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.12169367 = weight(abstract_txt:conferences in 1314) [ClassicSimilarity], result of:
           0.12169367 = score(doc=1314,freq=1.0), product of:
             0.1876424 = queryWeight, product of:
               1.3439763 = boost
               6.9177637 = idf(docFreq=118, maxDocs=44218)
               0.02018244 = queryNorm
             0.6485404 = fieldWeight in 1314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9177637 = idf(docFreq=118, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.09449298 = weight(abstract_txt:test in 1314) [ClassicSimilarity], result of:
           0.09449298 = score(doc=1314,freq=1.0), product of:
             0.19972329 = queryWeight, product of:
               1.9609001 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.02018244 = queryNorm
             0.4731195 = fieldWeight in 1314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.08016216 = weight(abstract_txt:retrieval in 1314) [ClassicSimilarity], result of:
           0.08016216 = score(doc=1314,freq=3.0), product of:
             0.14205787 = queryWeight, product of:
               2.02544 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.02018244 = queryNorm
             0.5642923 = fieldWeight in 1314, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.5743993 = weight(abstract_txt:trec in 1314) [ClassicSimilarity], result of:
           0.5743993 = score(doc=1314,freq=3.0), product of:
             0.52799314 = queryWeight, product of:
               3.9048188 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.02018244 = queryNorm
             1.0878916 = fieldWeight in 1314, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
       0.24 = coord(6/25)
   

5. Smeaton, A.F.; Harman, D.: ¬The TREC experiments and their impact on Europe (1997) 0.20

   0.19548713 = sum of:
     0.19548713 = product of:
       0.9774356 = sum of:
         0.070510216 = weight(abstract_txt:overall in 7702) [ClassicSimilarity], result of:
           0.070510216 = score(doc=7702,freq=1.0), product of:
             0.11767635 = queryWeight, product of:
               1.0643163 = boost
               5.478287 = idf(docFreq=501, maxDocs=44218)
               0.02018244 = queryNorm
             0.5991877 = fieldWeight in 7702, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.478287 = idf(docFreq=501, maxDocs=44218)
               0.109375 = fieldNorm(doc=7702)
         0.0181095 = weight(abstract_txt:from in 7702) [ClassicSimilarity], result of:
           0.0181095 = score(doc=7702,freq=1.0), product of:
             0.059905786 = queryWeight, product of:
               1.0739288 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.02018244 = queryNorm
             0.30229968 = fieldWeight in 7702, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.109375 = fieldNorm(doc=7702)
         0.03865265 = weight(abstract_txt:research in 7702) [ClassicSimilarity], result of:
           0.03865265 = score(doc=7702,freq=2.0), product of:
             0.07882077 = queryWeight, product of:
               1.2318603 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.02018244 = queryNorm
             0.4903866 = fieldWeight in 7702, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.109375 = fieldNorm(doc=7702)
         0.076360814 = weight(abstract_txt:retrieval in 7702) [ClassicSimilarity], result of:
           0.076360814 = score(doc=7702,freq=2.0), product of:
             0.14205787 = queryWeight, product of:
               2.02544 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.02018244 = queryNorm
             0.53753316 = fieldWeight in 7702, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.109375 = fieldNorm(doc=7702)
         0.7738024 = weight(abstract_txt:trec in 7702) [ClassicSimilarity], result of:
           0.7738024 = score(doc=7702,freq=4.0), product of:
             0.52799314 = queryWeight, product of:
               3.9048188 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.02018244 = queryNorm
             1.4655539 = fieldWeight in 7702, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.109375 = fieldNorm(doc=7702)
       0.2 = coord(5/25)