Document (#30083)

Author

Voorhees, E.M.
Harman, D.K.

Title

¬The Text REtrieval Conference

Source

TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman

Imprint

Cambridge, MA : MIT Press

Year

2005

Pages

S3-20

Abstract

Text retrieval technology targets a problem that is all too familiar: finding relevant information in large stores of electronic documents. The problem is an old one, with the first research conference devoted to the subject held in 1958 [11]. Since then the problem has continued to grow as more information is created in electronic form and more people gain electronic access. The advent of the World Wide Web, where anyone can publish so everyone must search, is a graphic illustration of the need for effective retrieval technology. The Text REtrieval Conference (TREC) is a workshop series designed to build the infrastructure necessary for the large-scale evaluation of text retrieval technology, thereby accelerating its transfer into the commercial sector. The series is sponsored by the U.S. National Institute of Standards and Technology (NIST) and the U.S. Department of Defense. At the time of this writing, there have been twelve TREC workshops and preparations for the thirteenth workshop are under way. Participants in the workshops have been drawn from the academic, commercial, and government sectors, and have included representatives from more than twenty different countries. These collective efforts have accomplished a great deal: a variety of large test collections have been built for both traditional ad hoc retrieval and related tasks such as cross-language retrieval, speech retrieval, and question answering; retrieval effectiveness has approximately doubled; and many commercial retrieval systems now contain technology first developed in TREC.
This book chronicles the evolution of retrieval systems over the course of TREC. To be sure, there has already been a wealth of information written about TREC. Each conference has produced a proceedings containing general overviews of the various tasks, papers written by the individual participants, and evaluation results.1 Reports on expanded versions of TREC experiments frequently appear in the wider information retrieval literature. There also have been special issues of journals devoted to particular TRECs [3; 13] and particular TREC tasks [6; 4]. No single volume could hope to be a comprehensive record of all TREC-related research. Instead, this book looks to distill the overabundance of detail into a manageable whole that summarizes the main lessons learned from TREC. The book consists of three main parts. The first part contains introductory and descriptive chapters on TREC's history, the major products of TREC (the test collections), and the retrieval evaluation methodology. Part II includes chapters describing the major TREC ''tracks,'' evaluations of special subtopics such as cross-language retrieval and question answering. Part III contains contributions from research groups that have participated in TREC. The epilogue to the book is written by Karen Sparck Jones, who reflects on the impact TREC has had on the information retrieval field. The structure of this introductory chapter is similar to that of the book as a whole. The chapter begins with a short history of TREC; expanded descriptions of specific aspects of the history are included in subsequent chapters to make those chapters self-contained. Section 1.2 describes TREC's track structure, which has been responsible for the growth of TREC and allows TREC to adapt to changing needs. The final section lists both the major accomplishments of TREC and some remaining challenges.

Theme

Retrievalstudien

Object

TREC

Similar documents (author)

1. Harman, D.; Voorhees, E.: Social TREC : an overview (2006) 6.16

   6.160694 = sum of:
     6.160694 = sum of:
       2.9201667 = weight(author_txt:harman in 4458) [ClassicSimilarity], result of:
         2.9201667 = score(doc=4458,freq=1.0), product of:
           0.6821709 = queryWeight, product of:
             8.561393 = idf(docFreq=22, maxDocs=44218)
             0.0796799 = queryNorm
           4.2806964 = fieldWeight in 4458, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.561393 = idf(docFreq=22, maxDocs=44218)
             0.5 = fieldNorm(doc=4458)
       3.2405274 = weight(author_txt:voorhees in 4458) [ClassicSimilarity], result of:
         3.2405274 = score(doc=4458,freq=1.0), product of:
           0.7311928 = queryWeight, product of:
             1.0353075 = boost
             8.863674 = idf(docFreq=16, maxDocs=44218)
             0.0796799 = queryNorm
           4.431837 = fieldWeight in 4458, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.863674 = idf(docFreq=16, maxDocs=44218)
             0.5 = fieldNorm(doc=4458)
   

2. Voorhees, E.M.; Harman, D.K.: Overview of the fifth Text Retrieval Conference (TREC-5) (1997) 6.16

   6.160694 = sum of:
     6.160694 = sum of:
       2.9201667 = weight(author_txt:harman in 3109) [ClassicSimilarity], result of:
         2.9201667 = score(doc=3109,freq=1.0), product of:
           0.6821709 = queryWeight, product of:
             8.561393 = idf(docFreq=22, maxDocs=44218)
             0.0796799 = queryNorm
           4.2806964 = fieldWeight in 3109, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.561393 = idf(docFreq=22, maxDocs=44218)
             0.5 = fieldNorm(doc=3109)
       3.2405274 = weight(author_txt:voorhees in 3109) [ClassicSimilarity], result of:
         3.2405274 = score(doc=3109,freq=1.0), product of:
           0.7311928 = queryWeight, product of:
             1.0353075 = boost
             8.863674 = idf(docFreq=16, maxDocs=44218)
             0.0796799 = queryNorm
           4.431837 = fieldWeight in 3109, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.863674 = idf(docFreq=16, maxDocs=44218)
             0.5 = fieldNorm(doc=3109)
   

3. Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000) 6.16

   6.160694 = sum of:
     6.160694 = sum of:
       2.9201667 = weight(author_txt:harman in 6438) [ClassicSimilarity], result of:
         2.9201667 = score(doc=6438,freq=1.0), product of:
           0.6821709 = queryWeight, product of:
             8.561393 = idf(docFreq=22, maxDocs=44218)
             0.0796799 = queryNorm
           4.2806964 = fieldWeight in 6438, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.561393 = idf(docFreq=22, maxDocs=44218)
             0.5 = fieldNorm(doc=6438)
       3.2405274 = weight(author_txt:voorhees in 6438) [ClassicSimilarity], result of:
         3.2405274 = score(doc=6438,freq=1.0), product of:
           0.7311928 = queryWeight, product of:
             1.0353075 = boost
             8.863674 = idf(docFreq=16, maxDocs=44218)
             0.0796799 = queryNorm
           4.431837 = fieldWeight in 6438, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.863674 = idf(docFreq=16, maxDocs=44218)
             0.5 = fieldNorm(doc=6438)
   

4. Voorhees, E.M.: Implementing agglomerative hierarchic clustering algorithms for use in document retrieval (1986) 2.03

   2.0253296 = sum of:
     2.0253296 = product of:
       4.050659 = sum of:
         4.050659 = weight(author_txt:voorhees in 402) [ClassicSimilarity], result of:
           4.050659 = score(doc=402,freq=1.0), product of:
             0.7311928 = queryWeight, product of:
               1.0353075 = boost
               8.863674 = idf(docFreq=16, maxDocs=44218)
               0.0796799 = queryNorm
             5.5397964 = fieldWeight in 402, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.863674 = idf(docFreq=16, maxDocs=44218)
               0.625 = fieldNorm(doc=402)
       0.5 = coord(1/2)
   

5. Voorhees, E.M.: Question answering in TREC (2005) 2.03

   2.0253296 = sum of:
     2.0253296 = product of:
       4.050659 = sum of:
         4.050659 = weight(author_txt:voorhees in 6487) [ClassicSimilarity], result of:
           4.050659 = score(doc=6487,freq=1.0), product of:
             0.7311928 = queryWeight, product of:
               1.0353075 = boost
               8.863674 = idf(docFreq=16, maxDocs=44218)
               0.0796799 = queryNorm
             5.5397964 = fieldWeight in 6487, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.863674 = idf(docFreq=16, maxDocs=44218)
               0.625 = fieldNorm(doc=6487)
       0.5 = coord(1/2)
   

Similar documents (content)

1. TREC: experiment and evaluation in information retrieval (2005) 0.90

   0.90115297 = sum of:
     0.90115297 = product of:
       1.6092017 = sum of:
         0.040093143 = weight(abstract_txt:workshop in 636) [ClassicSimilarity], result of:
           0.040093143 = score(doc=636,freq=1.0), product of:
             0.09705886 = queryWeight, product of:
               1.0439715 = boost
               6.609291 = idf(docFreq=161, maxDocs=44218)
               0.014066681 = queryNorm
             0.4130807 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.609291 = idf(docFreq=161, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.031881154 = weight(abstract_txt:large in 636) [ClassicSimilarity], result of:
           0.031881154 = score(doc=636,freq=3.0), product of:
             0.066120245 = queryWeight, product of:
               1.0553194 = boost
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.014066681 = queryNorm
             0.4821693 = fieldWeight in 636, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.02659558 = weight(abstract_txt:evaluation in 636) [ClassicSimilarity], result of:
           0.02659558 = score(doc=636,freq=2.0), product of:
             0.06707312 = queryWeight, product of:
               1.0628965 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.014066681 = queryNorm
             0.3965162 = fieldWeight in 636, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.02831055 = weight(abstract_txt:part in 636) [ClassicSimilarity], result of:
           0.02831055 = score(doc=636,freq=2.0), product of:
             0.06992639 = queryWeight, product of:
               1.0852686 = boost
               4.580493 = idf(docFreq=1231, maxDocs=44218)
               0.014066681 = queryNorm
             0.4048622 = fieldWeight in 636, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.580493 = idf(docFreq=1231, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.025712524 = weight(abstract_txt:history in 636) [ClassicSimilarity], result of:
           0.025712524 = score(doc=636,freq=1.0), product of:
             0.08262574 = queryWeight, product of:
               1.1797076 = boost
               4.9790826 = idf(docFreq=826, maxDocs=44218)
               0.014066681 = queryNorm
             0.31119266 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9790826 = idf(docFreq=826, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.04054552 = weight(abstract_txt:tasks in 636) [ClassicSimilarity], result of:
           0.04054552 = score(doc=636,freq=2.0), product of:
             0.088845916 = queryWeight, product of:
               1.2233069 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.014066681 = queryNorm
             0.45635772 = fieldWeight in 636, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.03673296 = weight(abstract_txt:text in 636) [ClassicSimilarity], result of:
           0.03673296 = score(doc=636,freq=4.0), product of:
             0.072668985 = queryWeight, product of:
               1.2774991 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.014066681 = queryNorm
             0.5054833 = fieldWeight in 636, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.04012567 = weight(abstract_txt:commercial in 636) [ClassicSimilarity], result of:
           0.04012567 = score(doc=636,freq=1.0), product of:
             0.11116475 = queryWeight, product of:
               1.3683596 = boost
               5.7753086 = idf(docFreq=372, maxDocs=44218)
               0.014066681 = queryNorm
             0.3609568 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7753086 = idf(docFreq=372, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.027332684 = weight(abstract_txt:technology in 636) [ClassicSimilarity], result of:
           0.027332684 = score(doc=636,freq=1.0), product of:
             0.10203676 = queryWeight, product of:
               1.6924638 = boost
               4.2859354 = idf(docFreq=1653, maxDocs=44218)
               0.014066681 = queryNorm
             0.26787096 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2859354 = idf(docFreq=1653, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.019723354 = weight(abstract_txt:been in 636) [ClassicSimilarity], result of:
           0.019723354 = score(doc=636,freq=1.0), product of:
             0.08723339 = queryWeight, product of:
               1.7142457 = boost
               3.617579 = idf(docFreq=3226, maxDocs=44218)
               0.014066681 = queryNorm
             0.22609869 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.617579 = idf(docFreq=3226, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.04782744 = weight(abstract_txt:conference in 636) [ClassicSimilarity], result of:
           0.04782744 = score(doc=636,freq=1.0), product of:
             0.13754661 = queryWeight, product of:
               1.7575635 = boost
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.014066681 = queryNorm
             0.34771806 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.08891151 = weight(abstract_txt:book in 636) [ClassicSimilarity], result of:
           0.08891151 = score(doc=636,freq=5.0), product of:
             0.13100377 = queryWeight, product of:
               1.9177101 = boost
               4.856341 = idf(docFreq=934, maxDocs=44218)
               0.014066681 = queryNorm
             0.6786943 = fieldWeight in 636, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.856341 = idf(docFreq=934, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.15141676 = weight(abstract_txt:retrieval in 636) [ClassicSimilarity], result of:
           0.15141676 = score(doc=636,freq=12.0), product of:
             0.20124778 = queryWeight, product of:
               4.116871 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.014066681 = queryNorm
             0.7523897 = fieldWeight in 636, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         1.0039928 = weight(abstract_txt:trec in 636) [ClassicSimilarity], result of:
           1.0039928 = score(doc=636,freq=8.0), product of:
             0.8477189 = queryWeight, product of:
               8.99511 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.014066681 = queryNorm
             1.1843464 = fieldWeight in 636, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
       0.56 = coord(14/25)
   

2. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 0.56

   0.56449646 = sum of:
     0.56449646 = product of:
       1.5680456 = sum of:
         0.100232854 = weight(abstract_txt:workshop in 3890) [ClassicSimilarity], result of:
           0.100232854 = score(doc=3890,freq=1.0), product of:
             0.09705886 = queryWeight, product of:
               1.0439715 = boost
               6.609291 = idf(docFreq=161, maxDocs=44218)
               0.014066681 = queryNorm
             1.0327017 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.609291 = idf(docFreq=161, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.04601648 = weight(abstract_txt:large in 3890) [ClassicSimilarity], result of:
           0.04601648 = score(doc=3890,freq=1.0), product of:
             0.066120245 = queryWeight, product of:
               1.0553194 = boost
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.014066681 = queryNorm
             0.69595146 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.047014788 = weight(abstract_txt:evaluation in 3890) [ClassicSimilarity], result of:
           0.047014788 = score(doc=3890,freq=1.0), product of:
             0.06707312 = queryWeight, product of:
               1.0628965 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.014066681 = queryNorm
             0.70094824 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.06428131 = weight(abstract_txt:history in 3890) [ClassicSimilarity], result of:
           0.06428131 = score(doc=3890,freq=1.0), product of:
             0.08262574 = queryWeight, product of:
               1.1797076 = boost
               4.9790826 = idf(docFreq=826, maxDocs=44218)
               0.014066681 = queryNorm
             0.77798164 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9790826 = idf(docFreq=826, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.0459162 = weight(abstract_txt:text in 3890) [ClassicSimilarity], result of:
           0.0459162 = score(doc=3890,freq=1.0), product of:
             0.072668985 = queryWeight, product of:
               1.2774991 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.014066681 = queryNorm
             0.6318542 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.06833171 = weight(abstract_txt:technology in 3890) [ClassicSimilarity], result of:
           0.06833171 = score(doc=3890,freq=1.0), product of:
             0.10203676 = queryWeight, product of:
               1.6924638 = boost
               4.2859354 = idf(docFreq=1653, maxDocs=44218)
               0.014066681 = queryNorm
             0.6696774 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2859354 = idf(docFreq=1653, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.1195686 = weight(abstract_txt:conference in 3890) [ClassicSimilarity], result of:
           0.1195686 = score(doc=3890,freq=1.0), product of:
             0.13754661 = queryWeight, product of:
               1.7575635 = boost
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.014066681 = queryNorm
             0.8692951 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.18927096 = weight(abstract_txt:retrieval in 3890) [ClassicSimilarity], result of:
           0.18927096 = score(doc=3890,freq=3.0), product of:
             0.20124778 = queryWeight, product of:
               4.116871 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.014066681 = queryNorm
             0.94048715 = fieldWeight in 3890, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
         0.88741267 = weight(abstract_txt:trec in 3890) [ClassicSimilarity], result of:
           0.88741267 = score(doc=3890,freq=1.0), product of:
             0.8477189 = queryWeight, product of:
               8.99511 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.014066681 = queryNorm
             1.0468242 = fieldWeight in 3890, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.15625 = fieldNorm(doc=3890)
       0.36 = coord(9/25)
   

3. Harman, D.: ¬The Text REtrieval Conferences (TRECs) : providing a test-bed for information retrieval systems (1998) 0.51

   0.5082172 = sum of:
     0.5082172 = product of:
       1.4117144 = sum of:
         0.060139712 = weight(abstract_txt:workshop in 1314) [ClassicSimilarity], result of:
           0.060139712 = score(doc=1314,freq=1.0), product of:
             0.09705886 = queryWeight, product of:
               1.0439715 = boost
               6.609291 = idf(docFreq=161, maxDocs=44218)
               0.014066681 = queryNorm
             0.61962104 = fieldWeight in 1314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.609291 = idf(docFreq=161, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.039046273 = weight(abstract_txt:large in 1314) [ClassicSimilarity], result of:
           0.039046273 = score(doc=1314,freq=2.0), product of:
             0.066120245 = queryWeight, product of:
               1.0553194 = boost
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.014066681 = queryNorm
             0.5905343 = fieldWeight in 1314, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.031544596 = weight(abstract_txt:major in 1314) [ClassicSimilarity], result of:
           0.031544596 = score(doc=1314,freq=1.0), product of:
             0.072261676 = queryWeight, product of:
               1.1032418 = boost
               4.6563506 = idf(docFreq=1141, maxDocs=44218)
               0.014066681 = queryNorm
             0.43653286 = fieldWeight in 1314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6563506 = idf(docFreq=1141, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.038961187 = weight(abstract_txt:text in 1314) [ClassicSimilarity], result of:
           0.038961187 = score(doc=1314,freq=2.0), product of:
             0.072668985 = queryWeight, product of:
               1.2774991 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.014066681 = queryNorm
             0.53614604 = fieldWeight in 1314, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.05798138 = weight(abstract_txt:technology in 1314) [ClassicSimilarity], result of:
           0.05798138 = score(doc=1314,freq=2.0), product of:
             0.10203676 = queryWeight, product of:
               1.6924638 = boost
               4.2859354 = idf(docFreq=1653, maxDocs=44218)
               0.014066681 = queryNorm
             0.5682401 = fieldWeight in 1314, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2859354 = idf(docFreq=1653, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.12425934 = weight(abstract_txt:conference in 1314) [ClassicSimilarity], result of:
           0.12425934 = score(doc=1314,freq=3.0), product of:
             0.13754661 = queryWeight, product of:
               1.7575635 = boost
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.014066681 = queryNorm
             0.90339804 = fieldWeight in 1314, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.023993134 = weight(abstract_txt:have in 1314) [ClassicSimilarity], result of:
           0.023993134 = score(doc=1314,freq=1.0), product of:
             0.07986227 = queryWeight, product of:
               1.7716417 = boost
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.014066681 = queryNorm
             0.30043143 = fieldWeight in 1314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.11356258 = weight(abstract_txt:retrieval in 1314) [ClassicSimilarity], result of:
           0.11356258 = score(doc=1314,freq=3.0), product of:
             0.20124778 = queryWeight, product of:
               4.116871 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.014066681 = queryNorm
             0.5642923 = fieldWeight in 1314, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
         0.92222625 = weight(abstract_txt:trec in 1314) [ClassicSimilarity], result of:
           0.92222625 = score(doc=1314,freq=3.0), product of:
             0.8477189 = queryWeight, product of:
               8.99511 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.014066681 = queryNorm
             1.0878916 = fieldWeight in 1314, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.09375 = fieldNorm(doc=1314)
       0.36 = coord(9/25)
   

4. Harman, D.K.: ¬The first text retrieval conference : TREC-1, 1992 (1993) 0.35

   0.35299376 = sum of:
     0.35299376 = product of:
       1.260692 = sum of:
         0.055670436 = weight(abstract_txt:text in 1317) [ClassicSimilarity], result of:
           0.055670436 = score(doc=1317,freq=3.0), product of:
             0.072668985 = queryWeight, product of:
               1.2774991 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.014066681 = queryNorm
             0.76608247 = fieldWeight in 1317, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.109375 = fieldNorm(doc=1317)
         0.0478322 = weight(abstract_txt:technology in 1317) [ClassicSimilarity], result of:
           0.0478322 = score(doc=1317,freq=1.0), product of:
             0.10203676 = queryWeight, product of:
               1.6924638 = boost
               4.2859354 = idf(docFreq=1653, maxDocs=44218)
               0.014066681 = queryNorm
             0.4687742 = fieldWeight in 1317, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2859354 = idf(docFreq=1653, maxDocs=44218)
               0.109375 = fieldNorm(doc=1317)
         0.03451587 = weight(abstract_txt:been in 1317) [ClassicSimilarity], result of:
           0.03451587 = score(doc=1317,freq=1.0), product of:
             0.08723339 = queryWeight, product of:
               1.7142457 = boost
               3.617579 = idf(docFreq=3226, maxDocs=44218)
               0.014066681 = queryNorm
             0.3956727 = fieldWeight in 1317, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.617579 = idf(docFreq=3226, maxDocs=44218)
               0.109375 = fieldNorm(doc=1317)
         0.08369803 = weight(abstract_txt:conference in 1317) [ClassicSimilarity], result of:
           0.08369803 = score(doc=1317,freq=1.0), product of:
             0.13754661 = queryWeight, product of:
               1.7575635 = boost
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.014066681 = queryNorm
             0.6085066 = fieldWeight in 1317, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.109375 = fieldNorm(doc=1317)
         0.02799199 = weight(abstract_txt:have in 1317) [ClassicSimilarity], result of:
           0.02799199 = score(doc=1317,freq=1.0), product of:
             0.07986227 = queryWeight, product of:
               1.7716417 = boost
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.014066681 = queryNorm
             0.35050333 = fieldWeight in 1317, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.109375 = fieldNorm(doc=1317)
         0.13248967 = weight(abstract_txt:retrieval in 1317) [ClassicSimilarity], result of:
           0.13248967 = score(doc=1317,freq=3.0), product of:
             0.20124778 = queryWeight, product of:
               4.116871 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.014066681 = queryNorm
             0.658341 = fieldWeight in 1317, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.109375 = fieldNorm(doc=1317)
         0.8784938 = weight(abstract_txt:trec in 1317) [ClassicSimilarity], result of:
           0.8784938 = score(doc=1317,freq=2.0), product of:
             0.8477189 = queryWeight, product of:
               8.99511 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.014066681 = queryNorm
             1.0363032 = fieldWeight in 1317, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.109375 = fieldNorm(doc=1317)
       0.28 = coord(7/25)
   

5. Robertson, S.E.; Walker, S.; Beaulieu, M.: Laboratory experiments with Okapi : participation in the TREC programme (1997) 0.34

   0.3442845 = sum of:
     0.3442845 = product of:
       1.2295876 = sum of:
         0.027730173 = weight(abstract_txt:problem in 2216) [ClassicSimilarity], result of:
           0.027730173 = score(doc=2216,freq=1.0), product of:
             0.06631215 = queryWeight, product of:
               1.0568497 = boost
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.014066681 = queryNorm
             0.41817635 = fieldWeight in 2216, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.09375 = fieldNorm(doc=2216)
         0.028208872 = weight(abstract_txt:evaluation in 2216) [ClassicSimilarity], result of:
           0.028208872 = score(doc=2216,freq=1.0), product of:
             0.06707312 = queryWeight, product of:
               1.0628965 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.014066681 = queryNorm
             0.42056894 = fieldWeight in 2216, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=2216)
         0.038568787 = weight(abstract_txt:history in 2216) [ClassicSimilarity], result of:
           0.038568787 = score(doc=2216,freq=1.0), product of:
             0.08262574 = queryWeight, product of:
               1.1797076 = boost
               4.9790826 = idf(docFreq=826, maxDocs=44218)
               0.014066681 = queryNorm
             0.466789 = fieldWeight in 2216, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9790826 = idf(docFreq=826, maxDocs=44218)
               0.09375 = fieldNorm(doc=2216)
         0.02754972 = weight(abstract_txt:text in 2216) [ClassicSimilarity], result of:
           0.02754972 = score(doc=2216,freq=1.0), product of:
             0.072668985 = queryWeight, product of:
               1.2774991 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.014066681 = queryNorm
             0.37911248 = fieldWeight in 2216, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.09375 = fieldNorm(doc=2216)
         0.071741164 = weight(abstract_txt:conference in 2216) [ClassicSimilarity], result of:
           0.071741164 = score(doc=2216,freq=1.0), product of:
             0.13754661 = queryWeight, product of:
               1.7575635 = boost
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.014066681 = queryNorm
             0.5215771 = fieldWeight in 2216, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.09375 = fieldNorm(doc=2216)
         0.11356258 = weight(abstract_txt:retrieval in 2216) [ClassicSimilarity], result of:
           0.11356258 = score(doc=2216,freq=3.0), product of:
             0.20124778 = queryWeight, product of:
               4.116871 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.014066681 = queryNorm
             0.5642923 = fieldWeight in 2216, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=2216)
         0.92222625 = weight(abstract_txt:trec in 2216) [ClassicSimilarity], result of:
           0.92222625 = score(doc=2216,freq=3.0), product of:
             0.8477189 = queryWeight, product of:
               8.99511 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.014066681 = queryNorm
             1.0878916 = fieldWeight in 2216, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.09375 = fieldNorm(doc=2216)
       0.28 = coord(7/25)