Document (#30084)

Author
Voorhees, E.M.
Harman, D.K.
Title
¬The Text REtrieval Conference
Source
TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
Imprint
Cambridge, MA : MIT Press
Year
2005
Pages
S3-20
Abstract
Text retrieval technology targets a problem that is all too familiar: finding relevant information in large stores of electronic documents. The problem is an old one, with the first research conference devoted to the subject held in 1958 [11]. Since then the problem has continued to grow as more information is created in electronic form and more people gain electronic access. The advent of the World Wide Web, where anyone can publish so everyone must search, is a graphic illustration of the need for effective retrieval technology. The Text REtrieval Conference (TREC) is a workshop series designed to build the infrastructure necessary for the large-scale evaluation of text retrieval technology, thereby accelerating its transfer into the commercial sector. The series is sponsored by the U.S. National Institute of Standards and Technology (NIST) and the U.S. Department of Defense. At the time of this writing, there have been twelve TREC workshops and preparations for the thirteenth workshop are under way. Participants in the workshops have been drawn from the academic, commercial, and government sectors, and have included representatives from more than twenty different countries. These collective efforts have accomplished a great deal: a variety of large test collections have been built for both traditional ad hoc retrieval and related tasks such as cross-language retrieval, speech retrieval, and question answering; retrieval effectiveness has approximately doubled; and many commercial retrieval systems now contain technology first developed in TREC.
This book chronicles the evolution of retrieval systems over the course of TREC. To be sure, there has already been a wealth of information written about TREC. Each conference has produced a proceedings containing general overviews of the various tasks, papers written by the individual participants, and evaluation results.1 Reports on expanded versions of TREC experiments frequently appear in the wider information retrieval literature. There also have been special issues of journals devoted to particular TRECs [3; 13] and particular TREC tasks [6; 4]. No single volume could hope to be a comprehensive record of all TREC-related research. Instead, this book looks to distill the overabundance of detail into a manageable whole that summarizes the main lessons learned from TREC. The book consists of three main parts. The first part contains introductory and descriptive chapters on TREC's history, the major products of TREC (the test collections), and the retrieval evaluation methodology. Part II includes chapters describing the major TREC ''tracks,'' evaluations of special subtopics such as cross-language retrieval and question answering. Part III contains contributions from research groups that have participated in TREC. The epilogue to the book is written by Karen Sparck Jones, who reflects on the impact TREC has had on the information retrieval field. The structure of this introductory chapter is similar to that of the book as a whole. The chapter begins with a short history of TREC; expanded descriptions of specific aspects of the history are included in subsequent chapters to make those chapters self-contained. Section 1.2 describes TREC's track structure, which has been responsible for the growth of TREC and allows TREC to adapt to changing needs. The final section lists both the major accomplishments of TREC and some remaining challenges.
Theme
Retrievalstudien
Object
TREC

Similar documents (author)

  1. Harman, D.; Voorhees, E.: Social TREC : an overview (2006) 6.13
    6.1294374 = sum of:
      6.1294374 = sum of:
        2.90454 = weight(author_txt:harman in 4458) [ClassicSimilarity], result of:
          2.90454 = score(doc=4458,freq=1.0), product of:
            0.6820419 = queryWeight, product of:
              8.51719 = idf(docFreq=22, maxDocs=42306)
              0.080078274 = queryNorm
            4.258595 = fieldWeight in 4458, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.51719 = idf(docFreq=22, maxDocs=42306)
              0.5 = fieldNorm(doc=4458)
        3.2248971 = weight(author_txt:voorhees in 4458) [ClassicSimilarity], result of:
          3.2248971 = score(doc=4458,freq=1.0), product of:
            0.7313131 = queryWeight, product of:
              1.0354906 = boost
              8.81947 = idf(docFreq=16, maxDocs=42306)
              0.080078274 = queryNorm
            4.409735 = fieldWeight in 4458, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.81947 = idf(docFreq=16, maxDocs=42306)
              0.5 = fieldNorm(doc=4458)
    
  2. Voorhees, E.M.; Harman, D.K.: Overview of the fifth Text Retrieval Conference (TREC-5) (1997) 6.13
    6.1294374 = sum of:
      6.1294374 = sum of:
        2.90454 = weight(author_txt:harman in 4110) [ClassicSimilarity], result of:
          2.90454 = score(doc=4110,freq=1.0), product of:
            0.6820419 = queryWeight, product of:
              8.51719 = idf(docFreq=22, maxDocs=42306)
              0.080078274 = queryNorm
            4.258595 = fieldWeight in 4110, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.51719 = idf(docFreq=22, maxDocs=42306)
              0.5 = fieldNorm(doc=4110)
        3.2248971 = weight(author_txt:voorhees in 4110) [ClassicSimilarity], result of:
          3.2248971 = score(doc=4110,freq=1.0), product of:
            0.7313131 = queryWeight, product of:
              1.0354906 = boost
              8.81947 = idf(docFreq=16, maxDocs=42306)
              0.080078274 = queryNorm
            4.409735 = fieldWeight in 4110, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.81947 = idf(docFreq=16, maxDocs=42306)
              0.5 = fieldNorm(doc=4110)
    
  3. Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000) 6.13
    6.1294374 = sum of:
      6.1294374 = sum of:
        2.90454 = weight(author_txt:harman in 439) [ClassicSimilarity], result of:
          2.90454 = score(doc=439,freq=1.0), product of:
            0.6820419 = queryWeight, product of:
              8.51719 = idf(docFreq=22, maxDocs=42306)
              0.080078274 = queryNorm
            4.258595 = fieldWeight in 439, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.51719 = idf(docFreq=22, maxDocs=42306)
              0.5 = fieldNorm(doc=439)
        3.2248971 = weight(author_txt:voorhees in 439) [ClassicSimilarity], result of:
          3.2248971 = score(doc=439,freq=1.0), product of:
            0.7313131 = queryWeight, product of:
              1.0354906 = boost
              8.81947 = idf(docFreq=16, maxDocs=42306)
              0.080078274 = queryNorm
            4.409735 = fieldWeight in 439, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.81947 = idf(docFreq=16, maxDocs=42306)
              0.5 = fieldNorm(doc=439)
    
  4. Voorhees, E.M.: Implementing agglomerative hierarchic clustering algorithms for use in document retrieval (1986) 2.02
    2.0155606 = sum of:
      2.0155606 = product of:
        4.0311213 = sum of:
          4.0311213 = weight(author_txt:voorhees in 402) [ClassicSimilarity], result of:
            4.0311213 = score(doc=402,freq=1.0), product of:
              0.7313131 = queryWeight, product of:
                1.0354906 = boost
                8.81947 = idf(docFreq=16, maxDocs=42306)
                0.080078274 = queryNorm
              5.512169 = fieldWeight in 402, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.81947 = idf(docFreq=16, maxDocs=42306)
                0.625 = fieldNorm(doc=402)
        0.5 = coord(1/2)
    
  5. Voorhees, E.M.: Question answering in TREC (2005) 2.02
    2.0155606 = sum of:
      2.0155606 = product of:
        4.0311213 = sum of:
          4.0311213 = weight(author_txt:voorhees in 6487) [ClassicSimilarity], result of:
            4.0311213 = score(doc=6487,freq=1.0), product of:
              0.7313131 = queryWeight, product of:
                1.0354906 = boost
                8.81947 = idf(docFreq=16, maxDocs=42306)
                0.080078274 = queryNorm
              5.512169 = fieldWeight in 6487, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.81947 = idf(docFreq=16, maxDocs=42306)
                0.625 = fieldNorm(doc=6487)
        0.5 = coord(1/2)
    

Similar documents (content)

  1. TREC: experiment and evaluation in information retrieval (2005) 0.98
    0.97968227 = sum of:
      0.97968227 = product of:
        1.6328037 = sum of:
          0.022241704 = weight(abstract_txt:first in 1762) [ClassicSimilarity], result of:
            0.022241704 = score(doc=1762,freq=2.0), product of:
              0.05966001 = queryWeight, product of:
                4.2178364 = idf(docFreq=1693, maxDocs=42306)
                0.014144695 = queryNorm
              0.3728076 = fieldWeight in 1762, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.2178364 = idf(docFreq=1693, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.04022375 = weight(abstract_txt:workshop in 1762) [ClassicSimilarity], result of:
            0.04022375 = score(doc=1762,freq=1.0), product of:
              0.09747036 = queryWeight, product of:
                1.0436358 = boost
                6.602828 = idf(docFreq=155, maxDocs=42306)
                0.014144695 = queryNorm
              0.41267675 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.602828 = idf(docFreq=155, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.03246437 = weight(abstract_txt:large in 1762) [ClassicSimilarity], result of:
            0.03246437 = score(doc=1762,freq=3.0), product of:
              0.06706236 = queryWeight, product of:
                1.0602243 = boost
                4.471853 = idf(docFreq=1313, maxDocs=42306)
                0.014144695 = queryNorm
              0.48409227 = fieldWeight in 1762, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.471853 = idf(docFreq=1313, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.026891928 = weight(abstract_txt:evaluation in 1762) [ClassicSimilarity], result of:
            0.026891928 = score(doc=1762,freq=2.0), product of:
              0.06770996 = queryWeight, product of:
                1.0653311 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.014144695 = queryNorm
              0.39716354 = fieldWeight in 1762, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.028753772 = weight(abstract_txt:part in 1762) [ClassicSimilarity], result of:
            0.028753772 = score(doc=1762,freq=2.0), product of:
              0.07080021 = queryWeight, product of:
                1.0893705 = boost
                4.594786 = idf(docFreq=1161, maxDocs=42306)
                0.014144695 = queryNorm
              0.40612555 = fieldWeight in 1762, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.594786 = idf(docFreq=1161, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.026609866 = weight(abstract_txt:history in 1762) [ClassicSimilarity], result of:
            0.026609866 = score(doc=1762,freq=1.0), product of:
              0.08471163 = queryWeight, product of:
                1.1915983 = boost
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.014144695 = queryNorm
              0.31412292 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.042271994 = weight(abstract_txt:tasks in 1762) [ClassicSimilarity], result of:
            0.042271994 = score(doc=1762,freq=2.0), product of:
              0.09153906 = queryWeight, product of:
                1.2386869 = boost
                5.224579 = idf(docFreq=618, maxDocs=42306)
                0.014144695 = queryNorm
              0.46179187 = fieldWeight in 1762, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.224579 = idf(docFreq=618, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.037178405 = weight(abstract_txt:text in 1762) [ClassicSimilarity], result of:
            0.037178405 = score(doc=1762,freq=4.0), product of:
              0.07340653 = queryWeight, product of:
                1.2808405 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.014144695 = queryNorm
              0.5064727 = fieldWeight in 1762, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.040191926 = weight(abstract_txt:commercial in 1762) [ClassicSimilarity], result of:
            0.040191926 = score(doc=1762,freq=1.0), product of:
              0.11151685 = queryWeight, product of:
                1.367189 = boost
                5.76658 = idf(docFreq=359, maxDocs=42306)
                0.014144695 = queryNorm
              0.36041126 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.76658 = idf(docFreq=359, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.027766269 = weight(abstract_txt:technology in 1762) [ClassicSimilarity], result of:
            0.027766269 = score(doc=1762,freq=1.0), product of:
              0.1033259 = queryWeight, product of:
                1.6989763 = boost
                4.2996025 = idf(docFreq=1560, maxDocs=42306)
                0.014144695 = queryNorm
              0.26872516 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.2996025 = idf(docFreq=1560, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.020289104 = weight(abstract_txt:been in 1762) [ClassicSimilarity], result of:
            0.020289104 = score(doc=1762,freq=1.0), product of:
              0.0890772 = queryWeight, product of:
                1.7280512 = boost
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.014144695 = queryNorm
              0.22776991 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.047491644 = weight(abstract_txt:conference in 1762) [ClassicSimilarity], result of:
            0.047491644 = score(doc=1762,freq=1.0), product of:
              0.1371847 = queryWeight, product of:
                1.7509774 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.014144695 = queryNorm
              0.34618762 = fieldWeight in 1762, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.09018473 = weight(abstract_txt:book in 1762) [ClassicSimilarity], result of:
            0.09018473 = score(doc=1762,freq=5.0), product of:
              0.1325245 = queryWeight, product of:
                1.924114 = boost
                4.869359 = idf(docFreq=882, maxDocs=42306)
                0.014144695 = queryNorm
              0.6805136 = fieldWeight in 1762, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.869359 = idf(docFreq=882, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.15071419 = weight(abstract_txt:retrieval in 1762) [ClassicSimilarity], result of:
            0.15071419 = score(doc=1762,freq=12.0), product of:
              0.201039 = queryWeight, product of:
                4.1047196 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.014144695 = queryNorm
              0.7496764 = fieldWeight in 1762, product of:
                3.4641016 = tf(freq=12.0), with freq of:
                  12.0 = termFreq=12.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
          0.99953 = weight(abstract_txt:trec in 1762) [ClassicSimilarity], result of:
            0.99953 = score(doc=1762,freq=8.0), product of:
              0.84694993 = queryWeight, product of:
                8.969145 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.014144695 = queryNorm
              1.1801524 = fieldWeight in 1762, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0625 = fieldNorm(doc=1762)
        0.6 = coord(15/25)
    
  2. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 0.56
    0.56446546 = sum of:
      0.56446546 = product of:
        1.5679595 = sum of:
          0.100559376 = weight(abstract_txt:workshop in 891) [ClassicSimilarity], result of:
            0.100559376 = score(doc=891,freq=1.0), product of:
              0.09747036 = queryWeight, product of:
                1.0436358 = boost
                6.602828 = idf(docFreq=155, maxDocs=42306)
                0.014144695 = queryNorm
              1.0316919 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.602828 = idf(docFreq=155, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.046858285 = weight(abstract_txt:large in 891) [ClassicSimilarity], result of:
            0.046858285 = score(doc=891,freq=1.0), product of:
              0.06706236 = queryWeight, product of:
                1.0602243 = boost
                4.471853 = idf(docFreq=1313, maxDocs=42306)
                0.014144695 = queryNorm
              0.698727 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.471853 = idf(docFreq=1313, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.04753866 = weight(abstract_txt:evaluation in 891) [ClassicSimilarity], result of:
            0.04753866 = score(doc=891,freq=1.0), product of:
              0.06770996 = queryWeight, product of:
                1.0653311 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.014144695 = queryNorm
              0.7020926 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.06652466 = weight(abstract_txt:history in 891) [ClassicSimilarity], result of:
            0.06652466 = score(doc=891,freq=1.0), product of:
              0.08471163 = queryWeight, product of:
                1.1915983 = boost
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.014144695 = queryNorm
              0.7853073 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0259666 = idf(docFreq=754, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.046473004 = weight(abstract_txt:text in 891) [ClassicSimilarity], result of:
            0.046473004 = score(doc=891,freq=1.0), product of:
              0.07340653 = queryWeight, product of:
                1.2808405 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.014144695 = queryNorm
              0.63309085 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.06941567 = weight(abstract_txt:technology in 891) [ClassicSimilarity], result of:
            0.06941567 = score(doc=891,freq=1.0), product of:
              0.1033259 = queryWeight, product of:
                1.6989763 = boost
                4.2996025 = idf(docFreq=1560, maxDocs=42306)
                0.014144695 = queryNorm
              0.6718129 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.2996025 = idf(docFreq=1560, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.11872911 = weight(abstract_txt:conference in 891) [ClassicSimilarity], result of:
            0.11872911 = score(doc=891,freq=1.0), product of:
              0.1371847 = queryWeight, product of:
                1.7509774 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.014144695 = queryNorm
              0.86546904 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.18839274 = weight(abstract_txt:retrieval in 891) [ClassicSimilarity], result of:
            0.18839274 = score(doc=891,freq=3.0), product of:
              0.201039 = queryWeight, product of:
                4.1047196 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.014144695 = queryNorm
              0.9370955 = fieldWeight in 891, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
          0.8834681 = weight(abstract_txt:trec in 891) [ClassicSimilarity], result of:
            0.8834681 = score(doc=891,freq=1.0), product of:
              0.84694993 = queryWeight, product of:
                8.969145 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.014144695 = queryNorm
              1.0431173 = fieldWeight in 891, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.15625 = fieldNorm(doc=891)
        0.36 = coord(9/25)
    
  3. Harman, D.: ¬The Text REtrieval Conferences (TRECs) : providing a test-bed for information retrieval systems (1998) 0.51
    0.50760823 = sum of:
      0.50760823 = product of:
        1.4100229 = sum of:
          0.060335625 = weight(abstract_txt:workshop in 2315) [ClassicSimilarity], result of:
            0.060335625 = score(doc=2315,freq=1.0), product of:
              0.09747036 = queryWeight, product of:
                1.0436358 = boost
                6.602828 = idf(docFreq=155, maxDocs=42306)
                0.014144695 = queryNorm
              0.6190151 = fieldWeight in 2315, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.602828 = idf(docFreq=155, maxDocs=42306)
                0.09375 = fieldNorm(doc=2315)
          0.039760575 = weight(abstract_txt:large in 2315) [ClassicSimilarity], result of:
            0.039760575 = score(doc=2315,freq=2.0), product of:
              0.06706236 = queryWeight, product of:
                1.0602243 = boost
                4.471853 = idf(docFreq=1313, maxDocs=42306)
                0.014144695 = queryNorm
              0.59288955 = fieldWeight in 2315, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.471853 = idf(docFreq=1313, maxDocs=42306)
                0.09375 = fieldNorm(doc=2315)
          0.032035753 = weight(abstract_txt:major in 2315) [ClassicSimilarity], result of:
            0.032035753 = score(doc=2315,freq=1.0), product of:
              0.07316057 = queryWeight, product of:
                1.1073805 = boost
                4.6707497 = idf(docFreq=1076, maxDocs=42306)
                0.014144695 = queryNorm
              0.43788278 = fieldWeight in 2315, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6707497 = idf(docFreq=1076, maxDocs=42306)
                0.09375 = fieldNorm(doc=2315)
          0.039433654 = weight(abstract_txt:text in 2315) [ClassicSimilarity], result of:
            0.039433654 = score(doc=2315,freq=2.0), product of:
              0.07340653 = queryWeight, product of:
                1.2808405 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.014144695 = queryNorm
              0.53719544 = fieldWeight in 2315, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.09375 = fieldNorm(doc=2315)
          0.058901154 = weight(abstract_txt:technology in 2315) [ClassicSimilarity], result of:
            0.058901154 = score(doc=2315,freq=2.0), product of:
              0.1033259 = queryWeight, product of:
                1.6989763 = boost
                4.2996025 = idf(docFreq=1560, maxDocs=42306)
                0.014144695 = queryNorm
              0.57005215 = fieldWeight in 2315, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.2996025 = idf(docFreq=1560, maxDocs=42306)
                0.09375 = fieldNorm(doc=2315)
          0.123386905 = weight(abstract_txt:conference in 2315) [ClassicSimilarity], result of:
            0.123386905 = score(doc=2315,freq=3.0), product of:
              0.1371847 = queryWeight, product of:
                1.7509774 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.014144695 = queryNorm
              0.8994218 = fieldWeight in 2315, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.09375 = fieldNorm(doc=2315)
          0.02500662 = weight(abstract_txt:have in 2315) [ClassicSimilarity], result of:
            0.02500662 = score(doc=2315,freq=1.0), product of:
              0.082265176 = queryWeight, product of:
                1.7937204 = boost
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.014144695 = queryNorm
              0.30397576 = fieldWeight in 2315, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.09375 = fieldNorm(doc=2315)
          0.11303564 = weight(abstract_txt:retrieval in 2315) [ClassicSimilarity], result of:
            0.11303564 = score(doc=2315,freq=3.0), product of:
              0.201039 = queryWeight, product of:
                4.1047196 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.014144695 = queryNorm
              0.5622573 = fieldWeight in 2315, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.09375 = fieldNorm(doc=2315)
          0.91812694 = weight(abstract_txt:trec in 2315) [ClassicSimilarity], result of:
            0.91812694 = score(doc=2315,freq=3.0), product of:
              0.84694993 = queryWeight, product of:
                8.969145 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.014144695 = queryNorm
              1.0840392 = fieldWeight in 2315, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.09375 = fieldNorm(doc=2315)
        0.36 = coord(9/25)
    
  4. Blair, D.C.: ¬The challenge of commercial document retrieval : Part I: Major issues, and a framework based on search exhaustivity, determinacy of representation and document collection size (2002) 0.36
    0.36244723 = sum of:
      0.36244723 = product of:
        0.8237437 = sum of:
          0.013761353 = weight(abstract_txt:first in 3581) [ClassicSimilarity], result of:
            0.013761353 = score(doc=3581,freq=1.0), product of:
              0.05966001 = queryWeight, product of:
                4.2178364 = idf(docFreq=1693, maxDocs=42306)
                0.014144695 = queryNorm
              0.23066293 = fieldWeight in 3581, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.2178364 = idf(docFreq=1693, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.023193667 = weight(abstract_txt:large in 3581) [ClassicSimilarity], result of:
            0.023193667 = score(doc=3581,freq=2.0), product of:
              0.06706236 = queryWeight, product of:
                1.0602243 = boost
                4.471853 = idf(docFreq=1313, maxDocs=42306)
                0.014144695 = queryNorm
              0.34585223 = fieldWeight in 3581, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.471853 = idf(docFreq=1313, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.035580978 = weight(abstract_txt:part in 3581) [ClassicSimilarity], result of:
            0.035580978 = score(doc=3581,freq=4.0), product of:
              0.07080021 = queryWeight, product of:
                1.0893705 = boost
                4.594786 = idf(docFreq=1161, maxDocs=42306)
                0.014144695 = queryNorm
              0.5025547 = fieldWeight in 3581, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.594786 = idf(docFreq=1161, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.018687522 = weight(abstract_txt:major in 3581) [ClassicSimilarity], result of:
            0.018687522 = score(doc=3581,freq=1.0), product of:
              0.07316057 = queryWeight, product of:
                1.1073805 = boost
                4.6707497 = idf(docFreq=1076, maxDocs=42306)
                0.014144695 = queryNorm
              0.25543162 = fieldWeight in 3581, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6707497 = idf(docFreq=1076, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.016265552 = weight(abstract_txt:text in 3581) [ClassicSimilarity], result of:
            0.016265552 = score(doc=3581,freq=1.0), product of:
              0.07340653 = queryWeight, product of:
                1.2808405 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.014144695 = queryNorm
              0.22158182 = fieldWeight in 3581, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.0786379 = weight(abstract_txt:commercial in 3581) [ClassicSimilarity], result of:
            0.0786379 = score(doc=3581,freq=5.0), product of:
              0.11151685 = queryWeight, product of:
                1.367189 = boost
                5.76658 = idf(docFreq=359, maxDocs=42306)
                0.014144695 = queryNorm
              0.7051661 = fieldWeight in 3581, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.76658 = idf(docFreq=359, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.017752968 = weight(abstract_txt:been in 3581) [ClassicSimilarity], result of:
            0.017752968 = score(doc=3581,freq=1.0), product of:
              0.0890772 = queryWeight, product of:
                1.7280512 = boost
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.014144695 = queryNorm
              0.19929868 = fieldWeight in 3581, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.04155519 = weight(abstract_txt:conference in 3581) [ClassicSimilarity], result of:
            0.04155519 = score(doc=3581,freq=1.0), product of:
              0.1371847 = queryWeight, product of:
                1.7509774 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.014144695 = queryNorm
              0.30291417 = fieldWeight in 3581, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.02062941 = weight(abstract_txt:have in 3581) [ClassicSimilarity], result of:
            0.02062941 = score(doc=3581,freq=2.0), product of:
              0.082265176 = queryWeight, product of:
                1.7937204 = boost
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.014144695 = queryNorm
              0.25076723 = fieldWeight in 3581, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.12038479 = weight(abstract_txt:retrieval in 3581) [ClassicSimilarity], result of:
            0.12038479 = score(doc=3581,freq=10.0), product of:
              0.201039 = queryWeight, product of:
                4.1047196 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.014144695 = queryNorm
              0.5988131 = fieldWeight in 3581, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
          0.43729436 = weight(abstract_txt:trec in 3581) [ClassicSimilarity], result of:
            0.43729436 = score(doc=3581,freq=2.0), product of:
              0.84694993 = queryWeight, product of:
                8.969145 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.014144695 = queryNorm
              0.51631665 = fieldWeight in 3581, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3581)
        0.44 = coord(11/25)
    
  5. Harman, D.K.: ¬The first text retrieval conference : TREC-1, 1992 (1993) 0.35
    0.35257342 = sum of:
      0.35257342 = product of:
        1.2591908 = sum of:
          0.056345522 = weight(abstract_txt:text in 2318) [ClassicSimilarity], result of:
            0.056345522 = score(doc=2318,freq=3.0), product of:
              0.07340653 = queryWeight, product of:
                1.2808405 = boost
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.014144695 = queryNorm
              0.7675819 = fieldWeight in 2318, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.0517817 = idf(docFreq=1999, maxDocs=42306)
                0.109375 = fieldNorm(doc=2318)
          0.048590973 = weight(abstract_txt:technology in 2318) [ClassicSimilarity], result of:
            0.048590973 = score(doc=2318,freq=1.0), product of:
              0.1033259 = queryWeight, product of:
                1.6989763 = boost
                4.2996025 = idf(docFreq=1560, maxDocs=42306)
                0.014144695 = queryNorm
              0.47026902 = fieldWeight in 2318, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.2996025 = idf(docFreq=1560, maxDocs=42306)
                0.109375 = fieldNorm(doc=2318)
          0.035505936 = weight(abstract_txt:been in 2318) [ClassicSimilarity], result of:
            0.035505936 = score(doc=2318,freq=1.0), product of:
              0.0890772 = queryWeight, product of:
                1.7280512 = boost
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.014144695 = queryNorm
              0.39859736 = fieldWeight in 2318, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.109375 = fieldNorm(doc=2318)
          0.08311038 = weight(abstract_txt:conference in 2318) [ClassicSimilarity], result of:
            0.08311038 = score(doc=2318,freq=1.0), product of:
              0.1371847 = queryWeight, product of:
                1.7509774 = boost
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.014144695 = queryNorm
              0.60582834 = fieldWeight in 2318, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.539002 = idf(docFreq=451, maxDocs=42306)
                0.109375 = fieldNorm(doc=2318)
          0.02917439 = weight(abstract_txt:have in 2318) [ClassicSimilarity], result of:
            0.02917439 = score(doc=2318,freq=1.0), product of:
              0.082265176 = queryWeight, product of:
                1.7937204 = boost
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.014144695 = queryNorm
              0.3546384 = fieldWeight in 2318, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.109375 = fieldNorm(doc=2318)
          0.13187492 = weight(abstract_txt:retrieval in 2318) [ClassicSimilarity], result of:
            0.13187492 = score(doc=2318,freq=3.0), product of:
              0.201039 = queryWeight, product of:
                4.1047196 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.014144695 = queryNorm
              0.6559669 = fieldWeight in 2318, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.109375 = fieldNorm(doc=2318)
          0.8745887 = weight(abstract_txt:trec in 2318) [ClassicSimilarity], result of:
            0.8745887 = score(doc=2318,freq=2.0), product of:
              0.84694993 = queryWeight, product of:
                8.969145 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.014144695 = queryNorm
              1.0326333 = fieldWeight in 2318, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.109375 = fieldNorm(doc=2318)
        0.28 = coord(7/25)