Document (#30081)

Author
Voorhees, E.M.
Harman, D.K.
Title
¬The Text REtrieval Conference
Source
TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
Imprint
Cambridge, MA : MIT Press
Year
2005
Pages
S3-20
Abstract
Text retrieval technology targets a problem that is all too familiar: finding relevant information in large stores of electronic documents. The problem is an old one, with the first research conference devoted to the subject held in 1958 [11]. Since then the problem has continued to grow as more information is created in electronic form and more people gain electronic access. The advent of the World Wide Web, where anyone can publish so everyone must search, is a graphic illustration of the need for effective retrieval technology. The Text REtrieval Conference (TREC) is a workshop series designed to build the infrastructure necessary for the large-scale evaluation of text retrieval technology, thereby accelerating its transfer into the commercial sector. The series is sponsored by the U.S. National Institute of Standards and Technology (NIST) and the U.S. Department of Defense. At the time of this writing, there have been twelve TREC workshops and preparations for the thirteenth workshop are under way. Participants in the workshops have been drawn from the academic, commercial, and government sectors, and have included representatives from more than twenty different countries. These collective efforts have accomplished a great deal: a variety of large test collections have been built for both traditional ad hoc retrieval and related tasks such as cross-language retrieval, speech retrieval, and question answering; retrieval effectiveness has approximately doubled; and many commercial retrieval systems now contain technology first developed in TREC.
This book chronicles the evolution of retrieval systems over the course of TREC. To be sure, there has already been a wealth of information written about TREC. Each conference has produced a proceedings containing general overviews of the various tasks, papers written by the individual participants, and evaluation results.1 Reports on expanded versions of TREC experiments frequently appear in the wider information retrieval literature. There also have been special issues of journals devoted to particular TRECs [3; 13] and particular TREC tasks [6; 4]. No single volume could hope to be a comprehensive record of all TREC-related research. Instead, this book looks to distill the overabundance of detail into a manageable whole that summarizes the main lessons learned from TREC. The book consists of three main parts. The first part contains introductory and descriptive chapters on TREC's history, the major products of TREC (the test collections), and the retrieval evaluation methodology. Part II includes chapters describing the major TREC ''tracks,'' evaluations of special subtopics such as cross-language retrieval and question answering. Part III contains contributions from research groups that have participated in TREC. The epilogue to the book is written by Karen Sparck Jones, who reflects on the impact TREC has had on the information retrieval field. The structure of this introductory chapter is similar to that of the book as a whole. The chapter begins with a short history of TREC; expanded descriptions of specific aspects of the history are included in subsequent chapters to make those chapters self-contained. Section 1.2 describes TREC's track structure, which has been responsible for the growth of TREC and allows TREC to adapt to changing needs. The final section lists both the major accomplishments of TREC and some remaining challenges.
Theme
Retrievalstudien
Object
TREC

Similar documents (author)

  1. Harman, D.; Voorhees, E.: Social TREC : an overview (2006) 6.15 
    6.1500273 = sum of:
  6.1500273 = sum of:
    2.9148343 = weight(author_txt:harman in 4457) [ClassicSimilarity], result of:
      2.9148343 = score(doc=4457,freq=1.0), product of:
        0.68212706 = queryWeight, product of:
          8.5463085 = idf(docFreq=22, maxDocs=43556)
          0.0798154 = queryNorm
        4.2731543 = fieldWeight in 4457, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.5463085 = idf(docFreq=22, maxDocs=43556)
          0.5 = fieldNorm(doc=4457)
    3.235193 = weight(author_txt:voorhees in 4457) [ClassicSimilarity], result of:
      3.235193 = score(doc=4457,freq=1.0), product of:
        0.73123366 = queryWeight, product of:
          1.0353698 = boost
          8.848589 = idf(docFreq=16, maxDocs=43556)
          0.0798154 = queryNorm
        4.4242945 = fieldWeight in 4457, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.848589 = idf(docFreq=16, maxDocs=43556)
          0.5 = fieldNorm(doc=4457)
  2. Voorhees, E.M.; Harman, D.K.: Overview of the fifth Text Retrieval Conference (TREC-5) (1997) 6.15 
    6.1500273 = sum of:
  6.1500273 = sum of:
    2.9148343 = weight(author_txt:harman in 4107) [ClassicSimilarity], result of:
      2.9148343 = score(doc=4107,freq=1.0), product of:
        0.68212706 = queryWeight, product of:
          8.5463085 = idf(docFreq=22, maxDocs=43556)
          0.0798154 = queryNorm
        4.2731543 = fieldWeight in 4107, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.5463085 = idf(docFreq=22, maxDocs=43556)
          0.5 = fieldNorm(doc=4107)
    3.235193 = weight(author_txt:voorhees in 4107) [ClassicSimilarity], result of:
      3.235193 = score(doc=4107,freq=1.0), product of:
        0.73123366 = queryWeight, product of:
          1.0353698 = boost
          8.848589 = idf(docFreq=16, maxDocs=43556)
          0.0798154 = queryNorm
        4.4242945 = fieldWeight in 4107, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.848589 = idf(docFreq=16, maxDocs=43556)
          0.5 = fieldNorm(doc=4107)
  3. Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000) 6.15 
    6.1500273 = sum of:
  6.1500273 = sum of:
    2.9148343 = weight(author_txt:harman in 436) [ClassicSimilarity], result of:
      2.9148343 = score(doc=436,freq=1.0), product of:
        0.68212706 = queryWeight, product of:
          8.5463085 = idf(docFreq=22, maxDocs=43556)
          0.0798154 = queryNorm
        4.2731543 = fieldWeight in 436, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.5463085 = idf(docFreq=22, maxDocs=43556)
          0.5 = fieldNorm(doc=436)
    3.235193 = weight(author_txt:voorhees in 436) [ClassicSimilarity], result of:
      3.235193 = score(doc=436,freq=1.0), product of:
        0.73123366 = queryWeight, product of:
          1.0353698 = boost
          8.848589 = idf(docFreq=16, maxDocs=43556)
          0.0798154 = queryNorm
        4.4242945 = fieldWeight in 436, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.848589 = idf(docFreq=16, maxDocs=43556)
          0.5 = fieldNorm(doc=436)
  4. Voorhees, E.M.: Implementing agglomerative hierarchic clustering algorithms for use in document retrieval (1986) 2.02 
    2.0219955 = sum of:
  2.0219955 = product of:
    4.043991 = sum of:
      4.043991 = weight(author_txt:voorhees in 402) [ClassicSimilarity], result of:
        4.043991 = score(doc=402,freq=1.0), product of:
          0.73123366 = queryWeight, product of:
            1.0353698 = boost
            8.848589 = idf(docFreq=16, maxDocs=43556)
            0.0798154 = queryNorm
          5.530368 = fieldWeight in 402, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.848589 = idf(docFreq=16, maxDocs=43556)
            0.625 = fieldNorm(doc=402)
    0.5 = coord(1/2)
  5. Voorhees, E.M.: Question answering in TREC (2005) 2.02 
    2.0219955 = sum of:
  2.0219955 = product of:
    4.043991 = sum of:
      4.043991 = weight(author_txt:voorhees in 6484) [ClassicSimilarity], result of:
        4.043991 = score(doc=6484,freq=1.0), product of:
          0.73123366 = queryWeight, product of:
            1.0353698 = boost
            8.848589 = idf(docFreq=16, maxDocs=43556)
            0.0798154 = queryNorm
          5.530368 = fieldWeight in 6484, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.848589 = idf(docFreq=16, maxDocs=43556)
            0.625 = fieldNorm(doc=6484)
    0.5 = coord(1/2)

Similar documents (content)

  1. TREC: experiment and evaluation in information retrieval (2005) 0.90 
    0.90099686 = sum of:
  0.90099686 = product of:
    1.608923 = sum of:
      0.0399833 = weight(abstract_txt:workshop in 1759) [ClassicSimilarity], result of:
        0.0399833 = score(doc=1759,freq=1.0), product of:
          0.09692336 = queryWeight, product of:
            1.0442826 = boost
            6.6003985 = idf(docFreq=160, maxDocs=43556)
            0.014061779 = queryNorm
          0.4125249 = fieldWeight in 1759, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.6003985 = idf(docFreq=160, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.032112155 = weight(abstract_txt:large in 1759) [ClassicSimilarity], result of:
        0.032112155 = score(doc=1759,freq=3.0), product of:
          0.06646796 = queryWeight, product of:
            1.0591455 = boost
            4.462893 = idf(docFreq=1364, maxDocs=43556)
            0.014061779 = queryNorm
          0.48312232 = fieldWeight in 1759, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.462893 = idf(docFreq=1364, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.026760655 = weight(abstract_txt:evaluation in 1759) [ClassicSimilarity], result of:
        0.026760655 = score(doc=1759,freq=2.0), product of:
          0.06737947 = queryWeight, product of:
            1.066383 = boost
            4.49339 = idf(docFreq=1323, maxDocs=43556)
            0.014061779 = queryNorm
          0.39716333 = fieldWeight in 1759, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.49339 = idf(docFreq=1323, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.02835576 = weight(abstract_txt:part in 1759) [ClassicSimilarity], result of:
        0.02835576 = score(doc=1759,freq=2.0), product of:
          0.070031054 = queryWeight, product of:
            1.0871632 = boost
            4.5809507 = idf(docFreq=1212, maxDocs=43556)
            0.014061779 = queryNorm
          0.40490267 = fieldWeight in 1759, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.5809507 = idf(docFreq=1212, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.026145598 = weight(abstract_txt:history in 1759) [ClassicSimilarity], result of:
        0.026145598 = score(doc=1759,freq=1.0), product of:
          0.08358702 = queryWeight, product of:
            1.187733 = boost
            5.0047193 = idf(docFreq=793, maxDocs=43556)
            0.014061779 = queryNorm
          0.31279495 = fieldWeight in 1759, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.0047193 = idf(docFreq=793, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.04140707 = weight(abstract_txt:tasks in 1759) [ClassicSimilarity], result of:
        0.04140707 = score(doc=1759,freq=2.0), product of:
          0.09013901 = queryWeight, product of:
            1.2334054 = boost
            5.1971674 = idf(docFreq=654, maxDocs=43556)
            0.014061779 = queryNorm
          0.45936903 = fieldWeight in 1759, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.1971674 = idf(docFreq=654, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.03693182 = weight(abstract_txt:text in 1759) [ClassicSimilarity], result of:
        0.03693182 = score(doc=1759,freq=4.0), product of:
          0.07296252 = queryWeight, product of:
            1.2813528 = boost
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.014061779 = queryNorm
          0.5061752 = fieldWeight in 1759, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.04003159 = weight(abstract_txt:commercial in 1759) [ClassicSimilarity], result of:
        0.04003159 = score(doc=1759,freq=1.0), product of:
          0.11103886 = queryWeight, product of:
            1.368948 = boost
            5.7682996 = idf(docFreq=369, maxDocs=43556)
            0.014061779 = queryNorm
          0.36051872 = fieldWeight in 1759, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.7682996 = idf(docFreq=369, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.027489051 = weight(abstract_txt:technology in 1759) [ClassicSimilarity], result of:
        0.027489051 = score(doc=1759,freq=1.0), product of:
          0.102469794 = queryWeight, product of:
            1.6977421 = boost
            4.2922387 = idf(docFreq=1618, maxDocs=43556)
            0.014061779 = queryNorm
          0.26826492 = fieldWeight in 1759, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.2922387 = idf(docFreq=1618, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.01994491 = weight(abstract_txt:been in 1759) [ClassicSimilarity], result of:
        0.01994491 = score(doc=1759,freq=1.0), product of:
          0.08792341 = queryWeight, product of:
            1.7227279 = boost
            3.6295063 = idf(docFreq=3140, maxDocs=43556)
            0.014061779 = queryNorm
          0.22684415 = fieldWeight in 1759, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6295063 = idf(docFreq=3140, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.047668852 = weight(abstract_txt:conference in 1759) [ClassicSimilarity], result of:
        0.047668852 = score(doc=1759,freq=1.0), product of:
          0.13730167 = queryWeight, product of:
            1.7577484 = boost
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.014061779 = queryNorm
          0.34718335 = fieldWeight in 1759, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.08908664 = weight(abstract_txt:book in 1759) [ClassicSimilarity], result of:
        0.08908664 = score(doc=1759,freq=5.0), product of:
          0.1312324 = queryWeight, product of:
            1.9212962 = boost
            4.857429 = idf(docFreq=919, maxDocs=43556)
            0.014061779 = queryNorm
          0.67884636 = fieldWeight in 1759, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            4.857429 = idf(docFreq=919, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      0.15144515 = weight(abstract_txt:retrieval in 1759) [ClassicSimilarity], result of:
        0.15144515 = score(doc=1759,freq=12.0), product of:
          0.2013599 = queryWeight, product of:
            4.122123 = boost
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.014061779 = queryNorm
          0.7521118 = fieldWeight in 1759, product of:
            3.4641016 = tf(freq=12.0), with freq of:
              12.0 = termFreq=12.0
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
      1.0015604 = weight(abstract_txt:trec in 1759) [ClassicSimilarity], result of:
        1.0015604 = score(doc=1759,freq=8.0), product of:
          0.84671474 = queryWeight, product of:
            8.998742 = boost
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.014061779 = queryNorm
          1.1828783 = fieldWeight in 1759, product of:
            2.828427 = tf(freq=8.0), with freq of:
              8.0 = termFreq=8.0
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.0625 = fieldNorm(doc=1759)
    0.56 = coord(14/25)
  2. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 0.56 
    0.5643387 = sum of:
  0.5643387 = product of:
    1.5676074 = sum of:
      0.09995825 = weight(abstract_txt:workshop in 888) [ClassicSimilarity], result of:
        0.09995825 = score(doc=888,freq=1.0), product of:
          0.09692336 = queryWeight, product of:
            1.0442826 = boost
            6.6003985 = idf(docFreq=160, maxDocs=43556)
            0.014061779 = queryNorm
          1.0313122 = fieldWeight in 888, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.6003985 = idf(docFreq=160, maxDocs=43556)
            0.15625 = fieldNorm(doc=888)
      0.046349905 = weight(abstract_txt:large in 888) [ClassicSimilarity], result of:
        0.046349905 = score(doc=888,freq=1.0), product of:
          0.06646796 = queryWeight, product of:
            1.0591455 = boost
            4.462893 = idf(docFreq=1364, maxDocs=43556)
            0.014061779 = queryNorm
          0.697327 = fieldWeight in 888, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.462893 = idf(docFreq=1364, maxDocs=43556)
            0.15625 = fieldNorm(doc=888)
      0.047306597 = weight(abstract_txt:evaluation in 888) [ClassicSimilarity], result of:
        0.047306597 = score(doc=888,freq=1.0), product of:
          0.06737947 = queryWeight, product of:
            1.066383 = boost
            4.49339 = idf(docFreq=1323, maxDocs=43556)
            0.014061779 = queryNorm
          0.7020922 = fieldWeight in 888, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.49339 = idf(docFreq=1323, maxDocs=43556)
            0.15625 = fieldNorm(doc=888)
      0.065363996 = weight(abstract_txt:history in 888) [ClassicSimilarity], result of:
        0.065363996 = score(doc=888,freq=1.0), product of:
          0.08358702 = queryWeight, product of:
            1.187733 = boost
            5.0047193 = idf(docFreq=793, maxDocs=43556)
            0.014061779 = queryNorm
          0.78198737 = fieldWeight in 888, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.0047193 = idf(docFreq=793, maxDocs=43556)
            0.15625 = fieldNorm(doc=888)
      0.046164777 = weight(abstract_txt:text in 888) [ClassicSimilarity], result of:
        0.046164777 = score(doc=888,freq=1.0), product of:
          0.07296252 = queryWeight, product of:
            1.2813528 = boost
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.014061779 = queryNorm
          0.63271904 = fieldWeight in 888, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.15625 = fieldNorm(doc=888)
      0.06872263 = weight(abstract_txt:technology in 888) [ClassicSimilarity], result of:
        0.06872263 = score(doc=888,freq=1.0), product of:
          0.102469794 = queryWeight, product of:
            1.6977421 = boost
            4.2922387 = idf(docFreq=1618, maxDocs=43556)
            0.014061779 = queryNorm
          0.6706623 = fieldWeight in 888, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.2922387 = idf(docFreq=1618, maxDocs=43556)
            0.15625 = fieldNorm(doc=888)
      0.11917213 = weight(abstract_txt:conference in 888) [ClassicSimilarity], result of:
        0.11917213 = score(doc=888,freq=1.0), product of:
          0.13730167 = queryWeight, product of:
            1.7577484 = boost
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.014061779 = queryNorm
          0.86795837 = fieldWeight in 888, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.15625 = fieldNorm(doc=888)
      0.18930645 = weight(abstract_txt:retrieval in 888) [ClassicSimilarity], result of:
        0.18930645 = score(doc=888,freq=3.0), product of:
          0.2013599 = queryWeight, product of:
            4.122123 = boost
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.014061779 = queryNorm
          0.9401398 = fieldWeight in 888, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.15625 = fieldNorm(doc=888)
      0.88526267 = weight(abstract_txt:trec in 888) [ClassicSimilarity], result of:
        0.88526267 = score(doc=888,freq=1.0), product of:
          0.84671474 = queryWeight, product of:
            8.998742 = boost
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.014061779 = queryNorm
          1.0455265 = fieldWeight in 888, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.15625 = fieldNorm(doc=888)
    0.36 = coord(9/25)
  3. Harman, D.: ¬The Text REtrieval Conferences (TRECs) : providing a test-bed for information retrieval systems (1998) 0.51 
    0.50766647 = sum of:
  0.50766647 = product of:
    1.4101846 = sum of:
      0.05997495 = weight(abstract_txt:workshop in 2312) [ClassicSimilarity], result of:
        0.05997495 = score(doc=2312,freq=1.0), product of:
          0.09692336 = queryWeight, product of:
            1.0442826 = boost
            6.6003985 = idf(docFreq=160, maxDocs=43556)
            0.014061779 = queryNorm
          0.61878735 = fieldWeight in 2312, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.6003985 = idf(docFreq=160, maxDocs=43556)
            0.09375 = fieldNorm(doc=2312)
      0.0393292 = weight(abstract_txt:large in 2312) [ClassicSimilarity], result of:
        0.0393292 = score(doc=2312,freq=2.0), product of:
          0.06646796 = queryWeight, product of:
            1.0591455 = boost
            4.462893 = idf(docFreq=1364, maxDocs=43556)
            0.014061779 = queryNorm
          0.5917016 = fieldWeight in 2312, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.462893 = idf(docFreq=1364, maxDocs=43556)
            0.09375 = fieldNorm(doc=2312)
      0.03160183 = weight(abstract_txt:major in 2312) [ClassicSimilarity], result of:
        0.03160183 = score(doc=2312,freq=1.0), product of:
          0.07238031 = queryWeight, product of:
            1.1052477 = boost
            4.6571536 = idf(docFreq=1123, maxDocs=43556)
            0.014061779 = queryNorm
          0.43660814 = fieldWeight in 2312, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.6571536 = idf(docFreq=1123, maxDocs=43556)
            0.09375 = fieldNorm(doc=2312)
      0.039172113 = weight(abstract_txt:text in 2312) [ClassicSimilarity], result of:
        0.039172113 = score(doc=2312,freq=2.0), product of:
          0.07296252 = queryWeight, product of:
            1.2813528 = boost
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.014061779 = queryNorm
          0.5368799 = fieldWeight in 2312, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.09375 = fieldNorm(doc=2312)
      0.058313083 = weight(abstract_txt:technology in 2312) [ClassicSimilarity], result of:
        0.058313083 = score(doc=2312,freq=2.0), product of:
          0.102469794 = queryWeight, product of:
            1.6977421 = boost
            4.2922387 = idf(docFreq=1618, maxDocs=43556)
            0.014061779 = queryNorm
          0.5690758 = fieldWeight in 2312, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.2922387 = idf(docFreq=1618, maxDocs=43556)
            0.09375 = fieldNorm(doc=2312)
      0.123847306 = weight(abstract_txt:conference in 2312) [ClassicSimilarity], result of:
        0.123847306 = score(doc=2312,freq=3.0), product of:
          0.13730167 = queryWeight, product of:
            1.7577484 = boost
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.014061779 = queryNorm
          0.9020088 = fieldWeight in 2312, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.09375 = fieldNorm(doc=2312)
      0.024370193 = weight(abstract_txt:have in 2312) [ClassicSimilarity], result of:
        0.024370193 = score(doc=2312,freq=1.0), product of:
          0.08073165 = queryWeight, product of:
            1.7830344 = boost
            3.2199109 = idf(docFreq=4730, maxDocs=43556)
            0.014061779 = queryNorm
          0.30186665 = fieldWeight in 2312, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.2199109 = idf(docFreq=4730, maxDocs=43556)
            0.09375 = fieldNorm(doc=2312)
      0.11358386 = weight(abstract_txt:retrieval in 2312) [ClassicSimilarity], result of:
        0.11358386 = score(doc=2312,freq=3.0), product of:
          0.2013599 = queryWeight, product of:
            4.122123 = boost
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.014061779 = queryNorm
          0.5640838 = fieldWeight in 2312, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.09375 = fieldNorm(doc=2312)
      0.919992 = weight(abstract_txt:trec in 2312) [ClassicSimilarity], result of:
        0.919992 = score(doc=2312,freq=3.0), product of:
          0.84671474 = queryWeight, product of:
            8.998742 = boost
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.014061779 = queryNorm
          1.0865431 = fieldWeight in 2312, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.09375 = fieldNorm(doc=2312)
    0.36 = coord(9/25)
  4. Harman, D.K.: ¬The first text retrieval conference : TREC-1, 1992 (1993) 0.35 
    0.35271978 = sum of:
  0.35271978 = product of:
    1.2597135 = sum of:
      0.055971816 = weight(abstract_txt:text in 2315) [ClassicSimilarity], result of:
        0.055971816 = score(doc=2315,freq=3.0), product of:
          0.07296252 = queryWeight, product of:
            1.2813528 = boost
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.014061779 = queryNorm
          0.76713103 = fieldWeight in 2315, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.109375 = fieldNorm(doc=2315)
      0.04810584 = weight(abstract_txt:technology in 2315) [ClassicSimilarity], result of:
        0.04810584 = score(doc=2315,freq=1.0), product of:
          0.102469794 = queryWeight, product of:
            1.6977421 = boost
            4.2922387 = idf(docFreq=1618, maxDocs=43556)
            0.014061779 = queryNorm
          0.46946362 = fieldWeight in 2315, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.2922387 = idf(docFreq=1618, maxDocs=43556)
            0.109375 = fieldNorm(doc=2315)
      0.034903593 = weight(abstract_txt:been in 2315) [ClassicSimilarity], result of:
        0.034903593 = score(doc=2315,freq=1.0), product of:
          0.08792341 = queryWeight, product of:
            1.7227279 = boost
            3.6295063 = idf(docFreq=3140, maxDocs=43556)
            0.014061779 = queryNorm
          0.39697725 = fieldWeight in 2315, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6295063 = idf(docFreq=3140, maxDocs=43556)
            0.109375 = fieldNorm(doc=2315)
      0.0834205 = weight(abstract_txt:conference in 2315) [ClassicSimilarity], result of:
        0.0834205 = score(doc=2315,freq=1.0), product of:
          0.13730167 = queryWeight, product of:
            1.7577484 = boost
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.014061779 = queryNorm
          0.6075709 = fieldWeight in 2315, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.109375 = fieldNorm(doc=2315)
      0.02843189 = weight(abstract_txt:have in 2315) [ClassicSimilarity], result of:
        0.02843189 = score(doc=2315,freq=1.0), product of:
          0.08073165 = queryWeight, product of:
            1.7830344 = boost
            3.2199109 = idf(docFreq=4730, maxDocs=43556)
            0.014061779 = queryNorm
          0.35217774 = fieldWeight in 2315, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.2199109 = idf(docFreq=4730, maxDocs=43556)
            0.109375 = fieldNorm(doc=2315)
      0.1325145 = weight(abstract_txt:retrieval in 2315) [ClassicSimilarity], result of:
        0.1325145 = score(doc=2315,freq=3.0), product of:
          0.2013599 = queryWeight, product of:
            4.122123 = boost
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.014061779 = queryNorm
          0.6580978 = fieldWeight in 2315, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.109375 = fieldNorm(doc=2315)
      0.87636536 = weight(abstract_txt:trec in 2315) [ClassicSimilarity], result of:
        0.87636536 = score(doc=2315,freq=2.0), product of:
          0.84671474 = queryWeight, product of:
            8.998742 = boost
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.014061779 = queryNorm
          1.0350184 = fieldWeight in 2315, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.109375 = fieldNorm(doc=2315)
    0.28 = coord(7/25)
  5. Robertson, S.E.; Walker, S.; Beaulieu, M.: Laboratory experiments with Okapi : participation in the TREC programme (1997) 0.34 
    0.34385136 = sum of:
  0.34385136 = product of:
    1.2280406 = sum of:
      0.02766017 = weight(abstract_txt:problem in 2282) [ClassicSimilarity], result of:
        0.02766017 = score(doc=2282,freq=1.0), product of:
          0.0662291 = queryWeight, product of:
            1.0572406 = boost
            4.454867 = idf(docFreq=1375, maxDocs=43556)
            0.014061779 = queryNorm
          0.4176438 = fieldWeight in 2282, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.454867 = idf(docFreq=1375, maxDocs=43556)
            0.09375 = fieldNorm(doc=2282)
      0.02838396 = weight(abstract_txt:evaluation in 2282) [ClassicSimilarity], result of:
        0.02838396 = score(doc=2282,freq=1.0), product of:
          0.06737947 = queryWeight, product of:
            1.066383 = boost
            4.49339 = idf(docFreq=1323, maxDocs=43556)
            0.014061779 = queryNorm
          0.42125532 = fieldWeight in 2282, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.49339 = idf(docFreq=1323, maxDocs=43556)
            0.09375 = fieldNorm(doc=2282)
      0.0392184 = weight(abstract_txt:history in 2282) [ClassicSimilarity], result of:
        0.0392184 = score(doc=2282,freq=1.0), product of:
          0.08358702 = queryWeight, product of:
            1.187733 = boost
            5.0047193 = idf(docFreq=793, maxDocs=43556)
            0.014061779 = queryNorm
          0.46919245 = fieldWeight in 2282, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.0047193 = idf(docFreq=793, maxDocs=43556)
            0.09375 = fieldNorm(doc=2282)
      0.027698865 = weight(abstract_txt:text in 2282) [ClassicSimilarity], result of:
        0.027698865 = score(doc=2282,freq=1.0), product of:
          0.07296252 = queryWeight, product of:
            1.2813528 = boost
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.014061779 = queryNorm
          0.3796314 = fieldWeight in 2282, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.0494018 = idf(docFreq=2063, maxDocs=43556)
            0.09375 = fieldNorm(doc=2282)
      0.07150328 = weight(abstract_txt:conference in 2282) [ClassicSimilarity], result of:
        0.07150328 = score(doc=2282,freq=1.0), product of:
          0.13730167 = queryWeight, product of:
            1.7577484 = boost
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.014061779 = queryNorm
          0.520775 = fieldWeight in 2282, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5549335 = idf(docFreq=457, maxDocs=43556)
            0.09375 = fieldNorm(doc=2282)
      0.11358386 = weight(abstract_txt:retrieval in 2282) [ClassicSimilarity], result of:
        0.11358386 = score(doc=2282,freq=3.0), product of:
          0.2013599 = queryWeight, product of:
            4.122123 = boost
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.014061779 = queryNorm
          0.5640838 = fieldWeight in 2282, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4738557 = idf(docFreq=3669, maxDocs=43556)
            0.09375 = fieldNorm(doc=2282)
      0.919992 = weight(abstract_txt:trec in 2282) [ClassicSimilarity], result of:
        0.919992 = score(doc=2282,freq=3.0), product of:
          0.84671474 = queryWeight, product of:
            8.998742 = boost
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.014061779 = queryNorm
          1.0865431 = fieldWeight in 2282, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.69137 = idf(docFreq=146, maxDocs=43556)
            0.09375 = fieldNorm(doc=2282)
    0.28 = coord(7/25)