Document (#31762)

Editor
Voorhees, E.M. u. D.K. Harman
Title
TREC: experiment and evaluation in information retrieval
Imprint
Cambridge, MA : MIT Press
Year
2005
Pages
X, 462 S
Isbn
0-262-22073-3
Series
Digital libraries and electronic publishing
Abstract
The Text REtrieval Conference (TREC), a yearly workshop hosted by the US government's National Institute of Standards and Technology, provides the infrastructure necessary for large-scale evaluation of text retrieval methodologies. With the goal of accelerating research in this area, TREC created the first large test collections of full-text documents and standardized retrieval evaluation. The impact has been significant; since TREC's beginning in 1992, retrieval effectiveness has approximately doubled. TREC has built a variety of large test collections, including collections for such specialized retrieval tasks as cross-language retrieval and retrieval of speech. Moreover, TREC has accelerated the transfer of research ideas into commercial systems, as demonstrated in the number of retrieval techniques developed in TREC that are now used in Web search engines. This book provides a comprehensive review of TREC research, summarizing the variety of TREC results, documenting the best practices in experimental information retrieval, and suggesting areas for further research. The first part of the book describes TREC's history, test collections, and retrieval methodology. Next, the book provides "track" reports -- describing the evaluations of specific tasks, including routing and filtering, interactive retrieval, and retrieving noisy text. The final part of the book offers perspectives on TREC from such participants as Microsoft Research, University of Massachusetts, Cornell University, University of Waterloo, City University of New York, and IBM. The book will be of interest to researchers in information retrieval and related technologies, including natural language processing.
Content
Enthält die Beiträge: 1. The Text REtrieval Conference - Ellen M. Voorhees and Donna K. Harman 2. The TREC Test Collections - Donna K. Harman 3. Retrieval System Evaluation - Chris Buckley and Ellen M. Voorhees 4. The TREC Ad Hoc Experiments - Donna K. Harman 5. Routing and Filtering - Stephen Robertson and Jamie Callan 6. The TREC Interactive Tracks: Putting the User into Search - Susan T. Dumais and Nicholas J. Belkin 7. Beyond English - Donna K. Harman 8. Retrieving Noisy Text - Ellen M. Voorhees and John S. Garofolo 9.The Very Large Collection and Web Tracks - David Hawking and Nick Craswell 10. Question Answering in TREC - Ellen M. Voorhees 11. The University of Massachusetts and a Dozen TRECs - James Allan, W. Bruce Croft and Jamie Callan 12. How Okapi Came to TREC - Stephen Robertson 13. The SMART Project at TREC - Chris Buckley 14. Ten Years of Ad Hoc Retrieval at TREC Using PIRCS - Kui-Lam Kwok 15. MultiText Experiments for TREC - Gordon V. Cormack, Charles L. A. Clarke, Christopher R. Palmer and Thomas R. Lynam 16. A Language-Modeling Approach to TREC - Djoerd Hiemstra and Wessel Kraaij 17. BM Research Activities at TREC - Eric W. Brown, David Carmel, Martin Franz, Abraham Ittycheriah, Tapas Kanungo, Yoelle Maarek, J. Scott McCarley, Robert L. Mack, John M. Prager, John R. Smith, Aya Soffer, Jason Y. Zien and Alan D. Marwick Epilogue: Metareflections on TREC - Karen Sparck Jones
Footnote
Rez. in: JASIST 58(2007) no.6, S.910-911 (J.L. Vicedo u. J. Gomez): "The Text REtrieval Conference (TREC) is a yearly workshop hosted by the U.S. government's National Institute of Standards and Technology (NIST) that fosters and supports research in information retrieval as well as speeding the transfer of technology between research labs and industry. Since 1992, TREC has provided the infrastructure necessary for large-scale evaluations of different text retrieval methodologies. TREC impact has been very important and its success has been mainly supported by its continuous adaptation to the emerging information retrieval needs. Not in vain, TREC has built evaluation benchmarks for more than 20 different retrieval problems such as Web retrieval, speech retrieval, or question-answering. The large and intense trajectory of annual TREC conferences has resulted in an immense bulk of documents reflecting the different eval uation and research efforts developed. This situation makes it difficult sometimes to observe clearly how research in information retrieval (IR) has evolved over the course of TREC. TREC: Experiment and Evaluation in Information Retrieval succeeds in organizing and condensing all this research into a manageable volume that describes TREC history and summarizes the main lessons learned. The book is organized into three parts. The first part is devoted to the description of TREC's origin and history, the test collections, and the evaluation methodology developed. The second part describes a selection of the major evaluation exercises (tracks), and the third part contains contributions from research groups that had a large and remarkable participation in TREC. Finally, Karen Spark Jones, one of the main promoters of research in IR, closes the book with an epilogue that analyzes the impact of TREC on this research field.
... TREC: Experiment and Evaluation in Information Retrieval is a reliable and comprehensive review of the TREC program and has been adopted by NIST as the official history of TREC (see http://trec.nist.gov). We were favorably surprised by the book. Well structured and written, chapters are self-contained and the existence of references to specialized and more detailed publications is continuous, which makes it easier to expand into the different aspects analyzed in the text. This book succeeds in compiling TREC evolution from its inception in 1992 to 2003 in an adequate and manageable volume. Thanks to the impressive effort performed by the authors and their experience in the field, it can satiate the interests of a great variety of readers. While expert researchers in the IR field and IR-related industrial companies can use it as a reference manual, it seems especially useful for students and non-expert readers willing to approach this research area. Like NIST, we would recommend this reading to anyone who may be interested in textual information retrieval."
Theme
Retrievalstudien
Object
TREC
LCSH
Text processing (Computer science) / Congresses
Information storage and retrieval systems / Congresses
Text REtrieval Conference
RSWK
Information Retrieval / Textverarbeitung / Aufsatzsammlung (BVB)
Kongress / Information Retrieval / Kongress (GBV)
BK
06.74 / Informationssysteme
54.75 / Sprachverarbeitung <Informatik>
DDC
025.04 / dc22
005.74 (SWB)
LCC
QA76.9.T48T74 2005
RVK
ST 270

Similar documents (content)

  1. Voorhees, E.M.; Harman, D.K.: ¬The Text REtrieval Conference (2005) 0.83 
    0.8326861 = sum of:
  0.8326861 = product of:
    1.3878101 = sum of:
      0.022180647 = weight(abstract_txt:part in 5082) [ClassicSimilarity], result of:
        0.022180647 = score(doc=5082,freq=3.0), product of:
          0.0715717 = queryWeight, product of:
            1.0113887 = boost
            4.580493 = idf(docFreq=1231, maxDocs=44218)
            0.0154493805 = queryNorm
          0.30990806 = fieldWeight in 5082, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.580493 = idf(docFreq=1231, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.05523833 = weight(abstract_txt:doubled in 5082) [ClassicSimilarity], result of:
        0.05523833 = score(doc=5082,freq=1.0), product of:
          0.15052754 = queryWeight, product of:
            1.0371472 = boost
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.0154493805 = queryNorm
          0.36696494 = fieldWeight in 5082, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.01820222 = weight(abstract_txt:variety in 5082) [ClassicSimilarity], result of:
        0.01820222 = score(doc=5082,freq=1.0), product of:
          0.09047915 = queryWeight, product of:
            1.1371602 = boost
            5.1501017 = idf(docFreq=696, maxDocs=44218)
            0.0154493805 = queryNorm
          0.20117584 = fieldWeight in 5082, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.1501017 = idf(docFreq=696, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.031766456 = weight(abstract_txt:tasks in 5082) [ClassicSimilarity], result of:
        0.031766456 = score(doc=5082,freq=3.0), product of:
          0.09093639 = queryWeight, product of:
            1.1400299 = boost
            5.1630983 = idf(docFreq=687, maxDocs=44218)
            0.0154493805 = queryNorm
          0.3493261 = fieldWeight in 5082, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.1630983 = idf(docFreq=687, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.039744705 = weight(abstract_txt:conference in 5082) [ClassicSimilarity], result of:
        0.039744705 = score(doc=5082,freq=3.0), product of:
          0.10558723 = queryWeight, product of:
            1.2284375 = boost
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.0154493805 = queryNorm
          0.37641585 = fieldWeight in 5082, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.030591836 = weight(abstract_txt:large in 5082) [ClassicSimilarity], result of:
        0.030591836 = score(doc=5082,freq=3.0), product of:
          0.10151401 = queryWeight, product of:
            1.4752173 = boost
            4.454089 = idf(docFreq=1397, maxDocs=44218)
            0.0154493805 = queryNorm
          0.3013558 = fieldWeight in 5082, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.454089 = idf(docFreq=1397, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.03125551 = weight(abstract_txt:evaluation in 5082) [ClassicSimilarity], result of:
        0.03125551 = score(doc=5082,freq=3.0), product of:
          0.10297694 = queryWeight, product of:
            1.4858091 = boost
            4.4860687 = idf(docFreq=1353, maxDocs=44218)
            0.0154493805 = queryNorm
          0.3035195 = fieldWeight in 5082, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.4860687 = idf(docFreq=1353, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.0126834875 = weight(abstract_txt:information in 5082) [ClassicSimilarity], result of:
        0.0126834875 = score(doc=5082,freq=5.0), product of:
          0.05998028 = queryWeight, product of:
            1.6036599 = boost
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.0154493805 = queryNorm
          0.21146096 = fieldWeight in 5082, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.03633138 = weight(abstract_txt:test in 5082) [ClassicSimilarity], result of:
        0.03633138 = score(doc=5082,freq=2.0), product of:
          0.13031888 = queryWeight, product of:
            1.6714627 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.0154493805 = queryNorm
          0.27878833 = fieldWeight in 5082, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.018386295 = weight(abstract_txt:research in 5082) [ClassicSimilarity], result of:
        0.018386295 = score(doc=5082,freq=3.0), product of:
          0.08571721 = queryWeight, product of:
            1.7500538 = boost
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.0154493805 = queryNorm
          0.21449946 = fieldWeight in 5082, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.038976397 = weight(abstract_txt:collections in 5082) [ClassicSimilarity], result of:
        0.038976397 = score(doc=5082,freq=2.0), product of:
          0.15031423 = queryWeight, product of:
            2.072824 = boost
            4.693822 = idf(docFreq=1099, maxDocs=44218)
            0.0154493805 = queryNorm
          0.25929946 = fieldWeight in 5082, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.693822 = idf(docFreq=1099, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.045787748 = weight(abstract_txt:text in 5082) [ClassicSimilarity], result of:
        0.045787748 = score(doc=5082,freq=3.0), product of:
          0.16735235 = queryWeight, product of:
            2.678699 = boost
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.0154493805 = queryNorm
          0.27360088 = fieldWeight in 5082, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.085315794 = weight(abstract_txt:book in 5082) [ClassicSimilarity], result of:
        0.085315794 = score(doc=5082,freq=5.0), product of:
          0.20112924 = queryWeight, product of:
            2.6807418 = boost
            4.856341 = idf(docFreq=934, maxDocs=44218)
            0.0154493805 = queryNorm
          0.42418393 = fieldWeight in 5082, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            4.856341 = idf(docFreq=934, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.17785928 = weight(abstract_txt:retrieval in 5082) [ClassicSimilarity], result of:
        0.17785928 = score(doc=5082,freq=14.0), product of:
          0.35017106 = queryWeight, product of:
            6.522243 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0154493805 = queryNorm
          0.5079211 = fieldWeight in 5082, product of:
            3.7416575 = tf(freq=14.0), with freq of:
              14.0 = termFreq=14.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
      0.74349 = weight(abstract_txt:trec in 5082) [ClassicSimilarity], result of:
        0.74349 = score(doc=5082,freq=17.0), product of:
          0.689028 = queryWeight, product of:
            6.656901 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0154493805 = queryNorm
          1.0790417 = fieldWeight in 5082, product of:
            4.1231055 = tf(freq=17.0), with freq of:
              17.0 = termFreq=17.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5082)
    0.6 = coord(15/25)
  2. Harman, D.: ¬The Text REtrieval Conferences (TRECs) : providing a test-bed for information retrieval systems (1998) 0.56 
    0.5569663 = sum of:
  0.5569663 = product of:
    1.3924158 = sum of:
      0.04368533 = weight(abstract_txt:variety in 1314) [ClassicSimilarity], result of:
        0.04368533 = score(doc=1314,freq=1.0), product of:
          0.09047915 = queryWeight, product of:
            1.1371602 = boost
            5.1501017 = idf(docFreq=696, maxDocs=44218)
            0.0154493805 = queryNorm
          0.48282203 = fieldWeight in 1314, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.1501017 = idf(docFreq=696, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
      0.095387295 = weight(abstract_txt:conference in 1314) [ClassicSimilarity], result of:
        0.095387295 = score(doc=1314,freq=3.0), product of:
          0.10558723 = queryWeight, product of:
            1.2284375 = boost
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.0154493805 = queryNorm
          0.90339804 = fieldWeight in 1314, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
      0.03954544 = weight(abstract_txt:including in 1314) [ClassicSimilarity], result of:
        0.03954544 = score(doc=1314,freq=1.0), product of:
          0.096921355 = queryWeight, product of:
            1.4414605 = boost
            4.352168 = idf(docFreq=1547, maxDocs=44218)
            0.0154493805 = queryNorm
          0.40801576 = fieldWeight in 1314, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.352168 = idf(docFreq=1547, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
      0.05994751 = weight(abstract_txt:large in 1314) [ClassicSimilarity], result of:
        0.05994751 = score(doc=1314,freq=2.0), product of:
          0.10151401 = queryWeight, product of:
            1.4752173 = boost
            4.454089 = idf(docFreq=1397, maxDocs=44218)
            0.0154493805 = queryNorm
          0.5905343 = fieldWeight in 1314, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.454089 = idf(docFreq=1397, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
      0.019252181 = weight(abstract_txt:information in 1314) [ClassicSimilarity], result of:
        0.019252181 = score(doc=1314,freq=2.0), product of:
          0.05998028 = queryWeight, product of:
            1.6036599 = boost
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.0154493805 = queryNorm
          0.32097518 = fieldWeight in 1314, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
      0.061656404 = weight(abstract_txt:test in 1314) [ClassicSimilarity], result of:
        0.061656404 = score(doc=1314,freq=1.0), product of:
          0.13031888 = queryWeight, product of:
            1.6714627 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.0154493805 = queryNorm
          0.4731195 = fieldWeight in 1314, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
      0.036029633 = weight(abstract_txt:research in 1314) [ClassicSimilarity], result of:
        0.036029633 = score(doc=1314,freq=2.0), product of:
          0.08571721 = queryWeight, product of:
            1.7500538 = boost
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.0154493805 = queryNorm
          0.4203314 = fieldWeight in 1314, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
      0.0897253 = weight(abstract_txt:text in 1314) [ClassicSimilarity], result of:
        0.0897253 = score(doc=1314,freq=2.0), product of:
          0.16735235 = queryWeight, product of:
            2.678699 = boost
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.0154493805 = queryNorm
          0.53614604 = fieldWeight in 1314, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
      0.19759883 = weight(abstract_txt:retrieval in 1314) [ClassicSimilarity], result of:
        0.19759883 = score(doc=1314,freq=3.0), product of:
          0.35017106 = queryWeight, product of:
            6.522243 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0154493805 = queryNorm
          0.5642923 = fieldWeight in 1314, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
      0.7495878 = weight(abstract_txt:trec in 1314) [ClassicSimilarity], result of:
        0.7495878 = score(doc=1314,freq=3.0), product of:
          0.689028 = queryWeight, product of:
            6.656901 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0154493805 = queryNorm
          1.0878916 = fieldWeight in 1314, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.09375 = fieldNorm(doc=1314)
    0.4 = coord(10/25)
  3. Emerging frameworks and methods : Proceedings of the Fourth International Conference on the Conceptions of Library and Information Science (CoLIS4), Seattle, WA, July 21 - 25, 2002 (2002) 0.44 
    0.44266063 = sum of:
  0.44266063 = product of:
    1.2296128 = sum of:
      0.02557561 = weight(abstract_txt:processing in 55) [ClassicSimilarity], result of:
        0.02557561 = score(doc=55,freq=1.0), product of:
          0.08297291 = queryWeight, product of:
            1.088969 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.0154493805 = queryNorm
          0.3082405 = fieldWeight in 55, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.0625 = fieldNorm(doc=55)
      0.04118692 = weight(abstract_txt:variety in 55) [ClassicSimilarity], result of:
        0.04118692 = score(doc=55,freq=2.0), product of:
          0.09047915 = queryWeight, product of:
            1.1371602 = boost
            5.1501017 = idf(docFreq=696, maxDocs=44218)
            0.0154493805 = queryNorm
          0.45520896 = fieldWeight in 55, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.1501017 = idf(docFreq=696, maxDocs=44218)
            0.0625 = fieldNorm(doc=55)
      0.036714587 = weight(abstract_txt:conference in 55) [ClassicSimilarity], result of:
        0.036714587 = score(doc=55,freq=1.0), product of:
          0.10558723 = queryWeight, product of:
            1.2284375 = boost
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.0154493805 = queryNorm
          0.34771806 = fieldWeight in 55, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.0625 = fieldNorm(doc=55)
      0.023963908 = weight(abstract_txt:provides in 55) [ClassicSimilarity], result of:
        0.023963908 = score(doc=55,freq=1.0), product of:
          0.09094688 = queryWeight, product of:
            1.3963263 = boost
            4.215895 = idf(docFreq=1773, maxDocs=44218)
            0.0154493805 = queryNorm
          0.26349345 = fieldWeight in 55, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.215895 = idf(docFreq=1773, maxDocs=44218)
            0.0625 = fieldNorm(doc=55)
      0.32556066 = weight(subject_txt:kongress in 55) [ClassicSimilarity], result of:
        0.32556066 = score(doc=55,freq=1.0), product of:
          0.1795148 = queryWeight, product of:
            1.6017603 = boost
            7.2542357 = idf(docFreq=84, maxDocs=44218)
            0.0154493805 = queryNorm
          1.8135589 = fieldWeight in 55, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.2542357 = idf(docFreq=84, maxDocs=44218)
            0.25 = fieldNorm(doc=55)
      0.025669575 = weight(abstract_txt:information in 55) [ClassicSimilarity], result of:
        0.025669575 = score(doc=55,freq=8.0), product of:
          0.05998028 = queryWeight, product of:
            1.6036599 = boost
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.0154493805 = queryNorm
          0.4279669 = fieldWeight in 55, product of:
            2.828427 = tf(freq=8.0), with freq of:
              8.0 = termFreq=8.0
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.0625 = fieldNorm(doc=55)
      0.024019755 = weight(abstract_txt:research in 55) [ClassicSimilarity], result of:
        0.024019755 = score(doc=55,freq=2.0), product of:
          0.08571721 = queryWeight, product of:
            1.7500538 = boost
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.0154493805 = queryNorm
          0.28022093 = fieldWeight in 55, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.0625 = fieldNorm(doc=55)
      0.6508659 = weight(subject_txt:congresses in 55) [ClassicSimilarity], result of:
        0.6508659 = score(doc=55,freq=2.0), product of:
          0.22611532 = queryWeight, product of:
            1.7976799 = boost
            8.14154 = idf(docFreq=34, maxDocs=44218)
            0.0154493805 = queryNorm
          2.878469 = fieldWeight in 55, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            8.14154 = idf(docFreq=34, maxDocs=44218)
            0.25 = fieldNorm(doc=55)
      0.076055825 = weight(abstract_txt:retrieval in 55) [ClassicSimilarity], result of:
        0.076055825 = score(doc=55,freq=1.0), product of:
          0.35017106 = queryWeight, product of:
            6.522243 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0154493805 = queryNorm
          0.21719621 = fieldWeight in 55, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0625 = fieldNorm(doc=55)
    0.36 = coord(9/25)
  4. Harman, D.: Overview of the first Text Retrieval Conference (1993) 0.40 
    0.40362507 = sum of:
  0.40362507 = product of:
    1.0090626 = sum of:
      0.04368533 = weight(abstract_txt:variety in 548) [ClassicSimilarity], result of:
        0.04368533 = score(doc=548,freq=1.0), product of:
          0.09047915 = queryWeight, product of:
            1.1371602 = boost
            5.1501017 = idf(docFreq=696, maxDocs=44218)
            0.0154493805 = queryNorm
          0.48282203 = fieldWeight in 548, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.1501017 = idf(docFreq=696, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
      0.07788339 = weight(abstract_txt:conference in 548) [ClassicSimilarity], result of:
        0.07788339 = score(doc=548,freq=2.0), product of:
          0.10558723 = queryWeight, product of:
            1.2284375 = boost
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.0154493805 = queryNorm
          0.73762137 = fieldWeight in 548, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
      0.03954544 = weight(abstract_txt:including in 548) [ClassicSimilarity], result of:
        0.03954544 = score(doc=548,freq=1.0), product of:
          0.096921355 = queryWeight, product of:
            1.4414605 = boost
            4.352168 = idf(docFreq=1547, maxDocs=44218)
            0.0154493805 = queryNorm
          0.40801576 = fieldWeight in 548, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.352168 = idf(docFreq=1547, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
      0.05994751 = weight(abstract_txt:large in 548) [ClassicSimilarity], result of:
        0.05994751 = score(doc=548,freq=2.0), product of:
          0.10151401 = queryWeight, product of:
            1.4752173 = boost
            4.454089 = idf(docFreq=1397, maxDocs=44218)
            0.0154493805 = queryNorm
          0.5905343 = fieldWeight in 548, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.454089 = idf(docFreq=1397, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
      0.043308903 = weight(abstract_txt:evaluation in 548) [ClassicSimilarity], result of:
        0.043308903 = score(doc=548,freq=1.0), product of:
          0.10297694 = queryWeight, product of:
            1.4858091 = boost
            4.4860687 = idf(docFreq=1353, maxDocs=44218)
            0.0154493805 = queryNorm
          0.42056894 = fieldWeight in 548, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.4860687 = idf(docFreq=1353, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
      0.061656404 = weight(abstract_txt:test in 548) [ClassicSimilarity], result of:
        0.061656404 = score(doc=548,freq=1.0), product of:
          0.13031888 = queryWeight, product of:
            1.6714627 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.0154493805 = queryNorm
          0.4731195 = fieldWeight in 548, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
      0.025476798 = weight(abstract_txt:research in 548) [ClassicSimilarity], result of:
        0.025476798 = score(doc=548,freq=1.0), product of:
          0.08571721 = queryWeight, product of:
            1.7500538 = boost
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.0154493805 = queryNorm
          0.2972192 = fieldWeight in 548, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
      0.06344537 = weight(abstract_txt:text in 548) [ClassicSimilarity], result of:
        0.06344537 = score(doc=548,freq=1.0), product of:
          0.16735235 = queryWeight, product of:
            2.678699 = boost
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.0154493805 = queryNorm
          0.37911248 = fieldWeight in 548, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
      0.16133876 = weight(abstract_txt:retrieval in 548) [ClassicSimilarity], result of:
        0.16133876 = score(doc=548,freq=2.0), product of:
          0.35017106 = queryWeight, product of:
            6.522243 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0154493805 = queryNorm
          0.4607427 = fieldWeight in 548, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
      0.43277475 = weight(abstract_txt:trec in 548) [ClassicSimilarity], result of:
        0.43277475 = score(doc=548,freq=1.0), product of:
          0.689028 = queryWeight, product of:
            6.656901 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0154493805 = queryNorm
          0.62809455 = fieldWeight in 548, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.09375 = fieldNorm(doc=548)
    0.4 = coord(10/25)
  5. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 0.40 
    0.39582774 = sum of:
  0.39582774 = product of:
    1.4136705 = sum of:
      0.09178647 = weight(abstract_txt:conference in 3890) [ClassicSimilarity], result of:
        0.09178647 = score(doc=3890,freq=1.0), product of:
          0.10558723 = queryWeight, product of:
            1.2284375 = boost
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.0154493805 = queryNorm
          0.8692951 = fieldWeight in 3890, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.563489 = idf(docFreq=460, maxDocs=44218)
            0.15625 = fieldNorm(doc=3890)
      0.07064883 = weight(abstract_txt:large in 3890) [ClassicSimilarity], result of:
        0.07064883 = score(doc=3890,freq=1.0), product of:
          0.10151401 = queryWeight, product of:
            1.4752173 = boost
            4.454089 = idf(docFreq=1397, maxDocs=44218)
            0.0154493805 = queryNorm
          0.69595146 = fieldWeight in 3890, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.454089 = idf(docFreq=1397, maxDocs=44218)
            0.15625 = fieldNorm(doc=3890)
      0.07218151 = weight(abstract_txt:evaluation in 3890) [ClassicSimilarity], result of:
        0.07218151 = score(doc=3890,freq=1.0), product of:
          0.10297694 = queryWeight, product of:
            1.4858091 = boost
            4.4860687 = idf(docFreq=1353, maxDocs=44218)
            0.0154493805 = queryNorm
          0.70094824 = fieldWeight in 3890, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.4860687 = idf(docFreq=1353, maxDocs=44218)
            0.15625 = fieldNorm(doc=3890)
      0.022688912 = weight(abstract_txt:information in 3890) [ClassicSimilarity], result of:
        0.022688912 = score(doc=3890,freq=1.0), product of:
          0.05998028 = queryWeight, product of:
            1.6036599 = boost
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.0154493805 = queryNorm
          0.37827286 = fieldWeight in 3890, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.15625 = fieldNorm(doc=3890)
      0.10574228 = weight(abstract_txt:text in 3890) [ClassicSimilarity], result of:
        0.10574228 = score(doc=3890,freq=1.0), product of:
          0.16735235 = queryWeight, product of:
            2.678699 = boost
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.0154493805 = queryNorm
          0.6318542 = fieldWeight in 3890, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.15625 = fieldNorm(doc=3890)
      0.32933137 = weight(abstract_txt:retrieval in 3890) [ClassicSimilarity], result of:
        0.32933137 = score(doc=3890,freq=3.0), product of:
          0.35017106 = queryWeight, product of:
            6.522243 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0154493805 = queryNorm
          0.94048715 = fieldWeight in 3890, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.15625 = fieldNorm(doc=3890)
      0.72129124 = weight(abstract_txt:trec in 3890) [ClassicSimilarity], result of:
        0.72129124 = score(doc=3890,freq=1.0), product of:
          0.689028 = queryWeight, product of:
            6.656901 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0154493805 = queryNorm
          1.0468242 = fieldWeight in 3890, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.15625 = fieldNorm(doc=3890)
    0.28 = coord(7/25)