Document (#35893)

Author
Carterette, B.
Title
Test collections
Source
Encyclopedia of library and information sciences. 3rd ed. Ed.: M.J. Bates
Imprint
London : Taylor & Francis
Year
2009
Pages
S.xx-xx
Abstract
Research and development of search engines and other information retrieval (IR) systems proceeds by a cycle of design, implementation, and experimentation, with the results of each experiment influencing design decisions in the next iteration of the cycle. Batch experiments on test collections help ensure that this process goes as smoothly and as quickly as possible. A test collection comprises a collection of documents, a set of information needs, and judgments of the relevance of documents to those needs.
Footnote
Vgl.: http://www.tandfonline.com/doi/book/10.1081/E-ELIS3.
Theme
Retrievalstudien

Similar documents (content)

  1. Keen, E.M.: Designing and testing an interactive ranked retrieval system for professional searchers (1994) 0.14
    0.14118996 = sum of:
      0.14118996 = product of:
        0.5882915 = sum of:
          0.09399447 = weight(abstract_txt:experiment in 1135) [ClassicSimilarity], result of:
            0.09399447 = score(doc=1135,freq=5.0), product of:
              0.11858916 = queryWeight, product of:
                1.149397 = boost
                5.671426 = idf(docFreq=399, maxDocs=42740)
                0.018192094 = queryNorm
              0.7926059 = fieldWeight in 1135, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.671426 = idf(docFreq=399, maxDocs=42740)
                0.0625 = fieldNorm(doc=1135)
          0.04907851 = weight(abstract_txt:design in 1135) [ClassicSimilarity], result of:
            0.04907851 = score(doc=1135,freq=3.0), product of:
              0.11486754 = queryWeight, product of:
                1.5997835 = boost
                3.9468753 = idf(docFreq=2243, maxDocs=42740)
                0.018192094 = queryNorm
              0.42726177 = fieldWeight in 1135, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.9468753 = idf(docFreq=2243, maxDocs=42740)
                0.0625 = fieldNorm(doc=1135)
          0.14075732 = weight(abstract_txt:batch in 1135) [ClassicSimilarity], result of:
            0.14075732 = score(doc=1135,freq=1.0), product of:
              0.26542845 = queryWeight, product of:
                1.7195756 = boost
                8.484837 = idf(docFreq=23, maxDocs=42740)
                0.018192094 = queryNorm
              0.5303023 = fieldWeight in 1135, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.484837 = idf(docFreq=23, maxDocs=42740)
                0.0625 = fieldNorm(doc=1135)
          0.08086279 = weight(abstract_txt:collection in 1135) [ClassicSimilarity], result of:
            0.08086279 = score(doc=1135,freq=3.0), product of:
              0.16023925 = queryWeight, product of:
                1.8895005 = boost
                4.661645 = idf(docFreq=1097, maxDocs=42740)
                0.018192094 = queryNorm
              0.50463784 = fieldWeight in 1135, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.661645 = idf(docFreq=1097, maxDocs=42740)
                0.0625 = fieldNorm(doc=1135)
          0.06769528 = weight(abstract_txt:collections in 1135) [ClassicSimilarity], result of:
            0.06769528 = score(doc=1135,freq=2.0), product of:
              0.16293177 = queryWeight, product of:
                1.9053091 = boost
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.018192094 = queryNorm
              0.4154824 = fieldWeight in 1135, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.0625 = fieldNorm(doc=1135)
          0.15590315 = weight(abstract_txt:test in 1135) [ClassicSimilarity], result of:
            0.15590315 = score(doc=1135,freq=3.0), product of:
              0.28414285 = queryWeight, product of:
                3.081602 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.018192094 = queryNorm
              0.54867876 = fieldWeight in 1135, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.0625 = fieldNorm(doc=1135)
        0.24 = coord(6/25)
    
  2. Spina, D.; Trippas, J.R.; Cavedon, L.; Sanderson, M.: Extracting audio summaries to support effective spoken document search (2017) 0.14
    0.13683483 = sum of:
      0.13683483 = product of:
        0.4886958 = sum of:
          0.048936404 = weight(abstract_txt:relevance in 5789) [ClassicSimilarity], result of:
            0.048936404 = score(doc=5789,freq=2.0), product of:
              0.08976455 = queryWeight, product of:
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.018192094 = queryNorm
              0.54516405 = fieldWeight in 5789, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.078125 = fieldNorm(doc=5789)
          0.0525445 = weight(abstract_txt:experiment in 5789) [ClassicSimilarity], result of:
            0.0525445 = score(doc=5789,freq=1.0), product of:
              0.11858916 = queryWeight, product of:
                1.149397 = boost
                5.671426 = idf(docFreq=399, maxDocs=42740)
                0.018192094 = queryNorm
              0.44308013 = fieldWeight in 5789, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.671426 = idf(docFreq=399, maxDocs=42740)
                0.078125 = fieldNorm(doc=5789)
          0.057365984 = weight(abstract_txt:decisions in 5789) [ClassicSimilarity], result of:
            0.057365984 = score(doc=5789,freq=1.0), product of:
              0.12573701 = queryWeight, product of:
                1.1835296 = boost
                5.8398447 = idf(docFreq=337, maxDocs=42740)
                0.018192094 = queryNorm
              0.45623785 = fieldWeight in 5789, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.8398447 = idf(docFreq=337, maxDocs=42740)
                0.078125 = fieldNorm(doc=5789)
          0.094652735 = weight(abstract_txt:judgments in 5789) [ClassicSimilarity], result of:
            0.094652735 = score(doc=5789,freq=1.0), product of:
              0.17556943 = queryWeight, product of:
                1.3985307 = boost
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.018192094 = queryNorm
              0.5391185 = fieldWeight in 5789, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.078125 = fieldNorm(doc=5789)
          0.040152553 = weight(abstract_txt:documents in 5789) [ClassicSimilarity], result of:
            0.040152553 = score(doc=5789,freq=1.0), product of:
              0.124885574 = queryWeight, product of:
                1.668087 = boost
                4.115389 = idf(docFreq=1895, maxDocs=42740)
                0.018192094 = queryNorm
              0.32151476 = fieldWeight in 5789, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.115389 = idf(docFreq=1895, maxDocs=42740)
                0.078125 = fieldNorm(doc=5789)
          0.08253024 = weight(abstract_txt:collection in 5789) [ClassicSimilarity], result of:
            0.08253024 = score(doc=5789,freq=2.0), product of:
              0.16023925 = queryWeight, product of:
                1.8895005 = boost
                4.661645 = idf(docFreq=1097, maxDocs=42740)
                0.018192094 = queryNorm
              0.51504385 = fieldWeight in 5789, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.661645 = idf(docFreq=1097, maxDocs=42740)
                0.078125 = fieldNorm(doc=5789)
          0.11251341 = weight(abstract_txt:test in 5789) [ClassicSimilarity], result of:
            0.11251341 = score(doc=5789,freq=1.0), product of:
              0.28414285 = queryWeight, product of:
                3.081602 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.018192094 = queryNorm
              0.39597479 = fieldWeight in 5789, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.078125 = fieldNorm(doc=5789)
        0.28 = coord(7/25)
    
  3. Losada, D.E.; Parapar, J.; Barreiro, A.: When to stop making relevance judgments? : a study of stopping methods for building information retrieval test collections (2019) 0.13
    0.12584686 = sum of:
      0.12584686 = product of:
        0.52436197 = sum of:
          0.047947694 = weight(abstract_txt:relevance in 675) [ClassicSimilarity], result of:
            0.047947694 = score(doc=675,freq=3.0), product of:
              0.08976455 = queryWeight, product of:
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.018192094 = queryNorm
              0.5341495 = fieldWeight in 675, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.0625 = fieldNorm(doc=675)
          0.13115466 = weight(abstract_txt:judgments in 675) [ClassicSimilarity], result of:
            0.13115466 = score(doc=675,freq=3.0), product of:
              0.17556943 = queryWeight, product of:
                1.3985307 = boost
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.018192094 = queryNorm
              0.7470245 = fieldWeight in 675, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.0625 = fieldNorm(doc=675)
          0.055637013 = weight(abstract_txt:documents in 675) [ClassicSimilarity], result of:
            0.055637013 = score(doc=675,freq=3.0), product of:
              0.124885574 = queryWeight, product of:
                1.668087 = boost
                4.115389 = idf(docFreq=1895, maxDocs=42740)
                0.018192094 = queryNorm
              0.44550392 = fieldWeight in 675, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.115389 = idf(docFreq=1895, maxDocs=42740)
                0.0625 = fieldNorm(doc=675)
          0.06602419 = weight(abstract_txt:collection in 675) [ClassicSimilarity], result of:
            0.06602419 = score(doc=675,freq=2.0), product of:
              0.16023925 = queryWeight, product of:
                1.8895005 = boost
                4.661645 = idf(docFreq=1097, maxDocs=42740)
                0.018192094 = queryNorm
              0.41203508 = fieldWeight in 675, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.661645 = idf(docFreq=1097, maxDocs=42740)
                0.0625 = fieldNorm(doc=675)
          0.06769528 = weight(abstract_txt:collections in 675) [ClassicSimilarity], result of:
            0.06769528 = score(doc=675,freq=2.0), product of:
              0.16293177 = queryWeight, product of:
                1.9053091 = boost
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.018192094 = queryNorm
              0.4154824 = fieldWeight in 675, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.0625 = fieldNorm(doc=675)
          0.15590315 = weight(abstract_txt:test in 675) [ClassicSimilarity], result of:
            0.15590315 = score(doc=675,freq=3.0), product of:
              0.28414285 = queryWeight, product of:
                3.081602 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.018192094 = queryNorm
              0.54867876 = fieldWeight in 675, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.0625 = fieldNorm(doc=675)
        0.24 = coord(6/25)
    
  4. Campos, L.M. de; Fernández-Luna, J.M.; Huete, J.F.: Implementing relevance feedback in the Bayesian network retrieval model (2003) 0.11
    0.1140213 = sum of:
      0.1140213 = product of:
        0.47508878 = sum of:
          0.06920653 = weight(abstract_txt:relevance in 2425) [ClassicSimilarity], result of:
            0.06920653 = score(doc=2425,freq=4.0), product of:
              0.08976455 = queryWeight, product of:
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.018192094 = queryNorm
              0.7709784 = fieldWeight in 2425, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.078125 = fieldNorm(doc=2425)
          0.094652735 = weight(abstract_txt:judgments in 2425) [ClassicSimilarity], result of:
            0.094652735 = score(doc=2425,freq=1.0), product of:
              0.17556943 = queryWeight, product of:
                1.3985307 = boost
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.018192094 = queryNorm
              0.5391185 = fieldWeight in 2425, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.078125 = fieldNorm(doc=2425)
          0.13625279 = weight(abstract_txt:experimentation in 2425) [ClassicSimilarity], result of:
            0.13625279 = score(doc=2425,freq=1.0), product of:
              0.22383282 = queryWeight, product of:
                1.5790993 = boost
                7.7916894 = idf(docFreq=47, maxDocs=42740)
                0.018192094 = queryNorm
              0.6087257 = fieldWeight in 2425, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.7916894 = idf(docFreq=47, maxDocs=42740)
                0.078125 = fieldNorm(doc=2425)
          0.056784287 = weight(abstract_txt:documents in 2425) [ClassicSimilarity], result of:
            0.056784287 = score(doc=2425,freq=2.0), product of:
              0.124885574 = queryWeight, product of:
                1.668087 = boost
                4.115389 = idf(docFreq=1895, maxDocs=42740)
                0.018192094 = queryNorm
              0.45469052 = fieldWeight in 2425, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.115389 = idf(docFreq=1895, maxDocs=42740)
                0.078125 = fieldNorm(doc=2425)
          0.058357693 = weight(abstract_txt:collection in 2425) [ClassicSimilarity], result of:
            0.058357693 = score(doc=2425,freq=1.0), product of:
              0.16023925 = queryWeight, product of:
                1.8895005 = boost
                4.661645 = idf(docFreq=1097, maxDocs=42740)
                0.018192094 = queryNorm
              0.364191 = fieldWeight in 2425, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.661645 = idf(docFreq=1097, maxDocs=42740)
                0.078125 = fieldNorm(doc=2425)
          0.059834745 = weight(abstract_txt:collections in 2425) [ClassicSimilarity], result of:
            0.059834745 = score(doc=2425,freq=1.0), product of:
              0.16293177 = queryWeight, product of:
                1.9053091 = boost
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.018192094 = queryNorm
              0.36723804 = fieldWeight in 2425, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.078125 = fieldNorm(doc=2425)
        0.24 = coord(6/25)
    
  5. Ravana, S.D.; Rajagopal, P.; Balakrishnan, V.: Ranking retrieval systems using pseudo relevance judgments (2015) 0.11
    0.11145895 = sum of:
      0.11145895 = product of:
        0.4644123 = sum of:
          0.07324131 = weight(abstract_txt:relevance in 4592) [ClassicSimilarity], result of:
            0.07324131 = score(doc=4592,freq=7.0), product of:
              0.08976455 = queryWeight, product of:
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.018192094 = queryNorm
              0.81592685 = fieldWeight in 4592, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.0625 = fieldNorm(doc=4592)
          0.16931996 = weight(abstract_txt:judgments in 4592) [ClassicSimilarity], result of:
            0.16931996 = score(doc=4592,freq=5.0), product of:
              0.17556943 = queryWeight, product of:
                1.3985307 = boost
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.018192094 = queryNorm
              0.9644045 = fieldWeight in 4592, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.0625 = fieldNorm(doc=4592)
          0.028335491 = weight(abstract_txt:design in 4592) [ClassicSimilarity], result of:
            0.028335491 = score(doc=4592,freq=1.0), product of:
              0.11486754 = queryWeight, product of:
                1.5997835 = boost
                3.9468753 = idf(docFreq=2243, maxDocs=42740)
                0.018192094 = queryNorm
              0.24667971 = fieldWeight in 4592, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.9468753 = idf(docFreq=2243, maxDocs=42740)
                0.0625 = fieldNorm(doc=4592)
          0.055637013 = weight(abstract_txt:documents in 4592) [ClassicSimilarity], result of:
            0.055637013 = score(doc=4592,freq=3.0), product of:
              0.124885574 = queryWeight, product of:
                1.668087 = boost
                4.115389 = idf(docFreq=1895, maxDocs=42740)
                0.018192094 = queryNorm
              0.44550392 = fieldWeight in 4592, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.115389 = idf(docFreq=1895, maxDocs=42740)
                0.0625 = fieldNorm(doc=4592)
          0.047867794 = weight(abstract_txt:collections in 4592) [ClassicSimilarity], result of:
            0.047867794 = score(doc=4592,freq=1.0), product of:
              0.16293177 = queryWeight, product of:
                1.9053091 = boost
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.018192094 = queryNorm
              0.29379043 = fieldWeight in 4592, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.700647 = idf(docFreq=1055, maxDocs=42740)
                0.0625 = fieldNorm(doc=4592)
          0.090010725 = weight(abstract_txt:test in 4592) [ClassicSimilarity], result of:
            0.090010725 = score(doc=4592,freq=1.0), product of:
              0.28414285 = queryWeight, product of:
                3.081602 = boost
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.018192094 = queryNorm
              0.31677982 = fieldWeight in 4592, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.068477 = idf(docFreq=730, maxDocs=42740)
                0.0625 = fieldNorm(doc=4592)
        0.24 = coord(6/25)