Document (#24981)

Author
Peters, C.
Braschler, M.
Title
Cross-language system evaluation : the CLEF campaigns
Source
Journal of the American Society for Information Science and technology. 52(2001) no.12, S.1067-1072
Year
2001
Abstract
The goals of the CLEF (Cross-Language Evaluation Forum) series of evaluation campaigns for information retrieval systems operating on European languages are described. The difficulties of organizing an activity which aims at an objective evaluation of systems running on and over a number' of different languages are examined. The discussion includes an analysis of the first results and proposals for possible developments in the future.
Theme
Multilinguale Probleme

Similar documents (author)

  1. Peters, C.; Braschler, M.; Clough, P.: Multilingual information retrieval : from research to practice (2012) 4.65
    4.646395 = sum of:
      4.646395 = sum of:
        1.4770818 = weight(author_txt:peters in 2362) [ClassicSimilarity], result of:
          1.4770818 = score(doc=2362,freq=1.0), product of:
            0.5152 = queryWeight, product of:
              7.645351 = idf(docFreq=54, maxDocs=42306)
              0.06738736 = queryNorm
            2.8670065 = fieldWeight in 2362, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              7.645351 = idf(docFreq=54, maxDocs=42306)
              0.375 = fieldNorm(doc=2362)
        3.1693134 = weight(author_txt:braschler in 2362) [ClassicSimilarity], result of:
          3.1693134 = score(doc=2362,freq=1.0), product of:
            0.85706997 = queryWeight, product of:
              1.2897936 = boost
              9.860925 = idf(docFreq=5, maxDocs=42306)
              0.06738736 = queryNorm
            3.697847 = fieldWeight in 2362, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              9.860925 = idf(docFreq=5, maxDocs=42306)
              0.375 = fieldNorm(doc=2362)
    
  2. Agosti, M.; Braschler, M.; Ferro, N.; Peters, C.; Siebinga, S.: Roadmap for multiLingual information access in the European Library (2007) 3.87
    3.871996 = sum of:
      3.871996 = sum of:
        1.2309015 = weight(author_txt:peters in 251) [ClassicSimilarity], result of:
          1.2309015 = score(doc=251,freq=1.0), product of:
            0.5152 = queryWeight, product of:
              7.645351 = idf(docFreq=54, maxDocs=42306)
              0.06738736 = queryNorm
            2.389172 = fieldWeight in 251, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              7.645351 = idf(docFreq=54, maxDocs=42306)
              0.3125 = fieldNorm(doc=251)
        2.6410944 = weight(author_txt:braschler in 251) [ClassicSimilarity], result of:
          2.6410944 = score(doc=251,freq=1.0), product of:
            0.85706997 = queryWeight, product of:
              1.2897936 = boost
              9.860925 = idf(docFreq=5, maxDocs=42306)
              0.06738736 = queryNorm
            3.081539 = fieldWeight in 251, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              9.860925 = idf(docFreq=5, maxDocs=42306)
              0.3125 = fieldNorm(doc=251)
    
  3. Peters, C.M.: CD-ROM: its potential in libraries (1986) 1.23
    1.2309015 = sum of:
      1.2309015 = product of:
        2.461803 = sum of:
          2.461803 = weight(author_txt:peters in 535) [ClassicSimilarity], result of:
            2.461803 = score(doc=535,freq=1.0), product of:
              0.5152 = queryWeight, product of:
                7.645351 = idf(docFreq=54, maxDocs=42306)
                0.06738736 = queryNorm
              4.778344 = fieldWeight in 535, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.645351 = idf(docFreq=54, maxDocs=42306)
                0.625 = fieldNorm(doc=535)
        0.5 = coord(1/2)
    
  4. Peters, T.A.: When smart people fail : an analysis of the transaction log of an online public access catalog (1989) 1.23
    1.2309015 = sum of:
      1.2309015 = product of:
        2.461803 = sum of:
          2.461803 = weight(author_txt:peters in 2283) [ClassicSimilarity], result of:
            2.461803 = score(doc=2283,freq=1.0), product of:
              0.5152 = queryWeight, product of:
                7.645351 = idf(docFreq=54, maxDocs=42306)
                0.06738736 = queryNorm
              4.778344 = fieldWeight in 2283, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.645351 = idf(docFreq=54, maxDocs=42306)
                0.625 = fieldNorm(doc=2283)
        0.5 = coord(1/2)
    
  5. Peters, C.M.: CD-ROM and optical technology : the user interface (1988) 1.23
    1.2309015 = sum of:
      1.2309015 = product of:
        2.461803 = sum of:
          2.461803 = weight(author_txt:peters in 4013) [ClassicSimilarity], result of:
            2.461803 = score(doc=4013,freq=1.0), product of:
              0.5152 = queryWeight, product of:
                7.645351 = idf(docFreq=54, maxDocs=42306)
                0.06738736 = queryNorm
              4.778344 = fieldWeight in 4013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.645351 = idf(docFreq=54, maxDocs=42306)
                0.625 = fieldNorm(doc=4013)
        0.5 = coord(1/2)
    

Similar documents (content)

  1. García Cumbreras, M.A.; Perea-Ortega, J.M.; García Vega, M.; Ureña López, L.A.: Information retrieval with geographical references : relevant documents filtering vs. query expansion (2009) 0.19
    0.19392239 = sum of:
      0.19392239 = product of:
        0.80801 = sum of:
          0.0252247 = weight(abstract_txt:systems in 1223) [ClassicSimilarity], result of:
            0.0252247 = score(doc=1223,freq=1.0), product of:
              0.07873515 = queryWeight, product of:
                1.4728038 = boost
                3.4173236 = idf(docFreq=3771, maxDocs=42306)
                0.015643634 = queryNorm
              0.32037407 = fieldWeight in 1223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4173236 = idf(docFreq=3771, maxDocs=42306)
                0.09375 = fieldNorm(doc=1223)
          0.104967006 = weight(abstract_txt:forum in 1223) [ClassicSimilarity], result of:
            0.104967006 = score(doc=1223,freq=1.0), product of:
              0.16167511 = queryWeight, product of:
                1.4923378 = boost
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.015643634 = queryNorm
              0.6492465 = fieldWeight in 1223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.09375 = fieldNorm(doc=1223)
          0.046761014 = weight(abstract_txt:language in 1223) [ClassicSimilarity], result of:
            0.046761014 = score(doc=1223,freq=1.0), product of:
              0.11881571 = queryWeight, product of:
                1.8092456 = boost
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.015643634 = queryNorm
              0.39355916 = fieldWeight in 1223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.09375 = fieldNorm(doc=1223)
          0.113188535 = weight(abstract_txt:cross in 1223) [ClassicSimilarity], result of:
            0.113188535 = score(doc=1223,freq=1.0), product of:
              0.21420006 = queryWeight, product of:
                2.4292397 = boost
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.015643634 = queryNorm
              0.5284244 = fieldWeight in 1223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.09375 = fieldNorm(doc=1223)
          0.40318 = weight(abstract_txt:clef in 1223) [ClassicSimilarity], result of:
            0.40318 = score(doc=1223,freq=1.0), product of:
              0.4995941 = queryWeight, product of:
                3.70996 = boost
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.015643634 = queryNorm
              0.8070152 = fieldWeight in 1223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.09375 = fieldNorm(doc=1223)
          0.11468874 = weight(abstract_txt:evaluation in 1223) [ClassicSimilarity], result of:
            0.11468874 = score(doc=1223,freq=1.0), product of:
              0.27225456 = queryWeight, product of:
                3.8731394 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.015643634 = queryNorm
              0.42125553 = fieldWeight in 1223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.09375 = fieldNorm(doc=1223)
        0.24 = coord(6/25)
    
  2. Kluck, M.; Mandl, T.; Womser-Hacker, C.: Cross-Language Evaluation Forum (CLEF) : Europäische Initiative zur Bewertung sprachübergreifender Retrievalverfahren (2002) 0.19
    0.1899576 = sum of:
      0.1899576 = product of:
        0.949788 = sum of:
          0.104967006 = weight(abstract_txt:forum in 1267) [ClassicSimilarity], result of:
            0.104967006 = score(doc=1267,freq=1.0), product of:
              0.16167511 = queryWeight, product of:
                1.4923378 = boost
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.015643634 = queryNorm
              0.6492465 = fieldWeight in 1267, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.09375 = fieldNorm(doc=1267)
          0.046761014 = weight(abstract_txt:language in 1267) [ClassicSimilarity], result of:
            0.046761014 = score(doc=1267,freq=1.0), product of:
              0.11881571 = queryWeight, product of:
                1.8092456 = boost
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.015643634 = queryNorm
              0.39355916 = fieldWeight in 1267, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.09375 = fieldNorm(doc=1267)
          0.113188535 = weight(abstract_txt:cross in 1267) [ClassicSimilarity], result of:
            0.113188535 = score(doc=1267,freq=1.0), product of:
              0.21420006 = queryWeight, product of:
                2.4292397 = boost
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.015643634 = queryNorm
              0.5284244 = fieldWeight in 1267, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.09375 = fieldNorm(doc=1267)
          0.5701827 = weight(abstract_txt:clef in 1267) [ClassicSimilarity], result of:
            0.5701827 = score(doc=1267,freq=2.0), product of:
              0.4995941 = queryWeight, product of:
                3.70996 = boost
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.015643634 = queryNorm
              1.1412919 = fieldWeight in 1267, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.09375 = fieldNorm(doc=1267)
          0.11468874 = weight(abstract_txt:evaluation in 1267) [ClassicSimilarity], result of:
            0.11468874 = score(doc=1267,freq=1.0), product of:
              0.27225456 = queryWeight, product of:
                3.8731394 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.015643634 = queryNorm
              0.42125553 = fieldWeight in 1267, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.09375 = fieldNorm(doc=1267)
        0.2 = coord(5/25)
    
  3. Scheufen, J.-H.: RECOIN: Modell offener Schnittstellen für Information-Retrieval-Systeme und -Komponenten (2006) 0.18
    0.18264991 = sum of:
      0.18264991 = product of:
        0.91324955 = sum of:
          0.122461505 = weight(abstract_txt:forum in 902) [ClassicSimilarity], result of:
            0.122461505 = score(doc=902,freq=1.0), product of:
              0.16167511 = queryWeight, product of:
                1.4923378 = boost
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.015643634 = queryNorm
              0.7574543 = fieldWeight in 902, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.109375 = fieldNorm(doc=902)
          0.05455451 = weight(abstract_txt:language in 902) [ClassicSimilarity], result of:
            0.05455451 = score(doc=902,freq=1.0), product of:
              0.11881571 = queryWeight, product of:
                1.8092456 = boost
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.015643634 = queryNorm
              0.45915234 = fieldWeight in 902, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.109375 = fieldNorm(doc=902)
          0.1320533 = weight(abstract_txt:cross in 902) [ClassicSimilarity], result of:
            0.1320533 = score(doc=902,freq=1.0), product of:
              0.21420006 = queryWeight, product of:
                2.4292397 = boost
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.015643634 = queryNorm
              0.61649513 = fieldWeight in 902, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.109375 = fieldNorm(doc=902)
          0.4703767 = weight(abstract_txt:clef in 902) [ClassicSimilarity], result of:
            0.4703767 = score(doc=902,freq=1.0), product of:
              0.4995941 = queryWeight, product of:
                3.70996 = boost
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.015643634 = queryNorm
              0.9415177 = fieldWeight in 902, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.109375 = fieldNorm(doc=902)
          0.13380353 = weight(abstract_txt:evaluation in 902) [ClassicSimilarity], result of:
            0.13380353 = score(doc=902,freq=1.0), product of:
              0.27225456 = queryWeight, product of:
                3.8731394 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.015643634 = queryNorm
              0.4914648 = fieldWeight in 902, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.109375 = fieldNorm(doc=902)
        0.2 = coord(5/25)
    
  4. Effektive Information Retrieval Verfahren in Theorie und Praxis : ausgewählte und erweiterte Beiträge des Vierten Hildesheimer Evaluierungs- und Retrievalworkshop (HIER 2005), Hildesheim, 20.7.2005 (2006) 0.16
    0.15655707 = sum of:
      0.15655707 = product of:
        0.7827853 = sum of:
          0.104967006 = weight(abstract_txt:forum in 974) [ClassicSimilarity], result of:
            0.104967006 = score(doc=974,freq=1.0), product of:
              0.16167511 = queryWeight, product of:
                1.4923378 = boost
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.015643634 = queryNorm
              0.6492465 = fieldWeight in 974, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.09375 = fieldNorm(doc=974)
          0.046761014 = weight(abstract_txt:language in 974) [ClassicSimilarity], result of:
            0.046761014 = score(doc=974,freq=1.0), product of:
              0.11881571 = queryWeight, product of:
                1.8092456 = boost
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.015643634 = queryNorm
              0.39355916 = fieldWeight in 974, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.09375 = fieldNorm(doc=974)
          0.113188535 = weight(abstract_txt:cross in 974) [ClassicSimilarity], result of:
            0.113188535 = score(doc=974,freq=1.0), product of:
              0.21420006 = queryWeight, product of:
                2.4292397 = boost
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.015643634 = queryNorm
              0.5284244 = fieldWeight in 974, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.09375 = fieldNorm(doc=974)
          0.40318 = weight(abstract_txt:clef in 974) [ClassicSimilarity], result of:
            0.40318 = score(doc=974,freq=1.0), product of:
              0.4995941 = queryWeight, product of:
                3.70996 = boost
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.015643634 = queryNorm
              0.8070152 = fieldWeight in 974, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.608162 = idf(docFreq=20, maxDocs=42306)
                0.09375 = fieldNorm(doc=974)
          0.11468874 = weight(abstract_txt:evaluation in 974) [ClassicSimilarity], result of:
            0.11468874 = score(doc=974,freq=1.0), product of:
              0.27225456 = queryWeight, product of:
                3.8731394 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.015643634 = queryNorm
              0.42125553 = fieldWeight in 974, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.09375 = fieldNorm(doc=974)
        0.2 = coord(5/25)
    
  5. Fujita, S.: NTCIR-2 as a Rosetta stone in laboratory experiments of IR systems (2005) 0.12
    0.12141443 = sum of:
      0.12141443 = product of:
        0.50589347 = sum of:
          0.05709273 = weight(abstract_txt:difficulties in 3018) [ClassicSimilarity], result of:
            0.05709273 = score(doc=3018,freq=1.0), product of:
              0.12165109 = queryWeight, product of:
                1.2945045 = boost
                6.0072374 = idf(docFreq=282, maxDocs=42306)
                0.015643634 = queryNorm
              0.4693154 = fieldWeight in 3018, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.0072374 = idf(docFreq=282, maxDocs=42306)
                0.078125 = fieldNorm(doc=3018)
          0.021020586 = weight(abstract_txt:systems in 3018) [ClassicSimilarity], result of:
            0.021020586 = score(doc=3018,freq=1.0), product of:
              0.07873515 = queryWeight, product of:
                1.4728038 = boost
                3.4173236 = idf(docFreq=3771, maxDocs=42306)
                0.015643634 = queryNorm
              0.2669784 = fieldWeight in 3018, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4173236 = idf(docFreq=3771, maxDocs=42306)
                0.078125 = fieldNorm(doc=3018)
          0.055108376 = weight(abstract_txt:language in 3018) [ClassicSimilarity], result of:
            0.055108376 = score(doc=3018,freq=2.0), product of:
              0.11881571 = queryWeight, product of:
                1.8092456 = boost
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.015643634 = queryNorm
              0.46381387 = fieldWeight in 3018, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.197964 = idf(docFreq=1727, maxDocs=42306)
                0.078125 = fieldNorm(doc=3018)
          0.104115844 = weight(abstract_txt:languages in 3018) [ClassicSimilarity], result of:
            0.104115844 = score(doc=3018,freq=2.0), product of:
              0.18158223 = queryWeight, product of:
                2.236646 = boost
                5.189655 = idf(docFreq=640, maxDocs=42306)
                0.015643634 = queryNorm
              0.57338125 = fieldWeight in 3018, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.189655 = idf(docFreq=640, maxDocs=42306)
                0.078125 = fieldNorm(doc=3018)
          0.13339397 = weight(abstract_txt:cross in 3018) [ClassicSimilarity], result of:
            0.13339397 = score(doc=3018,freq=2.0), product of:
              0.21420006 = queryWeight, product of:
                2.4292397 = boost
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.015643634 = queryNorm
              0.62275416 = fieldWeight in 3018, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.636527 = idf(docFreq=409, maxDocs=42306)
                0.078125 = fieldNorm(doc=3018)
          0.13516198 = weight(abstract_txt:evaluation in 3018) [ClassicSimilarity], result of:
            0.13516198 = score(doc=3018,freq=2.0), product of:
              0.27225456 = queryWeight, product of:
                3.8731394 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.015643634 = queryNorm
              0.49645442 = fieldWeight in 3018, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.078125 = fieldNorm(doc=3018)
        0.24 = coord(6/25)