Search (106 results, page 1 of 6)

  • × theme_ss:"Retrievalstudien"
  1. Ravana, S.D.; Taheri, M.S.; Rajagopal, P.: Document-based approach to improve the accuracy of pairwise comparison in evaluating information retrieval systems (2015) 0.04 
    0.04404157 = product of:
  0.08808314 = sum of:
    0.08808314 = sum of:
      0.052721076 = weight(_text_:p in 2587) [ClassicSimilarity], result of:
        0.052721076 = score(doc=2587,freq=4.0), product of:
          0.18768665 = queryWeight, product of:
            3.5955126 = idf(docFreq=3298, maxDocs=44218)
            0.052200247 = queryNorm
          0.28089944 = fieldWeight in 2587, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.5955126 = idf(docFreq=3298, maxDocs=44218)
            0.0390625 = fieldNorm(doc=2587)
      0.035362065 = weight(_text_:22 in 2587) [ClassicSimilarity], result of:
        0.035362065 = score(doc=2587,freq=2.0), product of:
          0.18279637 = queryWeight, product of:
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.052200247 = queryNorm
          0.19345059 = fieldWeight in 2587, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.0390625 = fieldNorm(doc=2587)
  0.5 = coord(1/2)
    Abstract
    Purpose The purpose of this paper is to propose a method to have more accurate results in comparing performance of the paired information retrieval (IR) systems with reference to the current method, which is based on the mean effectiveness scores of the systems across a set of identified topics/queries. Design/methodology/approach Based on the proposed approach, instead of the classic method of using a set of topic scores, the documents level scores are considered as the evaluation unit. These document scores are the defined document's weight, which play the role of the mean average precision (MAP) score of the systems as a significance test's statics. The experiments were conducted using the TREC 9 Web track collection. Findings The p-values generated through the two types of significance tests, namely the Student's t-test and Mann-Whitney show that by using the document level scores as an evaluation unit, the difference between IR systems is more significant compared with utilizing topic scores. Originality/value Utilizing a suitable test collection is a primary prerequisite for IR systems comparative evaluation. However, in addition to reusable test collections, having an accurate statistical testing is a necessity for these evaluations. The findings of this study will assist IR researchers to evaluate their retrieval systems and algorithms more accurately.
    Date
    20. 1.2015 18:30:22
  2. Reichert, S.; Mayr, P.: Untersuchung von Relevanzeigenschaften in einem kontrollierten Eyetracking-Experiment (2012) 0.04 
    0.043584894 = product of:
  0.08716979 = sum of:
    0.08716979 = sum of:
      0.044735312 = weight(_text_:p in 328) [ClassicSimilarity], result of:
        0.044735312 = score(doc=328,freq=2.0), product of:
          0.18768665 = queryWeight, product of:
            3.5955126 = idf(docFreq=3298, maxDocs=44218)
            0.052200247 = queryNorm
          0.23835106 = fieldWeight in 328, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5955126 = idf(docFreq=3298, maxDocs=44218)
            0.046875 = fieldNorm(doc=328)
      0.042434476 = weight(_text_:22 in 328) [ClassicSimilarity], result of:
        0.042434476 = score(doc=328,freq=2.0), product of:
          0.18279637 = queryWeight, product of:
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.052200247 = queryNorm
          0.23214069 = fieldWeight in 328, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.046875 = fieldNorm(doc=328)
  0.5 = coord(1/2)
    Date
    22. 7.2012 19:25:54
  3. Pal, S.; Mitra, M.; Kamps, J.: Evaluation effort, reliability and reusability in XML retrieval (2011) 0.04 
    0.03886983 = sum of:
  0.0211888 = product of:
    0.0847552 = sum of:
      0.0847552 = weight(_text_:authors in 4197) [ClassicSimilarity], result of:
        0.0847552 = score(doc=4197,freq=4.0), product of:
          0.23797122 = queryWeight, product of:
            4.558814 = idf(docFreq=1258, maxDocs=44218)
            0.052200247 = queryNorm
          0.35615736 = fieldWeight in 4197, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.558814 = idf(docFreq=1258, maxDocs=44218)
            0.0390625 = fieldNorm(doc=4197)
    0.25 = coord(1/4)
  0.017681032 = product of:
    0.035362065 = sum of:
      0.035362065 = weight(_text_:22 in 4197) [ClassicSimilarity], result of:
        0.035362065 = score(doc=4197,freq=2.0), product of:
          0.18279637 = queryWeight, product of:
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.052200247 = queryNorm
          0.19345059 = fieldWeight in 4197, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.0390625 = fieldNorm(doc=4197)
    0.5 = coord(1/2)
    Abstract
    The Initiative for the Evaluation of XML retrieval (INEX) provides a TREC-like platform for evaluating content-oriented XML retrieval systems. Since 2007, INEX has been using a set of precision-recall based metrics for its ad hoc tasks. The authors investigate the reliability and robustness of these focused retrieval measures, and of the INEX pooling method. They explore four specific questions: How reliable are the metrics when assessments are incomplete, or when query sets are small? What is the minimum pool/query-set size that can be used to reliably evaluate systems? Can the INEX collections be used to fairly evaluate "new" systems that did not participate in the pooling process? And, for a fixed amount of assessment effort, would this effort be better spent in thoroughly judging a few queries, or in judging many queries relatively superficially? The authors' findings validate properties of precision-recall-based metrics observed in document retrieval settings. Early precision measures are found to be more error-prone and less stable under incomplete judgments and small topic-set sizes. They also find that system rankings remain largely unaffected even when assessment effort is substantially (but systematically) reduced, and confirm that the INEX collections remain usable when evaluating nonparticipating systems. Finally, they observe that for a fixed amount of effort, judging shallow pools for many queries is better than judging deep pools for a smaller set of queries. However, when judging only a random sample of a pool, it is better to completely judge fewer topics than to partially judge many topics. This result confirms the effectiveness of pooling methods.
    Date
    22. 1.2011 14:20:56
  4. Rajagopal, P.; Ravana, S.D.; Koh, Y.S.; Balakrishnan, V.: Evaluating the effectiveness of information retrieval systems using effort-based relevance judgment (2019) 0.04 
    0.036320746 = product of:
  0.07264149 = sum of:
    0.07264149 = sum of:
      0.037279427 = weight(_text_:p in 5287) [ClassicSimilarity], result of:
        0.037279427 = score(doc=5287,freq=2.0), product of:
          0.18768665 = queryWeight, product of:
            3.5955126 = idf(docFreq=3298, maxDocs=44218)
            0.052200247 = queryNorm
          0.19862589 = fieldWeight in 5287, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5955126 = idf(docFreq=3298, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5287)
      0.035362065 = weight(_text_:22 in 5287) [ClassicSimilarity], result of:
        0.035362065 = score(doc=5287,freq=2.0), product of:
          0.18279637 = queryWeight, product of:
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.052200247 = queryNorm
          0.19345059 = fieldWeight in 5287, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5287)
  0.5 = coord(1/2)
    Date
    20. 1.2015 18:30:22
  5. Ballerini, J.-P.; Büchel, M.; Domenig, R.; Knaus, D.; Mateev, B.; Mittendorf, E.; Schäuble, P.; Wechsler, M.; Sheridan, P.: SPIDER retrieval system at TREC-5 (1997) 0.03 
    0.032284934 = product of:
  0.06456987 = sum of:
    0.06456987 = product of:
      0.12913974 = sum of:
        0.12913974 = weight(_text_:p in 3104) [ClassicSimilarity], result of:
          0.12913974 = score(doc=3104,freq=6.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.6880603 = fieldWeight in 3104, product of:
              2.4494898 = tf(freq=6.0), with freq of:
                6.0 = termFreq=6.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.078125 = fieldNorm(doc=3104)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
  6. Hawking, D.; Thistlewaite, P.; Bailey, P.: ANU/ACSys TREC-5 experiments : TREC-5 report (1997) 0.03 
    0.031632643 = product of:
  0.06326529 = sum of:
    0.06326529 = product of:
      0.12653057 = sum of:
        0.12653057 = weight(_text_:p in 3101) [ClassicSimilarity], result of:
          0.12653057 = score(doc=3101,freq=4.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.67415863 = fieldWeight in 3101, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.09375 = fieldNorm(doc=3101)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
  7. Sheridan, P.; Ballerini, J.P.; Schäuble, P.: Building a large multilingual test collection from comparable news documents (1998) 0.03 
    0.031632643 = product of:
  0.06326529 = sum of:
    0.06326529 = product of:
      0.12653057 = sum of:
        0.12653057 = weight(_text_:p in 6298) [ClassicSimilarity], result of:
          0.12653057 = score(doc=6298,freq=4.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.67415863 = fieldWeight in 6298, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.09375 = fieldNorm(doc=6298)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
  8. Larsen, B.; Ingwersen, P.; Lund, B.: Data fusion according to the principle of polyrepresentation (2009) 0.03 
    0.029056598 = product of:
  0.058113195 = sum of:
    0.058113195 = sum of:
      0.029823542 = weight(_text_:p in 2752) [ClassicSimilarity], result of:
        0.029823542 = score(doc=2752,freq=2.0), product of:
          0.18768665 = queryWeight, product of:
            3.5955126 = idf(docFreq=3298, maxDocs=44218)
            0.052200247 = queryNorm
          0.15890071 = fieldWeight in 2752, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5955126 = idf(docFreq=3298, maxDocs=44218)
            0.03125 = fieldNorm(doc=2752)
      0.028289651 = weight(_text_:22 in 2752) [ClassicSimilarity], result of:
        0.028289651 = score(doc=2752,freq=2.0), product of:
          0.18279637 = queryWeight, product of:
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.052200247 = queryNorm
          0.15476047 = fieldWeight in 2752, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.03125 = fieldNorm(doc=2752)
  0.5 = coord(1/2)
    Date
    22. 3.2009 18:48:28
  9. Hersh, W.R.; Over, P.: Interactivity at the Text Retrieval Conference (TREC) (2001) 0.03 
    0.026095599 = product of:
  0.052191198 = sum of:
    0.052191198 = product of:
      0.104382396 = sum of:
        0.104382396 = weight(_text_:p in 5486) [ClassicSimilarity], result of:
          0.104382396 = score(doc=5486,freq=2.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.55615246 = fieldWeight in 5486, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.109375 = fieldNorm(doc=5486)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
  10. Over, P.: ¬The TREC interactive track : an annotated bibliography (2001) 0.03 
    0.026095599 = product of:
  0.052191198 = sum of:
    0.052191198 = product of:
      0.104382396 = sum of:
        0.104382396 = weight(_text_:p in 5572) [ClassicSimilarity], result of:
          0.104382396 = score(doc=5572,freq=2.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.55615246 = fieldWeight in 5572, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.109375 = fieldNorm(doc=5572)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
  11. Krause, J.; Mutschke, P.: Indexierung und Fulcrum-Evaluierung (1999) 0.03 
    0.026095599 = product of:
  0.052191198 = sum of:
    0.052191198 = product of:
      0.104382396 = sum of:
        0.104382396 = weight(_text_:p in 6256) [ClassicSimilarity], result of:
          0.104382396 = score(doc=6256,freq=2.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.55615246 = fieldWeight in 6256, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.109375 = fieldNorm(doc=6256)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
  12. Oberhauser, O.; Labner, J.: Einführung der automatischen Indexierung im Österreichischen Verbundkatalog? : Bericht über eine empirische Studie (2003) 0.03 
    0.026095599 = product of:
  0.052191198 = sum of:
    0.052191198 = product of:
      0.104382396 = sum of:
        0.104382396 = weight(_text_:p in 1878) [ClassicSimilarity], result of:
          0.104382396 = score(doc=1878,freq=2.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.55615246 = fieldWeight in 1878, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.109375 = fieldNorm(doc=1878)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
    Type
    p
  13. Munkelt, J.; Schaer, P.: Towards an IR test collection for the German National Library (2018) 0.03 
    0.026095599 = product of:
  0.052191198 = sum of:
    0.052191198 = product of:
      0.104382396 = sum of:
        0.104382396 = weight(_text_:p in 5780) [ClassicSimilarity], result of:
          0.104382396 = score(doc=5780,freq=2.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.55615246 = fieldWeight in 5780, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.109375 = fieldNorm(doc=5780)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
  14. Balog, K.; Schuth, A.; Dekker, P.; Tavakolpoursaleh, N.; Schaer, P.; Chuang, P.-Y.: Overview of the TREC 2016 Open Search track Academic Search Edition (2016) 0.03 
    0.025827946 = product of:
  0.051655892 = sum of:
    0.051655892 = product of:
      0.103311785 = sum of:
        0.103311785 = weight(_text_:p in 43) [ClassicSimilarity], result of:
          0.103311785 = score(doc=43,freq=6.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.55044824 = fieldWeight in 43, product of:
              2.4494898 = tf(freq=6.0), with freq of:
                6.0 = termFreq=6.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.0625 = fieldNorm(doc=43)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
  15. Fuhr, N.; Niewelt, B.: ¬Ein Retrievaltest mit automatisch indexierten Dokumenten (1984) 0.02 
    0.024753446 = product of:
  0.04950689 = sum of:
    0.04950689 = product of:
      0.09901378 = sum of:
        0.09901378 = weight(_text_:22 in 262) [ClassicSimilarity], result of:
          0.09901378 = score(doc=262,freq=2.0), product of:
            0.18279637 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.052200247 = queryNorm
            0.5416616 = fieldWeight in 262, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.109375 = fieldNorm(doc=262)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
    Date
    20.10.2000 12:22:23
  16. Tomaiuolo, N.G.; Parker, J.: Maximizing relevant retrieval : keyword and natural language searching (1998) 0.02 
    0.024753446 = product of:
  0.04950689 = sum of:
    0.04950689 = product of:
      0.09901378 = sum of:
        0.09901378 = weight(_text_:22 in 6418) [ClassicSimilarity], result of:
          0.09901378 = score(doc=6418,freq=2.0), product of:
            0.18279637 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.052200247 = queryNorm
            0.5416616 = fieldWeight in 6418, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.109375 = fieldNorm(doc=6418)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
    Source
    Online. 22(1998) no.6, S.57-58
  17. Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000) 0.02 
    0.024753446 = product of:
  0.04950689 = sum of:
    0.04950689 = product of:
      0.09901378 = sum of:
        0.09901378 = weight(_text_:22 in 6438) [ClassicSimilarity], result of:
          0.09901378 = score(doc=6438,freq=2.0), product of:
            0.18279637 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.052200247 = queryNorm
            0.5416616 = fieldWeight in 6438, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.109375 = fieldNorm(doc=6438)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
    Date
    11. 8.2001 16:22:19
  18. Dalrymple, P.W.: Retrieval by reformulation in two library catalogs : toward a cognitive model of searching behavior (1990) 0.02 
    0.024753446 = product of:
  0.04950689 = sum of:
    0.04950689 = product of:
      0.09901378 = sum of:
        0.09901378 = weight(_text_:22 in 5089) [ClassicSimilarity], result of:
          0.09901378 = score(doc=5089,freq=2.0), product of:
            0.18279637 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.052200247 = queryNorm
            0.5416616 = fieldWeight in 5089, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.109375 = fieldNorm(doc=5089)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
    Date
    22. 7.2006 18:43:54
  19. Salton, G.; Lesk, M.E.: Computer evaluation of indexing and text processing (1968) 0.02 
    0.022367656 = product of:
  0.044735312 = sum of:
    0.044735312 = product of:
      0.089470625 = sum of:
        0.089470625 = weight(_text_:p in 77) [ClassicSimilarity], result of:
          0.089470625 = score(doc=77,freq=2.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.47670212 = fieldWeight in 77, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.09375 = fieldNorm(doc=77)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
    Footnote
    Wiederabgedruckt in: Readings in information retrieval. Ed.: K. Sparck Jones u. P. Willett. San Francisco: Morgan Kaufmann 1997. S.60-84.
  20. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1963) 0.02 
    0.022367656 = product of:
  0.044735312 = sum of:
    0.044735312 = product of:
      0.089470625 = sum of:
        0.089470625 = weight(_text_:p in 577) [ClassicSimilarity], result of:
          0.089470625 = score(doc=577,freq=2.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.47670212 = fieldWeight in 577, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.09375 = fieldNorm(doc=577)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
    Footnote
    Wiederabgedruckt in: Readings in information retrieval. Ed.: K. Sparck Jones u. P. Willett. San Francisco: Morgan Kaufmann 1997. S.98-110.

Authors

Years

Languages

  • e 94
  • d 9
  • f 2
  • More… Less…

Types

  • a 95
  • el 6
  • m 5
  • s 5
  • p 2
  • r 1
  • More… Less…

Themes

Subjects

Classifications