Document (#21804)

Author
Fricke, M.
Title
Measuring recall
Source
Journal of information science. 24(1998) no.6, S.409-417.
Year
1998
Abstract
Recall, the proortion of the relevant documents retrieved, is a key indicator of the performance of an information retrieval system. With large information systems, like the WWW, recal is almost impossible to measure or estimate by all standard techniques. Proposes an 'needle hiding' technique for measuring recall under these circumstances. Shows that ranking by relative recall does not have to be isomorphic to ranking by recall and hence the use of relative recall for comparative evaluation might not be entirely sound
Theme
Retrievalstudien

Similar documents (content)

  1. Thenmalar, S.; Geetha, T.V.: Enhanced ontology-based indexing and searching (2014) 0.22
    0.22137079 = sum of:
      0.22137079 = product of:
        0.6149188 = sum of:
          0.013473135 = weight(abstract_txt:standard in 3098) [ClassicSimilarity], result of:
            0.013473135 = score(doc=3098,freq=1.0), product of:
              0.07302709 = queryWeight, product of:
                4.723073 = idf(docFreq=1044, maxDocs=43254)
                0.015461774 = queryNorm
              0.18449503 = fieldWeight in 3098, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.723073 = idf(docFreq=1044, maxDocs=43254)
                0.0390625 = fieldNorm(doc=3098)
          0.00967253 = weight(abstract_txt:information in 3098) [ClassicSimilarity], result of:
            0.00967253 = score(doc=3098,freq=7.0), product of:
              0.038563423 = queryWeight, product of:
                1.0276868 = boost
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.015461774 = queryNorm
              0.25082135 = fieldWeight in 3098, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.0390625 = fieldNorm(doc=3098)
          0.017215738 = weight(abstract_txt:shows in 3098) [ClassicSimilarity], result of:
            0.017215738 = score(doc=3098,freq=1.0), product of:
              0.08599146 = queryWeight, product of:
                1.0851398 = boost
                5.125194 = idf(docFreq=698, maxDocs=43254)
                0.015461774 = queryNorm
              0.2002029 = fieldWeight in 3098, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.125194 = idf(docFreq=698, maxDocs=43254)
                0.0390625 = fieldNorm(doc=3098)
          0.028964888 = weight(abstract_txt:measure in 3098) [ClassicSimilarity], result of:
            0.028964888 = score(doc=3098,freq=2.0), product of:
              0.09654789 = queryWeight, product of:
                1.1498188 = boost
                5.430678 = idf(docFreq=514, maxDocs=43254)
                0.015461774 = queryNorm
              0.3000054 = fieldWeight in 3098, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.430678 = idf(docFreq=514, maxDocs=43254)
                0.0390625 = fieldNorm(doc=3098)
          0.02228696 = weight(abstract_txt:technique in 3098) [ClassicSimilarity], result of:
            0.02228696 = score(doc=3098,freq=1.0), product of:
              0.10214225 = queryWeight, product of:
                1.1826622 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.015461774 = queryNorm
              0.21819532 = fieldWeight in 3098, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0390625 = fieldNorm(doc=3098)
          0.023726737 = weight(abstract_txt:retrieved in 3098) [ClassicSimilarity], result of:
            0.023726737 = score(doc=3098,freq=1.0), product of:
              0.10649525 = queryWeight, product of:
                1.2076001 = boost
                5.7035832 = idf(docFreq=391, maxDocs=43254)
                0.015461774 = queryNorm
              0.22279622 = fieldWeight in 3098, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.7035832 = idf(docFreq=391, maxDocs=43254)
                0.0390625 = fieldNorm(doc=3098)
          0.06775218 = weight(abstract_txt:estimate in 3098) [ClassicSimilarity], result of:
            0.06775218 = score(doc=3098,freq=2.0), product of:
              0.1701285 = queryWeight, product of:
                1.5263233 = boost
                7.2089367 = idf(docFreq=86, maxDocs=43254)
                0.015461774 = queryNorm
              0.39824125 = fieldWeight in 3098, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.2089367 = idf(docFreq=86, maxDocs=43254)
                0.0390625 = fieldNorm(doc=3098)
          0.07786964 = weight(abstract_txt:ranking in 3098) [ClassicSimilarity], result of:
            0.07786964 = score(doc=3098,freq=3.0), product of:
              0.20545651 = queryWeight, product of:
                2.3720999 = boost
                5.6018004 = idf(docFreq=433, maxDocs=43254)
                0.015461774 = queryNorm
              0.3790079 = fieldWeight in 3098, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.6018004 = idf(docFreq=433, maxDocs=43254)
                0.0390625 = fieldNorm(doc=3098)
          0.35395697 = weight(abstract_txt:recall in 3098) [ClassicSimilarity], result of:
            0.35395697 = score(doc=3098,freq=6.0), product of:
              0.64536464 = queryWeight, product of:
                7.281758 = boost
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.015461774 = queryNorm
              0.5484604 = fieldWeight in 3098, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.0390625 = fieldNorm(doc=3098)
        0.36 = coord(9/25)
    
  2. Della Mea, V.; Mizzaro, S.: Measuring retrieval effectiveness : a new proposal and a first experimental validation (2004) 0.13
    0.13272776 = sum of:
      0.13272776 = product of:
        0.6636388 = sum of:
          0.012408443 = weight(abstract_txt:information in 4264) [ClassicSimilarity], result of:
            0.012408443 = score(doc=4264,freq=2.0), product of:
              0.038563423 = queryWeight, product of:
                1.0276868 = boost
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.015461774 = queryNorm
              0.32176715 = fieldWeight in 4264, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.09375 = fieldNorm(doc=4264)
          0.06951573 = weight(abstract_txt:measure in 4264) [ClassicSimilarity], result of:
            0.06951573 = score(doc=4264,freq=2.0), product of:
              0.09654789 = queryWeight, product of:
                1.1498188 = boost
                5.430678 = idf(docFreq=514, maxDocs=43254)
                0.015461774 = queryNorm
              0.72001296 = fieldWeight in 4264, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.430678 = idf(docFreq=514, maxDocs=43254)
                0.09375 = fieldNorm(doc=4264)
          0.056944173 = weight(abstract_txt:retrieved in 4264) [ClassicSimilarity], result of:
            0.056944173 = score(doc=4264,freq=1.0), product of:
              0.10649525 = queryWeight, product of:
                1.2076001 = boost
                5.7035832 = idf(docFreq=391, maxDocs=43254)
                0.015461774 = queryNorm
              0.53471094 = fieldWeight in 4264, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.7035832 = idf(docFreq=391, maxDocs=43254)
                0.09375 = fieldNorm(doc=4264)
          0.17796487 = weight(abstract_txt:measuring in 4264) [ClassicSimilarity], result of:
            0.17796487 = score(doc=4264,freq=1.0), product of:
              0.2868117 = queryWeight, product of:
                2.8026667 = boost
                6.6185994 = idf(docFreq=156, maxDocs=43254)
                0.015461774 = queryNorm
              0.6204937 = fieldWeight in 4264, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6185994 = idf(docFreq=156, maxDocs=43254)
                0.09375 = fieldNorm(doc=4264)
          0.34680557 = weight(abstract_txt:recall in 4264) [ClassicSimilarity], result of:
            0.34680557 = score(doc=4264,freq=1.0), product of:
              0.64536464 = queryWeight, product of:
                7.281758 = boost
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.015461774 = queryNorm
              0.53737926 = fieldWeight in 4264, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.09375 = fieldNorm(doc=4264)
        0.2 = coord(5/25)
    
  3. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.12
    0.12276439 = sum of:
      0.12276439 = product of:
        0.7672775 = sum of:
          0.0709492 = weight(abstract_txt:measure in 5515) [ClassicSimilarity], result of:
            0.0709492 = score(doc=5515,freq=3.0), product of:
              0.09654789 = queryWeight, product of:
                1.1498188 = boost
                5.430678 = idf(docFreq=514, maxDocs=43254)
                0.015461774 = queryNorm
              0.7348602 = fieldWeight in 5515, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.430678 = idf(docFreq=514, maxDocs=43254)
                0.078125 = fieldNorm(doc=5515)
          0.047453474 = weight(abstract_txt:retrieved in 5515) [ClassicSimilarity], result of:
            0.047453474 = score(doc=5515,freq=1.0), product of:
              0.10649525 = queryWeight, product of:
                1.2076001 = boost
                5.7035832 = idf(docFreq=391, maxDocs=43254)
                0.015461774 = queryNorm
              0.44559243 = fieldWeight in 5515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.7035832 = idf(docFreq=391, maxDocs=43254)
                0.078125 = fieldNorm(doc=5515)
          0.14830406 = weight(abstract_txt:measuring in 5515) [ClassicSimilarity], result of:
            0.14830406 = score(doc=5515,freq=1.0), product of:
              0.2868117 = queryWeight, product of:
                2.8026667 = boost
                6.6185994 = idf(docFreq=156, maxDocs=43254)
                0.015461774 = queryNorm
              0.5170781 = fieldWeight in 5515, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6185994 = idf(docFreq=156, maxDocs=43254)
                0.078125 = fieldNorm(doc=5515)
          0.5005707 = weight(abstract_txt:recall in 5515) [ClassicSimilarity], result of:
            0.5005707 = score(doc=5515,freq=3.0), product of:
              0.64536464 = queryWeight, product of:
                7.281758 = boost
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.015461774 = queryNorm
              0.77564013 = fieldWeight in 5515, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.078125 = fieldNorm(doc=5515)
        0.16 = coord(4/25)
    
  4. Kenter, T.; Balog, K.; Rijke, M. de: Evaluating document filtering systems over time (2015) 0.12
    0.119110666 = sum of:
      0.119110666 = product of:
        0.49629444 = sum of:
          0.0072382586 = weight(abstract_txt:information in 4137) [ClassicSimilarity], result of:
            0.0072382586 = score(doc=4137,freq=2.0), product of:
              0.038563423 = queryWeight, product of:
                1.0276868 = boost
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.015461774 = queryNorm
              0.18769751 = fieldWeight in 4137, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4137)
          0.03607006 = weight(abstract_txt:like in 4137) [ClassicSimilarity], result of:
            0.03607006 = score(doc=4137,freq=2.0), product of:
              0.0892978 = queryWeight, product of:
                1.1058047 = boost
                5.222796 = idf(docFreq=633, maxDocs=43254)
                0.015461774 = queryNorm
              0.40393 = fieldWeight in 4137, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.222796 = idf(docFreq=633, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4137)
          0.036267437 = weight(abstract_txt:does in 4137) [ClassicSimilarity], result of:
            0.036267437 = score(doc=4137,freq=2.0), product of:
              0.089623265 = queryWeight, product of:
                1.107818 = boost
                5.232305 = idf(docFreq=627, maxDocs=43254)
                0.015461774 = queryNorm
              0.40466544 = fieldWeight in 4137, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.232305 = idf(docFreq=627, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4137)
          0.02680584 = weight(abstract_txt:might in 4137) [ClassicSimilarity], result of:
            0.02680584 = score(doc=4137,freq=1.0), product of:
              0.09230795 = queryWeight, product of:
                1.124288 = boost
                5.3100944 = idf(docFreq=580, maxDocs=43254)
                0.015461774 = queryNorm
              0.2903958 = fieldWeight in 4137, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3100944 = idf(docFreq=580, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4137)
          0.103812836 = weight(abstract_txt:measuring in 4137) [ClassicSimilarity], result of:
            0.103812836 = score(doc=4137,freq=1.0), product of:
              0.2868117 = queryWeight, product of:
                2.8026667 = boost
                6.6185994 = idf(docFreq=156, maxDocs=43254)
                0.015461774 = queryNorm
              0.36195466 = fieldWeight in 4137, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6185994 = idf(docFreq=156, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4137)
          0.2861 = weight(abstract_txt:recall in 4137) [ClassicSimilarity], result of:
            0.2861 = score(doc=4137,freq=2.0), product of:
              0.64536464 = queryWeight, product of:
                7.281758 = boost
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.015461774 = queryNorm
              0.44331527 = fieldWeight in 4137, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4137)
        0.24 = coord(6/25)
    
  5. Huuskonen, S.; Vakkari, P.: Students' search process and outcome in Medline in writing an essay for a class on evidence-based medicine (2008) 0.11
    0.11305042 = sum of:
      0.11305042 = product of:
        0.70656514 = sum of:
          0.012537031 = weight(abstract_txt:information in 3892) [ClassicSimilarity], result of:
            0.012537031 = score(doc=3892,freq=6.0), product of:
              0.038563423 = queryWeight, product of:
                1.0276868 = boost
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.015461774 = queryNorm
              0.3251016 = fieldWeight in 3892, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.0546875 = fieldNorm(doc=3892)
          0.05753428 = weight(abstract_txt:retrieved in 3892) [ClassicSimilarity], result of:
            0.05753428 = score(doc=3892,freq=3.0), product of:
              0.10649525 = queryWeight, product of:
                1.2076001 = boost
                5.7035832 = idf(docFreq=391, maxDocs=43254)
                0.015461774 = queryNorm
              0.5402521 = fieldWeight in 3892, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.7035832 = idf(docFreq=391, maxDocs=43254)
                0.0546875 = fieldNorm(doc=3892)
          0.14095405 = weight(abstract_txt:relative in 3892) [ClassicSimilarity], result of:
            0.14095405 = score(doc=3892,freq=3.0), product of:
              0.24384141 = queryWeight, product of:
                2.5842037 = boost
                6.102691 = idf(docFreq=262, maxDocs=43254)
                0.015461774 = queryNorm
              0.5780562 = fieldWeight in 3892, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.102691 = idf(docFreq=262, maxDocs=43254)
                0.0546875 = fieldNorm(doc=3892)
          0.49553975 = weight(abstract_txt:recall in 3892) [ClassicSimilarity], result of:
            0.49553975 = score(doc=3892,freq=6.0), product of:
              0.64536464 = queryWeight, product of:
                7.281758 = boost
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.015461774 = queryNorm
              0.7678446 = fieldWeight in 3892, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.7320457 = idf(docFreq=380, maxDocs=43254)
                0.0546875 = fieldNorm(doc=3892)
        0.16 = coord(4/25)