Document (#8322)

Author
Dyer, H.
Title
Beyond relevance, precision and recall : the 'worth' of information retrieval results
Source
Journal of document and text management. 2(1994) no.1, S.35-47
Year
1994
Abstract
The existing tools of relevance, recall and precision have their place in the evaluation of information retrieval systems, but do not tell the whole story. They cannot, for example, make allowance for the enquirer already knowing of the existence of a document or the subsequent availability of items. Utility theory goes part way towards meeting the need by assessing the likely usefulness of documents. Arguing that information is not information until it is used, the paper suggests an additional approach to information system evaluation - the 'use-value' of information
Theme
Information

Similar documents (author)

  1. Dyer, S.: ¬The dark side of the moon : introducing IT to the school library (1993) 6.17
    6.169457 = sum of:
      6.169457 = weight(author_txt:dyer in 5537) [ClassicSimilarity], result of:
        6.169457 = fieldWeight in 5537, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.871131 = idf(docFreq=5, maxDocs=42740)
          0.625 = fieldNorm(doc=5537)
    
  2. Dyer, H.; Morris, A.: Human aspects of library automation (1990) 4.94
    4.9355655 = sum of:
      4.9355655 = weight(author_txt:dyer in 2178) [ClassicSimilarity], result of:
        4.9355655 = fieldWeight in 2178, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.871131 = idf(docFreq=5, maxDocs=42740)
          0.5 = fieldNorm(doc=2178)
    
  3. Dyer, H.; Bouchet, M.-L.: ¬A comparison between the perceived value of information retrieved via end-user searching of CD-ROMs and mediated online searching (1995) 4.32
    4.3186197 = sum of:
      4.3186197 = weight(author_txt:dyer in 2486) [ClassicSimilarity], result of:
        4.3186197 = fieldWeight in 2486, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.871131 = idf(docFreq=5, maxDocs=42740)
          0.4375 = fieldNorm(doc=2486)
    
  4. Dyer, H. u. A. Gunson (Comp.): ¬A directory of library and information retrieval software for microcomputers (1990) 3.70
    3.701674 = sum of:
      3.701674 = weight(author_txt:dyer in 1817) [ClassicSimilarity], result of:
        3.701674 = fieldWeight in 1817, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.871131 = idf(docFreq=5, maxDocs=42740)
          0.375 = fieldNorm(doc=1817)
    

Similar documents (content)

  1. Lesk, M.E.; Salton, G.: Relevance assements and retrieval system evaluation (1969) 0.24
    0.23586485 = sum of:
      0.23586485 = product of:
        0.84237444 = sum of:
          0.08112572 = weight(abstract_txt:cannot in 4220) [ClassicSimilarity], result of:
            0.08112572 = score(doc=4220,freq=1.0), product of:
              0.14447471 = queryWeight, product of:
                1.0333214 = boost
                5.9895673 = idf(docFreq=290, maxDocs=42740)
                0.023343232 = queryNorm
              0.56152195 = fieldWeight in 4220, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.9895673 = idf(docFreq=290, maxDocs=42740)
                0.09375 = fieldNorm(doc=4220)
          0.031407773 = weight(abstract_txt:retrieval in 4220) [ClassicSimilarity], result of:
            0.031407773 = score(doc=4220,freq=1.0), product of:
              0.09669134 = queryWeight, product of:
                1.1954964 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.023343232 = queryNorm
              0.3248251 = fieldWeight in 4220, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.09375 = fieldNorm(doc=4220)
          0.068477064 = weight(abstract_txt:evaluation in 4220) [ClassicSimilarity], result of:
            0.068477064 = score(doc=4220,freq=1.0), product of:
              0.16257717 = queryWeight, product of:
                1.5501876 = boost
                4.492771 = idf(docFreq=1299, maxDocs=42740)
                0.023343232 = queryNorm
              0.4211973 = fieldWeight in 4220, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.492771 = idf(docFreq=1299, maxDocs=42740)
                0.09375 = fieldNorm(doc=4220)
          0.09071285 = weight(abstract_txt:relevance in 4220) [ClassicSimilarity], result of:
            0.09071285 = score(doc=4220,freq=1.0), product of:
              0.19609898 = queryWeight, product of:
                1.7025198 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.023343232 = queryNorm
              0.46258706 = fieldWeight in 4220, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.09375 = fieldNorm(doc=4220)
          0.25353482 = weight(abstract_txt:precision in 4220) [ClassicSimilarity], result of:
            0.25353482 = score(doc=4220,freq=4.0), product of:
              0.24511386 = queryWeight, product of:
                1.9034367 = boost
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.023343232 = queryNorm
              1.0343553 = fieldWeight in 4220, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.09375 = fieldNorm(doc=4220)
          0.28460756 = weight(abstract_txt:recall in 4220) [ClassicSimilarity], result of:
            0.28460756 = score(doc=4220,freq=4.0), product of:
              0.26475272 = queryWeight, product of:
                1.9782206 = boost
                5.733301 = idf(docFreq=375, maxDocs=42740)
                0.023343232 = queryNorm
              1.074994 = fieldWeight in 4220, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.733301 = idf(docFreq=375, maxDocs=42740)
                0.09375 = fieldNorm(doc=4220)
          0.032508582 = weight(abstract_txt:information in 4220) [ClassicSimilarity], result of:
            0.032508582 = score(doc=4220,freq=1.0), product of:
              0.14269274 = queryWeight, product of:
                2.5154521 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.023343232 = queryNorm
              0.22782224 = fieldWeight in 4220, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.09375 = fieldNorm(doc=4220)
        0.28 = coord(7/25)
    
  2. Wallis, P.; Thom, J.A.: Relevance judgements for assessing recall (1996) 0.19
    0.18993834 = sum of:
      0.18993834 = product of:
        0.79140973 = sum of:
          0.18448752 = weight(abstract_txt:assessing in 5018) [ClassicSimilarity], result of:
            0.18448752 = score(doc=5018,freq=2.0), product of:
              0.17893265 = queryWeight, product of:
                1.1499641 = boost
                6.665678 = idf(docFreq=147, maxDocs=42740)
                0.023343232 = queryNorm
              1.0310445 = fieldWeight in 5018, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.665678 = idf(docFreq=147, maxDocs=42740)
                0.109375 = fieldNorm(doc=5018)
          0.036642406 = weight(abstract_txt:retrieval in 5018) [ClassicSimilarity], result of:
            0.036642406 = score(doc=5018,freq=1.0), product of:
              0.09669134 = queryWeight, product of:
                1.1954964 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.023343232 = queryNorm
              0.37896264 = fieldWeight in 5018, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.109375 = fieldNorm(doc=5018)
          0.14966856 = weight(abstract_txt:relevance in 5018) [ClassicSimilarity], result of:
            0.14966856 = score(doc=5018,freq=2.0), product of:
              0.19609898 = queryWeight, product of:
                1.7025198 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.023343232 = queryNorm
              0.76322967 = fieldWeight in 5018, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.109375 = fieldNorm(doc=5018)
          0.1478953 = weight(abstract_txt:precision in 5018) [ClassicSimilarity], result of:
            0.1478953 = score(doc=5018,freq=1.0), product of:
              0.24511386 = queryWeight, product of:
                1.9034367 = boost
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.023343232 = queryNorm
              0.6033739 = fieldWeight in 5018, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.109375 = fieldNorm(doc=5018)
          0.23478927 = weight(abstract_txt:recall in 5018) [ClassicSimilarity], result of:
            0.23478927 = score(doc=5018,freq=2.0), product of:
              0.26475272 = queryWeight, product of:
                1.9782206 = boost
                5.733301 = idf(docFreq=375, maxDocs=42740)
                0.023343232 = queryNorm
              0.8868248 = fieldWeight in 5018, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.733301 = idf(docFreq=375, maxDocs=42740)
                0.109375 = fieldNorm(doc=5018)
          0.03792668 = weight(abstract_txt:information in 5018) [ClassicSimilarity], result of:
            0.03792668 = score(doc=5018,freq=1.0), product of:
              0.14269274 = queryWeight, product of:
                2.5154521 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.023343232 = queryNorm
              0.26579264 = fieldWeight in 5018, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.109375 = fieldNorm(doc=5018)
        0.24 = coord(6/25)
    
  3. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.16
    0.15721741 = sum of:
      0.15721741 = product of:
        0.65507257 = sum of:
          0.06281555 = weight(abstract_txt:retrieval in 3308) [ClassicSimilarity], result of:
            0.06281555 = score(doc=3308,freq=4.0), product of:
              0.09669134 = queryWeight, product of:
                1.1954964 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.023343232 = queryNorm
              0.6496502 = fieldWeight in 3308, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.09375 = fieldNorm(doc=3308)
          0.068477064 = weight(abstract_txt:evaluation in 3308) [ClassicSimilarity], result of:
            0.068477064 = score(doc=3308,freq=1.0), product of:
              0.16257717 = queryWeight, product of:
                1.5501876 = boost
                4.492771 = idf(docFreq=1299, maxDocs=42740)
                0.023343232 = queryNorm
              0.4211973 = fieldWeight in 3308, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.492771 = idf(docFreq=1299, maxDocs=42740)
                0.09375 = fieldNorm(doc=3308)
          0.22220019 = weight(abstract_txt:relevance in 3308) [ClassicSimilarity], result of:
            0.22220019 = score(doc=3308,freq=6.0), product of:
              0.19609898 = queryWeight, product of:
                1.7025198 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.023343232 = queryNorm
              1.1331022 = fieldWeight in 3308, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.09375 = fieldNorm(doc=3308)
          0.12676741 = weight(abstract_txt:precision in 3308) [ClassicSimilarity], result of:
            0.12676741 = score(doc=3308,freq=1.0), product of:
              0.24511386 = queryWeight, product of:
                1.9034367 = boost
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.023343232 = queryNorm
              0.51717764 = fieldWeight in 3308, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.09375 = fieldNorm(doc=3308)
          0.14230378 = weight(abstract_txt:recall in 3308) [ClassicSimilarity], result of:
            0.14230378 = score(doc=3308,freq=1.0), product of:
              0.26475272 = queryWeight, product of:
                1.9782206 = boost
                5.733301 = idf(docFreq=375, maxDocs=42740)
                0.023343232 = queryNorm
              0.537497 = fieldWeight in 3308, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.733301 = idf(docFreq=375, maxDocs=42740)
                0.09375 = fieldNorm(doc=3308)
          0.032508582 = weight(abstract_txt:information in 3308) [ClassicSimilarity], result of:
            0.032508582 = score(doc=3308,freq=1.0), product of:
              0.14269274 = queryWeight, product of:
                2.5154521 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.023343232 = queryNorm
              0.22782224 = fieldWeight in 3308, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.09375 = fieldNorm(doc=3308)
        0.24 = coord(6/25)
    
  4. Spink, A.; Greisdorf, H.: Regions and levels : Measuring and mapping users' relevance judgements (2001) 0.15
    0.1533596 = sum of:
      0.1533596 = product of:
        0.54771286 = sum of:
          0.056035697 = weight(abstract_txt:usefulness in 502) [ClassicSimilarity], result of:
            0.056035697 = score(doc=502,freq=1.0), product of:
              0.14793019 = queryWeight, product of:
                1.0456057 = boost
                6.060772 = idf(docFreq=270, maxDocs=42740)
                0.023343232 = queryNorm
              0.37879825 = fieldWeight in 502, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.060772 = idf(docFreq=270, maxDocs=42740)
                0.0625 = fieldNorm(doc=502)
          0.06473922 = weight(abstract_txt:utility in 502) [ClassicSimilarity], result of:
            0.06473922 = score(doc=502,freq=1.0), product of:
              0.16287656 = queryWeight, product of:
                1.097157 = boost
                6.359586 = idf(docFreq=200, maxDocs=42740)
                0.023343232 = queryNorm
              0.3974741 = fieldWeight in 502, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.359586 = idf(docFreq=200, maxDocs=42740)
                0.0625 = fieldNorm(doc=502)
          0.020938518 = weight(abstract_txt:retrieval in 502) [ClassicSimilarity], result of:
            0.020938518 = score(doc=502,freq=1.0), product of:
              0.09669134 = queryWeight, product of:
                1.1954964 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.023343232 = queryNorm
              0.21655008 = fieldWeight in 502, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.0625 = fieldNorm(doc=502)
          0.06456079 = weight(abstract_txt:evaluation in 502) [ClassicSimilarity], result of:
            0.06456079 = score(doc=502,freq=2.0), product of:
              0.16257717 = queryWeight, product of:
                1.5501876 = boost
                4.492771 = idf(docFreq=1299, maxDocs=42740)
                0.023343232 = queryNorm
              0.3971086 = fieldWeight in 502, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.492771 = idf(docFreq=1299, maxDocs=42740)
                0.0625 = fieldNorm(doc=502)
          0.22627762 = weight(abstract_txt:relevance in 502) [ClassicSimilarity], result of:
            0.22627762 = score(doc=502,freq=14.0), product of:
              0.19609898 = queryWeight, product of:
                1.7025198 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.023343232 = queryNorm
              1.1538949 = fieldWeight in 502, product of:
                3.7416575 = tf(freq=14.0), with freq of:
                  14.0 = termFreq=14.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.0625 = fieldNorm(doc=502)
          0.08451161 = weight(abstract_txt:precision in 502) [ClassicSimilarity], result of:
            0.08451161 = score(doc=502,freq=1.0), product of:
              0.24511386 = queryWeight, product of:
                1.9034367 = boost
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.023343232 = queryNorm
              0.3447851 = fieldWeight in 502, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.0625 = fieldNorm(doc=502)
          0.030649384 = weight(abstract_txt:information in 502) [ClassicSimilarity], result of:
            0.030649384 = score(doc=502,freq=2.0), product of:
              0.14269274 = queryWeight, product of:
                2.5154521 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.023343232 = queryNorm
              0.21479288 = fieldWeight in 502, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.0625 = fieldNorm(doc=502)
        0.28 = coord(7/25)
    
  5. Vakkari, P.; Huuskonen, S.: Search effort degrades search output but improves task outcome (2012) 0.14
    0.14288877 = sum of:
      0.14288877 = product of:
        0.510317 = sum of:
          0.056035697 = weight(abstract_txt:usefulness in 2047) [ClassicSimilarity], result of:
            0.056035697 = score(doc=2047,freq=1.0), product of:
              0.14793019 = queryWeight, product of:
                1.0456057 = boost
                6.060772 = idf(docFreq=270, maxDocs=42740)
                0.023343232 = queryNorm
              0.37879825 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.060772 = idf(docFreq=270, maxDocs=42740)
                0.0625 = fieldNorm(doc=2047)
          0.07454421 = weight(abstract_txt:assessing in 2047) [ClassicSimilarity], result of:
            0.07454421 = score(doc=2047,freq=1.0), product of:
              0.17893265 = queryWeight, product of:
                1.1499641 = boost
                6.665678 = idf(docFreq=147, maxDocs=42740)
                0.023343232 = queryNorm
              0.41660488 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.665678 = idf(docFreq=147, maxDocs=42740)
                0.0625 = fieldNorm(doc=2047)
          0.029611535 = weight(abstract_txt:retrieval in 2047) [ClassicSimilarity], result of:
            0.029611535 = score(doc=2047,freq=2.0), product of:
              0.09669134 = queryWeight, product of:
                1.1954964 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.023343232 = queryNorm
              0.30624807 = fieldWeight in 2047, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.0625 = fieldNorm(doc=2047)
          0.06456079 = weight(abstract_txt:evaluation in 2047) [ClassicSimilarity], result of:
            0.06456079 = score(doc=2047,freq=2.0), product of:
              0.16257717 = queryWeight, product of:
                1.5501876 = boost
                4.492771 = idf(docFreq=1299, maxDocs=42740)
                0.023343232 = queryNorm
              0.3971086 = fieldWeight in 2047, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.492771 = idf(docFreq=1299, maxDocs=42740)
                0.0625 = fieldNorm(doc=2047)
          0.16902322 = weight(abstract_txt:precision in 2047) [ClassicSimilarity], result of:
            0.16902322 = score(doc=2047,freq=4.0), product of:
              0.24511386 = queryWeight, product of:
                1.9034367 = boost
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.023343232 = queryNorm
              0.6895702 = fieldWeight in 2047, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.5165615 = idf(docFreq=466, maxDocs=42740)
                0.0625 = fieldNorm(doc=2047)
          0.09486919 = weight(abstract_txt:recall in 2047) [ClassicSimilarity], result of:
            0.09486919 = score(doc=2047,freq=1.0), product of:
              0.26475272 = queryWeight, product of:
                1.9782206 = boost
                5.733301 = idf(docFreq=375, maxDocs=42740)
                0.023343232 = queryNorm
              0.35833132 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.733301 = idf(docFreq=375, maxDocs=42740)
                0.0625 = fieldNorm(doc=2047)
          0.021672389 = weight(abstract_txt:information in 2047) [ClassicSimilarity], result of:
            0.021672389 = score(doc=2047,freq=1.0), product of:
              0.14269274 = queryWeight, product of:
                2.5154521 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.023343232 = queryNorm
              0.1518815 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.0625 = fieldNorm(doc=2047)
        0.28 = coord(7/25)