Document (#4866)

Author
Katzer, J.
Snyder, H.
Title
Toward a more realistic assessment of information retrieval performance
Source
ASIS'90: Information in the year 2000, from research to applications. Proc. of the 53rd Annual Meeting of the American Society for Information Science, Toronto, Canada, 4.-8.11.1990. Ed. by Diana Henderson
Imprint
Medford, NJ : Learned Information Inc.
Year
1990
Pages
S.80-85
Abstract
The dominant approach to information retrieval (IR) experiments contains several questionable assumptions which are no longer necessary for pragmatic reasons nor warranted conceptually. The consequence of continued acceptance of one particular untenable assumption, namely that the user's information need does not change as a result of interacting with the system or with the search intermediary, is that our understanding of the IR process and the evaluation of IR systems is distored. This distortion tends to underestimate the performance of the system and its benefits of the user. Describes work-in-progress empirically to test this assertion and obtain estimates of the value added to the user's output by various components of the search process

Similar documents (author)

  1. Snyder, J.: Diving into the Internet : the trouble with Gopher (1994) 5.58
    5.5776863 = sum of:
      5.5776863 = weight(author_txt:snyder in 7947) [ClassicSimilarity], result of:
        5.5776863 = fieldWeight in 7947, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.924298 = idf(docFreq=15, maxDocs=44218)
          0.625 = fieldNorm(doc=7947)
    
  2. Snyder, I.: Hypertext: the electronic labrynth (1996) 5.58
    5.5776863 = sum of:
      5.5776863 = weight(author_txt:snyder in 289) [ClassicSimilarity], result of:
        5.5776863 = fieldWeight in 289, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.924298 = idf(docFreq=15, maxDocs=44218)
          0.625 = fieldNorm(doc=289)
    
  3. Snyder, H.L.: ¬The application of information technology to the bibliography of early printed books (1998) 5.58
    5.5776863 = sum of:
      5.5776863 = weight(author_txt:snyder in 2100) [ClassicSimilarity], result of:
        5.5776863 = fieldWeight in 2100, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.924298 = idf(docFreq=15, maxDocs=44218)
          0.625 = fieldNorm(doc=2100)
    
  4. Snyder, J.: Visual representation of information as communicative practice (2014) 5.58
    5.5776863 = sum of:
      5.5776863 = weight(author_txt:snyder in 1529) [ClassicSimilarity], result of:
        5.5776863 = fieldWeight in 1529, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.924298 = idf(docFreq=15, maxDocs=44218)
          0.625 = fieldNorm(doc=1529)
    
  5. Snyder, H.; Bonzi, S.: Patterns of self-citation across disciplines : 1980-1989 (1998) 4.46
    4.462149 = sum of:
      4.462149 = weight(author_txt:snyder in 3692) [ClassicSimilarity], result of:
        4.462149 = fieldWeight in 3692, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.924298 = idf(docFreq=15, maxDocs=44218)
          0.5 = fieldNorm(doc=3692)
    

Similar documents (content)

  1. Conlon, J.R.; Conlon, S.J.: Robustness of well-designed retrieval performance measures under optimal user behavior (1998) 0.12
    0.12448117 = sum of:
      0.12448117 = product of:
        0.5186716 = sum of:
          0.109191164 = weight(abstract_txt:assumptions in 2880) [ClassicSimilarity], result of:
            0.109191164 = score(doc=2880,freq=1.0), product of:
              0.15336339 = queryWeight, product of:
                6.5095015 = idf(docFreq=178, maxDocs=44218)
                0.02355993 = queryNorm
              0.7119767 = fieldWeight in 2880, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.5095015 = idf(docFreq=178, maxDocs=44218)
                0.109375 = fieldNorm(doc=2880)
          0.03036381 = weight(abstract_txt:system in 2880) [ClassicSimilarity], result of:
            0.03036381 = score(doc=2880,freq=1.0), product of:
              0.08232105 = queryWeight, product of:
                1.0361189 = boost
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.02355993 = queryNorm
              0.36884624 = fieldWeight in 2880, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.109375 = fieldNorm(doc=2880)
          0.057550833 = weight(abstract_txt:retrieval in 2880) [ClassicSimilarity], result of:
            0.057550833 = score(doc=2880,freq=3.0), product of:
              0.08741797 = queryWeight, product of:
                1.0677129 = boost
                3.4751394 = idf(docFreq=3720, maxDocs=44218)
                0.02355993 = queryNorm
              0.658341 = fieldWeight in 2880, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4751394 = idf(docFreq=3720, maxDocs=44218)
                0.109375 = fieldNorm(doc=2880)
          0.029186478 = weight(abstract_txt:information in 2880) [ClassicSimilarity], result of:
            0.029186478 = score(doc=2880,freq=3.0), product of:
              0.063638195 = queryWeight, product of:
                1.115729 = boost
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.02355993 = queryNorm
              0.45863146 = fieldWeight in 2880, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.109375 = fieldNorm(doc=2880)
          0.13614325 = weight(abstract_txt:performance in 2880) [ClassicSimilarity], result of:
            0.13614325 = score(doc=2880,freq=3.0), product of:
              0.15520191 = queryWeight, product of:
                1.4226651 = boost
                4.63042 = idf(docFreq=1171, maxDocs=44218)
                0.02355993 = queryNorm
              0.8772009 = fieldWeight in 2880, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.63042 = idf(docFreq=1171, maxDocs=44218)
                0.109375 = fieldNorm(doc=2880)
          0.15623604 = weight(abstract_txt:user's in 2880) [ClassicSimilarity], result of:
            0.15623604 = score(doc=2880,freq=1.0), product of:
              0.24535458 = queryWeight, product of:
                1.7887565 = boost
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.02355993 = queryNorm
              0.6367765 = fieldWeight in 2880, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.109375 = fieldNorm(doc=2880)
        0.24 = coord(6/25)
    
  2. Muresan, G.; Harper, D.J.: Topic modeling for mediated access to very large document collections (2004) 0.12
    0.11880228 = sum of:
      0.11880228 = product of:
        0.37125713 = sum of:
          0.054595582 = weight(abstract_txt:assumptions in 2507) [ClassicSimilarity], result of:
            0.054595582 = score(doc=2507,freq=1.0), product of:
              0.15336339 = queryWeight, product of:
                6.5095015 = idf(docFreq=178, maxDocs=44218)
                0.02355993 = queryNorm
              0.35598835 = fieldWeight in 2507, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.5095015 = idf(docFreq=178, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2507)
          0.02629583 = weight(abstract_txt:system in 2507) [ClassicSimilarity], result of:
            0.02629583 = score(doc=2507,freq=3.0), product of:
              0.08232105 = queryWeight, product of:
                1.0361189 = boost
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.02355993 = queryNorm
              0.3194302 = fieldWeight in 2507, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2507)
          0.023495028 = weight(abstract_txt:retrieval in 2507) [ClassicSimilarity], result of:
            0.023495028 = score(doc=2507,freq=2.0), product of:
              0.08741797 = queryWeight, product of:
                1.0677129 = boost
                3.4751394 = idf(docFreq=3720, maxDocs=44218)
                0.02355993 = queryNorm
              0.26876658 = fieldWeight in 2507, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4751394 = idf(docFreq=3720, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2507)
          0.016850822 = weight(abstract_txt:information in 2507) [ClassicSimilarity], result of:
            0.016850822 = score(doc=2507,freq=4.0), product of:
              0.063638195 = queryWeight, product of:
                1.115729 = boost
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.02355993 = queryNorm
              0.264791 = fieldWeight in 2507, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2507)
          0.019377338 = weight(abstract_txt:search in 2507) [ClassicSimilarity], result of:
            0.019377338 = score(doc=2507,freq=1.0), product of:
              0.0968626 = queryWeight, product of:
                1.1239117 = boost
                3.6580524 = idf(docFreq=3098, maxDocs=44218)
                0.02355993 = queryNorm
              0.20004974 = fieldWeight in 2507, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6580524 = idf(docFreq=3098, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2507)
          0.08086581 = weight(abstract_txt:intermediary in 2507) [ClassicSimilarity], result of:
            0.08086581 = score(doc=2507,freq=1.0), product of:
              0.1992783 = queryWeight, product of:
                1.1399063 = boost
                7.4202213 = idf(docFreq=71, maxDocs=44218)
                0.02355993 = queryNorm
              0.40579337 = fieldWeight in 2507, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4202213 = idf(docFreq=71, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2507)
          0.039301176 = weight(abstract_txt:performance in 2507) [ClassicSimilarity], result of:
            0.039301176 = score(doc=2507,freq=1.0), product of:
              0.15520191 = queryWeight, product of:
                1.4226651 = boost
                4.63042 = idf(docFreq=1171, maxDocs=44218)
                0.02355993 = queryNorm
              0.2532261 = fieldWeight in 2507, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.63042 = idf(docFreq=1171, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2507)
          0.110475555 = weight(abstract_txt:user's in 2507) [ClassicSimilarity], result of:
            0.110475555 = score(doc=2507,freq=2.0), product of:
              0.24535458 = queryWeight, product of:
                1.7887565 = boost
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.02355993 = queryNorm
              0.45026898 = fieldWeight in 2507, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2507)
        0.32 = coord(8/25)
    
  3. Ennis, M.; Sutcliffe, A.G.; Watkinson, S.J.: Towards a predictive model of information seeking : empirical studies of end-user-searching (1999) 0.11
    0.10696804 = sum of:
      0.10696804 = product of:
        0.3820287 = sum of:
          0.021470455 = weight(abstract_txt:system in 296) [ClassicSimilarity], result of:
            0.021470455 = score(doc=296,freq=2.0), product of:
              0.08232105 = queryWeight, product of:
                1.0361189 = boost
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.02355993 = queryNorm
              0.26081368 = fieldWeight in 296, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.0546875 = fieldNorm(doc=296)
          0.020637957 = weight(abstract_txt:information in 296) [ClassicSimilarity], result of:
            0.020637957 = score(doc=296,freq=6.0), product of:
              0.063638195 = queryWeight, product of:
                1.115729 = boost
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.02355993 = queryNorm
              0.32430142 = fieldWeight in 296, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.0546875 = fieldNorm(doc=296)
          0.05813201 = weight(abstract_txt:search in 296) [ClassicSimilarity], result of:
            0.05813201 = score(doc=296,freq=9.0), product of:
              0.0968626 = queryWeight, product of:
                1.1239117 = boost
                3.6580524 = idf(docFreq=3098, maxDocs=44218)
                0.02355993 = queryNorm
              0.6001492 = fieldWeight in 296, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                3.6580524 = idf(docFreq=3098, maxDocs=44218)
                0.0546875 = fieldNorm(doc=296)
          0.08086581 = weight(abstract_txt:intermediary in 296) [ClassicSimilarity], result of:
            0.08086581 = score(doc=296,freq=1.0), product of:
              0.1992783 = queryWeight, product of:
                1.1399063 = boost
                7.4202213 = idf(docFreq=71, maxDocs=44218)
                0.02355993 = queryNorm
              0.40579337 = fieldWeight in 296, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4202213 = idf(docFreq=71, maxDocs=44218)
                0.0546875 = fieldNorm(doc=296)
          0.026316904 = weight(abstract_txt:process in 296) [ClassicSimilarity], result of:
            0.026316904 = score(doc=296,freq=1.0), product of:
              0.11879092 = queryWeight, product of:
                1.2446457 = boost
                4.0510116 = idf(docFreq=2091, maxDocs=44218)
                0.02355993 = queryNorm
              0.22153969 = fieldWeight in 296, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0510116 = idf(docFreq=2091, maxDocs=44218)
                0.0546875 = fieldNorm(doc=296)
          0.039301176 = weight(abstract_txt:performance in 296) [ClassicSimilarity], result of:
            0.039301176 = score(doc=296,freq=1.0), product of:
              0.15520191 = queryWeight, product of:
                1.4226651 = boost
                4.63042 = idf(docFreq=1171, maxDocs=44218)
                0.02355993 = queryNorm
              0.2532261 = fieldWeight in 296, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.63042 = idf(docFreq=1171, maxDocs=44218)
                0.0546875 = fieldNorm(doc=296)
          0.13530436 = weight(abstract_txt:user's in 296) [ClassicSimilarity], result of:
            0.13530436 = score(doc=296,freq=3.0), product of:
              0.24535458 = queryWeight, product of:
                1.7887565 = boost
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.02355993 = queryNorm
              0.5514646 = fieldWeight in 296, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.0546875 = fieldNorm(doc=296)
        0.28 = coord(7/25)
    
  4. Stojanovic, N.: Ontology-based Information Retrieval : methods and tools for cooperative query answering (2005) 0.10
    0.09820933 = sum of:
      0.09820933 = product of:
        0.40920556 = sum of:
          0.022539284 = weight(abstract_txt:system in 701) [ClassicSimilarity], result of:
            0.022539284 = score(doc=701,freq=3.0), product of:
              0.08232105 = queryWeight, product of:
                1.0361189 = boost
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.02355993 = queryNorm
              0.27379733 = fieldWeight in 701, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.046875 = fieldNorm(doc=701)
          0.05134355 = weight(abstract_txt:retrieval in 701) [ClassicSimilarity], result of:
            0.05134355 = score(doc=701,freq=13.0), product of:
              0.08741797 = queryWeight, product of:
                1.0677129 = boost
                3.4751394 = idf(docFreq=3720, maxDocs=44218)
                0.02355993 = queryNorm
              0.58733404 = fieldWeight in 701, product of:
                3.6055512 = tf(freq=13.0), with freq of:
                  13.0 = termFreq=13.0
                3.4751394 = idf(docFreq=3720, maxDocs=44218)
                0.046875 = fieldNorm(doc=701)
          0.02042628 = weight(abstract_txt:information in 701) [ClassicSimilarity], result of:
            0.02042628 = score(doc=701,freq=8.0), product of:
              0.063638195 = queryWeight, product of:
                1.115729 = boost
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.02355993 = queryNorm
              0.32097518 = fieldWeight in 701, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.046875 = fieldNorm(doc=701)
          0.07606853 = weight(abstract_txt:conceptually in 701) [ClassicSimilarity], result of:
            0.07606853 = score(doc=701,freq=1.0), product of:
              0.21202378 = queryWeight, product of:
                1.1757945 = boost
                7.653836 = idf(docFreq=56, maxDocs=44218)
                0.02355993 = queryNorm
              0.35877356 = fieldWeight in 701, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.653836 = idf(docFreq=56, maxDocs=44218)
                0.046875 = fieldNorm(doc=701)
          0.07481426 = weight(abstract_txt:process in 701) [ClassicSimilarity], result of:
            0.07481426 = score(doc=701,freq=11.0), product of:
              0.11879092 = queryWeight, product of:
                1.2446457 = boost
                4.0510116 = idf(docFreq=2091, maxDocs=44218)
                0.02355993 = queryNorm
              0.6297978 = fieldWeight in 701, product of:
                3.3166249 = tf(freq=11.0), with freq of:
                  11.0 = termFreq=11.0
                4.0510116 = idf(docFreq=2091, maxDocs=44218)
                0.046875 = fieldNorm(doc=701)
          0.16401367 = weight(abstract_txt:user's in 701) [ClassicSimilarity], result of:
            0.16401367 = score(doc=701,freq=6.0), product of:
              0.24535458 = queryWeight, product of:
                1.7887565 = boost
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.02355993 = queryNorm
              0.6684761 = fieldWeight in 701, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.046875 = fieldNorm(doc=701)
        0.24 = coord(6/25)
    
  5. Cole, C.: Interaction with an enabling information retrieval system : modeling the user's decoding and encoding operations (2000) 0.10
    0.0951596 = sum of:
      0.0951596 = product of:
        0.39649832 = sum of:
          0.04590576 = weight(abstract_txt:system in 4585) [ClassicSimilarity], result of:
            0.04590576 = score(doc=4585,freq=7.0), product of:
              0.08232105 = queryWeight, product of:
                1.0361189 = boost
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.02355993 = queryNorm
              0.55764306 = fieldWeight in 4585, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.0625 = fieldNorm(doc=4585)
          0.018986851 = weight(abstract_txt:retrieval in 4585) [ClassicSimilarity], result of:
            0.018986851 = score(doc=4585,freq=1.0), product of:
              0.08741797 = queryWeight, product of:
                1.0677129 = boost
                3.4751394 = idf(docFreq=3720, maxDocs=44218)
                0.02355993 = queryNorm
              0.21719621 = fieldWeight in 4585, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4751394 = idf(docFreq=3720, maxDocs=44218)
                0.0625 = fieldNorm(doc=4585)
          0.025476048 = weight(abstract_txt:information in 4585) [ClassicSimilarity], result of:
            0.025476048 = score(doc=4585,freq=7.0), product of:
              0.063638195 = queryWeight, product of:
                1.115729 = boost
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.02355993 = queryNorm
              0.40032637 = fieldWeight in 4585, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                2.4209464 = idf(docFreq=10677, maxDocs=44218)
                0.0625 = fieldNorm(doc=4585)
          0.097497724 = weight(abstract_txt:interacting in 4585) [ClassicSimilarity], result of:
            0.097497724 = score(doc=4585,freq=1.0), product of:
              0.20651506 = queryWeight, product of:
                1.1604195 = boost
                7.5537524 = idf(docFreq=62, maxDocs=44218)
                0.02355993 = queryNorm
              0.47210953 = fieldWeight in 4585, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.5537524 = idf(docFreq=62, maxDocs=44218)
                0.0625 = fieldNorm(doc=4585)
          0.03007646 = weight(abstract_txt:process in 4585) [ClassicSimilarity], result of:
            0.03007646 = score(doc=4585,freq=1.0), product of:
              0.11879092 = queryWeight, product of:
                1.2446457 = boost
                4.0510116 = idf(docFreq=2091, maxDocs=44218)
                0.02355993 = queryNorm
              0.25318822 = fieldWeight in 4585, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0510116 = idf(docFreq=2091, maxDocs=44218)
                0.0625 = fieldNorm(doc=4585)
          0.17855546 = weight(abstract_txt:user's in 4585) [ClassicSimilarity], result of:
            0.17855546 = score(doc=4585,freq=4.0), product of:
              0.24535458 = queryWeight, product of:
                1.7887565 = boost
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.02355993 = queryNorm
              0.7277446 = fieldWeight in 4585, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.8219566 = idf(docFreq=355, maxDocs=44218)
                0.0625 = fieldNorm(doc=4585)
        0.24 = coord(6/25)