Document (#12073)

Author
Ellis, D.
Title
¬The dilemma of measurement in information retrieval research
Source
Journal of the American Society for Information Science. 47(1996) no.1, S.23-36
Year
1996
Abstract
The problem of measurement in information retrieval research is traced to its source in the first retrieval tests. The problem is seen as presenting a chronic dilemma for the field. This dilemma has taken 3 forms as the discipline has evloved: (1) the dilemma of measurement in the archetypal approach: stated relevance versus user relevance; (2) the dilemma of measurement in the probabilistic approach: realism versus formalism; and (3) the dilemma of measurement in the Information Retrieval-Expert System (IR-ES) approach: linear measures of relevance versus logarithmic measures of knowledge. It is argued that the dilemma of measurement has remained intractable even given the different assumptions of the different approaches for 3 connecte reasons - the nature of the subject matter of the field; the nature of relevance jidgement; and the nature of cognition and knowledge. Finally, it is concluded that the original vision of information retrieval research as a discipline founded on quantification proved restricting for its theoretical and methodological development and that increasing recognition of this is reflected in growing interest in qualitative methods in information retrieval research in relation to cognitive, behavioral, and affective aspects of the information retrieval interaction
Theme
Retrievalstudien

Similar documents (author)

  1. Ellis, D.: ¬A behavioral approach to information system design (1989) 4.87
    4.865316 = sum of:
      4.865316 = weight(author_txt:ellis in 2706) [ClassicSimilarity], result of:
        4.865316 = fieldWeight in 2706, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.7845054 = idf(docFreq=46, maxDocs=41550)
          0.625 = fieldNorm(doc=2706)
    
  2. Ellis, D.: ¬A behavioral model for information retrieval system design (1989) 4.87
    4.865316 = sum of:
      4.865316 = weight(author_txt:ellis in 2707) [ClassicSimilarity], result of:
        4.865316 = fieldWeight in 2707, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.7845054 = idf(docFreq=46, maxDocs=41550)
          0.625 = fieldNorm(doc=2707)
    
  3. Ellis, D.: Hypertext; origins and use (1991) 4.87
    4.865316 = sum of:
      4.865316 = weight(author_txt:ellis in 4916) [ClassicSimilarity], result of:
        4.865316 = fieldWeight in 4916, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.7845054 = idf(docFreq=46, maxDocs=41550)
          0.625 = fieldNorm(doc=4916)
    
  4. Ellis, D.: Theory and explanation in information retrieval research (1984) 4.87
    4.865316 = sum of:
      4.865316 = weight(author_txt:ellis in 5337) [ClassicSimilarity], result of:
        4.865316 = fieldWeight in 5337, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.7845054 = idf(docFreq=46, maxDocs=41550)
          0.625 = fieldNorm(doc=5337)
    
  5. Ellis, D.: ¬The physical and cognitive paradigms in information retrieval research (1992) 4.87
    4.865316 = sum of:
      4.865316 = weight(author_txt:ellis in 161) [ClassicSimilarity], result of:
        4.865316 = fieldWeight in 161, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.7845054 = idf(docFreq=46, maxDocs=41550)
          0.625 = fieldNorm(doc=161)
    

Similar documents (content)

  1. Thornley, C.: Dilemmas in information science (IS) and information retrieval (IR) : recurring challenges or new solutions? (2009) 0.25
    0.25069273 = sum of:
      0.25069273 = product of:
        0.69636863 = sum of:
          0.024270877 = weight(abstract_txt:problem in 4964) [ClassicSimilarity], result of:
            0.024270877 = score(doc=4964,freq=2.0), product of:
              0.061463136 = queryWeight, product of:
                1.2319993 = boost
                4.467615 = idf(docFreq=1295, maxDocs=41550)
                0.011166794 = queryNorm
              0.39488512 = fieldWeight in 4964, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.467615 = idf(docFreq=1295, maxDocs=41550)
                0.0625 = fieldNorm(doc=4964)
          0.017945996 = weight(abstract_txt:field in 4964) [ClassicSimilarity], result of:
            0.017945996 = score(doc=4964,freq=1.0), product of:
              0.063320756 = queryWeight, product of:
                1.2504783 = boost
                4.5346255 = idf(docFreq=1211, maxDocs=41550)
                0.011166794 = queryNorm
              0.2834141 = fieldWeight in 4964, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5346255 = idf(docFreq=1211, maxDocs=41550)
                0.0625 = fieldNorm(doc=4964)
          0.14541015 = weight(abstract_txt:intractable in 4964) [ClassicSimilarity], result of:
            0.14541015 = score(doc=4964,freq=3.0), product of:
              0.14057685 = queryWeight, product of:
                1.317483 = boost
                9.555211 = idf(docFreq=7, maxDocs=41550)
                0.011166794 = queryNorm
              1.0343819 = fieldWeight in 4964, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                9.555211 = idf(docFreq=7, maxDocs=41550)
                0.0625 = fieldNorm(doc=4964)
          0.015819635 = weight(abstract_txt:approach in 4964) [ClassicSimilarity], result of:
            0.015819635 = score(doc=4964,freq=1.0), product of:
              0.0666391 = queryWeight, product of:
                1.5711343 = boost
                3.798283 = idf(docFreq=2530, maxDocs=41550)
                0.011166794 = queryNorm
              0.2373927 = fieldWeight in 4964, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.798283 = idf(docFreq=2530, maxDocs=41550)
                0.0625 = fieldNorm(doc=4964)
          0.018389193 = weight(abstract_txt:research in 4964) [ClassicSimilarity], result of:
            0.018389193 = score(doc=4964,freq=2.0), product of:
              0.06435903 = queryWeight, product of:
                1.782883 = boost
                3.232646 = idf(docFreq=4455, maxDocs=41550)
                0.011166794 = queryNorm
              0.28572825 = fieldWeight in 4964, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.232646 = idf(docFreq=4455, maxDocs=41550)
                0.0625 = fieldNorm(doc=4964)
          0.01663627 = weight(abstract_txt:information in 4964) [ClassicSimilarity], result of:
            0.01663627 = score(doc=4964,freq=4.0), product of:
              0.054696403 = queryWeight, product of:
                2.012997 = boost
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.011166794 = queryNorm
              0.30415654 = fieldWeight in 4964, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.0625 = fieldNorm(doc=4964)
          0.04717825 = weight(abstract_txt:nature in 4964) [ClassicSimilarity], result of:
            0.04717825 = score(doc=4964,freq=2.0), product of:
              0.10958456 = queryWeight, product of:
                2.0147605 = boost
                4.870768 = idf(docFreq=865, maxDocs=41550)
                0.011166794 = queryNorm
              0.43051913 = fieldWeight in 4964, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.870768 = idf(docFreq=865, maxDocs=41550)
                0.0625 = fieldNorm(doc=4964)
          0.039218456 = weight(abstract_txt:retrieval in 4964) [ClassicSimilarity], result of:
            0.039218456 = score(doc=4964,freq=2.0), product of:
              0.12850127 = queryWeight, product of:
                3.3326585 = boost
                3.4529324 = idf(docFreq=3574, maxDocs=41550)
                0.011166794 = queryNorm
              0.30519897 = fieldWeight in 4964, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4529324 = idf(docFreq=3574, maxDocs=41550)
                0.0625 = fieldNorm(doc=4964)
          0.3714998 = weight(abstract_txt:dilemma in 4964) [ClassicSimilarity], result of:
            0.3714998 = score(doc=4964,freq=1.0), product of:
              0.7248188 = queryWeight, product of:
                7.915017 = boost
                8.200665 = idf(docFreq=30, maxDocs=41550)
                0.011166794 = queryNorm
              0.5125416 = fieldWeight in 4964, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.200665 = idf(docFreq=30, maxDocs=41550)
                0.0625 = fieldNorm(doc=4964)
        0.36 = coord(9/25)
    
  2. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.12
    0.12351694 = sum of:
      0.12351694 = product of:
        0.5146539 = sum of:
          0.017162103 = weight(abstract_txt:problem in 3073) [ClassicSimilarity], result of:
            0.017162103 = score(doc=3073,freq=1.0), product of:
              0.061463136 = queryWeight, product of:
                1.2319993 = boost
                4.467615 = idf(docFreq=1295, maxDocs=41550)
                0.011166794 = queryNorm
              0.27922595 = fieldWeight in 3073, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.467615 = idf(docFreq=1295, maxDocs=41550)
                0.0625 = fieldNorm(doc=3073)
          0.04372585 = weight(abstract_txt:measures in 3073) [ClassicSimilarity], result of:
            0.04372585 = score(doc=3073,freq=2.0), product of:
              0.09100179 = queryWeight, product of:
                1.4990913 = boost
                5.436174 = idf(docFreq=491, maxDocs=41550)
                0.011166794 = queryNorm
              0.4804944 = fieldWeight in 3073, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.436174 = idf(docFreq=491, maxDocs=41550)
                0.0625 = fieldNorm(doc=3073)
          0.011763618 = weight(abstract_txt:information in 3073) [ClassicSimilarity], result of:
            0.011763618 = score(doc=3073,freq=2.0), product of:
              0.054696403 = queryWeight, product of:
                2.012997 = boost
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.011166794 = queryNorm
              0.21507116 = fieldWeight in 3073, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.0625 = fieldNorm(doc=3073)
          0.10447536 = weight(abstract_txt:relevance in 3073) [ClassicSimilarity], result of:
            0.10447536 = score(doc=3073,freq=5.0), product of:
              0.15098378 = queryWeight, product of:
                2.7307582 = boost
                4.951292 = idf(docFreq=798, maxDocs=41550)
                0.011166794 = queryNorm
              0.6919641 = fieldWeight in 3073, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.951292 = idf(docFreq=798, maxDocs=41550)
                0.0625 = fieldNorm(doc=3073)
          0.062009826 = weight(abstract_txt:retrieval in 3073) [ClassicSimilarity], result of:
            0.062009826 = score(doc=3073,freq=5.0), product of:
              0.12850127 = queryWeight, product of:
                3.3326585 = boost
                3.4529324 = idf(docFreq=3574, maxDocs=41550)
                0.011166794 = queryNorm
              0.48256198 = fieldWeight in 3073, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.4529324 = idf(docFreq=3574, maxDocs=41550)
                0.0625 = fieldNorm(doc=3073)
          0.27551714 = weight(abstract_txt:measurement in 3073) [ClassicSimilarity], result of:
            0.27551714 = score(doc=3073,freq=2.0), product of:
              0.44774482 = queryWeight, product of:
                5.7594233 = boost
                6.961824 = idf(docFreq=106, maxDocs=41550)
                0.011166794 = queryNorm
              0.6153441 = fieldWeight in 3073, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.961824 = idf(docFreq=106, maxDocs=41550)
                0.0625 = fieldNorm(doc=3073)
        0.24 = coord(6/25)
    
  3. Skyrme, D.J.: Valuing information : is it worth it? (1998) 0.11
    0.10724522 = sum of:
      0.10724522 = product of:
        0.67028266 = sum of:
          0.03589199 = weight(abstract_txt:field in 3230) [ClassicSimilarity], result of:
            0.03589199 = score(doc=3230,freq=1.0), product of:
              0.063320756 = queryWeight, product of:
                1.2504783 = boost
                4.5346255 = idf(docFreq=1211, maxDocs=41550)
                0.011166794 = queryNorm
              0.5668282 = fieldWeight in 3230, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5346255 = idf(docFreq=1211, maxDocs=41550)
                0.125 = fieldNorm(doc=3230)
          0.01663627 = weight(abstract_txt:information in 3230) [ClassicSimilarity], result of:
            0.01663627 = score(doc=3230,freq=1.0), product of:
              0.054696403 = queryWeight, product of:
                2.012997 = boost
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.011166794 = queryNorm
              0.30415654 = fieldWeight in 3230, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.125 = fieldNorm(doc=3230)
          0.06672012 = weight(abstract_txt:nature in 3230) [ClassicSimilarity], result of:
            0.06672012 = score(doc=3230,freq=1.0), product of:
              0.10958456 = queryWeight, product of:
                2.0147605 = boost
                4.870768 = idf(docFreq=865, maxDocs=41550)
                0.011166794 = queryNorm
              0.608846 = fieldWeight in 3230, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.870768 = idf(docFreq=865, maxDocs=41550)
                0.125 = fieldNorm(doc=3230)
          0.5510343 = weight(abstract_txt:measurement in 3230) [ClassicSimilarity], result of:
            0.5510343 = score(doc=3230,freq=2.0), product of:
              0.44774482 = queryWeight, product of:
                5.7594233 = boost
                6.961824 = idf(docFreq=106, maxDocs=41550)
                0.011166794 = queryNorm
              1.2306882 = fieldWeight in 3230, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.961824 = idf(docFreq=106, maxDocs=41550)
                0.125 = fieldNorm(doc=3230)
        0.16 = coord(4/25)
    
  4. Houston, R.D.; Harmon, E.G.: Re-envisioning the information concept : systematic definitions (2002) 0.10
    0.10439615 = sum of:
      0.10439615 = product of:
        0.65247595 = sum of:
          0.19812901 = weight(abstract_txt:quantification in 2136) [ClassicSimilarity], result of:
            0.19812901 = score(doc=2136,freq=2.0), product of:
              0.12459285 = queryWeight, product of:
                1.2403226 = boost
                8.995596 = idf(docFreq=13, maxDocs=41550)
                0.011166794 = queryNorm
              1.5902117 = fieldWeight in 2136, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                8.995596 = idf(docFreq=13, maxDocs=41550)
                0.125 = fieldNorm(doc=2136)
          0.03589199 = weight(abstract_txt:field in 2136) [ClassicSimilarity], result of:
            0.03589199 = score(doc=2136,freq=1.0), product of:
              0.063320756 = queryWeight, product of:
                1.2504783 = boost
                4.5346255 = idf(docFreq=1211, maxDocs=41550)
                0.011166794 = queryNorm
              0.5668282 = fieldWeight in 2136, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5346255 = idf(docFreq=1211, maxDocs=41550)
                0.125 = fieldNorm(doc=2136)
          0.028814863 = weight(abstract_txt:information in 2136) [ClassicSimilarity], result of:
            0.028814863 = score(doc=2136,freq=3.0), product of:
              0.054696403 = queryWeight, product of:
                2.012997 = boost
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.011166794 = queryNorm
              0.5268146 = fieldWeight in 2136, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.125 = fieldNorm(doc=2136)
          0.38964006 = weight(abstract_txt:measurement in 2136) [ClassicSimilarity], result of:
            0.38964006 = score(doc=2136,freq=1.0), product of:
              0.44774482 = queryWeight, product of:
                5.7594233 = boost
                6.961824 = idf(docFreq=106, maxDocs=41550)
                0.011166794 = queryNorm
              0.870228 = fieldWeight in 2136, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.961824 = idf(docFreq=106, maxDocs=41550)
                0.125 = fieldNorm(doc=2136)
        0.16 = coord(4/25)
    
  5. Fidel, R.: ¬The image retrieval task : implications for the design and evaluation of image databases (1997) 0.10
    0.10287239 = sum of:
      0.10287239 = product of:
        0.5143619 = sum of:
          0.016253905 = weight(abstract_txt:research in 4363) [ClassicSimilarity], result of:
            0.016253905 = score(doc=4363,freq=1.0), product of:
              0.06435903 = queryWeight, product of:
                1.782883 = boost
                3.232646 = idf(docFreq=4455, maxDocs=41550)
                0.011166794 = queryNorm
              0.25255048 = fieldWeight in 4363, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.232646 = idf(docFreq=4455, maxDocs=41550)
                0.078125 = fieldNorm(doc=4363)
          0.010397668 = weight(abstract_txt:information in 4363) [ClassicSimilarity], result of:
            0.010397668 = score(doc=4363,freq=1.0), product of:
              0.054696403 = queryWeight, product of:
                2.012997 = boost
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.011166794 = queryNorm
              0.19009784 = fieldWeight in 4363, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4332523 = idf(docFreq=9910, maxDocs=41550)
                0.078125 = fieldNorm(doc=4363)
          0.0584035 = weight(abstract_txt:relevance in 4363) [ClassicSimilarity], result of:
            0.0584035 = score(doc=4363,freq=1.0), product of:
              0.15098378 = queryWeight, product of:
                2.7307582 = boost
                4.951292 = idf(docFreq=798, maxDocs=41550)
                0.011166794 = queryNorm
              0.3868197 = fieldWeight in 4363, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.951292 = idf(docFreq=798, maxDocs=41550)
                0.078125 = fieldNorm(doc=4363)
          0.08491045 = weight(abstract_txt:retrieval in 4363) [ClassicSimilarity], result of:
            0.08491045 = score(doc=4363,freq=6.0), product of:
              0.12850127 = queryWeight, product of:
                3.3326585 = boost
                3.4529324 = idf(docFreq=3574, maxDocs=41550)
                0.011166794 = queryNorm
              0.66077524 = fieldWeight in 4363, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                3.4529324 = idf(docFreq=3574, maxDocs=41550)
                0.078125 = fieldNorm(doc=4363)
          0.3443964 = weight(abstract_txt:measurement in 4363) [ClassicSimilarity], result of:
            0.3443964 = score(doc=4363,freq=2.0), product of:
              0.44774482 = queryWeight, product of:
                5.7594233 = boost
                6.961824 = idf(docFreq=106, maxDocs=41550)
                0.011166794 = queryNorm
              0.7691801 = fieldWeight in 4363, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.961824 = idf(docFreq=106, maxDocs=41550)
                0.078125 = fieldNorm(doc=4363)
        0.2 = coord(5/25)