Document (#12073)

Author
Ellis, D.
Title
¬The dilemma of measurement in information retrieval research
Source
Journal of the American Society for Information Science. 47(1996) no.1, S.23-36
Year
1996
Abstract
The problem of measurement in information retrieval research is traced to its source in the first retrieval tests. The problem is seen as presenting a chronic dilemma for the field. This dilemma has taken 3 forms as the discipline has evloved: (1) the dilemma of measurement in the archetypal approach: stated relevance versus user relevance; (2) the dilemma of measurement in the probabilistic approach: realism versus formalism; and (3) the dilemma of measurement in the Information Retrieval-Expert System (IR-ES) approach: linear measures of relevance versus logarithmic measures of knowledge. It is argued that the dilemma of measurement has remained intractable even given the different assumptions of the different approaches for 3 connecte reasons - the nature of the subject matter of the field; the nature of relevance jidgement; and the nature of cognition and knowledge. Finally, it is concluded that the original vision of information retrieval research as a discipline founded on quantification proved restricting for its theoretical and methodological development and that increasing recognition of this is reflected in growing interest in qualitative methods in information retrieval research in relation to cognitive, behavioral, and affective aspects of the information retrieval interaction
Theme
Retrievalstudien

Similar documents (author)

  1. Ellis, D.: ¬A behavioral approach to information system design (1989) 4.88
    4.8765855 = sum of:
      4.8765855 = weight(author_txt:ellis in 2706) [ClassicSimilarity], result of:
        4.8765855 = fieldWeight in 2706, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.8025365 = idf(docFreq=46, maxDocs=42306)
          0.625 = fieldNorm(doc=2706)
    
  2. Ellis, D.: ¬A behavioral model for information retrieval system design (1989) 4.88
    4.8765855 = sum of:
      4.8765855 = weight(author_txt:ellis in 2707) [ClassicSimilarity], result of:
        4.8765855 = fieldWeight in 2707, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.8025365 = idf(docFreq=46, maxDocs=42306)
          0.625 = fieldNorm(doc=2707)
    
  3. Ellis, D.: Hypertext; origins and use (1991) 4.88
    4.8765855 = sum of:
      4.8765855 = weight(author_txt:ellis in 4916) [ClassicSimilarity], result of:
        4.8765855 = fieldWeight in 4916, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.8025365 = idf(docFreq=46, maxDocs=42306)
          0.625 = fieldNorm(doc=4916)
    
  4. Ellis, D.: Theory and explanation in information retrieval research (1984) 4.88
    4.8765855 = sum of:
      4.8765855 = weight(author_txt:ellis in 5337) [ClassicSimilarity], result of:
        4.8765855 = fieldWeight in 5337, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.8025365 = idf(docFreq=46, maxDocs=42306)
          0.625 = fieldNorm(doc=5337)
    
  5. Ellis, D.: ¬The physical and cognitive paradigms in information retrieval research (1992) 4.88
    4.8765855 = sum of:
      4.8765855 = weight(author_txt:ellis in 161) [ClassicSimilarity], result of:
        4.8765855 = fieldWeight in 161, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          7.8025365 = idf(docFreq=46, maxDocs=42306)
          0.625 = fieldNorm(doc=161)
    

Similar documents (content)

  1. Thornley, C.: Dilemmas in information science (IS) and information retrieval (IR) : recurring challenges or new solutions? (2009) 0.25
    0.25117537 = sum of:
      0.25117537 = product of:
        0.6977093 = sum of:
          0.024204964 = weight(abstract_txt:problem in 784) [ClassicSimilarity], result of:
            0.024204964 = score(doc=784,freq=2.0), product of:
              0.06129018 = queryWeight, product of:
                1.2332534 = boost
                4.4680552 = idf(docFreq=1318, maxDocs=42306)
                0.011122951 = queryNorm
              0.394924 = fieldWeight in 784, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4680552 = idf(docFreq=1318, maxDocs=42306)
                0.0625 = fieldNorm(doc=784)
          0.017902067 = weight(abstract_txt:field in 784) [ClassicSimilarity], result of:
            0.017902067 = score(doc=784,freq=1.0), product of:
              0.06315388 = queryWeight, product of:
                1.2518632 = boost
                4.5354786 = idf(docFreq=1232, maxDocs=42306)
                0.011122951 = queryNorm
              0.2834674 = fieldWeight in 784, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5354786 = idf(docFreq=1232, maxDocs=42306)
                0.0625 = fieldNorm(doc=784)
          0.14579463 = weight(abstract_txt:intractable in 784) [ClassicSimilarity], result of:
            0.14579463 = score(doc=784,freq=3.0), product of:
              0.14068308 = queryWeight, product of:
                1.3211825 = boost
                9.573242 = idf(docFreq=7, maxDocs=42306)
                0.011122951 = queryNorm
              1.0363338 = fieldWeight in 784, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                9.573242 = idf(docFreq=7, maxDocs=42306)
                0.0625 = fieldNorm(doc=784)
          0.01565706 = weight(abstract_txt:approach in 784) [ClassicSimilarity], result of:
            0.01565706 = score(doc=784,freq=1.0), product of:
              0.066115275 = queryWeight, product of:
                1.5687488 = boost
                3.789033 = idf(docFreq=2600, maxDocs=42306)
                0.011122951 = queryNorm
              0.23681456 = fieldWeight in 784, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.789033 = idf(docFreq=2600, maxDocs=42306)
                0.0625 = fieldNorm(doc=784)
          0.01825566 = weight(abstract_txt:research in 784) [ClassicSimilarity], result of:
            0.01825566 = score(doc=784,freq=2.0), product of:
              0.063982755 = queryWeight, product of:
                1.7819821 = boost
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.011122951 = queryNorm
              0.28532156 = fieldWeight in 784, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.0625 = fieldNorm(doc=784)
          0.04699541 = weight(abstract_txt:nature in 784) [ClassicSimilarity], result of:
            0.04699541 = score(doc=784,freq=2.0), product of:
              0.10919145 = queryWeight, product of:
                2.0160291 = boost
                4.869359 = idf(docFreq=882, maxDocs=42306)
                0.011122951 = queryNorm
              0.4303946 = fieldWeight in 784, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.869359 = idf(docFreq=882, maxDocs=42306)
                0.0625 = fieldNorm(doc=784)
          0.016639668 = weight(abstract_txt:information in 784) [ClassicSimilarity], result of:
            0.016639668 = score(doc=784,freq=4.0), product of:
              0.054648902 = queryWeight, product of:
                2.0170107 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.011122951 = queryNorm
              0.30448312 = fieldWeight in 784, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.0625 = fieldNorm(doc=784)
          0.039429978 = weight(abstract_txt:retrieval in 784) [ClassicSimilarity], result of:
            0.039429978 = score(doc=784,freq=2.0), product of:
              0.12883335 = queryWeight, product of:
                3.3450687 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.011122951 = queryNorm
              0.30605412 = fieldWeight in 784, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0625 = fieldNorm(doc=784)
          0.37282985 = weight(abstract_txt:dilemma in 784) [ClassicSimilarity], result of:
            0.37282985 = score(doc=784,freq=1.0), product of:
              0.725818 = queryWeight, product of:
                7.939712 = boost
                8.218697 = idf(docFreq=30, maxDocs=42306)
                0.011122951 = queryNorm
              0.51366854 = fieldWeight in 784, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.218697 = idf(docFreq=30, maxDocs=42306)
                0.0625 = fieldNorm(doc=784)
        0.36 = coord(9/25)
    
  2. Stebelman, S.: Analysis of retrieval performance in four cross-disciplinary databases : Article1st, Faxon Finder, UnCover, and a locally mounted database (1994) 0.12
    0.12410261 = sum of:
      0.12410261 = product of:
        0.620513 = sum of:
          0.04562496 = weight(abstract_txt:stated in 1021) [ClassicSimilarity], result of:
            0.04562496 = score(doc=1021,freq=1.0), product of:
              0.080596514 = queryWeight, product of:
                7.245965 = idf(docFreq=81, maxDocs=42306)
                0.011122951 = queryNorm
              0.566091 = fieldWeight in 1021, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.245965 = idf(docFreq=81, maxDocs=42306)
                0.078125 = fieldNorm(doc=1021)
          0.016135875 = weight(abstract_txt:research in 1021) [ClassicSimilarity], result of:
            0.016135875 = score(doc=1021,freq=1.0), product of:
              0.063982755 = queryWeight, product of:
                1.7819821 = boost
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.011122951 = queryNorm
              0.252191 = fieldWeight in 1021, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.078125 = fieldNorm(doc=1021)
          0.05786335 = weight(abstract_txt:relevance in 1021) [ClassicSimilarity], result of:
            0.05786335 = score(doc=1021,freq=1.0), product of:
              0.14990069 = queryWeight, product of:
                2.727556 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.011122951 = queryNorm
              0.38601124 = fieldWeight in 1021, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.078125 = fieldNorm(doc=1021)
          0.034851506 = weight(abstract_txt:retrieval in 1021) [ClassicSimilarity], result of:
            0.034851506 = score(doc=1021,freq=1.0), product of:
              0.12883335 = queryWeight, product of:
                3.3450687 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.011122951 = queryNorm
              0.2705162 = fieldWeight in 1021, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.078125 = fieldNorm(doc=1021)
          0.46603733 = weight(abstract_txt:dilemma in 1021) [ClassicSimilarity], result of:
            0.46603733 = score(doc=1021,freq=1.0), product of:
              0.725818 = queryWeight, product of:
                7.939712 = boost
                8.218697 = idf(docFreq=30, maxDocs=42306)
                0.011122951 = queryNorm
              0.6420857 = fieldWeight in 1021, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.218697 = idf(docFreq=30, maxDocs=42306)
                0.078125 = fieldNorm(doc=1021)
        0.2 = coord(5/25)
    
  3. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.12
    0.12340648 = sum of:
      0.12340648 = product of:
        0.51419365 = sum of:
          0.017115494 = weight(abstract_txt:problem in 3073) [ClassicSimilarity], result of:
            0.017115494 = score(doc=3073,freq=1.0), product of:
              0.06129018 = queryWeight, product of:
                1.2332534 = boost
                4.4680552 = idf(docFreq=1318, maxDocs=42306)
                0.011122951 = queryNorm
              0.27925345 = fieldWeight in 3073, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4680552 = idf(docFreq=1318, maxDocs=42306)
                0.0625 = fieldNorm(doc=3073)
          0.04373656 = weight(abstract_txt:measures in 3073) [ClassicSimilarity], result of:
            0.04373656 = score(doc=3073,freq=2.0), product of:
              0.09092521 = queryWeight, product of:
                1.5021006 = boost
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.011122951 = queryNorm
              0.48101684 = fieldWeight in 3073, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.4420843 = idf(docFreq=497, maxDocs=42306)
                0.0625 = fieldNorm(doc=3073)
          0.011766021 = weight(abstract_txt:information in 3073) [ClassicSimilarity], result of:
            0.011766021 = score(doc=3073,freq=2.0), product of:
              0.054648902 = queryWeight, product of:
                2.0170107 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.011122951 = queryNorm
              0.21530207 = fieldWeight in 3073, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.0625 = fieldNorm(doc=3073)
          0.10350911 = weight(abstract_txt:relevance in 3073) [ClassicSimilarity], result of:
            0.10350911 = score(doc=3073,freq=5.0), product of:
              0.14990069 = queryWeight, product of:
                2.727556 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.011122951 = queryNorm
              0.6905179 = fieldWeight in 3073, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0625 = fieldNorm(doc=3073)
          0.06234427 = weight(abstract_txt:retrieval in 3073) [ClassicSimilarity], result of:
            0.06234427 = score(doc=3073,freq=5.0), product of:
              0.12883335 = queryWeight, product of:
                3.3450687 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.011122951 = queryNorm
              0.48391408 = fieldWeight in 3073, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0625 = fieldNorm(doc=3073)
          0.2757222 = weight(abstract_txt:measurement in 3073) [ClassicSimilarity], result of:
            0.2757222 = score(doc=3073,freq=2.0), product of:
              0.44751698 = queryWeight, product of:
                5.771946 = boost
                6.970553 = idf(docFreq=107, maxDocs=42306)
                0.011122951 = queryNorm
              0.6161156 = fieldWeight in 3073, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.970553 = idf(docFreq=107, maxDocs=42306)
                0.0625 = fieldNorm(doc=3073)
        0.24 = coord(6/25)
    
  4. Skyrme, D.J.: Valuing information : is it worth it? (1998) 0.11
    0.107255965 = sum of:
      0.107255965 = product of:
        0.6703498 = sum of:
          0.035804134 = weight(abstract_txt:field in 2753) [ClassicSimilarity], result of:
            0.035804134 = score(doc=2753,freq=1.0), product of:
              0.06315388 = queryWeight, product of:
                1.2518632 = boost
                4.5354786 = idf(docFreq=1232, maxDocs=42306)
                0.011122951 = queryNorm
              0.5669348 = fieldWeight in 2753, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5354786 = idf(docFreq=1232, maxDocs=42306)
                0.125 = fieldNorm(doc=2753)
          0.06646155 = weight(abstract_txt:nature in 2753) [ClassicSimilarity], result of:
            0.06646155 = score(doc=2753,freq=1.0), product of:
              0.10919145 = queryWeight, product of:
                2.0160291 = boost
                4.869359 = idf(docFreq=882, maxDocs=42306)
                0.011122951 = queryNorm
              0.6086699 = fieldWeight in 2753, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.869359 = idf(docFreq=882, maxDocs=42306)
                0.125 = fieldNorm(doc=2753)
          0.016639668 = weight(abstract_txt:information in 2753) [ClassicSimilarity], result of:
            0.016639668 = score(doc=2753,freq=1.0), product of:
              0.054648902 = queryWeight, product of:
                2.0170107 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.011122951 = queryNorm
              0.30448312 = fieldWeight in 2753, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.125 = fieldNorm(doc=2753)
          0.5514444 = weight(abstract_txt:measurement in 2753) [ClassicSimilarity], result of:
            0.5514444 = score(doc=2753,freq=2.0), product of:
              0.44751698 = queryWeight, product of:
                5.771946 = boost
                6.970553 = idf(docFreq=107, maxDocs=42306)
                0.011122951 = queryNorm
              1.2322313 = fieldWeight in 2753, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.970553 = idf(docFreq=107, maxDocs=42306)
                0.125 = fieldNorm(doc=2753)
        0.16 = coord(4/25)
    
  5. Houston, R.D.; Harmon, E.G.: Re-envisioning the information concept : systematic definitions (2002) 0.10
    0.104524426 = sum of:
      0.104524426 = product of:
        0.6532777 = sum of:
          0.19872272 = weight(abstract_txt:quantification in 2137) [ClassicSimilarity], result of:
            0.19872272 = score(doc=2137,freq=2.0), product of:
              0.12471622 = queryWeight, product of:
                1.2439512 = boost
                9.013627 = idf(docFreq=13, maxDocs=42306)
                0.011122951 = queryNorm
              1.5933992 = fieldWeight in 2137, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                9.013627 = idf(docFreq=13, maxDocs=42306)
                0.125 = fieldNorm(doc=2137)
          0.035804134 = weight(abstract_txt:field in 2137) [ClassicSimilarity], result of:
            0.035804134 = score(doc=2137,freq=1.0), product of:
              0.06315388 = queryWeight, product of:
                1.2518632 = boost
                4.5354786 = idf(docFreq=1232, maxDocs=42306)
                0.011122951 = queryNorm
              0.5669348 = fieldWeight in 2137, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5354786 = idf(docFreq=1232, maxDocs=42306)
                0.125 = fieldNorm(doc=2137)
          0.028820751 = weight(abstract_txt:information in 2137) [ClassicSimilarity], result of:
            0.028820751 = score(doc=2137,freq=3.0), product of:
              0.054648902 = queryWeight, product of:
                2.0170107 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.011122951 = queryNorm
              0.5273802 = fieldWeight in 2137, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.125 = fieldNorm(doc=2137)
          0.3899301 = weight(abstract_txt:measurement in 2137) [ClassicSimilarity], result of:
            0.3899301 = score(doc=2137,freq=1.0), product of:
              0.44751698 = queryWeight, product of:
                5.771946 = boost
                6.970553 = idf(docFreq=107, maxDocs=42306)
                0.011122951 = queryNorm
              0.8713191 = fieldWeight in 2137, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.970553 = idf(docFreq=107, maxDocs=42306)
                0.125 = fieldNorm(doc=2137)
        0.16 = coord(4/25)