Document (#12072)

Author
Blair, D.C.
Title
STAIRS Redux : thoughts on the STAIRS evaluation, ten years after
Source
Journal of the American Society for Information Science. 47(1996) no.1, S.4-22
Year
1996
Abstract
The test of retrieval effectiveness performed on IBM's STAIRS and reported in 'Communications of the ACM' 10 years ago, continues to be cited frequently in the information retrieval literature. The reasons for the study's continuing pertinence to today's research are discussed, and the political, legal, and commercial aspects of the study are presented. In addition, the method of calculating recall that was used in the STAIRS study is discussed in some detail, especially how it reduces the 5 major types of uncertainty in recall estimations. It is also suggested that this method of recall estimation may serve as the basis for recall estimations that might be truly comparable between systems
Theme
Retrievalstudien
Object
STAIRS

Similar documents (author)

  1. Blair, D.C.: ¬An extended relational document retrieval model (1988) 5.59
    5.5903964 = sum of:
      5.5903964 = weight(author_txt:blair in 5281) [ClassicSimilarity], result of:
        5.5903964 = fieldWeight in 5281, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.944634 = idf(docFreq=14, maxDocs=42306)
          0.625 = fieldNorm(doc=5281)
    
  2. Blair, D.C.: Full text retrieval : Evaluation and implications (1986) 5.59
    5.5903964 = sum of:
      5.5903964 = weight(author_txt:blair in 2116) [ClassicSimilarity], result of:
        5.5903964 = fieldWeight in 2116, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.944634 = idf(docFreq=14, maxDocs=42306)
          0.625 = fieldNorm(doc=2116)
    
  3. Blair, D.C.: Knowledge management : hype, hope, or help? (2002) 5.59
    5.5903964 = sum of:
      5.5903964 = weight(author_txt:blair in 1983) [ClassicSimilarity], result of:
        5.5903964 = fieldWeight in 1983, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.944634 = idf(docFreq=14, maxDocs=42306)
          0.625 = fieldNorm(doc=1983)
    
  4. Blair, D.C.: ¬The challenge of commercial document retrieval : Part II: a strategy for document searching based on identifiable document partitions (2002) 5.59
    5.5903964 = sum of:
      5.5903964 = weight(author_txt:blair in 3577) [ClassicSimilarity], result of:
        5.5903964 = fieldWeight in 3577, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.944634 = idf(docFreq=14, maxDocs=42306)
          0.625 = fieldNorm(doc=3577)
    
  5. Blair, D.C.: ¬The challenge of commercial document retrieval : Part I: Major issues, and a framework based on search exhaustivity, determinacy of representation and document collection size (2002) 5.59
    5.5903964 = sum of:
      5.5903964 = weight(author_txt:blair in 3581) [ClassicSimilarity], result of:
        5.5903964 = fieldWeight in 3581, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.944634 = idf(docFreq=14, maxDocs=42306)
          0.625 = fieldNorm(doc=3581)
    

Similar documents (content)

  1. Berger, F.C.; Hofstede, A.H.M. ter; Van der Weide, T.P.: Supporting query by navigation (1996) 0.15
    0.15061985 = sum of:
      0.15061985 = product of:
        0.94137406 = sum of:
          0.022975462 = weight(abstract_txt:retrieval in 36) [ClassicSimilarity], result of:
            0.022975462 = score(doc=36,freq=1.0), product of:
              0.07077661 = queryWeight, product of:
                1.1459491 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.017836975 = queryNorm
              0.3246194 = fieldWeight in 36, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.09375 = fieldNorm(doc=36)
          0.03314425 = weight(abstract_txt:study in 36) [ClassicSimilarity], result of:
            0.03314425 = score(doc=36,freq=2.0), product of:
              0.071720354 = queryWeight, product of:
                1.153564 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.017836975 = queryNorm
              0.46213174 = fieldWeight in 36, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.09375 = fieldNorm(doc=36)
          0.134803 = weight(abstract_txt:estimation in 36) [ClassicSimilarity], result of:
            0.134803 = score(doc=36,freq=1.0), product of:
              0.18274127 = queryWeight, product of:
                1.3020384 = boost
                7.8684945 = idf(docFreq=43, maxDocs=42306)
                0.017836975 = queryNorm
              0.7376714 = fieldWeight in 36, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.8684945 = idf(docFreq=43, maxDocs=42306)
                0.09375 = fieldNorm(doc=36)
          0.7504513 = weight(abstract_txt:estimations in 36) [ClassicSimilarity], result of:
            0.7504513 = score(doc=36,freq=2.0), product of:
              0.5740089 = queryWeight, product of:
                3.2634711 = boost
                9.860925 = idf(docFreq=5, maxDocs=42306)
                0.017836975 = queryNorm
              1.3073863 = fieldWeight in 36, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                9.860925 = idf(docFreq=5, maxDocs=42306)
                0.09375 = fieldNorm(doc=36)
        0.16 = coord(4/25)
    
  2. Cox, K.: ¬An experiment to test the utility of repeating phrases for information retrieval systems (1994) 0.10
    0.103539884 = sum of:
      0.103539884 = product of:
        0.5176994 = sum of:
          0.026804708 = weight(abstract_txt:retrieval in 896) [ClassicSimilarity], result of:
            0.026804708 = score(doc=896,freq=1.0), product of:
              0.07077661 = queryWeight, product of:
                1.1459491 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.017836975 = queryNorm
              0.37872267 = fieldWeight in 896, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.109375 = fieldNorm(doc=896)
          0.013469753 = weight(abstract_txt:that in 896) [ClassicSimilarity], result of:
            0.013469753 = score(doc=896,freq=1.0), product of:
              0.05120974 = queryWeight, product of:
                1.1938297 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.017836975 = queryNorm
              0.26303107 = fieldWeight in 896, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.109375 = fieldNorm(doc=896)
          0.17515853 = weight(abstract_txt:calculating in 896) [ClassicSimilarity], result of:
            0.17515853 = score(doc=896,freq=1.0), product of:
              0.19634806 = queryWeight, product of:
                1.3496425 = boost
                8.156177 = idf(docFreq=32, maxDocs=42306)
                0.017836975 = queryNorm
              0.8920818 = fieldWeight in 896, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.156177 = idf(docFreq=32, maxDocs=42306)
                0.109375 = fieldNorm(doc=896)
          0.06020574 = weight(abstract_txt:method in 896) [ClassicSimilarity], result of:
            0.06020574 = score(doc=896,freq=1.0), product of:
              0.1213876 = queryWeight, product of:
                1.5007476 = boost
                4.534668 = idf(docFreq=1233, maxDocs=42306)
                0.017836975 = queryNorm
              0.4959793 = fieldWeight in 896, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.534668 = idf(docFreq=1233, maxDocs=42306)
                0.109375 = fieldNorm(doc=896)
          0.24206068 = weight(abstract_txt:recall in 896) [ClassicSimilarity], result of:
            0.24206068 = score(doc=896,freq=1.0), product of:
              0.38670093 = queryWeight, product of:
                3.7881143 = boost
                5.723095 = idf(docFreq=375, maxDocs=42306)
                0.017836975 = queryNorm
              0.6259635 = fieldWeight in 896, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.723095 = idf(docFreq=375, maxDocs=42306)
                0.109375 = fieldNorm(doc=896)
        0.2 = coord(5/25)
    
  3. Alemayehu, N.: Analysis of performance variation using quey expansion (2003) 0.09
    0.09431462 = sum of:
      0.09431462 = product of:
        0.3929776 = sum of:
          0.037518773 = weight(abstract_txt:retrieval in 2455) [ClassicSimilarity], result of:
            0.037518773 = score(doc=2455,freq=6.0), product of:
              0.07077661 = queryWeight, product of:
                1.1459491 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.017836975 = queryNorm
              0.5301013 = fieldWeight in 2455, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.0625 = fieldNorm(doc=2455)
          0.022096168 = weight(abstract_txt:study in 2455) [ClassicSimilarity], result of:
            0.022096168 = score(doc=2455,freq=2.0), product of:
              0.071720354 = queryWeight, product of:
                1.153564 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.017836975 = queryNorm
              0.30808783 = fieldWeight in 2455, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.0625 = fieldNorm(doc=2455)
          0.013331598 = weight(abstract_txt:that in 2455) [ClassicSimilarity], result of:
            0.013331598 = score(doc=2455,freq=3.0), product of:
              0.05120974 = queryWeight, product of:
                1.1938297 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.017836975 = queryNorm
              0.26033324 = fieldWeight in 2455, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=2455)
          0.07576293 = weight(abstract_txt:truly in 2455) [ClassicSimilarity], result of:
            0.07576293 = score(doc=2455,freq=1.0), product of:
              0.16308059 = queryWeight, product of:
                1.2300042 = boost
                7.4331765 = idf(docFreq=67, maxDocs=42306)
                0.017836975 = queryNorm
              0.46457353 = fieldWeight in 2455, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4331765 = idf(docFreq=67, maxDocs=42306)
                0.0625 = fieldNorm(doc=2455)
          0.04865358 = weight(abstract_txt:method in 2455) [ClassicSimilarity], result of:
            0.04865358 = score(doc=2455,freq=2.0), product of:
              0.1213876 = queryWeight, product of:
                1.5007476 = boost
                4.534668 = idf(docFreq=1233, maxDocs=42306)
                0.017836975 = queryNorm
              0.4008118 = fieldWeight in 2455, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.534668 = idf(docFreq=1233, maxDocs=42306)
                0.0625 = fieldNorm(doc=2455)
          0.19561456 = weight(abstract_txt:recall in 2455) [ClassicSimilarity], result of:
            0.19561456 = score(doc=2455,freq=2.0), product of:
              0.38670093 = queryWeight, product of:
                3.7881143 = boost
                5.723095 = idf(docFreq=375, maxDocs=42306)
                0.017836975 = queryNorm
              0.5058549 = fieldWeight in 2455, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.723095 = idf(docFreq=375, maxDocs=42306)
                0.0625 = fieldNorm(doc=2455)
        0.24 = coord(6/25)
    
  4. Keen, E.M.: Presenting results of experimental retrieval comparisons (1992) 0.09
    0.086053476 = sum of:
      0.086053476 = product of:
        0.5378342 = sum of:
          0.039794665 = weight(abstract_txt:retrieval in 3644) [ClassicSimilarity], result of:
            0.039794665 = score(doc=3644,freq=3.0), product of:
              0.07077661 = queryWeight, product of:
                1.1459491 = boost
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.017836975 = queryNorm
              0.5622573 = fieldWeight in 3644, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4626071 = idf(docFreq=3604, maxDocs=42306)
                0.09375 = fieldNorm(doc=3644)
          0.15013587 = weight(abstract_txt:calculating in 3644) [ClassicSimilarity], result of:
            0.15013587 = score(doc=3644,freq=1.0), product of:
              0.19634806 = queryWeight, product of:
                1.3496425 = boost
                8.156177 = idf(docFreq=32, maxDocs=42306)
                0.017836975 = queryNorm
              0.7646415 = fieldWeight in 3644, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.156177 = idf(docFreq=32, maxDocs=42306)
                0.09375 = fieldNorm(doc=3644)
          0.054481804 = weight(abstract_txt:discussed in 3644) [ClassicSimilarity], result of:
            0.054481804 = score(doc=3644,freq=1.0), product of:
              0.12585813 = queryWeight, product of:
                1.5281328 = boost
                4.6174154 = idf(docFreq=1135, maxDocs=42306)
                0.017836975 = queryNorm
              0.4328827 = fieldWeight in 3644, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6174154 = idf(docFreq=1135, maxDocs=42306)
                0.09375 = fieldNorm(doc=3644)
          0.29342186 = weight(abstract_txt:recall in 3644) [ClassicSimilarity], result of:
            0.29342186 = score(doc=3644,freq=2.0), product of:
              0.38670093 = queryWeight, product of:
                3.7881143 = boost
                5.723095 = idf(docFreq=375, maxDocs=42306)
                0.017836975 = queryNorm
              0.7587824 = fieldWeight in 3644, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.723095 = idf(docFreq=375, maxDocs=42306)
                0.09375 = fieldNorm(doc=3644)
        0.16 = coord(4/25)
    
  5. Chen, H.; Martinez, J.; Kirchhoff, A.; Ng, T.D.; Schatz, B.R.: Alleviating search uncertainty through concept associations : automatic indexing, co-occurence analysis, and parallel computing (1998) 0.08
    0.08338469 = sum of:
      0.08338469 = product of:
        0.41692346 = sum of:
          0.075160086 = weight(abstract_txt:comparable in 203) [ClassicSimilarity], result of:
            0.075160086 = score(doc=203,freq=1.0), product of:
              0.1397921 = queryWeight, product of:
                1.1387982 = boost
                6.8819995 = idf(docFreq=117, maxDocs=42306)
                0.017836975 = queryNorm
              0.5376562 = fieldWeight in 203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.8819995 = idf(docFreq=117, maxDocs=42306)
                0.078125 = fieldNorm(doc=203)
          0.112252295 = weight(abstract_txt:uncertainty in 203) [ClassicSimilarity], result of:
            0.112252295 = score(doc=203,freq=2.0), product of:
              0.14496993 = queryWeight, product of:
                1.1596967 = boost
                7.008293 = idf(docFreq=103, maxDocs=42306)
                0.017836975 = queryNorm
              0.77431434 = fieldWeight in 203, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.008293 = idf(docFreq=103, maxDocs=42306)
                0.078125 = fieldNorm(doc=203)
          0.013606505 = weight(abstract_txt:that in 203) [ClassicSimilarity], result of:
            0.013606505 = score(doc=203,freq=2.0), product of:
              0.05120974 = queryWeight, product of:
                1.1938297 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.017836975 = queryNorm
              0.2657015 = fieldWeight in 203, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.078125 = fieldNorm(doc=203)
          0.0430041 = weight(abstract_txt:method in 203) [ClassicSimilarity], result of:
            0.0430041 = score(doc=203,freq=1.0), product of:
              0.1213876 = queryWeight, product of:
                1.5007476 = boost
                4.534668 = idf(docFreq=1233, maxDocs=42306)
                0.017836975 = queryNorm
              0.35427094 = fieldWeight in 203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.534668 = idf(docFreq=1233, maxDocs=42306)
                0.078125 = fieldNorm(doc=203)
          0.17290048 = weight(abstract_txt:recall in 203) [ClassicSimilarity], result of:
            0.17290048 = score(doc=203,freq=1.0), product of:
              0.38670093 = queryWeight, product of:
                3.7881143 = boost
                5.723095 = idf(docFreq=375, maxDocs=42306)
                0.017836975 = queryNorm
              0.4471168 = fieldWeight in 203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.723095 = idf(docFreq=375, maxDocs=42306)
                0.078125 = fieldNorm(doc=203)
        0.2 = coord(5/25)