Document (#12072)

Author

Blair, D.C.

Title

STAIRS Redux : thoughts on the STAIRS evaluation, ten years after

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.4-22

Year

1996

Abstract

The test of retrieval effectiveness performed on IBM's STAIRS and reported in 'Communications of the ACM' 10 years ago, continues to be cited frequently in the information retrieval literature. The reasons for the study's continuing pertinence to today's research are discussed, and the political, legal, and commercial aspects of the study are presented. In addition, the method of calculating recall that was used in the STAIRS study is discussed in some detail, especially how it reduces the 5 major types of uncertainty in recall estimations. It is also suggested that this method of recall estimation may serve as the basis for recall estimations that might be truly comparable between systems

Theme

Retrievalstudien

Object

STAIRS

Similar documents (author)

1. Blair, D.C.: ¬An extended relational document retrieval model (1988) 5.62

   5.6180234 = sum of:
     5.6180234 = weight(author_txt:blair in 5281) [ClassicSimilarity], result of:
       5.6180234 = fieldWeight in 5281, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.625 = fieldNorm(doc=5281)
   

2. Blair, D.C.: Full text retrieval : Evaluation and implications (1986) 5.62

   5.6180234 = sum of:
     5.6180234 = weight(author_txt:blair in 2047) [ClassicSimilarity], result of:
       5.6180234 = fieldWeight in 2047, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.625 = fieldNorm(doc=2047)
   

3. Blair, D.C.: Knowledge management : hype, hope, or help? (2002) 5.62

   5.6180234 = sum of:
     5.6180234 = weight(author_txt:blair in 982) [ClassicSimilarity], result of:
       5.6180234 = fieldWeight in 982, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.625 = fieldNorm(doc=982)
   

4. Blair, D.C.: ¬The challenge of commercial document retrieval : Part II: a strategy for document searching based on identifiable document partitions (2002) 5.62

   5.6180234 = sum of:
     5.6180234 = weight(author_txt:blair in 2576) [ClassicSimilarity], result of:
       5.6180234 = fieldWeight in 2576, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.625 = fieldNorm(doc=2576)
   

5. Blair, D.C.: ¬The challenge of commercial document retrieval : Part I: Major issues, and a framework based on search exhaustivity, determinacy of representation and document collection size (2002) 5.62

   5.6180234 = sum of:
     5.6180234 = weight(author_txt:blair in 2580) [ClassicSimilarity], result of:
       5.6180234 = fieldWeight in 2580, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.625 = fieldNorm(doc=2580)
   

Similar documents (content)

1. Berger, F.C.; Hofstede, A.H.M. ter; Van der Weide, T.P.: Supporting query by navigation (1996) 0.15

   0.14801899 = sum of:
     0.14801899 = product of:
       0.9251187 = sum of:
         0.031718265 = weight(abstract_txt:study in 6966) [ClassicSimilarity], result of:
           0.031718265 = score(doc=6966,freq=2.0), product of:
             0.06987374 = queryWeight, product of:
               1.1400284 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.017901491 = queryNorm
             0.45393682 = fieldWeight in 6966, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.09375 = fieldNorm(doc=6966)
         0.023452204 = weight(abstract_txt:retrieval in 6966) [ClassicSimilarity], result of:
           0.023452204 = score(doc=6966,freq=1.0), product of:
             0.07198469 = queryWeight, product of:
               1.1571208 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017901491 = queryNorm
             0.3257943 = fieldWeight in 6966, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=6966)
         0.13724773 = weight(abstract_txt:estimation in 6966) [ClassicSimilarity], result of:
           0.13724773 = score(doc=6966,freq=1.0), product of:
             0.18554296 = queryWeight, product of:
               1.3136083 = boost
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.017901491 = queryNorm
             0.7397086 = fieldWeight in 6966, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.09375 = fieldNorm(doc=6966)
         0.73270047 = weight(abstract_txt:estimations in 6966) [ClassicSimilarity], result of:
           0.73270047 = score(doc=6966,freq=2.0), product of:
             0.56675065 = queryWeight, product of:
               3.2467933 = boost
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.017901491 = queryNorm
             1.2928092 = fieldWeight in 6966, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.09375 = fieldNorm(doc=6966)
       0.16 = coord(4/25)
   

2. Cox, K.: ¬An experiment to test the utility of repeating phrases for information retrieval systems (1994) 0.10

   0.103977896 = sum of:
     0.103977896 = product of:
       0.5198895 = sum of:
         0.027360905 = weight(abstract_txt:retrieval in 827) [ClassicSimilarity], result of:
           0.027360905 = score(doc=827,freq=1.0), product of:
             0.07198469 = queryWeight, product of:
               1.1571208 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017901491 = queryNorm
             0.38009337 = fieldWeight in 827, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.109375 = fieldNorm(doc=827)
         0.013009528 = weight(abstract_txt:that in 827) [ClassicSimilarity], result of:
           0.013009528 = score(doc=827,freq=1.0), product of:
             0.050198562 = queryWeight, product of:
               1.18345 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.017901491 = queryNorm
             0.25916135 = fieldWeight in 827, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.109375 = fieldNorm(doc=827)
         0.17233759 = weight(abstract_txt:calculating in 827) [ClassicSimilarity], result of:
           0.17233759 = score(doc=827,freq=1.0), product of:
             0.19486322 = queryWeight, product of:
               1.3461969 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.017901491 = queryNorm
             0.8844029 = fieldWeight in 827, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.109375 = fieldNorm(doc=827)
         0.059446506 = weight(abstract_txt:method in 827) [ClassicSimilarity], result of:
           0.059446506 = score(doc=827,freq=1.0), product of:
             0.12075471 = queryWeight, product of:
               1.4986861 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.017901491 = queryNorm
             0.4922914 = fieldWeight in 827, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.109375 = fieldNorm(doc=827)
         0.24773492 = weight(abstract_txt:recall in 827) [ClassicSimilarity], result of:
           0.24773492 = score(doc=827,freq=1.0), product of:
             0.39399254 = queryWeight, product of:
               3.828403 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017901491 = queryNorm
             0.6287807 = fieldWeight in 827, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.109375 = fieldNorm(doc=827)
       0.2 = coord(5/25)
   

3. Alemayehu, N.: Analysis of performance variation using quey expansion (2003) 0.10

   0.09530212 = sum of:
     0.09530212 = product of:
       0.39709216 = sum of:
         0.02114551 = weight(abstract_txt:study in 1454) [ClassicSimilarity], result of:
           0.02114551 = score(doc=1454,freq=2.0), product of:
             0.06987374 = queryWeight, product of:
               1.1400284 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.017901491 = queryNorm
             0.30262455 = fieldWeight in 1454, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0625 = fieldNorm(doc=1454)
         0.03829729 = weight(abstract_txt:retrieval in 1454) [ClassicSimilarity], result of:
           0.03829729 = score(doc=1454,freq=6.0), product of:
             0.07198469 = queryWeight, product of:
               1.1571208 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017901491 = queryNorm
             0.5320199 = fieldWeight in 1454, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=1454)
         0.0128760915 = weight(abstract_txt:that in 1454) [ClassicSimilarity], result of:
           0.0128760915 = score(doc=1454,freq=3.0), product of:
             0.050198562 = queryWeight, product of:
               1.18345 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.017901491 = queryNorm
             0.2565032 = fieldWeight in 1454, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=1454)
         0.076533176 = weight(abstract_txt:truly in 1454) [ClassicSimilarity], result of:
           0.076533176 = score(doc=1454,freq=1.0), product of:
             0.16471572 = queryWeight, product of:
               1.237688 = boost
               7.4342074 = idf(docFreq=70, maxDocs=44218)
               0.017901491 = queryNorm
             0.46463796 = fieldWeight in 1454, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4342074 = idf(docFreq=70, maxDocs=44218)
               0.0625 = fieldNorm(doc=1454)
         0.04804003 = weight(abstract_txt:method in 1454) [ClassicSimilarity], result of:
           0.04804003 = score(doc=1454,freq=2.0), product of:
             0.12075471 = queryWeight, product of:
               1.4986861 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.017901491 = queryNorm
             0.3978315 = fieldWeight in 1454, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.0625 = fieldNorm(doc=1454)
         0.20020005 = weight(abstract_txt:recall in 1454) [ClassicSimilarity], result of:
           0.20020005 = score(doc=1454,freq=2.0), product of:
             0.39399254 = queryWeight, product of:
               3.828403 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017901491 = queryNorm
             0.50813156 = fieldWeight in 1454, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0625 = fieldNorm(doc=1454)
       0.24 = coord(6/25)
   

4. Keen, E.M.: Presenting results of experimental retrieval comparisons (1992) 0.09

   0.08687185 = sum of:
     0.08687185 = product of:
       0.5429491 = sum of:
         0.04062041 = weight(abstract_txt:retrieval in 3644) [ClassicSimilarity], result of:
           0.04062041 = score(doc=3644,freq=3.0), product of:
             0.07198469 = queryWeight, product of:
               1.1571208 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017901491 = queryNorm
             0.5642923 = fieldWeight in 3644, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=3644)
         0.14771794 = weight(abstract_txt:calculating in 3644) [ClassicSimilarity], result of:
           0.14771794 = score(doc=3644,freq=1.0), product of:
             0.19486322 = queryWeight, product of:
               1.3461969 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.017901491 = queryNorm
             0.7580596 = fieldWeight in 3644, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.09375 = fieldNorm(doc=3644)
         0.054310616 = weight(abstract_txt:discussed in 3644) [ClassicSimilarity], result of:
           0.054310616 = score(doc=3644,freq=1.0), product of:
             0.12600106 = queryWeight, product of:
               1.5308962 = boost
               4.5976853 = idf(docFreq=1210, maxDocs=44218)
               0.017901491 = queryNorm
             0.43103302 = fieldWeight in 3644, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5976853 = idf(docFreq=1210, maxDocs=44218)
               0.09375 = fieldNorm(doc=3644)
         0.3003001 = weight(abstract_txt:recall in 3644) [ClassicSimilarity], result of:
           0.3003001 = score(doc=3644,freq=2.0), product of:
             0.39399254 = queryWeight, product of:
               3.828403 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017901491 = queryNorm
             0.7621974 = fieldWeight in 3644, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.09375 = fieldNorm(doc=3644)
       0.16 = coord(4/25)
   

5. Chen, H.; Martinez, J.; Kirchhoff, A.; Ng, T.D.; Schatz, B.R.: Alleviating search uncertainty through concept associations : automatic indexing, co-occurence analysis, and parallel computing (1998) 0.08

   0.08386101 = sum of:
     0.08386101 = product of:
       0.41930503 = sum of:
         0.076526195 = weight(abstract_txt:comparable in 5202) [ClassicSimilarity], result of:
           0.076526195 = score(doc=5202,freq=1.0), product of:
             0.14193907 = queryWeight, product of:
               1.1489328 = boost
               6.901097 = idf(docFreq=120, maxDocs=44218)
               0.017901491 = queryNorm
             0.5391482 = fieldWeight in 5202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.901097 = idf(docFreq=120, maxDocs=44218)
               0.078125 = fieldNorm(doc=5202)
         0.110221915 = weight(abstract_txt:uncertainty in 5202) [ClassicSimilarity], result of:
           0.110221915 = score(doc=5202,freq=2.0), product of:
             0.14368029 = queryWeight, product of:
               1.1559585 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017901491 = queryNorm
             0.7671332 = fieldWeight in 5202, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.078125 = fieldNorm(doc=5202)
         0.013141606 = weight(abstract_txt:that in 5202) [ClassicSimilarity], result of:
           0.013141606 = score(doc=5202,freq=2.0), product of:
             0.050198562 = queryWeight, product of:
               1.18345 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.017901491 = queryNorm
             0.26179248 = fieldWeight in 5202, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=5202)
         0.04246179 = weight(abstract_txt:method in 5202) [ClassicSimilarity], result of:
           0.04246179 = score(doc=5202,freq=1.0), product of:
             0.12075471 = queryWeight, product of:
               1.4986861 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.017901491 = queryNorm
             0.3516367 = fieldWeight in 5202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.078125 = fieldNorm(doc=5202)
         0.17695351 = weight(abstract_txt:recall in 5202) [ClassicSimilarity], result of:
           0.17695351 = score(doc=5202,freq=1.0), product of:
             0.39399254 = queryWeight, product of:
               3.828403 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017901491 = queryNorm
             0.44912907 = fieldWeight in 5202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.078125 = fieldNorm(doc=5202)
       0.2 = coord(5/25)