Document (#13233)

Author

Tague-Sutcliffe, J.M.

Title

Some perspectives on the evaluation of information retrieval systems

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.1-3

Year

1996

Abstract

As an introduction to the papers in this special issue, some of the major problems facing in investigators evaluating information retrieval systems are presented. These problems include the question of the necessity of using real users, as opposed to subject experts, in making relevance judgements, the possibility of evaluating individual components of the retrieval process, rather than the process as a whole, the kinds of aggregation that are appropriate for the measures used in evaluating systems, the value of an analytic or simulatory, as opposed to an experimental, approach in evaluation retrieval systems, the difficulties in evaluating interactive systems, and the kind of generalization which are possible from information retrieval tests.

Theme

Retrievalstudien

Similar documents (author)

1. Tague-Sutcliffe, J.: ¬The pragmatics of information retrieval experimentation, revisited (1992) 6.38

   6.383844 = sum of:
     6.383844 = sum of:
       3.0818431 = weight(author_txt:sutcliffe in 1735) [ClassicSimilarity], result of:
         3.0818431 = score(doc=1735,freq=1.0), product of:
           0.6906634 = queryWeight, product of:
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.07739134 = queryNorm
           4.462149 = fieldWeight in 1735, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.5 = fieldNorm(doc=1735)
       3.3020008 = weight(author_txt:tague in 1735) [ClassicSimilarity], result of:
         3.3020008 = score(doc=1735,freq=1.0), product of:
           0.72317636 = queryWeight, product of:
             1.0232668 = boost
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.07739134 = queryNorm
           4.565969 = fieldWeight in 1735, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.5 = fieldNorm(doc=1735)
   

2. Tague-Sutcliffe, J.: Measuring information : an information services perspective (1995) 6.38

   6.383844 = sum of:
     6.383844 = sum of:
       3.0818431 = weight(author_txt:sutcliffe in 225) [ClassicSimilarity], result of:
         3.0818431 = score(doc=225,freq=1.0), product of:
           0.6906634 = queryWeight, product of:
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.07739134 = queryNorm
           4.462149 = fieldWeight in 225, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.5 = fieldNorm(doc=225)
       3.3020008 = weight(author_txt:tague in 225) [ClassicSimilarity], result of:
         3.3020008 = score(doc=225,freq=1.0), product of:
           0.72317636 = queryWeight, product of:
             1.0232668 = boost
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.07739134 = queryNorm
           4.565969 = fieldWeight in 225, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.5 = fieldNorm(doc=225)
   

3. Tague-Sutcliffe, J.: Information retrieval experimentation (1996) 6.38

   6.383844 = sum of:
     6.383844 = sum of:
       3.0818431 = weight(author_txt:sutcliffe in 7793) [ClassicSimilarity], result of:
         3.0818431 = score(doc=7793,freq=1.0), product of:
           0.6906634 = queryWeight, product of:
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.07739134 = queryNorm
           4.462149 = fieldWeight in 7793, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.5 = fieldNorm(doc=7793)
       3.3020008 = weight(author_txt:tague in 7793) [ClassicSimilarity], result of:
         3.3020008 = score(doc=7793,freq=1.0), product of:
           0.72317636 = queryWeight, product of:
             1.0232668 = boost
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.07739134 = queryNorm
           4.565969 = fieldWeight in 7793, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.5 = fieldNorm(doc=7793)
   

4. Tague-Sutcliffe, J.: Information retrieval experimentation (2009) 6.38

   6.383844 = sum of:
     6.383844 = sum of:
       3.0818431 = weight(author_txt:sutcliffe in 3801) [ClassicSimilarity], result of:
         3.0818431 = score(doc=3801,freq=1.0), product of:
           0.6906634 = queryWeight, product of:
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.07739134 = queryNorm
           4.462149 = fieldWeight in 3801, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.5 = fieldNorm(doc=3801)
       3.3020008 = weight(author_txt:tague in 3801) [ClassicSimilarity], result of:
         3.3020008 = score(doc=3801,freq=1.0), product of:
           0.72317636 = queryWeight, product of:
             1.0232668 = boost
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.07739134 = queryNorm
           4.565969 = fieldWeight in 3801, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.5 = fieldNorm(doc=3801)
   

5. Salminen, A.; Tague-Sutcliffe, J.; McClellan, C.: From text to hypertext by indexing (1995) 4.79

   4.787883 = sum of:
     4.787883 = sum of:
       2.3113823 = weight(author_txt:sutcliffe in 1863) [ClassicSimilarity], result of:
         2.3113823 = score(doc=1863,freq=1.0), product of:
           0.6906634 = queryWeight, product of:
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.07739134 = queryNorm
           3.346612 = fieldWeight in 1863, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.924298 = idf(docFreq=15, maxDocs=44218)
             0.375 = fieldNorm(doc=1863)
       2.4765005 = weight(author_txt:tague in 1863) [ClassicSimilarity], result of:
         2.4765005 = score(doc=1863,freq=1.0), product of:
           0.72317636 = queryWeight, product of:
             1.0232668 = boost
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.07739134 = queryNorm
           3.4244766 = fieldWeight in 1863, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.131938 = idf(docFreq=12, maxDocs=44218)
             0.375 = fieldNorm(doc=1863)
   

Similar documents (content)

1. Golub, K.; Soergel, D.; Buchanan, G.; Tudhope, D.; Lykke, M.; Hiom, D.: ¬A framework for evaluating automatic indexing or classification in the context of retrieval (2016) 0.17

   0.1702183 = sum of:
     0.1702183 = product of:
       0.6079225 = sum of:
         0.009554216 = weight(abstract_txt:information in 3311) [ClassicSimilarity], result of:
           0.009554216 = score(doc=3311,freq=1.0), product of:
             0.06314368 = queryWeight, product of:
               1.293021 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020171544 = queryNorm
             0.15130915 = fieldWeight in 3311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.022333642 = weight(abstract_txt:some in 3311) [ClassicSimilarity], result of:
           0.022333642 = score(doc=3311,freq=1.0), product of:
             0.09715738 = queryWeight, product of:
               1.3095826 = boost
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.020171544 = queryNorm
             0.22987078 = fieldWeight in 3311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.0356281 = weight(abstract_txt:problems in 3311) [ClassicSimilarity], result of:
           0.0356281 = score(doc=3311,freq=1.0), product of:
             0.13264713 = queryWeight, product of:
               1.530185 = boost
               4.297489 = idf(docFreq=1634, maxDocs=44218)
               0.020171544 = queryNorm
             0.26859307 = fieldWeight in 3311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.297489 = idf(docFreq=1634, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.07019508 = weight(abstract_txt:evaluation in 3311) [ClassicSimilarity], result of:
           0.07019508 = score(doc=3311,freq=3.0), product of:
             0.14454402 = queryWeight, product of:
               1.5973315 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020171544 = queryNorm
             0.48563117 = fieldWeight in 3311, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.0445727 = weight(abstract_txt:systems in 3311) [ClassicSimilarity], result of:
           0.0445727 = score(doc=3311,freq=1.0), product of:
             0.20902362 = queryWeight, product of:
               3.037125 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.020171544 = queryNorm
             0.2132424 = fieldWeight in 3311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.066607006 = weight(abstract_txt:retrieval in 3311) [ClassicSimilarity], result of:
           0.066607006 = score(doc=3311,freq=2.0), product of:
             0.21684664 = queryWeight, product of:
               3.0934377 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020171544 = queryNorm
             0.3071618 = fieldWeight in 3311, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
         0.35903177 = weight(abstract_txt:evaluating in 3311) [ClassicSimilarity], result of:
           0.35903177 = score(doc=3311,freq=4.0), product of:
             0.4911883 = queryWeight, product of:
               4.164223 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.020171544 = queryNorm
             0.7309453 = fieldWeight in 3311, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.0625 = fieldNorm(doc=3311)
       0.28 = coord(7/25)
   

2. Dunlop, M.D.; Johnson, C.W.; Reid, J.: Exploring the layers of information retrieval evaluation (1998) 0.17

   0.16875312 = sum of:
     0.16875312 = product of:
       0.703138 = sum of:
         0.024822582 = weight(abstract_txt:information in 3762) [ClassicSimilarity], result of:
           0.024822582 = score(doc=3762,freq=3.0), product of:
             0.06314368 = queryWeight, product of:
               1.293021 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020171544 = queryNorm
             0.3931127 = fieldWeight in 3762, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=3762)
         0.044764113 = weight(abstract_txt:process in 3762) [ClassicSimilarity], result of:
           0.044764113 = score(doc=3762,freq=1.0), product of:
             0.11786782 = queryWeight, product of:
               1.442423 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.020171544 = queryNorm
             0.37978232 = fieldWeight in 3762, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.09375 = fieldNorm(doc=3762)
         0.08597107 = weight(abstract_txt:evaluation in 3762) [ClassicSimilarity], result of:
           0.08597107 = score(doc=3762,freq=2.0), product of:
             0.14454402 = queryWeight, product of:
               1.5973315 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020171544 = queryNorm
             0.5947743 = fieldWeight in 3762, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=3762)
         0.066859044 = weight(abstract_txt:systems in 3762) [ClassicSimilarity], result of:
           0.066859044 = score(doc=3762,freq=1.0), product of:
             0.20902362 = queryWeight, product of:
               3.037125 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.020171544 = queryNorm
             0.3198636 = fieldWeight in 3762, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.09375 = fieldNorm(doc=3762)
         0.09991051 = weight(abstract_txt:retrieval in 3762) [ClassicSimilarity], result of:
           0.09991051 = score(doc=3762,freq=2.0), product of:
             0.21684664 = queryWeight, product of:
               3.0934377 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020171544 = queryNorm
             0.4607427 = fieldWeight in 3762, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=3762)
         0.38081068 = weight(abstract_txt:evaluating in 3762) [ClassicSimilarity], result of:
           0.38081068 = score(doc=3762,freq=2.0), product of:
             0.4911883 = queryWeight, product of:
               4.164223 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.020171544 = queryNorm
             0.7752845 = fieldWeight in 3762, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.09375 = fieldNorm(doc=3762)
       0.24 = coord(6/25)
   

3. Styltsvig, H.B.: Ontology-based information retrieval (2006) 0.17

   0.16769922 = sum of:
     0.16769922 = product of:
       0.41924804 = sum of:
         0.029831981 = weight(abstract_txt:introduction in 1154) [ClassicSimilarity], result of:
           0.029831981 = score(doc=1154,freq=1.0), product of:
             0.113302626 = queryWeight, product of:
               5.616954 = idf(docFreq=436, maxDocs=44218)
               0.020171544 = queryNorm
             0.2632947 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.616954 = idf(docFreq=436, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.034534127 = weight(abstract_txt:kind in 1154) [ClassicSimilarity], result of:
           0.034534127 = score(doc=1154,freq=1.0), product of:
             0.12491585 = queryWeight, product of:
               1.0499988 = boost
               5.8977947 = idf(docFreq=329, maxDocs=44218)
               0.020171544 = queryNorm
             0.27645913 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8977947 = idf(docFreq=329, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.017552216 = weight(abstract_txt:information in 1154) [ClassicSimilarity], result of:
           0.017552216 = score(doc=1154,freq=6.0), product of:
             0.06314368 = queryWeight, product of:
               1.293021 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020171544 = queryNorm
             0.27797264 = fieldWeight in 1154, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.065221705 = weight(abstract_txt:aggregation in 1154) [ClassicSimilarity], result of:
           0.065221705 = score(doc=1154,freq=1.0), product of:
             0.1908593 = queryWeight, product of:
               1.2978864 = boost
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.020171544 = queryNorm
             0.3417266 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.016750231 = weight(abstract_txt:some in 1154) [ClassicSimilarity], result of:
           0.016750231 = score(doc=1154,freq=1.0), product of:
             0.09715738 = queryWeight, product of:
               1.3095826 = boost
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.020171544 = queryNorm
             0.17240308 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.022382056 = weight(abstract_txt:process in 1154) [ClassicSimilarity], result of:
           0.022382056 = score(doc=1154,freq=1.0), product of:
             0.11786782 = queryWeight, product of:
               1.442423 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.020171544 = queryNorm
             0.18989116 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.05344215 = weight(abstract_txt:problems in 1154) [ClassicSimilarity], result of:
           0.05344215 = score(doc=1154,freq=4.0), product of:
             0.13264713 = queryWeight, product of:
               1.530185 = boost
               4.297489 = idf(docFreq=1634, maxDocs=44218)
               0.020171544 = queryNorm
             0.4028896 = fieldWeight in 1154, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.297489 = idf(docFreq=1634, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.05264631 = weight(abstract_txt:evaluation in 1154) [ClassicSimilarity], result of:
           0.05264631 = score(doc=1154,freq=3.0), product of:
             0.14454402 = queryWeight, product of:
               1.5973315 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020171544 = queryNorm
             0.36422336 = fieldWeight in 1154, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.033429522 = weight(abstract_txt:systems in 1154) [ClassicSimilarity], result of:
           0.033429522 = score(doc=1154,freq=1.0), product of:
             0.20902362 = queryWeight, product of:
               3.037125 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.020171544 = queryNorm
             0.1599318 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.09345772 = weight(abstract_txt:retrieval in 1154) [ClassicSimilarity], result of:
           0.09345772 = score(doc=1154,freq=7.0), product of:
             0.21684664 = queryWeight, product of:
               3.0934377 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020171544 = queryNorm
             0.43098533 = fieldWeight in 1154, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
       0.4 = coord(10/25)
   

4. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.17

   0.16529302 = sum of:
     0.16529302 = product of:
       0.5903322 = sum of:
         0.05035886 = weight(abstract_txt:tests in 3700) [ClassicSimilarity], result of:
           0.05035886 = score(doc=3700,freq=1.0), product of:
             0.13259995 = queryWeight, product of:
               1.0818118 = boost
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.020171544 = queryNorm
             0.3797804 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.02527808 = weight(abstract_txt:information in 3700) [ClassicSimilarity], result of:
           0.02527808 = score(doc=3700,freq=7.0), product of:
             0.06314368 = queryWeight, product of:
               1.293021 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020171544 = queryNorm
             0.40032637 = fieldWeight in 3700, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.0356281 = weight(abstract_txt:problems in 3700) [ClassicSimilarity], result of:
           0.0356281 = score(doc=3700,freq=1.0), product of:
             0.13264713 = queryWeight, product of:
               1.530185 = boost
               4.297489 = idf(docFreq=1634, maxDocs=44218)
               0.020171544 = queryNorm
             0.26859307 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.297489 = idf(docFreq=1634, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.0810543 = weight(abstract_txt:evaluation in 3700) [ClassicSimilarity], result of:
           0.0810543 = score(doc=3700,freq=4.0), product of:
             0.14454402 = queryWeight, product of:
               1.5973315 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020171544 = queryNorm
             0.5607586 = fieldWeight in 3700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.07720218 = weight(abstract_txt:systems in 3700) [ClassicSimilarity], result of:
           0.07720218 = score(doc=3700,freq=3.0), product of:
             0.20902362 = queryWeight, product of:
               3.037125 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.020171544 = queryNorm
             0.36934665 = fieldWeight in 3700, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.1412948 = weight(abstract_txt:retrieval in 3700) [ClassicSimilarity], result of:
           0.1412948 = score(doc=3700,freq=9.0), product of:
             0.21684664 = queryWeight, product of:
               3.0934377 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020171544 = queryNorm
             0.6515886 = fieldWeight in 3700, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.17951588 = weight(abstract_txt:evaluating in 3700) [ClassicSimilarity], result of:
           0.17951588 = score(doc=3700,freq=1.0), product of:
             0.4911883 = queryWeight, product of:
               4.164223 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.020171544 = queryNorm
             0.36547264 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
       0.28 = coord(7/25)
   

5. Rada, R.: Connecting and evaluating thesauri : issues and cases (1987) 0.16

   0.15825619 = sum of:
     0.15825619 = product of:
       0.6594008 = sum of:
         0.06596163 = weight(abstract_txt:kinds in 823) [ClassicSimilarity], result of:
           0.06596163 = score(doc=823,freq=1.0), product of:
             0.12114147 = queryWeight, product of:
               1.034014 = boost
               5.808009 = idf(docFreq=360, maxDocs=44218)
               0.020171544 = queryNorm
             0.5445008 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.808009 = idf(docFreq=360, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.014331325 = weight(abstract_txt:information in 823) [ClassicSimilarity], result of:
           0.014331325 = score(doc=823,freq=1.0), product of:
             0.06314368 = queryWeight, product of:
               1.293021 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020171544 = queryNorm
             0.22696373 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.060790725 = weight(abstract_txt:evaluation in 823) [ClassicSimilarity], result of:
           0.060790725 = score(doc=823,freq=1.0), product of:
             0.14454402 = queryWeight, product of:
               1.5973315 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020171544 = queryNorm
             0.42056894 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.066859044 = weight(abstract_txt:systems in 823) [ClassicSimilarity], result of:
           0.066859044 = score(doc=823,freq=1.0), product of:
             0.20902362 = queryWeight, product of:
               3.037125 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.020171544 = queryNorm
             0.3198636 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.0706474 = weight(abstract_txt:retrieval in 823) [ClassicSimilarity], result of:
           0.0706474 = score(doc=823,freq=1.0), product of:
             0.21684664 = queryWeight, product of:
               3.0934377 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020171544 = queryNorm
             0.3257943 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.38081068 = weight(abstract_txt:evaluating in 823) [ClassicSimilarity], result of:
           0.38081068 = score(doc=823,freq=2.0), product of:
             0.4911883 = queryWeight, product of:
               4.164223 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.020171544 = queryNorm
             0.7752845 = fieldWeight in 823, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
       0.24 = coord(6/25)