Document (#12070)

Author

Lancaster, F.W.
Ulvila, J.W.
Humphrey, S.M.
Smith, L.C.
Allen, B.
Herner, S.

Title

Evaluation of interactive knowledge-based systems : overview and design for empirical testing

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.57-69

Year

1996

Abstract

An overview of levels and approaches in the evalution of knowledge-based systems is presented. There is a need for empirical studies using objective criteria in advance of completing the technical evaluation of such systems. A methodology for this type of evaluation developed for a particular knowledge-based indexing system is presented. It is suggested that the proposed study may serve as a model for the design of any evaluation in which the results of existing intellectual procedures are compared with results achieved when these procedures are aided by use of an appropriate expert system

Similar documents (author)

1. Lancaster, F.W.; Smith, L.C.: Compatibility issues affecting information systems and services (1983) 1.48

   1.4839721 = sum of:
     1.4839721 = product of:
       2.9679441 = sum of:
         1.0501493 = weight(author_txt:smith in 7130) [ClassicSimilarity], result of:
           1.0501493 = score(doc=7130,freq=1.0), product of:
             0.3253684 = queryWeight, product of:
               6.45514 = idf(docFreq=188, maxDocs=44218)
               0.050404545 = queryNorm
             3.22757 = fieldWeight in 7130, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.45514 = idf(docFreq=188, maxDocs=44218)
               0.5 = fieldNorm(doc=7130)
         1.917795 = weight(author_txt:lancaster in 7130) [ClassicSimilarity], result of:
           1.917795 = score(doc=7130,freq=1.0), product of:
             0.4861192 = queryWeight, product of:
               1.2223166 = boost
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.050404545 = queryNorm
             3.9451125 = fieldWeight in 7130, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.5 = fieldNorm(doc=7130)
       0.5 = coord(2/4)
   

2. Allen, F.R.; Smith, R.H.: ¬A survey of telephone enquiries : case study and operational impact in an academic library reference department (1993) 1.38

   1.3772812 = sum of:
     1.3772812 = product of:
       2.7545624 = sum of:
         1.0501493 = weight(author_txt:smith in 5030) [ClassicSimilarity], result of:
           1.0501493 = score(doc=5030,freq=1.0), product of:
             0.3253684 = queryWeight, product of:
               6.45514 = idf(docFreq=188, maxDocs=44218)
               0.050404545 = queryNorm
             3.22757 = fieldWeight in 5030, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.45514 = idf(docFreq=188, maxDocs=44218)
               0.5 = fieldNorm(doc=5030)
         1.7044129 = weight(author_txt:allen in 5030) [ClassicSimilarity], result of:
           1.7044129 = score(doc=5030,freq=1.0), product of:
             0.4493567 = queryWeight, product of:
               1.1751896 = boost
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.050404545 = queryNorm
             3.7930067 = fieldWeight in 5030, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.5 = fieldNorm(doc=5030)
       0.5 = coord(2/4)
   

3. Qin, J.; Lancaster, F.W.; Allen, B.: Types and levels of collaboration in interdisciplinary research in the sciences (1997) 1.36

   1.358328 = sum of:
     1.358328 = product of:
       2.716656 = sum of:
         1.2783097 = weight(author_txt:allen in 1593) [ClassicSimilarity], result of:
           1.2783097 = score(doc=1593,freq=1.0), product of:
             0.4493567 = queryWeight, product of:
               1.1751896 = boost
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.050404545 = queryNorm
             2.844755 = fieldWeight in 1593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.375 = fieldNorm(doc=1593)
         1.4383463 = weight(author_txt:lancaster in 1593) [ClassicSimilarity], result of:
           1.4383463 = score(doc=1593,freq=1.0), product of:
             0.4861192 = queryWeight, product of:
               1.2223166 = boost
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.050404545 = queryNorm
             2.9588344 = fieldWeight in 1593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.375 = fieldNorm(doc=1593)
       0.5 = coord(2/4)
   

4. Humphrey, S.M.: Use and management of classification systems for knowledge-based indexing (1992) 0.98

   0.9810512 = sum of:
     0.9810512 = product of:
       3.9242048 = sum of:
         3.9242048 = weight(author_txt:humphrey in 2094) [ClassicSimilarity], result of:
           3.9242048 = score(doc=2094,freq=1.0), product of:
             0.6752052 = queryWeight, product of:
               1.4405562 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.050404545 = queryNorm
             5.81187 = fieldWeight in 2094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=2094)
       0.25 = coord(1/4)
   

5. Humphrey, S.M.: Indexing biomedical documents : from thesaural to knowledge-based retrieval systems (1992) 0.98

   0.9810512 = sum of:
     0.9810512 = product of:
       3.9242048 = sum of:
         3.9242048 = weight(author_txt:humphrey in 7641) [ClassicSimilarity], result of:
           3.9242048 = score(doc=7641,freq=1.0), product of:
             0.6752052 = queryWeight, product of:
               1.4405562 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.050404545 = queryNorm
             5.81187 = fieldWeight in 7641, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=7641)
       0.25 = coord(1/4)
   

Similar documents (content)

1. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.28

   0.27783614 = sum of:
     0.27783614 = product of:
       0.63144577 = sum of:
         0.030664062 = weight(abstract_txt:levels in 2019) [ClassicSimilarity], result of:
           0.030664062 = score(doc=2019,freq=1.0), product of:
             0.12532133 = queryWeight, product of:
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.02400831 = queryNorm
             0.2446835 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.045912255 = weight(abstract_txt:appropriate in 2019) [ClassicSimilarity], result of:
           0.045912255 = score(doc=2019,freq=2.0), product of:
             0.130181 = queryWeight, product of:
               1.0192044 = boost
               5.3201604 = idf(docFreq=587, maxDocs=44218)
               0.02400831 = queryNorm
             0.35268015 = fieldWeight in 2019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3201604 = idf(docFreq=587, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.06400546 = weight(abstract_txt:interactive in 2019) [ClassicSimilarity], result of:
           0.06400546 = score(doc=2019,freq=3.0), product of:
             0.14191973 = queryWeight, product of:
               1.0641648 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.02400831 = queryNorm
             0.4509976 = fieldWeight in 2019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.052813802 = weight(abstract_txt:criteria in 2019) [ClassicSimilarity], result of:
           0.052813802 = score(doc=2019,freq=2.0), product of:
             0.14292017 = queryWeight, product of:
               1.067909 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.02400831 = queryNorm
             0.3695336 = fieldWeight in 2019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.023386559 = weight(abstract_txt:system in 2019) [ClassicSimilarity], result of:
           0.023386559 = score(doc=2019,freq=2.0), product of:
             0.1046123 = queryWeight, product of:
               1.2920933 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.02400831 = queryNorm
             0.22355458 = fieldWeight in 2019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.018210156 = weight(abstract_txt:results in 2019) [ClassicSimilarity], result of:
           0.018210156 = score(doc=2019,freq=1.0), product of:
             0.111555494 = queryWeight, product of:
               1.3342831 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.02400831 = queryNorm
             0.16323854 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.044957258 = weight(abstract_txt:presented in 2019) [ClassicSimilarity], result of:
           0.044957258 = score(doc=2019,freq=1.0), product of:
             0.20377383 = queryWeight, product of:
               1.8033361 = boost
               4.7066307 = idf(docFreq=1085, maxDocs=44218)
               0.02400831 = queryNorm
             0.22062331 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7066307 = idf(docFreq=1085, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.020954926 = weight(abstract_txt:based in 2019) [ClassicSimilarity], result of:
           0.020954926 = score(doc=2019,freq=1.0), product of:
             0.14022852 = queryWeight, product of:
               1.8321723 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.02400831 = queryNorm
             0.14943412 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.06796578 = weight(abstract_txt:systems in 2019) [ClassicSimilarity], result of:
           0.06796578 = score(doc=2019,freq=7.0), product of:
             0.16062254 = queryWeight, product of:
               1.9608816 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.02400831 = queryNorm
             0.42313975 = fieldWeight in 2019, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.02900473 = weight(abstract_txt:knowledge in 2019) [ClassicSimilarity], result of:
           0.02900473 = score(doc=2019,freq=1.0), product of:
             0.17416391 = queryWeight, product of:
               2.0418658 = boost
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.02400831 = queryNorm
             0.16653697 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.23357075 = weight(abstract_txt:evaluation in 2019) [ClassicSimilarity], result of:
           0.23357075 = score(doc=2019,freq=9.0), product of:
             0.3702457 = queryWeight, product of:
               3.4376566 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.02400831 = queryNorm
             0.6308534 = fieldWeight in 2019, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
       0.44 = coord(11/25)
   

2. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.22

   0.21605997 = sum of:
     0.21605997 = product of:
       0.60016656 = sum of:
         0.070331454 = weight(abstract_txt:testing in 3700) [ClassicSimilarity], result of:
           0.070331454 = score(doc=3700,freq=1.0), product of:
             0.17991987 = queryWeight, product of:
               1.1981938 = boost
               6.2544694 = idf(docFreq=230, maxDocs=44218)
               0.02400831 = queryNorm
             0.39090434 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2544694 = idf(docFreq=230, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.022049058 = weight(abstract_txt:system in 3700) [ClassicSimilarity], result of:
           0.022049058 = score(doc=3700,freq=1.0), product of:
             0.1046123 = queryWeight, product of:
               1.2920933 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.02400831 = queryNorm
             0.21076928 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.024280207 = weight(abstract_txt:results in 3700) [ClassicSimilarity], result of:
           0.024280207 = score(doc=3700,freq=1.0), product of:
             0.111555494 = queryWeight, product of:
               1.3342831 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.02400831 = queryNorm
             0.21765138 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.034651566 = weight(abstract_txt:design in 3700) [ClassicSimilarity], result of:
           0.034651566 = score(doc=3700,freq=1.0), product of:
             0.14140712 = queryWeight, product of:
               1.5022359 = boost
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.02400831 = queryNorm
             0.24504824 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.0279399 = weight(abstract_txt:based in 3700) [ClassicSimilarity], result of:
           0.0279399 = score(doc=3700,freq=1.0), product of:
             0.14022852 = queryWeight, product of:
               1.8321723 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.02400831 = queryNorm
             0.19924548 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.059325397 = weight(abstract_txt:systems in 3700) [ClassicSimilarity], result of:
           0.059325397 = score(doc=3700,freq=3.0), product of:
             0.16062254 = queryWeight, product of:
               1.9608816 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.02400831 = queryNorm
             0.36934665 = fieldWeight in 3700, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.038672972 = weight(abstract_txt:knowledge in 3700) [ClassicSimilarity], result of:
           0.038672972 = score(doc=3700,freq=1.0), product of:
             0.17416391 = queryWeight, product of:
               2.0418658 = boost
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.02400831 = queryNorm
             0.2220493 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.115297556 = weight(abstract_txt:procedures in 3700) [ClassicSimilarity], result of:
           0.115297556 = score(doc=3700,freq=1.0), product of:
             0.31516364 = queryWeight, product of:
               2.2426968 = boost
               5.853343 = idf(docFreq=344, maxDocs=44218)
               0.02400831 = queryNorm
             0.36583394 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.853343 = idf(docFreq=344, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.20761846 = weight(abstract_txt:evaluation in 3700) [ClassicSimilarity], result of:
           0.20761846 = score(doc=3700,freq=4.0), product of:
             0.3702457 = queryWeight, product of:
               3.4376566 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.02400831 = queryNorm
             0.5607586 = fieldWeight in 3700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
       0.36 = coord(9/25)
   

3. Oliver, R.: ¬An investigation of skills transfer between hypermedia systems (1995) 0.18

   0.18431401 = sum of:
     0.18431401 = product of:
       0.5759813 = sum of:
         0.08673107 = weight(abstract_txt:levels in 4718) [ClassicSimilarity], result of:
           0.08673107 = score(doc=4718,freq=2.0), product of:
             0.12532133 = queryWeight, product of:
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.02400831 = queryNorm
             0.6920695 = fieldWeight in 4718, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.09375 = fieldNorm(doc=4718)
         0.09344153 = weight(abstract_txt:achieved in 4718) [ClassicSimilarity], result of:
           0.09344153 = score(doc=4718,freq=1.0), product of:
             0.16593774 = queryWeight, product of:
               1.1506946 = boost
               6.006528 = idf(docFreq=295, maxDocs=44218)
               0.02400831 = queryNorm
             0.563112 = fieldWeight in 4718, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.006528 = idf(docFreq=295, maxDocs=44218)
               0.09375 = fieldNorm(doc=4718)
         0.10549719 = weight(abstract_txt:testing in 4718) [ClassicSimilarity], result of:
           0.10549719 = score(doc=4718,freq=1.0), product of:
             0.17991987 = queryWeight, product of:
               1.1981938 = boost
               6.2544694 = idf(docFreq=230, maxDocs=44218)
               0.02400831 = queryNorm
             0.5863565 = fieldWeight in 4718, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2544694 = idf(docFreq=230, maxDocs=44218)
               0.09375 = fieldNorm(doc=4718)
         0.057285137 = weight(abstract_txt:system in 4718) [ClassicSimilarity], result of:
           0.057285137 = score(doc=4718,freq=3.0), product of:
             0.1046123 = queryWeight, product of:
               1.2920933 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.02400831 = queryNorm
             0.54759467 = fieldWeight in 4718, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.09375 = fieldNorm(doc=4718)
         0.03642031 = weight(abstract_txt:results in 4718) [ClassicSimilarity], result of:
           0.03642031 = score(doc=4718,freq=1.0), product of:
             0.111555494 = queryWeight, product of:
               1.3342831 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.02400831 = queryNorm
             0.32647708 = fieldWeight in 4718, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.09375 = fieldNorm(doc=4718)
         0.04190985 = weight(abstract_txt:based in 4718) [ClassicSimilarity], result of:
           0.04190985 = score(doc=4718,freq=1.0), product of:
             0.14022852 = queryWeight, product of:
               1.8321723 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.02400831 = queryNorm
             0.29886824 = fieldWeight in 4718, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.09375 = fieldNorm(doc=4718)
         0.07265848 = weight(abstract_txt:systems in 4718) [ClassicSimilarity], result of:
           0.07265848 = score(doc=4718,freq=2.0), product of:
             0.16062254 = queryWeight, product of:
               1.9608816 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.02400831 = queryNorm
             0.45235544 = fieldWeight in 4718, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.09375 = fieldNorm(doc=4718)
         0.08203776 = weight(abstract_txt:knowledge in 4718) [ClassicSimilarity], result of:
           0.08203776 = score(doc=4718,freq=2.0), product of:
             0.17416391 = queryWeight, product of:
               2.0418658 = boost
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.02400831 = queryNorm
             0.4710377 = fieldWeight in 4718, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.09375 = fieldNorm(doc=4718)
       0.32 = coord(8/25)
   

4. Zhang, X.; Han, H.: ¬An empirical testing of user stereotypes of information retrieval systems (2005) 0.18

   0.17929536 = sum of:
     0.17929536 = product of:
       0.49804264 = sum of:
         0.070331454 = weight(abstract_txt:testing in 1031) [ClassicSimilarity], result of:
           0.070331454 = score(doc=1031,freq=1.0), product of:
             0.17991987 = queryWeight, product of:
               1.1981938 = boost
               6.2544694 = idf(docFreq=230, maxDocs=44218)
               0.02400831 = queryNorm
             0.39090434 = fieldWeight in 1031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2544694 = idf(docFreq=230, maxDocs=44218)
               0.0625 = fieldNorm(doc=1031)
         0.022049058 = weight(abstract_txt:system in 1031) [ClassicSimilarity], result of:
           0.022049058 = score(doc=1031,freq=1.0), product of:
             0.1046123 = queryWeight, product of:
               1.2920933 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.02400831 = queryNorm
             0.21076928 = fieldWeight in 1031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=1031)
         0.034337398 = weight(abstract_txt:results in 1031) [ClassicSimilarity], result of:
           0.034337398 = score(doc=1031,freq=2.0), product of:
             0.111555494 = queryWeight, product of:
               1.3342831 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.02400831 = queryNorm
             0.30780554 = fieldWeight in 1031, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=1031)
         0.034651566 = weight(abstract_txt:design in 1031) [ClassicSimilarity], result of:
           0.034651566 = score(doc=1031,freq=1.0), product of:
             0.14140712 = queryWeight, product of:
               1.5022359 = boost
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.02400831 = queryNorm
             0.24504824 = fieldWeight in 1031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.0625 = fieldNorm(doc=1031)
         0.048393324 = weight(abstract_txt:based in 1031) [ClassicSimilarity], result of:
           0.048393324 = score(doc=1031,freq=3.0), product of:
             0.14022852 = queryWeight, product of:
               1.8321723 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.02400831 = queryNorm
             0.3451033 = fieldWeight in 1031, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=1031)
         0.048438985 = weight(abstract_txt:systems in 1031) [ClassicSimilarity], result of:
           0.048438985 = score(doc=1031,freq=2.0), product of:
             0.16062254 = queryWeight, product of:
               1.9608816 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.02400831 = queryNorm
             0.3015703 = fieldWeight in 1031, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=1031)
         0.08133977 = weight(abstract_txt:empirical in 1031) [ClassicSimilarity], result of:
           0.08133977 = score(doc=1031,freq=1.0), product of:
             0.24976103 = queryWeight, product of:
               1.9964794 = boost
               5.2107263 = idf(docFreq=655, maxDocs=44218)
               0.02400831 = queryNorm
             0.3256704 = fieldWeight in 1031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2107263 = idf(docFreq=655, maxDocs=44218)
               0.0625 = fieldNorm(doc=1031)
         0.054691844 = weight(abstract_txt:knowledge in 1031) [ClassicSimilarity], result of:
           0.054691844 = score(doc=1031,freq=2.0), product of:
             0.17416391 = queryWeight, product of:
               2.0418658 = boost
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.02400831 = queryNorm
             0.31402513 = fieldWeight in 1031, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.0625 = fieldNorm(doc=1031)
         0.10380923 = weight(abstract_txt:evaluation in 1031) [ClassicSimilarity], result of:
           0.10380923 = score(doc=1031,freq=1.0), product of:
             0.3702457 = queryWeight, product of:
               3.4376566 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.02400831 = queryNorm
             0.2803793 = fieldWeight in 1031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=1031)
       0.36 = coord(9/25)
   

5. Bosch, V.M.; Hancock-Beaulieu, M.: CD-ROM user interface evaluation : the appropriateness of GUIs (1995) 0.18

   0.17870148 = sum of:
     0.17870148 = product of:
       0.5584421 = sum of:
         0.051106773 = weight(abstract_txt:levels in 2734) [ClassicSimilarity], result of:
           0.051106773 = score(doc=2734,freq=1.0), product of:
             0.12532133 = queryWeight, product of:
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.02400831 = queryNorm
             0.40780586 = fieldWeight in 2734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.078125 = fieldNorm(doc=2734)
         0.05410811 = weight(abstract_txt:appropriate in 2734) [ClassicSimilarity], result of:
           0.05410811 = score(doc=2734,freq=1.0), product of:
             0.130181 = queryWeight, product of:
               1.0192044 = boost
               5.3201604 = idf(docFreq=587, maxDocs=44218)
               0.02400831 = queryNorm
             0.41563752 = fieldWeight in 2734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3201604 = idf(docFreq=587, maxDocs=44218)
               0.078125 = fieldNorm(doc=2734)
         0.06224167 = weight(abstract_txt:criteria in 2734) [ClassicSimilarity], result of:
           0.06224167 = score(doc=2734,freq=1.0), product of:
             0.14292017 = queryWeight, product of:
               1.067909 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.02400831 = queryNorm
             0.43549955 = fieldWeight in 2734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.078125 = fieldNorm(doc=2734)
         0.06717705 = weight(abstract_txt:expert in 2734) [ClassicSimilarity], result of:
           0.06717705 = score(doc=2734,freq=1.0), product of:
             0.15037881 = queryWeight, product of:
               1.0954204 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.02400831 = queryNorm
             0.44671887 = fieldWeight in 2734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.078125 = fieldNorm(doc=2734)
         0.03035026 = weight(abstract_txt:results in 2734) [ClassicSimilarity], result of:
           0.03035026 = score(doc=2734,freq=1.0), product of:
             0.111555494 = queryWeight, product of:
               1.3342831 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.02400831 = queryNorm
             0.27206424 = fieldWeight in 2734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=2734)
         0.07502284 = weight(abstract_txt:design in 2734) [ClassicSimilarity], result of:
           0.07502284 = score(doc=2734,freq=3.0), product of:
             0.14140712 = queryWeight, product of:
               1.5022359 = boost
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.02400831 = queryNorm
             0.530545 = fieldWeight in 2734, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.078125 = fieldNorm(doc=2734)
         0.034924876 = weight(abstract_txt:based in 2734) [ClassicSimilarity], result of:
           0.034924876 = score(doc=2734,freq=1.0), product of:
             0.14022852 = queryWeight, product of:
               1.8321723 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.02400831 = queryNorm
             0.24905685 = fieldWeight in 2734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.078125 = fieldNorm(doc=2734)
         0.18351053 = weight(abstract_txt:evaluation in 2734) [ClassicSimilarity], result of:
           0.18351053 = score(doc=2734,freq=2.0), product of:
             0.3702457 = queryWeight, product of:
               3.4376566 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.02400831 = queryNorm
             0.49564525 = fieldWeight in 2734, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2734)
       0.32 = coord(8/25)