Document (#12067)

Author

Lancaster, F.W.
Ulvila, J.W.
Humphrey, S.M.
Smith, L.C.
Allen, B.
Herner, S.

Title

Evaluation of interactive knowledge-based systems : overview and design for empirical testing

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.57-69

Year

1996

Abstract

An overview of levels and approaches in the evalution of knowledge-based systems is presented. There is a need for empirical studies using objective criteria in advance of completing the technical evaluation of such systems. A methodology for this type of evaluation developed for a particular knowledge-based indexing system is presented. It is suggested that the proposed study may serve as a model for the design of any evaluation in which the results of existing intellectual procedures are compared with results achieved when these procedures are aided by use of an appropriate expert system

Similar documents (author)

1. Lancaster, F.W.; Smith, L.C.: Compatibility issues affecting information systems and services (1983) 1.48

   1.4841931 = sum of:
     1.4841931 = product of:
       2.9683862 = sum of:
         1.0579096 = weight(author_txt:smith in 7127) [ClassicSimilarity], result of:
           1.0579096 = score(doc=7127,freq=1.0), product of:
             0.32717842 = queryWeight, product of:
               6.466867 = idf(docFreq=183, maxDocs=43556)
               0.050593033 = queryNorm
             3.2334335 = fieldWeight in 7127, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.466867 = idf(docFreq=183, maxDocs=43556)
               0.5 = fieldNorm(doc=7127)
         1.9104764 = weight(author_txt:lancaster in 7127) [ClassicSimilarity], result of:
           1.9104764 = score(doc=7127,freq=1.0), product of:
             0.48519173 = queryWeight, product of:
               1.2177675 = boost
               7.87514 = idf(docFreq=44, maxDocs=43556)
               0.050593033 = queryNorm
             3.93757 = fieldWeight in 7127, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.87514 = idf(docFreq=44, maxDocs=43556)
               0.5 = fieldNorm(doc=7127)
       0.5 = coord(2/4)
   

2. Allen, F.R.; Smith, R.H.: ¬A survey of telephone enquiries : case study and operational impact in an academic library reference department (1993) 1.38

   1.3832849 = sum of:
     1.3832849 = product of:
       2.7665699 = sum of:
         1.0579096 = weight(author_txt:smith in 5027) [ClassicSimilarity], result of:
           1.0579096 = score(doc=5027,freq=1.0), product of:
             0.32717842 = queryWeight, product of:
               6.466867 = idf(docFreq=183, maxDocs=43556)
               0.050593033 = queryNorm
             3.2334335 = fieldWeight in 5027, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.466867 = idf(docFreq=183, maxDocs=43556)
               0.5 = fieldNorm(doc=5027)
         1.7086602 = weight(author_txt:allen in 5027) [ClassicSimilarity], result of:
           1.7086602 = score(doc=5027,freq=1.0), product of:
             0.4503907 = queryWeight, product of:
               1.1732819 = boost
               7.587458 = idf(docFreq=59, maxDocs=43556)
               0.050593033 = queryNorm
             3.793729 = fieldWeight in 5027, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.587458 = idf(docFreq=59, maxDocs=43556)
               0.5 = fieldNorm(doc=5027)
       0.5 = coord(2/4)
   

3. Qin, J.; Lancaster, F.W.; Allen, B.: Types and levels of collaboration in interdisciplinary research in the sciences (1997) 1.36

   1.3571763 = sum of:
     1.3571763 = product of:
       2.7143526 = sum of:
         1.2814952 = weight(author_txt:allen in 2591) [ClassicSimilarity], result of:
           1.2814952 = score(doc=2591,freq=1.0), product of:
             0.4503907 = queryWeight, product of:
               1.1732819 = boost
               7.587458 = idf(docFreq=59, maxDocs=43556)
               0.050593033 = queryNorm
             2.8452969 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.587458 = idf(docFreq=59, maxDocs=43556)
               0.375 = fieldNorm(doc=2591)
         1.4328573 = weight(author_txt:lancaster in 2591) [ClassicSimilarity], result of:
           1.4328573 = score(doc=2591,freq=1.0), product of:
             0.48519173 = queryWeight, product of:
               1.2177675 = boost
               7.87514 = idf(docFreq=44, maxDocs=43556)
               0.050593033 = queryNorm
             2.9531775 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.87514 = idf(docFreq=44, maxDocs=43556)
               0.375 = fieldNorm(doc=2591)
       0.5 = coord(2/4)
   

4. Humphrey, S.M.: Use and management of classification systems for knowledge-based indexing (1992) 0.98

   0.9781586 = sum of:
     0.9781586 = product of:
       3.9126344 = sum of:
         3.9126344 = weight(author_txt:humphrey in 2094) [ClassicSimilarity], result of:
           3.9126344 = score(doc=2094,freq=1.0), product of:
             0.6743082 = queryWeight, product of:
               1.4356114 = boost
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.050593033 = queryNorm
             5.8024426 = fieldWeight in 2094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.625 = fieldNorm(doc=2094)
       0.25 = coord(1/4)
   

5. Humphrey, S.M.: Indexing biomedical documents : from thesaural to knowledge-based retrieval systems (1992) 0.98

   0.9781586 = sum of:
     0.9781586 = product of:
       3.9126344 = sum of:
         3.9126344 = weight(author_txt:humphrey in 7638) [ClassicSimilarity], result of:
           3.9126344 = score(doc=7638,freq=1.0), product of:
             0.6743082 = queryWeight, product of:
               1.4356114 = boost
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.050593033 = queryNorm
             5.8024426 = fieldWeight in 7638, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.625 = fieldNorm(doc=7638)
       0.25 = coord(1/4)
   

Similar documents (content)

1. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.28

   0.27816403 = sum of:
     0.27816403 = product of:
       0.632191 = sum of:
         0.030703139 = weight(abstract_txt:levels in 4017) [ClassicSimilarity], result of:
           0.030703139 = score(doc=4017,freq=1.0), product of:
             0.12528272 = queryWeight, product of:
               5.2281775 = idf(docFreq=634, maxDocs=43556)
               0.023962982 = queryNorm
             0.24507082 = fieldWeight in 4017, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2281775 = idf(docFreq=634, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.045851253 = weight(abstract_txt:appropriate in 4017) [ClassicSimilarity], result of:
           0.045851253 = score(doc=4017,freq=2.0), product of:
             0.12991525 = queryWeight, product of:
               1.0183204 = boost
               5.3239603 = idf(docFreq=576, maxDocs=43556)
               0.023962982 = queryNorm
             0.35293204 = fieldWeight in 4017, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3239603 = idf(docFreq=576, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.063786544 = weight(abstract_txt:interactive in 4017) [ClassicSimilarity], result of:
           0.063786544 = score(doc=4017,freq=3.0), product of:
             0.1414322 = queryWeight, product of:
               1.062499 = boost
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.023962982 = queryNorm
             0.4510044 = fieldWeight in 4017, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.05289561 = weight(abstract_txt:criteria in 4017) [ClassicSimilarity], result of:
           0.05289561 = score(doc=4017,freq=2.0), product of:
             0.14290226 = queryWeight, product of:
               1.0680066 = boost
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.023962982 = queryNorm
             0.37015238 = fieldWeight in 4017, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.023179848 = weight(abstract_txt:system in 4017) [ClassicSimilarity], result of:
           0.023179848 = score(doc=4017,freq=2.0), product of:
             0.10387468 = queryWeight, product of:
               1.2877283 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.023962982 = queryNorm
             0.22315204 = fieldWeight in 4017, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.018358491 = weight(abstract_txt:results in 4017) [ClassicSimilarity], result of:
           0.018358491 = score(doc=4017,freq=1.0), product of:
             0.112030774 = queryWeight, product of:
               1.3373284 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.023962982 = queryNorm
             0.16387008 = fieldWeight in 4017, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.044955317 = weight(abstract_txt:presented in 4017) [ClassicSimilarity], result of:
           0.044955317 = score(doc=4017,freq=1.0), product of:
             0.20353231 = queryWeight, product of:
               1.8025448 = boost
               4.7120123 = idf(docFreq=1063, maxDocs=43556)
               0.023962982 = queryNorm
             0.22087558 = fieldWeight in 4017, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7120123 = idf(docFreq=1063, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.021116925 = weight(abstract_txt:based in 4017) [ClassicSimilarity], result of:
           0.021116925 = score(doc=4017,freq=1.0), product of:
             0.14078732 = queryWeight, product of:
               1.836102 = boost
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.023962982 = queryNorm
             0.14999168 = fieldWeight in 4017, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.06795441 = weight(abstract_txt:systems in 4017) [ClassicSimilarity], result of:
           0.06795441 = score(doc=4017,freq=7.0), product of:
             0.1604189 = queryWeight, product of:
               1.9599401 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.023962982 = queryNorm
             0.42360604 = fieldWeight in 4017, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.02948669 = weight(abstract_txt:knowledge in 4017) [ClassicSimilarity], result of:
           0.02948669 = score(doc=4017,freq=1.0), product of:
             0.1758843 = queryWeight, product of:
               2.052242 = boost
               3.5764952 = idf(docFreq=3311, maxDocs=43556)
               0.023962982 = queryNorm
             0.16764821 = fieldWeight in 4017, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5764952 = idf(docFreq=3311, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
         0.2339028 = weight(abstract_txt:evaluation in 4017) [ClassicSimilarity], result of:
           0.2339028 = score(doc=4017,freq=9.0), product of:
             0.3701679 = queryWeight, product of:
               3.4378252 = boost
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.023962982 = queryNorm
             0.63188297 = fieldWeight in 4017, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.046875 = fieldNorm(doc=4017)
       0.44 = coord(11/25)
   

2. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.22

   0.21629639 = sum of:
     0.21629639 = product of:
       0.6008233 = sum of:
         0.0700201 = weight(abstract_txt:testing in 698) [ClassicSimilarity], result of:
           0.0700201 = score(doc=698,freq=1.0), product of:
             0.17918101 = queryWeight, product of:
               1.1959152 = boost
               6.252457 = idf(docFreq=227, maxDocs=43556)
               0.023962982 = queryNorm
             0.39077857 = fieldWeight in 698, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.252457 = idf(docFreq=227, maxDocs=43556)
               0.0625 = fieldNorm(doc=698)
         0.02185417 = weight(abstract_txt:system in 698) [ClassicSimilarity], result of:
           0.02185417 = score(doc=698,freq=1.0), product of:
             0.10387468 = queryWeight, product of:
               1.2877283 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.023962982 = queryNorm
             0.21038976 = fieldWeight in 698, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.0625 = fieldNorm(doc=698)
         0.02447799 = weight(abstract_txt:results in 698) [ClassicSimilarity], result of:
           0.02447799 = score(doc=698,freq=1.0), product of:
             0.112030774 = queryWeight, product of:
               1.3373284 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.023962982 = queryNorm
             0.21849345 = fieldWeight in 698, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=698)
         0.034727573 = weight(abstract_txt:design in 698) [ClassicSimilarity], result of:
           0.034727573 = score(doc=698,freq=1.0), product of:
             0.14145006 = queryWeight, product of:
               1.5026954 = boost
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.023962982 = queryNorm
             0.2455112 = fieldWeight in 698, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.0625 = fieldNorm(doc=698)
         0.0281559 = weight(abstract_txt:based in 698) [ClassicSimilarity], result of:
           0.0281559 = score(doc=698,freq=1.0), product of:
             0.14078732 = queryWeight, product of:
               1.836102 = boost
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.023962982 = queryNorm
             0.1999889 = fieldWeight in 698, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.0625 = fieldNorm(doc=698)
         0.05931548 = weight(abstract_txt:systems in 698) [ClassicSimilarity], result of:
           0.05931548 = score(doc=698,freq=3.0), product of:
             0.1604189 = queryWeight, product of:
               1.9599401 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.023962982 = queryNorm
             0.3697537 = fieldWeight in 698, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.0625 = fieldNorm(doc=698)
         0.039315585 = weight(abstract_txt:knowledge in 698) [ClassicSimilarity], result of:
           0.039315585 = score(doc=698,freq=1.0), product of:
             0.1758843 = queryWeight, product of:
               2.052242 = boost
               3.5764952 = idf(docFreq=3311, maxDocs=43556)
               0.023962982 = queryNorm
             0.22353095 = fieldWeight in 698, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5764952 = idf(docFreq=3311, maxDocs=43556)
               0.0625 = fieldNorm(doc=698)
         0.1150429 = weight(abstract_txt:procedures in 698) [ClassicSimilarity], result of:
           0.1150429 = score(doc=698,freq=1.0), product of:
             0.31433547 = queryWeight, product of:
               2.2400932 = boost
               5.8558025 = idf(docFreq=338, maxDocs=43556)
               0.023962982 = queryNorm
             0.36598766 = fieldWeight in 698, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8558025 = idf(docFreq=338, maxDocs=43556)
               0.0625 = fieldNorm(doc=698)
         0.2079136 = weight(abstract_txt:evaluation in 698) [ClassicSimilarity], result of:
           0.2079136 = score(doc=698,freq=4.0), product of:
             0.3701679 = queryWeight, product of:
               3.4378252 = boost
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.023962982 = queryNorm
             0.56167376 = fieldWeight in 698, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.0625 = fieldNorm(doc=698)
       0.36 = coord(9/25)
   

3. Oliver, R.: ¬An investigation of skills transfer between hypermedia systems (1995) 0.18

   0.18459429 = sum of:
     0.18459429 = product of:
       0.57685715 = sum of:
         0.08684159 = weight(abstract_txt:levels in 4784) [ClassicSimilarity], result of:
           0.08684159 = score(doc=4784,freq=2.0), product of:
             0.12528272 = queryWeight, product of:
               5.2281775 = idf(docFreq=634, maxDocs=43556)
               0.023962982 = queryNorm
             0.69316494 = fieldWeight in 4784, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2281775 = idf(docFreq=634, maxDocs=43556)
               0.09375 = fieldNorm(doc=4784)
         0.09320851 = weight(abstract_txt:achieved in 4784) [ClassicSimilarity], result of:
           0.09320851 = score(doc=4784,freq=1.0), product of:
             0.16547017 = queryWeight, product of:
               1.1492493 = boost
               6.0084796 = idf(docFreq=290, maxDocs=43556)
               0.023962982 = queryNorm
             0.56329495 = fieldWeight in 4784, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0084796 = idf(docFreq=290, maxDocs=43556)
               0.09375 = fieldNorm(doc=4784)
         0.10503015 = weight(abstract_txt:testing in 4784) [ClassicSimilarity], result of:
           0.10503015 = score(doc=4784,freq=1.0), product of:
             0.17918101 = queryWeight, product of:
               1.1959152 = boost
               6.252457 = idf(docFreq=227, maxDocs=43556)
               0.023962982 = queryNorm
             0.5861679 = fieldWeight in 4784, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.252457 = idf(docFreq=227, maxDocs=43556)
               0.09375 = fieldNorm(doc=4784)
         0.0567788 = weight(abstract_txt:system in 4784) [ClassicSimilarity], result of:
           0.0567788 = score(doc=4784,freq=3.0), product of:
             0.10387468 = queryWeight, product of:
               1.2877283 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.023962982 = queryNorm
             0.5466086 = fieldWeight in 4784, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.09375 = fieldNorm(doc=4784)
         0.036716983 = weight(abstract_txt:results in 4784) [ClassicSimilarity], result of:
           0.036716983 = score(doc=4784,freq=1.0), product of:
             0.112030774 = queryWeight, product of:
               1.3373284 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.023962982 = queryNorm
             0.32774016 = fieldWeight in 4784, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.09375 = fieldNorm(doc=4784)
         0.04223385 = weight(abstract_txt:based in 4784) [ClassicSimilarity], result of:
           0.04223385 = score(doc=4784,freq=1.0), product of:
             0.14078732 = queryWeight, product of:
               1.836102 = boost
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.023962982 = queryNorm
             0.29998335 = fieldWeight in 4784, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.09375 = fieldNorm(doc=4784)
         0.07264633 = weight(abstract_txt:systems in 4784) [ClassicSimilarity], result of:
           0.07264633 = score(doc=4784,freq=2.0), product of:
             0.1604189 = queryWeight, product of:
               1.9599401 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.023962982 = queryNorm
             0.45285392 = fieldWeight in 4784, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.09375 = fieldNorm(doc=4784)
         0.08340096 = weight(abstract_txt:knowledge in 4784) [ClassicSimilarity], result of:
           0.08340096 = score(doc=4784,freq=2.0), product of:
             0.1758843 = queryWeight, product of:
               2.052242 = boost
               3.5764952 = idf(docFreq=3311, maxDocs=43556)
               0.023962982 = queryNorm
             0.47418076 = fieldWeight in 4784, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5764952 = idf(docFreq=3311, maxDocs=43556)
               0.09375 = fieldNorm(doc=4784)
       0.32 = coord(8/25)
   

4. Zhang, X.; Han, H.: ¬An empirical testing of user stereotypes of information retrieval systems (2005) 0.18

   0.18007983 = sum of:
     0.18007983 = product of:
       0.5002217 = sum of:
         0.0700201 = weight(abstract_txt:testing in 3029) [ClassicSimilarity], result of:
           0.0700201 = score(doc=3029,freq=1.0), product of:
             0.17918101 = queryWeight, product of:
               1.1959152 = boost
               6.252457 = idf(docFreq=227, maxDocs=43556)
               0.023962982 = queryNorm
             0.39077857 = fieldWeight in 3029, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.252457 = idf(docFreq=227, maxDocs=43556)
               0.0625 = fieldNorm(doc=3029)
         0.02185417 = weight(abstract_txt:system in 3029) [ClassicSimilarity], result of:
           0.02185417 = score(doc=3029,freq=1.0), product of:
             0.10387468 = queryWeight, product of:
               1.2877283 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.023962982 = queryNorm
             0.21038976 = fieldWeight in 3029, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.0625 = fieldNorm(doc=3029)
         0.034617104 = weight(abstract_txt:results in 3029) [ClassicSimilarity], result of:
           0.034617104 = score(doc=3029,freq=2.0), product of:
             0.112030774 = queryWeight, product of:
               1.3373284 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.023962982 = queryNorm
             0.30899638 = fieldWeight in 3029, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=3029)
         0.034727573 = weight(abstract_txt:design in 3029) [ClassicSimilarity], result of:
           0.034727573 = score(doc=3029,freq=1.0), product of:
             0.14145006 = queryWeight, product of:
               1.5026954 = boost
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.023962982 = queryNorm
             0.2455112 = fieldWeight in 3029, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.0625 = fieldNorm(doc=3029)
         0.04876745 = weight(abstract_txt:based in 3029) [ClassicSimilarity], result of:
           0.04876745 = score(doc=3029,freq=3.0), product of:
             0.14078732 = queryWeight, product of:
               1.836102 = boost
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.023962982 = queryNorm
             0.34639093 = fieldWeight in 3029, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.0625 = fieldNorm(doc=3029)
         0.048430886 = weight(abstract_txt:systems in 3029) [ClassicSimilarity], result of:
           0.048430886 = score(doc=3029,freq=2.0), product of:
             0.1604189 = queryWeight, product of:
               1.9599401 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.023962982 = queryNorm
             0.30190262 = fieldWeight in 3029, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.0625 = fieldNorm(doc=3029)
         0.08224701 = weight(abstract_txt:empirical in 3029) [ClassicSimilarity], result of:
           0.08224701 = score(doc=3029,freq=1.0), product of:
             0.2513238 = queryWeight, product of:
               2.003024 = boost
               5.236083 = idf(docFreq=629, maxDocs=43556)
               0.023962982 = queryNorm
             0.3272552 = fieldWeight in 3029, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.236083 = idf(docFreq=629, maxDocs=43556)
               0.0625 = fieldNorm(doc=3029)
         0.055600636 = weight(abstract_txt:knowledge in 3029) [ClassicSimilarity], result of:
           0.055600636 = score(doc=3029,freq=2.0), product of:
             0.1758843 = queryWeight, product of:
               2.052242 = boost
               3.5764952 = idf(docFreq=3311, maxDocs=43556)
               0.023962982 = queryNorm
             0.3161205 = fieldWeight in 3029, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5764952 = idf(docFreq=3311, maxDocs=43556)
               0.0625 = fieldNorm(doc=3029)
         0.1039568 = weight(abstract_txt:evaluation in 3029) [ClassicSimilarity], result of:
           0.1039568 = score(doc=3029,freq=1.0), product of:
             0.3701679 = queryWeight, product of:
               3.4378252 = boost
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.023962982 = queryNorm
             0.28083688 = fieldWeight in 3029, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.0625 = fieldNorm(doc=3029)
       0.36 = coord(9/25)
   

5. Bosch, V.M.; Hancock-Beaulieu, M.: CD-ROM user interface evaluation : the appropriateness of GUIs (1995) 0.18

   0.17916457 = sum of:
     0.17916457 = product of:
       0.5598893 = sum of:
         0.0511719 = weight(abstract_txt:levels in 3732) [ClassicSimilarity], result of:
           0.0511719 = score(doc=3732,freq=1.0), product of:
             0.12528272 = queryWeight, product of:
               5.2281775 = idf(docFreq=634, maxDocs=43556)
               0.023962982 = queryNorm
             0.40845138 = fieldWeight in 3732, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2281775 = idf(docFreq=634, maxDocs=43556)
               0.078125 = fieldNorm(doc=3732)
         0.05403622 = weight(abstract_txt:appropriate in 3732) [ClassicSimilarity], result of:
           0.05403622 = score(doc=3732,freq=1.0), product of:
             0.12991525 = queryWeight, product of:
               1.0183204 = boost
               5.3239603 = idf(docFreq=576, maxDocs=43556)
               0.023962982 = queryNorm
             0.41593438 = fieldWeight in 3732, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3239603 = idf(docFreq=576, maxDocs=43556)
               0.078125 = fieldNorm(doc=3732)
         0.062338077 = weight(abstract_txt:criteria in 3732) [ClassicSimilarity], result of:
           0.062338077 = score(doc=3732,freq=1.0), product of:
             0.14290226 = queryWeight, product of:
               1.0680066 = boost
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.023962982 = queryNorm
             0.43622878 = fieldWeight in 3732, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.078125 = fieldNorm(doc=3732)
         0.06759192 = weight(abstract_txt:expert in 3732) [ClassicSimilarity], result of:
           0.06759192 = score(doc=3732,freq=1.0), product of:
             0.1508227 = queryWeight, product of:
               1.0972049 = boost
               5.736382 = idf(docFreq=381, maxDocs=43556)
               0.023962982 = queryNorm
             0.44815484 = fieldWeight in 3732, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.736382 = idf(docFreq=381, maxDocs=43556)
               0.078125 = fieldNorm(doc=3732)
         0.030597486 = weight(abstract_txt:results in 3732) [ClassicSimilarity], result of:
           0.030597486 = score(doc=3732,freq=1.0), product of:
             0.112030774 = queryWeight, product of:
               1.3373284 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.023962982 = queryNorm
             0.2731168 = fieldWeight in 3732, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.078125 = fieldNorm(doc=3732)
         0.0751874 = weight(abstract_txt:design in 3732) [ClassicSimilarity], result of:
           0.0751874 = score(doc=3732,freq=3.0), product of:
             0.14145006 = queryWeight, product of:
               1.5026954 = boost
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.023962982 = queryNorm
             0.5315473 = fieldWeight in 3732, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.078125 = fieldNorm(doc=3732)
         0.035194878 = weight(abstract_txt:based in 3732) [ClassicSimilarity], result of:
           0.035194878 = score(doc=3732,freq=1.0), product of:
             0.14078732 = queryWeight, product of:
               1.836102 = boost
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.023962982 = queryNorm
             0.24998613 = fieldWeight in 3732, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.078125 = fieldNorm(doc=3732)
         0.1837714 = weight(abstract_txt:evaluation in 3732) [ClassicSimilarity], result of:
           0.1837714 = score(doc=3732,freq=2.0), product of:
             0.3701679 = queryWeight, product of:
               3.4378252 = boost
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.023962982 = queryNorm
             0.49645418 = fieldWeight in 3732, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.078125 = fieldNorm(doc=3732)
       0.32 = coord(8/25)