Document (#20935)

Author

Sparck Jones, K.
Galliers, J.R.

Title

Evaluating natural language processing systems : an analysis and review

Imprint

Berlin : Springer

Year

1996

Pages

XV,228 S

Isbn

3-540-61309-9

Series

Lecture notes in artificial intelligence; vol.1083

Abstract

This comprehensive state-of-the-art book is the first devoted to the important and timely issue of evaluating NLP systems. It addresses the whole area of NLP system evaluation, including aims and scope, problems and methodology. The authors provide a wide-ranging and careful analysis of evaluation concepts, reinforced with extensive illustrations; they relate systems to their environments and develop a framework for proper evaluation. The discussion of principles is completed by a detailed review of practice and strategies in the field, covering both systems for specific tasks, like translation, and core language processors. The methodology lessons drawn from the analysis and review are applied in a series of example cases. A comprehensive bibliography, a subject index, and term glossary are included

Footnote

Rez. in: Machine translation 12(1997) no.4, S.375-379 (D. Estival)

Theme

Computerlinguistik

Similar documents (author)

1. Sparck Jones, K.: Fashionable trends and feasible strategies in information management (1988) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 817) [ClassicSimilarity], result of:
         2.0544336 = score(doc=817,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 817, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=817)
       3.2568877 = weight(author_txt:sparck in 817) [ClassicSimilarity], result of:
         3.2568877 = score(doc=817,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 817, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=817)
   

2. Sparck Jones, K.: Automatic classification (1976) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 2908) [ClassicSimilarity], result of:
         2.0544336 = score(doc=2908,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 2908, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=2908)
       3.2568877 = weight(author_txt:sparck in 2908) [ClassicSimilarity], result of:
         3.2568877 = score(doc=2908,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 2908, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=2908)
   

3. Sparck Jones, K.: ¬The role of artificial intelligence in information retrieval (1991) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 4811) [ClassicSimilarity], result of:
         2.0544336 = score(doc=4811,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 4811, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=4811)
       3.2568877 = weight(author_txt:sparck in 4811) [ClassicSimilarity], result of:
         3.2568877 = score(doc=4811,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 4811, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=4811)
   

4. Sparck Jones, K.: Automatic keyword classification for information retrieval (1971) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 5176) [ClassicSimilarity], result of:
         2.0544336 = score(doc=5176,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 5176, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=5176)
       3.2568877 = weight(author_txt:sparck in 5176) [ClassicSimilarity], result of:
         3.2568877 = score(doc=5176,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 5176, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=5176)
   

5. Sparck Jones, K.: ¬A statistical interpretation of term specifity and its application in retrieval (1972) 5.31

   5.3113213 = sum of:
     5.3113213 = sum of:
       2.0544336 = weight(author_txt:jones in 5187) [ClassicSimilarity], result of:
         2.0544336 = score(doc=5187,freq=1.0), product of:
           0.5925071 = queryWeight, product of:
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.085440755 = queryNorm
           3.4673567 = fieldWeight in 5187, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.9347134 = idf(docFreq=116, maxDocs=44218)
             0.5 = fieldNorm(doc=5187)
       3.2568877 = weight(author_txt:sparck in 5187) [ClassicSimilarity], result of:
         3.2568877 = score(doc=5187,freq=1.0), product of:
           0.80556524 = queryWeight, product of:
             1.1660135 = boost
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.085440755 = queryNorm
           4.0429845 = fieldWeight in 5187, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.5 = fieldNorm(doc=5187)
   

Similar documents (content)

1. Kremer, S.; Kolbe, L.M.; Brenner, W.: Towards a procedure model in terminology management (2005) 0.13

   0.13131426 = sum of:
     0.13131426 = product of:
       0.5471428 = sum of:
         0.051919922 = weight(abstract_txt:extensive in 4401) [ClassicSimilarity], result of:
           0.051919922 = score(doc=4401,freq=1.0), product of:
             0.13814673 = queryWeight, product of:
               1.0061461 = boost
               6.0133076 = idf(docFreq=293, maxDocs=44218)
               0.022833167 = queryNorm
             0.37583172 = fieldWeight in 4401, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0133076 = idf(docFreq=293, maxDocs=44218)
               0.0625 = fieldNorm(doc=4401)
         0.29442897 = weight(abstract_txt:glossary in 4401) [ClassicSimilarity], result of:
           0.29442897 = score(doc=4401,freq=5.0), product of:
             0.25691035 = queryWeight, product of:
               1.3720866 = boost
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.022833167 = queryNorm
             1.1460378 = fieldWeight in 4401, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.0625 = fieldNorm(doc=4401)
         0.045772843 = weight(abstract_txt:methodology in 4401) [ClassicSimilarity], result of:
           0.045772843 = score(doc=4401,freq=1.0), product of:
             0.16002943 = queryWeight, product of:
               1.5314599 = boost
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.022833167 = queryNorm
             0.28602767 = fieldWeight in 4401, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.0625 = fieldNorm(doc=4401)
         0.03493481 = weight(abstract_txt:analysis in 4401) [ClassicSimilarity], result of:
           0.03493481 = score(doc=4401,freq=1.0), product of:
             0.15299031 = queryWeight, product of:
               1.8339324 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.022833167 = queryNorm
             0.22834657 = fieldWeight in 4401, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=4401)
         0.0379345 = weight(abstract_txt:systems in 4401) [ClassicSimilarity], result of:
           0.0379345 = score(doc=4401,freq=1.0), product of:
             0.1778938 = queryWeight, product of:
               2.2835007 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.022833167 = queryNorm
             0.2132424 = fieldWeight in 4401, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=4401)
         0.08215173 = weight(abstract_txt:review in 4401) [ClassicSimilarity], result of:
           0.08215173 = score(doc=4401,freq=1.0), product of:
             0.2705429 = queryWeight, product of:
               2.438762 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.022833167 = queryNorm
             0.30365512 = fieldWeight in 4401, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=4401)
       0.24 = coord(6/25)
   

2. Kelly, D.; Sugimoto, C.R.: ¬A systematic review of interactive information retrieval evaluation studies, 1967-2006 (2013) 0.11

   0.11430636 = sum of:
     0.11430636 = product of:
       0.47627652 = sum of:
         0.05097427 = weight(abstract_txt:bibliography in 684) [ClassicSimilarity], result of:
           0.05097427 = score(doc=684,freq=1.0), product of:
             0.13646415 = queryWeight, product of:
               5.9765754 = idf(docFreq=304, maxDocs=44218)
               0.022833167 = queryNorm
             0.37353596 = fieldWeight in 684, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9765754 = idf(docFreq=304, maxDocs=44218)
               0.0625 = fieldNorm(doc=684)
         0.049405284 = weight(abstract_txt:analysis in 684) [ClassicSimilarity], result of:
           0.049405284 = score(doc=684,freq=2.0), product of:
             0.15299031 = queryWeight, product of:
               1.8339324 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.022833167 = queryNorm
             0.3229308 = fieldWeight in 684, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=684)
         0.09548789 = weight(abstract_txt:evaluating in 684) [ClassicSimilarity], result of:
           0.09548789 = score(doc=684,freq=1.0), product of:
             0.26127234 = queryWeight, product of:
               1.956827 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.022833167 = queryNorm
             0.36547264 = fieldWeight in 684, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.0625 = fieldNorm(doc=684)
         0.14460984 = weight(abstract_txt:evaluation in 684) [ClassicSimilarity], result of:
           0.14460984 = score(doc=684,freq=5.0), product of:
             0.23065713 = queryWeight, product of:
               2.2518258 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022833167 = queryNorm
             0.62694716 = fieldWeight in 684, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=684)
         0.05364749 = weight(abstract_txt:systems in 684) [ClassicSimilarity], result of:
           0.05364749 = score(doc=684,freq=2.0), product of:
             0.1778938 = queryWeight, product of:
               2.2835007 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.022833167 = queryNorm
             0.3015703 = fieldWeight in 684, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=684)
         0.08215173 = weight(abstract_txt:review in 684) [ClassicSimilarity], result of:
           0.08215173 = score(doc=684,freq=1.0), product of:
             0.2705429 = queryWeight, product of:
               2.438762 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.022833167 = queryNorm
             0.30365512 = fieldWeight in 684, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=684)
       0.24 = coord(6/25)
   

3. Voorhees, E.M.; Harman, D.K.: ¬The Text REtrieval Conference (2005) 0.11

   0.11182677 = sum of:
     0.11182677 = product of:
       0.34945866 = sum of:
         0.049995877 = weight(abstract_txt:devoted in 5082) [ClassicSimilarity], result of:
           0.049995877 = score(doc=5082,freq=2.0), product of:
             0.1462662 = queryWeight, product of:
               1.0352917 = boost
               6.187499 = idf(docFreq=246, maxDocs=44218)
               0.022833167 = queryNorm
             0.34181428 = fieldWeight in 5082, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.187499 = idf(docFreq=246, maxDocs=44218)
               0.0390625 = fieldNorm(doc=5082)
         0.036139056 = weight(abstract_txt:drawn in 5082) [ClassicSimilarity], result of:
           0.036139056 = score(doc=5082,freq=1.0), product of:
             0.14842798 = queryWeight, product of:
               1.0429143 = boost
               6.2330556 = idf(docFreq=235, maxDocs=44218)
               0.022833167 = queryNorm
             0.24347873 = fieldWeight in 5082, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2330556 = idf(docFreq=235, maxDocs=44218)
               0.0390625 = fieldNorm(doc=5082)
         0.05052177 = weight(abstract_txt:lessons in 5082) [ClassicSimilarity], result of:
           0.05052177 = score(doc=5082,freq=1.0), product of:
             0.18557392 = queryWeight, product of:
               1.166136 = boost
               6.9694996 = idf(docFreq=112, maxDocs=44218)
               0.022833167 = queryNorm
             0.27224606 = fieldWeight in 5082, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9694996 = idf(docFreq=112, maxDocs=44218)
               0.0390625 = fieldNorm(doc=5082)
         0.030874368 = weight(abstract_txt:language in 5082) [ClassicSimilarity], result of:
           0.030874368 = score(doc=5082,freq=2.0), product of:
             0.133638 = queryWeight, product of:
               1.3994929 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.022833167 = queryNorm
             0.23102987 = fieldWeight in 5082, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0390625 = fieldNorm(doc=5082)
         0.028608028 = weight(abstract_txt:methodology in 5082) [ClassicSimilarity], result of:
           0.028608028 = score(doc=5082,freq=1.0), product of:
             0.16002943 = queryWeight, product of:
               1.5314599 = boost
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.022833167 = queryNorm
             0.1787673 = fieldWeight in 5082, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.0390625 = fieldNorm(doc=5082)
         0.049780954 = weight(abstract_txt:comprehensive in 5082) [ClassicSimilarity], result of:
           0.049780954 = score(doc=5082,freq=1.0), product of:
             0.23151726 = queryWeight, product of:
               1.842033 = boost
               5.5045247 = idf(docFreq=488, maxDocs=44218)
               0.022833167 = queryNorm
             0.2150205 = fieldWeight in 5082, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5045247 = idf(docFreq=488, maxDocs=44218)
               0.0390625 = fieldNorm(doc=5082)
         0.07000893 = weight(abstract_txt:evaluation in 5082) [ClassicSimilarity], result of:
           0.07000893 = score(doc=5082,freq=3.0), product of:
             0.23065713 = queryWeight, product of:
               2.2518258 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022833167 = queryNorm
             0.3035195 = fieldWeight in 5082, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0390625 = fieldNorm(doc=5082)
         0.03352968 = weight(abstract_txt:systems in 5082) [ClassicSimilarity], result of:
           0.03352968 = score(doc=5082,freq=2.0), product of:
             0.1778938 = queryWeight, product of:
               2.2835007 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.022833167 = queryNorm
             0.18848144 = fieldWeight in 5082, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0390625 = fieldNorm(doc=5082)
       0.32 = coord(8/25)
   

4. Su, L.T.: ¬A comprehensive and systematic model of user evaluation of Web search engines : I. Theory and background (2003) 0.11

   0.10989258 = sum of:
     0.10989258 = product of:
       0.45788574 = sum of:
         0.03493481 = weight(abstract_txt:analysis in 5164) [ClassicSimilarity], result of:
           0.03493481 = score(doc=5164,freq=1.0), product of:
             0.15299031 = queryWeight, product of:
               1.8339324 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.022833167 = queryNorm
             0.22834657 = fieldWeight in 5164, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=5164)
         0.07964953 = weight(abstract_txt:comprehensive in 5164) [ClassicSimilarity], result of:
           0.07964953 = score(doc=5164,freq=1.0), product of:
             0.23151726 = queryWeight, product of:
               1.842033 = boost
               5.5045247 = idf(docFreq=488, maxDocs=44218)
               0.022833167 = queryNorm
             0.3440328 = fieldWeight in 5164, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5045247 = idf(docFreq=488, maxDocs=44218)
               0.0625 = fieldNorm(doc=5164)
         0.09548789 = weight(abstract_txt:evaluating in 5164) [ClassicSimilarity], result of:
           0.09548789 = score(doc=5164,freq=1.0), product of:
             0.26127234 = queryWeight, product of:
               1.956827 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.022833167 = queryNorm
             0.36547264 = fieldWeight in 5164, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.0625 = fieldNorm(doc=5164)
         0.11201429 = weight(abstract_txt:evaluation in 5164) [ClassicSimilarity], result of:
           0.11201429 = score(doc=5164,freq=3.0), product of:
             0.23065713 = queryWeight, product of:
               2.2518258 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022833167 = queryNorm
             0.48563117 = fieldWeight in 5164, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=5164)
         0.05364749 = weight(abstract_txt:systems in 5164) [ClassicSimilarity], result of:
           0.05364749 = score(doc=5164,freq=2.0), product of:
             0.1778938 = queryWeight, product of:
               2.2835007 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.022833167 = queryNorm
             0.3015703 = fieldWeight in 5164, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=5164)
         0.08215173 = weight(abstract_txt:review in 5164) [ClassicSimilarity], result of:
           0.08215173 = score(doc=5164,freq=1.0), product of:
             0.2705429 = queryWeight, product of:
               2.438762 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.022833167 = queryNorm
             0.30365512 = fieldWeight in 5164, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=5164)
       0.24 = coord(6/25)
   

5. Haas, S.W.: Natural language processing : toward large-scale, robust systems (1996) 0.11

   0.108174324 = sum of:
     0.108174324 = product of:
       0.5408716 = sum of:
         0.08435016 = weight(abstract_txt:translation in 7415) [ClassicSimilarity], result of:
           0.08435016 = score(doc=7415,freq=1.0), product of:
             0.14569601 = queryWeight, product of:
               1.0332718 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.022833167 = queryNorm
             0.57894623 = fieldWeight in 7415, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.09375 = fieldNorm(doc=7415)
         0.12834235 = weight(abstract_txt:language in 7415) [ClassicSimilarity], result of:
           0.12834235 = score(doc=7415,freq=6.0), product of:
             0.133638 = queryWeight, product of:
               1.3994929 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.022833167 = queryNorm
             0.96037316 = fieldWeight in 7415, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.09375 = fieldNorm(doc=7415)
         0.09700722 = weight(abstract_txt:evaluation in 7415) [ClassicSimilarity], result of:
           0.09700722 = score(doc=7415,freq=1.0), product of:
             0.23065713 = queryWeight, product of:
               2.2518258 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022833167 = queryNorm
             0.42056894 = fieldWeight in 7415, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=7415)
         0.05690175 = weight(abstract_txt:systems in 7415) [ClassicSimilarity], result of:
           0.05690175 = score(doc=7415,freq=1.0), product of:
             0.1778938 = queryWeight, product of:
               2.2835007 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.022833167 = queryNorm
             0.3198636 = fieldWeight in 7415, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.09375 = fieldNorm(doc=7415)
         0.17427014 = weight(abstract_txt:review in 7415) [ClassicSimilarity], result of:
           0.17427014 = score(doc=7415,freq=2.0), product of:
             0.2705429 = queryWeight, product of:
               2.438762 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.022833167 = queryNorm
             0.6441498 = fieldWeight in 7415, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.09375 = fieldNorm(doc=7415)
       0.2 = coord(5/25)