Document (#27571)

Author

Can, F.
Nuray, R.
Sevdik, A.B.

Title

Automatic performance evaluation of Web search engines

Source

Information processing and management. 40(2004) no.3, S.495-514

Year

2004

Abstract

Measuring the information retrieval effectiveness of World Wide Web search engines is costly because of human relevance judgments involved. However, both for business enterprises and people it is important to know the most effective Web search engines, since such search engines help their users find higher number of relevant Web pages with less effort. Furthermore, this information can be used for several practical purposes. In this study we introduce automatic Web search engine evaluation method as an efficient and effective assessment tool of such systems. The experiments based on eight Web search engines, 25 queries, and binary user relevance judgments show that our method provides results consistent with human-based evaluations. It is shown that the observed consistencies are statistically significant. This indicates that the new method can be successfully used in the evaluation of Web search engines.

Theme

Suchmaschinen

Similar documents (content)

1. Jones, S.; Paynter, G.W.: Automatic extractionof document keyphrases for use in digital libraries : evaluations and applications (2002) 0.36

   0.3610948 = sum of:
     0.3610948 = product of:
       0.75228083 = sum of:
         0.013494616 = weight(abstract_txt:based in 601) [ClassicSimilarity], result of:
           0.013494616 = score(doc=601,freq=1.0), product of:
             0.067728594 = queryWeight, product of:
               1.0410013 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.020408558 = queryNorm
             0.19924548 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.059627637 = weight(abstract_txt:measuring in 601) [ClassicSimilarity], result of:
           0.059627637 = score(doc=601,freq=1.0), product of:
             0.1447505 = queryWeight, product of:
               1.0761191 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.020408558 = queryNorm
             0.41193387 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.06243902 = weight(abstract_txt:evaluations in 601) [ClassicSimilarity], result of:
           0.06243902 = score(doc=601,freq=1.0), product of:
             0.14926538 = queryWeight, product of:
               1.0927726 = boost
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.020408558 = queryNorm
             0.4183088 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.022330385 = weight(abstract_txt:used in 601) [ClassicSimilarity], result of:
           0.022330385 = score(doc=601,freq=2.0), product of:
             0.075206004 = queryWeight, product of:
               1.0969619 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.020408558 = queryNorm
             0.2969229 = fieldWeight in 601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.02350866 = weight(abstract_txt:that in 601) [ClassicSimilarity], result of:
           0.02350866 = score(doc=601,freq=8.0), product of:
             0.056124274 = queryWeight, product of:
               1.1606098 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.020408558 = queryNorm
             0.41886798 = fieldWeight in 601, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.017556496 = weight(abstract_txt:this in 601) [ClassicSimilarity], result of:
           0.017556496 = score(doc=601,freq=4.0), product of:
             0.058205947 = queryWeight, product of:
               1.1819377 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.020408558 = queryNorm
             0.3016272 = fieldWeight in 601, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.09677824 = weight(abstract_txt:costly in 601) [ClassicSimilarity], result of:
           0.09677824 = score(doc=601,freq=1.0), product of:
             0.19991261 = queryWeight, product of:
               1.26465 = boost
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.020408558 = queryNorm
             0.48410273 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.0608451 = weight(abstract_txt:human in 601) [ClassicSimilarity], result of:
           0.0608451 = score(doc=601,freq=2.0), product of:
             0.1467142 = queryWeight, product of:
               1.5321501 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.020408558 = queryNorm
             0.41471857 = fieldWeight in 601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.04711447 = weight(abstract_txt:effective in 601) [ClassicSimilarity], result of:
           0.04711447 = score(doc=601,freq=1.0), product of:
             0.15587193 = queryWeight, product of:
               1.5792439 = boost
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.020408558 = queryNorm
             0.30226398 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.082614586 = weight(abstract_txt:automatic in 601) [ClassicSimilarity], result of:
           0.082614586 = score(doc=601,freq=2.0), product of:
             0.17989795 = queryWeight, product of:
               1.6965957 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.020408558 = queryNorm
             0.45923027 = fieldWeight in 601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.079769924 = weight(abstract_txt:evaluation in 601) [ClassicSimilarity], result of:
           0.079769924 = score(doc=601,freq=2.0), product of:
             0.20117696 = queryWeight, product of:
               2.1973538 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020408558 = queryNorm
             0.3965162 = fieldWeight in 601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
         0.18620168 = weight(abstract_txt:engines in 601) [ClassicSimilarity], result of:
           0.18620168 = score(doc=601,freq=1.0), product of:
             0.5619459 = queryWeight, product of:
               5.1936555 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.020408558 = queryNorm
             0.3313516 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0625 = fieldNorm(doc=601)
       0.48 = coord(12/25)
   

2. Kutlu, M.; Elsayed, T.; Lease, M.: Intelligent topic selection for low-cost information retrieval evaluation : a new perspective on deep vs. shallow judging (2018) 0.31

   0.3145308 = sum of:
     0.3145308 = product of:
       0.7148427 = sum of:
         0.010120963 = weight(abstract_txt:based in 5092) [ClassicSimilarity], result of:
           0.010120963 = score(doc=5092,freq=1.0), product of:
             0.067728594 = queryWeight, product of:
               1.0410013 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.020408558 = queryNorm
             0.14943412 = fieldWeight in 5092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.01246735 = weight(abstract_txt:that in 5092) [ClassicSimilarity], result of:
           0.01246735 = score(doc=5092,freq=4.0), product of:
             0.056124274 = queryWeight, product of:
               1.1606098 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.020408558 = queryNorm
             0.22213829 = fieldWeight in 5092, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.011403278 = weight(abstract_txt:this in 5092) [ClassicSimilarity], result of:
           0.011403278 = score(doc=5092,freq=3.0), product of:
             0.058205947 = queryWeight, product of:
               1.1819377 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.020408558 = queryNorm
             0.1959126 = fieldWeight in 5092, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.072583675 = weight(abstract_txt:costly in 5092) [ClassicSimilarity], result of:
           0.072583675 = score(doc=5092,freq=1.0), product of:
             0.19991261 = queryWeight, product of:
               1.26465 = boost
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.020408558 = queryNorm
             0.36307704 = fieldWeight in 5092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.055889793 = weight(abstract_txt:human in 5092) [ClassicSimilarity], result of:
           0.055889793 = score(doc=5092,freq=3.0), product of:
             0.1467142 = queryWeight, product of:
               1.5321501 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.020408558 = queryNorm
             0.38094333 = fieldWeight in 5092, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.06120349 = weight(abstract_txt:effective in 5092) [ClassicSimilarity], result of:
           0.06120349 = score(doc=5092,freq=3.0), product of:
             0.15587193 = queryWeight, product of:
               1.5792439 = boost
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.020408558 = queryNorm
             0.39265242 = fieldWeight in 5092, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.05299568 = weight(abstract_txt:relevance in 5092) [ClassicSimilarity], result of:
           0.05299568 = score(doc=5092,freq=2.0), product of:
             0.16209683 = queryWeight, product of:
               1.6104696 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.020408558 = queryNorm
             0.32693842 = fieldWeight in 5092, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.09459549 = weight(abstract_txt:evaluation in 5092) [ClassicSimilarity], result of:
           0.09459549 = score(doc=5092,freq=5.0), product of:
             0.20117696 = queryWeight, product of:
               2.1973538 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020408558 = queryNorm
             0.47021037 = fieldWeight in 5092, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.08545358 = weight(abstract_txt:method in 5092) [ClassicSimilarity], result of:
           0.08545358 = score(doc=5092,freq=4.0), product of:
             0.20251387 = queryWeight, product of:
               2.204643 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.020408558 = queryNorm
             0.42196405 = fieldWeight in 5092, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.20460959 = weight(abstract_txt:judgments in 5092) [ClassicSimilarity], result of:
           0.20460959 = score(doc=5092,freq=4.0), product of:
             0.31663203 = queryWeight, product of:
               2.25083 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.020408558 = queryNorm
             0.6462062 = fieldWeight in 5092, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
         0.053519774 = weight(abstract_txt:search in 5092) [ClassicSimilarity], result of:
           0.053519774 = score(doc=5092,freq=1.0), product of:
             0.31212106 = queryWeight, product of:
               4.180814 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.020408558 = queryNorm
             0.17147121 = fieldWeight in 5092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.046875 = fieldNorm(doc=5092)
       0.44 = coord(11/25)
   

3. Schaer, P.; Mayr, P.; Sünkler, S.; Lewandowski, D.: How relevant is the long tail? : a relevance assessment study on million short (2016) 0.29

   0.29467848 = sum of:
     0.29467848 = product of:
       0.9208703 = sum of:
         0.010389458 = weight(abstract_txt:that in 3144) [ClassicSimilarity], result of:
           0.010389458 = score(doc=3144,freq=1.0), product of:
             0.056124274 = queryWeight, product of:
               1.1606098 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.020408558 = queryNorm
             0.18511525 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.01097281 = weight(abstract_txt:this in 3144) [ClassicSimilarity], result of:
           0.01097281 = score(doc=3144,freq=1.0), product of:
             0.058205947 = queryWeight, product of:
               1.1819377 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.020408558 = queryNorm
             0.18851699 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.101372205 = weight(abstract_txt:binary in 3144) [ClassicSimilarity], result of:
           0.101372205 = score(doc=3144,freq=1.0), product of:
             0.17768916 = queryWeight, product of:
               1.1922868 = boost
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.020408558 = queryNorm
             0.570503 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.12491202 = weight(abstract_txt:relevance in 3144) [ClassicSimilarity], result of:
           0.12491202 = score(doc=3144,freq=4.0), product of:
             0.16209683 = queryWeight, product of:
               1.6104696 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.020408558 = queryNorm
             0.7706013 = fieldWeight in 3144, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.07050732 = weight(abstract_txt:evaluation in 3144) [ClassicSimilarity], result of:
           0.07050732 = score(doc=3144,freq=1.0), product of:
             0.20117696 = queryWeight, product of:
               2.1973538 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020408558 = queryNorm
             0.35047412 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.170508 = weight(abstract_txt:judgments in 3144) [ClassicSimilarity], result of:
           0.170508 = score(doc=3144,freq=1.0), product of:
             0.31663203 = queryWeight, product of:
               2.25083 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.020408558 = queryNorm
             0.5385052 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.19945642 = weight(abstract_txt:search in 3144) [ClassicSimilarity], result of:
           0.19945642 = score(doc=3144,freq=5.0), product of:
             0.31212106 = queryWeight, product of:
               4.180814 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.020408558 = queryNorm
             0.63903546 = fieldWeight in 3144, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.23275211 = weight(abstract_txt:engines in 3144) [ClassicSimilarity], result of:
           0.23275211 = score(doc=3144,freq=1.0), product of:
             0.5619459 = queryWeight, product of:
               5.1936555 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.020408558 = queryNorm
             0.41418952 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
       0.32 = coord(8/25)
   

4. Lewandowski, D.; Spree, U.: Ranking of Wikipedia articles in search engines revisited : fair ranking for reasonable quality? (2011) 0.28

   0.28458235 = sum of:
     0.28458235 = product of:
       0.8893199 = sum of:
         0.008311567 = weight(abstract_txt:that in 444) [ClassicSimilarity], result of:
           0.008311567 = score(doc=444,freq=1.0), product of:
             0.056124274 = queryWeight, product of:
               1.1606098 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.020408558 = queryNorm
             0.1480922 = fieldWeight in 444, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=444)
         0.012414318 = weight(abstract_txt:this in 444) [ClassicSimilarity], result of:
           0.012414318 = score(doc=444,freq=2.0), product of:
             0.058205947 = queryWeight, product of:
               1.1819377 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.020408558 = queryNorm
             0.21328263 = fieldWeight in 444, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=444)
         0.086541586 = weight(abstract_txt:relevance in 444) [ClassicSimilarity], result of:
           0.086541586 = score(doc=444,freq=3.0), product of:
             0.16209683 = queryWeight, product of:
               1.6104696 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.020408558 = queryNorm
             0.5338882 = fieldWeight in 444, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=444)
         0.12612732 = weight(abstract_txt:evaluation in 444) [ClassicSimilarity], result of:
           0.12612732 = score(doc=444,freq=5.0), product of:
             0.20117696 = queryWeight, product of:
               2.1973538 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020408558 = queryNorm
             0.62694716 = fieldWeight in 444, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=444)
         0.05696905 = weight(abstract_txt:method in 444) [ClassicSimilarity], result of:
           0.05696905 = score(doc=444,freq=1.0), product of:
             0.20251387 = queryWeight, product of:
               2.204643 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.020408558 = queryNorm
             0.28130937 = fieldWeight in 444, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.0625 = fieldNorm(doc=444)
         0.19290777 = weight(abstract_txt:judgments in 444) [ClassicSimilarity], result of:
           0.19290777 = score(doc=444,freq=2.0), product of:
             0.31663203 = queryWeight, product of:
               2.25083 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.020408558 = queryNorm
             0.60924906 = fieldWeight in 444, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=444)
         0.1427194 = weight(abstract_txt:search in 444) [ClassicSimilarity], result of:
           0.1427194 = score(doc=444,freq=4.0), product of:
             0.31212106 = queryWeight, product of:
               4.180814 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.020408558 = queryNorm
             0.45725656 = fieldWeight in 444, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=444)
         0.26332894 = weight(abstract_txt:engines in 444) [ClassicSimilarity], result of:
           0.26332894 = score(doc=444,freq=2.0), product of:
             0.5619459 = queryWeight, product of:
               5.1936555 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.020408558 = queryNorm
             0.46860194 = fieldWeight in 444, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0625 = fieldNorm(doc=444)
       0.32 = coord(8/25)
   

5. Blakeman, K.: Intelligent agents : search tools of the future? (1997) 0.28

   0.28039348 = sum of:
     0.28039348 = product of:
       0.87622964 = sum of:
         0.091272265 = weight(abstract_txt:indicates in 765) [ClassicSimilarity], result of:
           0.091272265 = score(doc=765,freq=1.0), product of:
             0.13239011 = queryWeight, product of:
               1.0291485 = boost
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.020408558 = queryNorm
             0.68941903 = fieldWeight in 765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.109375 = fieldNorm(doc=765)
         0.02361558 = weight(abstract_txt:based in 765) [ClassicSimilarity], result of:
           0.02361558 = score(doc=765,freq=1.0), product of:
             0.067728594 = queryWeight, product of:
               1.0410013 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.020408558 = queryNorm
             0.3486796 = fieldWeight in 765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.109375 = fieldNorm(doc=765)
         0.027632443 = weight(abstract_txt:used in 765) [ClassicSimilarity], result of:
           0.027632443 = score(doc=765,freq=1.0), product of:
             0.075206004 = queryWeight, product of:
               1.0969619 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.020408558 = queryNorm
             0.36742336 = fieldWeight in 765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.109375 = fieldNorm(doc=765)
         0.014545242 = weight(abstract_txt:that in 765) [ClassicSimilarity], result of:
           0.014545242 = score(doc=765,freq=1.0), product of:
             0.056124274 = queryWeight, product of:
               1.1606098 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.020408558 = queryNorm
             0.25916135 = fieldWeight in 765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.109375 = fieldNorm(doc=765)
         0.015361935 = weight(abstract_txt:this in 765) [ClassicSimilarity], result of:
           0.015361935 = score(doc=765,freq=1.0), product of:
             0.058205947 = queryWeight, product of:
               1.1819377 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.020408558 = queryNorm
             0.2639238 = fieldWeight in 765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.109375 = fieldNorm(doc=765)
         0.09871025 = weight(abstract_txt:evaluation in 765) [ClassicSimilarity], result of:
           0.09871025 = score(doc=765,freq=1.0), product of:
             0.20117696 = queryWeight, product of:
               2.1973538 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020408558 = queryNorm
             0.49066377 = fieldWeight in 765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.109375 = fieldNorm(doc=765)
         0.279239 = weight(abstract_txt:search in 765) [ClassicSimilarity], result of:
           0.279239 = score(doc=765,freq=5.0), product of:
             0.31212106 = queryWeight, product of:
               4.180814 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.020408558 = queryNorm
             0.8946497 = fieldWeight in 765, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.109375 = fieldNorm(doc=765)
         0.32585296 = weight(abstract_txt:engines in 765) [ClassicSimilarity], result of:
           0.32585296 = score(doc=765,freq=1.0), product of:
             0.5619459 = queryWeight, product of:
               5.1936555 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.020408558 = queryNorm
             0.57986534 = fieldWeight in 765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.109375 = fieldNorm(doc=765)
       0.32 = coord(8/25)