Document (#37445)

Author

Lewandowski, D.
Spree, U.

Title

Ranking of Wikipedia articles in search engines revisited : fair ranking for reasonable quality?

Source

Journal of the American Society for Information Science and Technology. 62(2011) no.1, S.117-132

Year

2011

Abstract

This paper aims to review the fiercely discussed question of whether the ranking of Wikipedia articles in search engines is justified by the quality of the articles. After an overview of current research on information quality in Wikipedia, a summary of the extended discussion on the quality of encyclopedic entries in general is given. On this basis, a heuristic method for evaluating Wikipedia entries is developed and applied to Wikipedia articles that scored highly in a search engine retrieval effectiveness test and compared with the relevance judgment of jurors. In all search engines tested, Wikipedia results are unanimously judged better by the jurors than other results on the corresponding results position. Relevance judgments often roughly correspond with the results from the heuristic evaluation. Cases in which high relevance judgments are not in accordance with the comparatively low score from the heuristic evaluation are interpreted as an indicator of a high degree of trust in Wikipedia. One of the systemic shortcomings of Wikipedia lies in its necessarily incoherent user model. A further tuning of the suggested criteria catalog, for instance, the different weighing of the supplied criteria, could serve as a starting point for a user model differentiated evaluation of Wikipedia articles. Approved methods of quality evaluation of reference works are applied to Wikipedia articles and integrated with the question of search engine evaluation.

Content

Vgl. auch: http://hdl.handle.net/10760/16051. http://www.bui.haw-hamburg.de/fileadmin/user_upload/lewandowski/doc/Wikipedia_Lewandowski-Spree_preprint.pdf.

Theme

Suchmaschinen

Object

Wikipedia

Similar documents (author)

1. Lewandowski, D.; Spree, U.: ¬Die Forschungsgruppe Search Studies an der HAW Hamburg (2019) 6.01

   6.012074 = sum of:
     6.012074 = sum of:
       2.0826364 = weight(author_txt:lewandowski in 5021) [ClassicSimilarity], result of:
         2.0826364 = score(doc=5021,freq=1.0), product of:
           0.54787886 = queryWeight, product of:
             7.602543 = idf(docFreq=59, maxDocs=44218)
             0.07206521 = queryNorm
           3.8012714 = fieldWeight in 5021, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.602543 = idf(docFreq=59, maxDocs=44218)
             0.5 = fieldNorm(doc=5021)
       3.9294376 = weight(author_txt:spree in 5021) [ClassicSimilarity], result of:
         3.9294376 = score(doc=5021,freq=1.0), product of:
           0.8365576 = queryWeight, product of:
             1.235679 = boost
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07206521 = queryNorm
           4.697151 = fieldWeight in 5021, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.5 = fieldNorm(doc=5021)
   

2. Spree, U.: Wissensorganisation und Records Management : Was ist der State of the Art? Literaturübersicht (2009) 2.46

   2.4558985 = sum of:
     2.4558985 = product of:
       4.911797 = sum of:
         4.911797 = weight(author_txt:spree in 3132) [ClassicSimilarity], result of:
           4.911797 = score(doc=3132,freq=1.0), product of:
             0.8365576 = queryWeight, product of:
               1.235679 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.07206521 = queryNorm
             5.871439 = fieldWeight in 3132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.625 = fieldNorm(doc=3132)
       0.5 = coord(1/2)
   

3. Spree, U.: Wörterbücher und Enzyklopädien (2013) 2.46

   2.4558985 = sum of:
     2.4558985 = product of:
       4.911797 = sum of:
         4.911797 = weight(author_txt:spree in 734) [ClassicSimilarity], result of:
           4.911797 = score(doc=734,freq=1.0), product of:
             0.8365576 = queryWeight, product of:
               1.235679 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.07206521 = queryNorm
             5.871439 = fieldWeight in 734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.625 = fieldNorm(doc=734)
       0.5 = coord(1/2)
   

4. Geeb, F.; Spree, U.: Wörterbücher und Enzyklopädien (2004) 1.96

   1.9647188 = sum of:
     1.9647188 = product of:
       3.9294376 = sum of:
         3.9294376 = weight(author_txt:spree in 2944) [ClassicSimilarity], result of:
           3.9294376 = score(doc=2944,freq=1.0), product of:
             0.8365576 = queryWeight, product of:
               1.235679 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.07206521 = queryNorm
             4.697151 = fieldWeight in 2944, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.5 = fieldNorm(doc=2944)
       0.5 = coord(1/2)
   

5. Spree, U.; Geeb, F.: lookedup4you - Mikrostruktur und Makrostruktur und all das : Erfahrungen mit der Produktion eines Online-Nachschlagewerks als studentisches Projekt (2005) 1.96

   1.9647188 = sum of:
     1.9647188 = product of:
       3.9294376 = sum of:
         3.9294376 = weight(author_txt:spree in 3970) [ClassicSimilarity], result of:
           3.9294376 = score(doc=3970,freq=1.0), product of:
             0.8365576 = queryWeight, product of:
               1.235679 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.07206521 = queryNorm
             4.697151 = fieldWeight in 3970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.5 = fieldNorm(doc=3970)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Categorical relevance judgment (2018) 0.24

   0.2368462 = sum of:
     0.2368462 = product of:
       0.65790606 = sum of:
         0.025289023 = weight(abstract_txt:high in 4457) [ClassicSimilarity], result of:
           0.025289023 = score(doc=4457,freq=1.0), product of:
             0.08326368 = queryWeight, product of:
               1.1895328 = boost
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.014403989 = queryNorm
             0.30372214 = fieldWeight in 4457, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.0625 = fieldNorm(doc=4457)
         0.009735737 = weight(abstract_txt:with in 4457) [ClassicSimilarity], result of:
           0.009735737 = score(doc=4457,freq=2.0), product of:
             0.044063613 = queryWeight, product of:
               1.2237809 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.014403989 = queryNorm
             0.22094731 = fieldWeight in 4457, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=4457)
         0.037211426 = weight(abstract_txt:engine in 4457) [ClassicSimilarity], result of:
           0.037211426 = score(doc=4457,freq=1.0), product of:
             0.10771721 = queryWeight, product of:
               1.3529793 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.014403989 = queryNorm
             0.34545478 = fieldWeight in 4457, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.0625 = fieldNorm(doc=4457)
         0.072167605 = weight(abstract_txt:judgments in 4457) [ClassicSimilarity], result of:
           0.072167605 = score(doc=4457,freq=1.0), product of:
             0.16751836 = queryWeight, product of:
               1.6872514 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.014403989 = queryNorm
             0.43080413 = fieldWeight in 4457, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=4457)
         0.041619986 = weight(abstract_txt:results in 4457) [ClassicSimilarity], result of:
           0.041619986 = score(doc=4457,freq=5.0), product of:
             0.0855176 = queryWeight, product of:
               1.7048703 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.014403989 = queryNorm
             0.48668328 = fieldWeight in 4457, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=4457)
         0.08866415 = weight(abstract_txt:relevance in 4457) [ClassicSimilarity], result of:
           0.08866415 = score(doc=4457,freq=5.0), product of:
             0.1286392 = queryWeight, product of:
               1.8108433 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.014403989 = queryNorm
             0.6892467 = fieldWeight in 4457, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=4457)
         0.058012545 = weight(abstract_txt:ranking in 4457) [ClassicSimilarity], result of:
           0.058012545 = score(doc=4457,freq=1.0), product of:
             0.16578527 = queryWeight, product of:
               2.0557353 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.014403989 = queryNorm
             0.34992582 = fieldWeight in 4457, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=4457)
         0.053933986 = weight(abstract_txt:search in 4457) [ClassicSimilarity], result of:
           0.053933986 = score(doc=4457,freq=4.0), product of:
             0.11795126 = queryWeight, product of:
               2.238566 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014403989 = queryNorm
             0.45725656 = fieldWeight in 4457, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=4457)
         0.27127162 = weight(abstract_txt:wikipedia in 4457) [ClassicSimilarity], result of:
           0.27127162 = score(doc=4457,freq=1.0), product of:
             0.69251174 = queryWeight, product of:
               7.670915 = boost
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.014403989 = queryNorm
             0.39172134 = fieldWeight in 4457, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.0625 = fieldNorm(doc=4457)
       0.36 = coord(9/25)
   

2. Arazy, O.; Yeo, L.; Nov, O.: Stay on the Wikipedia task : when task-related disagreements slip into personal and procedural conflicts (2013) 0.23

   0.23085485 = sum of:
     0.23085485 = product of:
       0.8244816 = sum of:
         0.06621453 = weight(abstract_txt:encyclopedic in 1006) [ClassicSimilarity], result of:
           0.06621453 = score(doc=1006,freq=1.0), product of:
             0.12554318 = queryWeight, product of:
               1.0328331 = boost
               8.43879 = idf(docFreq=25, maxDocs=44218)
               0.014403989 = queryNorm
             0.5274244 = fieldWeight in 1006, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.43879 = idf(docFreq=25, maxDocs=44218)
               0.0625 = fieldNorm(doc=1006)
         0.0068842056 = weight(abstract_txt:with in 1006) [ClassicSimilarity], result of:
           0.0068842056 = score(doc=1006,freq=1.0), product of:
             0.044063613 = queryWeight, product of:
               1.2237809 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.014403989 = queryNorm
             0.15623334 = fieldWeight in 1006, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=1006)
         0.051497996 = weight(abstract_txt:entries in 1006) [ClassicSimilarity], result of:
           0.051497996 = score(doc=1006,freq=1.0), product of:
             0.13377073 = queryWeight, product of:
               1.5077493 = boost
               6.159553 = idf(docFreq=253, maxDocs=44218)
               0.014403989 = queryNorm
             0.38497207 = fieldWeight in 1006, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.159553 = idf(docFreq=253, maxDocs=44218)
               0.0625 = fieldNorm(doc=1006)
         0.026322791 = weight(abstract_txt:results in 1006) [ClassicSimilarity], result of:
           0.026322791 = score(doc=1006,freq=2.0), product of:
             0.0855176 = queryWeight, product of:
               1.7048703 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.014403989 = queryNorm
             0.30780554 = fieldWeight in 1006, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=1006)
         0.07847948 = weight(abstract_txt:quality in 1006) [ClassicSimilarity], result of:
           0.07847948 = score(doc=1006,freq=2.0), product of:
             0.19082782 = queryWeight, product of:
               2.8473408 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.014403989 = queryNorm
             0.4112581 = fieldWeight in 1006, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.0625 = fieldNorm(doc=1006)
         0.12522642 = weight(abstract_txt:articles in 1006) [ClassicSimilarity], result of:
           0.12522642 = score(doc=1006,freq=3.0), product of:
             0.2418976 = queryWeight, product of:
               3.5117614 = boost
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.014403989 = queryNorm
             0.5176836 = fieldWeight in 1006, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.0625 = fieldNorm(doc=1006)
         0.4698562 = weight(abstract_txt:wikipedia in 1006) [ClassicSimilarity], result of:
           0.4698562 = score(doc=1006,freq=3.0), product of:
             0.69251174 = queryWeight, product of:
               7.670915 = boost
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.014403989 = queryNorm
             0.6784812 = fieldWeight in 1006, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.0625 = fieldNorm(doc=1006)
       0.28 = coord(7/25)
   

3. Schaer, P.; Mayr, P.; Sünkler, S.; Lewandowski, D.: How relevant is the long tail? : a relevance assessment study on million short (2016) 0.20

   0.20494485 = sum of:
     0.20494485 = product of:
       0.56929123 = sum of:
         0.008605257 = weight(abstract_txt:with in 3144) [ClassicSimilarity], result of:
           0.008605257 = score(doc=3144,freq=1.0), product of:
             0.044063613 = queryWeight, product of:
               1.2237809 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.014403989 = queryNorm
             0.19529167 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.038903274 = weight(abstract_txt:question in 3144) [ClassicSimilarity], result of:
           0.038903274 = score(doc=3144,freq=1.0), product of:
             0.09562064 = queryWeight, product of:
               1.2747482 = boost
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.014403989 = queryNorm
             0.40685016 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.09302856 = weight(abstract_txt:engine in 3144) [ClassicSimilarity], result of:
           0.09302856 = score(doc=3144,freq=4.0), product of:
             0.10771721 = queryWeight, product of:
               1.3529793 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.014403989 = queryNorm
             0.863637 = fieldWeight in 3144, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.09020951 = weight(abstract_txt:judgments in 3144) [ClassicSimilarity], result of:
           0.09020951 = score(doc=3144,freq=1.0), product of:
             0.16751836 = queryWeight, product of:
               1.6872514 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.014403989 = queryNorm
             0.5385052 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.04029838 = weight(abstract_txt:results in 3144) [ClassicSimilarity], result of:
           0.04029838 = score(doc=3144,freq=3.0), product of:
             0.0855176 = queryWeight, product of:
               1.7048703 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.014403989 = queryNorm
             0.47122908 = fieldWeight in 3144, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.099129535 = weight(abstract_txt:relevance in 3144) [ClassicSimilarity], result of:
           0.099129535 = score(doc=3144,freq=4.0), product of:
             0.1286392 = queryWeight, product of:
               1.8108433 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.014403989 = queryNorm
             0.7706013 = fieldWeight in 3144, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.061570294 = weight(abstract_txt:engines in 3144) [ClassicSimilarity], result of:
           0.061570294 = score(doc=3144,freq=1.0), product of:
             0.14865246 = queryWeight, product of:
               1.9466159 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.014403989 = queryNorm
             0.41418952 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.075375035 = weight(abstract_txt:search in 3144) [ClassicSimilarity], result of:
           0.075375035 = score(doc=3144,freq=5.0), product of:
             0.11795126 = queryWeight, product of:
               2.238566 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014403989 = queryNorm
             0.63903546 = fieldWeight in 3144, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
         0.062171385 = weight(abstract_txt:evaluation in 3144) [ClassicSimilarity], result of:
           0.062171385 = score(doc=3144,freq=1.0), product of:
             0.17739223 = queryWeight, product of:
               2.7452753 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.014403989 = queryNorm
             0.35047412 = fieldWeight in 3144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=3144)
       0.36 = coord(9/25)
   

4. Liu, X.: Generating metadata for cyberlearning resources through information retrieval and meta-search (2013) 0.19

   0.19423117 = sum of:
     0.19423117 = product of:
       0.69368273 = sum of:
         0.02326628 = weight(abstract_txt:results in 676) [ClassicSimilarity], result of:
           0.02326628 = score(doc=676,freq=1.0), product of:
             0.0855176 = queryWeight, product of:
               1.7048703 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.014403989 = queryNorm
             0.27206424 = fieldWeight in 676, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=676)
         0.049564768 = weight(abstract_txt:relevance in 676) [ClassicSimilarity], result of:
           0.049564768 = score(doc=676,freq=1.0), product of:
             0.1286392 = queryWeight, product of:
               1.8108433 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.014403989 = queryNorm
             0.38530064 = fieldWeight in 676, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=676)
         0.10255265 = weight(abstract_txt:ranking in 676) [ClassicSimilarity], result of:
           0.10255265 = score(doc=676,freq=2.0), product of:
             0.16578527 = queryWeight, product of:
               2.0557353 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.014403989 = queryNorm
             0.61858726 = fieldWeight in 676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.078125 = fieldNorm(doc=676)
         0.04767136 = weight(abstract_txt:search in 676) [ClassicSimilarity], result of:
           0.04767136 = score(doc=676,freq=2.0), product of:
             0.11795126 = queryWeight, product of:
               2.238566 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014403989 = queryNorm
             0.4041615 = fieldWeight in 676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=676)
         0.062171385 = weight(abstract_txt:evaluation in 676) [ClassicSimilarity], result of:
           0.062171385 = score(doc=676,freq=1.0), product of:
             0.17739223 = queryWeight, product of:
               2.7452753 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.014403989 = queryNorm
             0.35047412 = fieldWeight in 676, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=676)
         0.06936672 = weight(abstract_txt:quality in 676) [ClassicSimilarity], result of:
           0.06936672 = score(doc=676,freq=1.0), product of:
             0.19082782 = queryWeight, product of:
               2.8473408 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.014403989 = queryNorm
             0.36350426 = fieldWeight in 676, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.078125 = fieldNorm(doc=676)
         0.33908954 = weight(abstract_txt:wikipedia in 676) [ClassicSimilarity], result of:
           0.33908954 = score(doc=676,freq=1.0), product of:
             0.69251174 = queryWeight, product of:
               7.670915 = boost
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.014403989 = queryNorm
             0.48965168 = fieldWeight in 676, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.078125 = fieldNorm(doc=676)
       0.28 = coord(7/25)
   

5. Can, F.; Nuray, R.; Sevdik, A.B.: Automatic performance evaluation of Web search engines (2004) 0.19

   0.1880925 = sum of:
     0.1880925 = product of:
       0.58778906 = sum of:
         0.012169671 = weight(abstract_txt:with in 2570) [ClassicSimilarity], result of:
           0.012169671 = score(doc=2570,freq=2.0), product of:
             0.044063613 = queryWeight, product of:
               1.2237809 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.014403989 = queryNorm
             0.27618414 = fieldWeight in 2570, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.078125 = fieldNorm(doc=2570)
         0.04651428 = weight(abstract_txt:engine in 2570) [ClassicSimilarity], result of:
           0.04651428 = score(doc=2570,freq=1.0), product of:
             0.10771721 = queryWeight, product of:
               1.3529793 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.014403989 = queryNorm
             0.4318185 = fieldWeight in 2570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.078125 = fieldNorm(doc=2570)
         0.1275755 = weight(abstract_txt:judgments in 2570) [ClassicSimilarity], result of:
           0.1275755 = score(doc=2570,freq=2.0), product of:
             0.16751836 = queryWeight, product of:
               1.6872514 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.014403989 = queryNorm
             0.76156133 = fieldWeight in 2570, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.078125 = fieldNorm(doc=2570)
         0.02326628 = weight(abstract_txt:results in 2570) [ClassicSimilarity], result of:
           0.02326628 = score(doc=2570,freq=1.0), product of:
             0.0855176 = queryWeight, product of:
               1.7048703 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.014403989 = queryNorm
             0.27206424 = fieldWeight in 2570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=2570)
         0.07009517 = weight(abstract_txt:relevance in 2570) [ClassicSimilarity], result of:
           0.07009517 = score(doc=2570,freq=2.0), product of:
             0.1286392 = queryWeight, product of:
               1.8108433 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.014403989 = queryNorm
             0.5448974 = fieldWeight in 2570, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=2570)
         0.13767536 = weight(abstract_txt:engines in 2570) [ClassicSimilarity], result of:
           0.13767536 = score(doc=2570,freq=5.0), product of:
             0.14865246 = queryWeight, product of:
               1.9466159 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.014403989 = queryNorm
             0.9261559 = fieldWeight in 2570, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.078125 = fieldNorm(doc=2570)
         0.08256922 = weight(abstract_txt:search in 2570) [ClassicSimilarity], result of:
           0.08256922 = score(doc=2570,freq=6.0), product of:
             0.11795126 = queryWeight, product of:
               2.238566 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014403989 = queryNorm
             0.7000283 = fieldWeight in 2570, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=2570)
         0.087923616 = weight(abstract_txt:evaluation in 2570) [ClassicSimilarity], result of:
           0.087923616 = score(doc=2570,freq=2.0), product of:
             0.17739223 = queryWeight, product of:
               2.7452753 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.014403989 = queryNorm
             0.49564525 = fieldWeight in 2570, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2570)
       0.32 = coord(8/25)