Document (#32472)

Author

Bar-Ilan, J.
Keenoy, K.
Yaari, E.
Levene, M.

Title

User rankings of search engine results

Source

Journal of the American Society for Information Science and Technology. 58(2007) no.9, S.1254-1266

Year

2007

Abstract

In this study, we investigate the similarities and differences between rankings of search results by users and search engines. Sixty-seven students took part in a 3-week-long experiment, during which they were asked to identify and rank the top 10 documents from the set of URLs that were retrieved by three major search engines (Google, MSN Search, and Yahoo!) for 12 selected queries. The URLs and accompanying snippets were displayed in random order, without disclosing which search engine(s) retrieved any specific URL for the query. We computed the similarity of the rankings of the users and search engines using four nonparametric correlation measures in [0,1] that complement each other. The findings show that the similarities between the users' choices and the rankings of the search engines are low. We examined the effects of the presentation order of the results, and of the thinking styles of the participants. Presentation order influences the rankings, but overall the results indicate that there is no "average user," and even if the users have the same basic knowledge of a topic, they evaluate information in their own context, which is influenced by cognitive, affective, and physical factors. This is the first large-scale experiment in which users were asked to rank the results of identical queries. The analysis of the experimental results demonstrates the potential for personalized search.

Theme

Suchmaschinen
Benutzerstudien

Object

Google
MSN Search
Yahoo

Similar documents (author)

1. Bar-Ilan, J.; Levene, M.: ¬The hw-rank : an h-index variant for ranking web pages (2015) 5.39

   5.387313 = sum of:
     5.387313 = sum of:
       2.0954535 = weight(author_txt:ilan in 3695) [ClassicSimilarity], result of:
         2.0954535 = score(doc=3695,freq=1.0), product of:
           0.5948366 = queryWeight, product of:
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.073874645 = queryNorm
           3.522738 = fieldWeight in 3695, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.4375 = fieldNorm(doc=3695)
       3.2918596 = weight(author_txt:levene in 3695) [ClassicSimilarity], result of:
         3.2918596 = score(doc=3695,freq=1.0), product of:
           0.80384666 = queryWeight, product of:
             1.1624861 = boost
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.073874645 = queryNorm
           4.095134 = fieldWeight in 3695, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.4375 = fieldNorm(doc=3695)
   

2. Bar-Ilan, J.; Levene, M.; Mat-Hassan, M.: Methods for evaluating dynamic changes in search engine rankings : a case study (2006) 3.85

   3.8480806 = sum of:
     3.8480806 = sum of:
       1.4967524 = weight(author_txt:ilan in 1742) [ClassicSimilarity], result of:
         1.4967524 = score(doc=1742,freq=1.0), product of:
           0.5948366 = queryWeight, product of:
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.073874645 = queryNorm
           2.5162413 = fieldWeight in 1742, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.3125 = fieldNorm(doc=1742)
       2.3513284 = weight(author_txt:levene in 1742) [ClassicSimilarity], result of:
         2.3513284 = score(doc=1742,freq=1.0), product of:
           0.80384666 = queryWeight, product of:
             1.1624861 = boost
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.073874645 = queryNorm
           2.9250956 = fieldWeight in 1742, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.3125 = fieldNorm(doc=1742)
   

3. Bar-Ilan, J.; Keenoy, K.; Levene, M.; Yaari, E.: Presentation bias is significant in determining user preference for search results : a user study (2009) 3.85

   3.8480806 = sum of:
     3.8480806 = sum of:
       1.4967524 = weight(author_txt:ilan in 4704) [ClassicSimilarity], result of:
         1.4967524 = score(doc=4704,freq=1.0), product of:
           0.5948366 = queryWeight, product of:
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.073874645 = queryNorm
           2.5162413 = fieldWeight in 4704, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.3125 = fieldNorm(doc=4704)
       2.3513284 = weight(author_txt:levene in 4704) [ClassicSimilarity], result of:
         2.3513284 = score(doc=4704,freq=1.0), product of:
           0.80384666 = queryWeight, product of:
             1.1624861 = boost
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.073874645 = queryNorm
           2.9250956 = fieldWeight in 4704, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.3125 = fieldNorm(doc=4704)
   

4. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016) 3.85

   3.8480806 = sum of:
     3.8480806 = sum of:
       1.4967524 = weight(author_txt:ilan in 5072) [ClassicSimilarity], result of:
         1.4967524 = score(doc=5072,freq=1.0), product of:
           0.5948366 = queryWeight, product of:
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.073874645 = queryNorm
           2.5162413 = fieldWeight in 5072, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.3125 = fieldNorm(doc=5072)
       2.3513284 = weight(author_txt:levene in 5072) [ClassicSimilarity], result of:
         2.3513284 = score(doc=5072,freq=1.0), product of:
           0.80384666 = queryWeight, product of:
             1.1624861 = boost
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.073874645 = queryNorm
           2.9250956 = fieldWeight in 5072, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.3125 = fieldNorm(doc=5072)
   

5. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Analysis of change in users' assessment of search results over time (2017) 3.85

   3.8480806 = sum of:
     3.8480806 = sum of:
       1.4967524 = weight(author_txt:ilan in 5594) [ClassicSimilarity], result of:
         1.4967524 = score(doc=5594,freq=1.0), product of:
           0.5948366 = queryWeight, product of:
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.073874645 = queryNorm
           2.5162413 = fieldWeight in 5594, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.051972 = idf(docFreq=36, maxDocs=42740)
             0.3125 = fieldNorm(doc=5594)
       2.3513284 = weight(author_txt:levene in 5594) [ClassicSimilarity], result of:
         2.3513284 = score(doc=5594,freq=1.0), product of:
           0.80384666 = queryWeight, product of:
             1.1624861 = boost
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.073874645 = queryNorm
           2.9250956 = fieldWeight in 5594, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.360306 = idf(docFreq=9, maxDocs=42740)
             0.3125 = fieldNorm(doc=5594)
   

Similar documents (content)

1. Bar-Ilan, J.; Levene, M.; Mat-Hassan, M.: Methods for evaluating dynamic changes in search engine rankings : a case study (2006) 0.65

   0.64888984 = sum of:
     0.64888984 = product of:
       1.3518538 = sum of:
         0.05507532 = weight(abstract_txt:computed in 1742) [ClassicSimilarity], result of:
           0.05507532 = score(doc=1742,freq=1.0), product of:
             0.13216704 = queryWeight, product of:
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.017345123 = queryNorm
             0.41670996 = fieldWeight in 1742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.011843255 = weight(abstract_txt:that in 1742) [ClassicSimilarity], result of:
           0.011843255 = score(doc=1742,freq=3.0), product of:
             0.052213017 = queryWeight, product of:
               1.2570652 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.017345123 = queryNorm
             0.22682571 = fieldWeight in 1742, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.04641046 = weight(abstract_txt:queries in 1742) [ClassicSimilarity], result of:
           0.04641046 = score(doc=1742,freq=2.0), product of:
             0.117913194 = queryWeight, product of:
               1.335779 = boost
               5.0892105 = idf(docFreq=715, maxDocs=42740)
               0.017345123 = queryNorm
             0.39359853 = fieldWeight in 1742, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0892105 = idf(docFreq=715, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.059111234 = weight(abstract_txt:engine in 1742) [ClassicSimilarity], result of:
           0.059111234 = score(doc=1742,freq=2.0), product of:
             0.13854744 = queryWeight, product of:
               1.4479469 = boost
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.017345123 = queryNorm
             0.42664978 = fieldWeight in 1742, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.045417838 = weight(abstract_txt:experiment in 1742) [ClassicSimilarity], result of:
           0.045417838 = score(doc=1742,freq=1.0), product of:
             0.14643541 = queryWeight, product of:
               1.4885947 = boost
               5.671426 = idf(docFreq=399, maxDocs=42740)
               0.017345123 = queryNorm
             0.3101561 = fieldWeight in 1742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.671426 = idf(docFreq=399, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.047051303 = weight(abstract_txt:order in 1742) [ClassicSimilarity], result of:
           0.047051303 = score(doc=1742,freq=2.0), product of:
             0.1362166 = queryWeight, product of:
               1.7583853 = boost
               4.466204 = idf(docFreq=1334, maxDocs=42740)
               0.017345123 = queryNorm
             0.34541535 = fieldWeight in 1742, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.466204 = idf(docFreq=1334, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.043408852 = weight(abstract_txt:were in 1742) [ClassicSimilarity], result of:
           0.043408852 = score(doc=1742,freq=3.0), product of:
             0.12412243 = queryWeight, product of:
               1.9381775 = boost
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.017345123 = queryNorm
             0.34972608 = fieldWeight in 1742, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.028408566 = weight(abstract_txt:users in 1742) [ClassicSimilarity], result of:
           0.028408566 = score(doc=1742,freq=1.0), product of:
             0.14535882 = queryWeight, product of:
               2.3450067 = boost
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.017345123 = queryNorm
             0.19543752 = fieldWeight in 1742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.0852544 = weight(abstract_txt:results in 1742) [ClassicSimilarity], result of:
           0.0852544 = score(doc=1742,freq=7.0), product of:
             0.16800186 = queryWeight, product of:
               2.7616656 = boost
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.017345123 = queryNorm
             0.5074611 = fieldWeight in 1742, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.19612022 = weight(abstract_txt:engines in 1742) [ClassicSimilarity], result of:
           0.19612022 = score(doc=1742,freq=7.0), product of:
             0.25575298 = queryWeight, product of:
               2.7821386 = boost
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.017345123 = queryNorm
             0.76683456 = fieldWeight in 1742, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.16364774 = weight(abstract_txt:search in 1742) [ClassicSimilarity], result of:
           0.16364774 = score(doc=1742,freq=9.0), product of:
             0.27316505 = queryWeight, product of:
               4.312928 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.017345123 = queryNorm
             0.5990801 = fieldWeight in 1742, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
         0.5701048 = weight(abstract_txt:rankings in 1742) [ClassicSimilarity], result of:
           0.5701048 = score(doc=1742,freq=8.0), product of:
             0.53672063 = queryWeight, product of:
               4.506066 = boost
               6.8671 = idf(docFreq=120, maxDocs=42740)
               0.017345123 = queryNorm
             1.0622002 = fieldWeight in 1742, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.8671 = idf(docFreq=120, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1742)
       0.48 = coord(12/25)
   

2. Bar-Ilan, J.: Comparing rankings of search results on the Web (2005) 0.56

   0.5563501 = sum of:
     0.5563501 = product of:
       1.2644321 = sum of:
         0.08901516 = weight(abstract_txt:computed in 3069) [ClassicSimilarity], result of:
           0.08901516 = score(doc=3069,freq=2.0), product of:
             0.13216704 = queryWeight, product of:
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.017345123 = queryNorm
             0.673505 = fieldWeight in 3069, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.015629044 = weight(abstract_txt:that in 3069) [ClassicSimilarity], result of:
           0.015629044 = score(doc=3069,freq=4.0), product of:
             0.052213017 = queryWeight, product of:
               1.2570652 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.017345123 = queryNorm
             0.29933232 = fieldWeight in 3069, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.053040527 = weight(abstract_txt:queries in 3069) [ClassicSimilarity], result of:
           0.053040527 = score(doc=3069,freq=2.0), product of:
             0.117913194 = queryWeight, product of:
               1.335779 = boost
               5.0892105 = idf(docFreq=715, maxDocs=42740)
               0.017345123 = queryNorm
             0.4498269 = fieldWeight in 3069, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0892105 = idf(docFreq=715, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.047769092 = weight(abstract_txt:engine in 3069) [ClassicSimilarity], result of:
           0.047769092 = score(doc=3069,freq=1.0), product of:
             0.13854744 = queryWeight, product of:
               1.4479469 = boost
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.017345123 = queryNorm
             0.3447851 = fieldWeight in 3069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.05281856 = weight(abstract_txt:retrieved in 3069) [ClassicSimilarity], result of:
           0.05281856 = score(doc=3069,freq=1.0), product of:
             0.14814655 = queryWeight, product of:
               1.4972668 = boost
               5.704466 = idf(docFreq=386, maxDocs=42740)
               0.017345123 = queryNorm
             0.35652912 = fieldWeight in 3069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.704466 = idf(docFreq=386, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.107101694 = weight(abstract_txt:urls in 3069) [ClassicSimilarity], result of:
           0.107101694 = score(doc=3069,freq=1.0), product of:
             0.2373366 = queryWeight, product of:
               1.8951159 = boost
               7.220239 = idf(docFreq=84, maxDocs=42740)
               0.017345123 = queryNorm
             0.45126495 = fieldWeight in 3069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.220239 = idf(docFreq=84, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.028642416 = weight(abstract_txt:were in 3069) [ClassicSimilarity], result of:
           0.028642416 = score(doc=3069,freq=1.0), product of:
             0.12412243 = queryWeight, product of:
               1.9381775 = boost
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.017345123 = queryNorm
             0.23075938 = fieldWeight in 3069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.082346424 = weight(abstract_txt:results in 3069) [ClassicSimilarity], result of:
           0.082346424 = score(doc=3069,freq=5.0), product of:
             0.16800186 = queryWeight, product of:
               2.7616656 = boost
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.017345123 = queryNorm
             0.49015188 = fieldWeight in 3069, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.2241374 = weight(abstract_txt:engines in 3069) [ClassicSimilarity], result of:
           0.2241374 = score(doc=3069,freq=7.0), product of:
             0.25575298 = queryWeight, product of:
               2.7821386 = boost
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.017345123 = queryNorm
             0.87638235 = fieldWeight in 3069, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.1649414 = weight(abstract_txt:search in 3069) [ClassicSimilarity], result of:
           0.1649414 = score(doc=3069,freq=7.0), product of:
             0.27316505 = queryWeight, product of:
               4.312928 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.017345123 = queryNorm
             0.6038159 = fieldWeight in 3069, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
         0.39899024 = weight(abstract_txt:rankings in 3069) [ClassicSimilarity], result of:
           0.39899024 = score(doc=3069,freq=3.0), product of:
             0.53672063 = queryWeight, product of:
               4.506066 = boost
               6.8671 = idf(docFreq=120, maxDocs=42740)
               0.017345123 = queryNorm
             0.7433853 = fieldWeight in 3069, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8671 = idf(docFreq=120, maxDocs=42740)
               0.0625 = fieldNorm(doc=3069)
       0.44 = coord(11/25)
   

3. Bar-Ilan, J.; Keenoy, K.; Levene, M.; Yaari, E.: Presentation bias is significant in determining user preference for search results : a user study (2009) 0.40

   0.404297 = sum of:
     0.404297 = product of:
       0.8422854 = sum of:
         0.10216101 = weight(abstract_txt:snippets in 4704) [ClassicSimilarity], result of:
           0.10216101 = score(doc=4704,freq=1.0), product of:
             0.18253548 = queryWeight, product of:
               1.1752007 = boost
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.017345123 = queryNorm
             0.55967754 = fieldWeight in 4704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.011051402 = weight(abstract_txt:that in 4704) [ClassicSimilarity], result of:
           0.011051402 = score(doc=4704,freq=2.0), product of:
             0.052213017 = queryWeight, product of:
               1.2570652 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.017345123 = queryNorm
             0.21165991 = fieldWeight in 4704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.037505317 = weight(abstract_txt:queries in 4704) [ClassicSimilarity], result of:
           0.037505317 = score(doc=4704,freq=1.0), product of:
             0.117913194 = queryWeight, product of:
               1.335779 = boost
               5.0892105 = idf(docFreq=715, maxDocs=42740)
               0.017345123 = queryNorm
             0.31807566 = fieldWeight in 4704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0892105 = idf(docFreq=715, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.047769092 = weight(abstract_txt:engine in 4704) [ClassicSimilarity], result of:
           0.047769092 = score(doc=4704,freq=1.0), product of:
             0.13854744 = queryWeight, product of:
               1.4479469 = boost
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.017345123 = queryNorm
             0.3447851 = fieldWeight in 4704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.0734063 = weight(abstract_txt:experiment in 4704) [ClassicSimilarity], result of:
           0.0734063 = score(doc=4704,freq=2.0), product of:
             0.14643541 = queryWeight, product of:
               1.4885947 = boost
               5.671426 = idf(docFreq=399, maxDocs=42740)
               0.017345123 = queryNorm
             0.50128794 = fieldWeight in 4704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.671426 = idf(docFreq=399, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.05281856 = weight(abstract_txt:retrieved in 4704) [ClassicSimilarity], result of:
           0.05281856 = score(doc=4704,freq=1.0), product of:
             0.14814655 = queryWeight, product of:
               1.4972668 = boost
               5.704466 = idf(docFreq=386, maxDocs=42740)
               0.017345123 = queryNorm
             0.35652912 = fieldWeight in 4704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.704466 = idf(docFreq=386, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.06806227 = weight(abstract_txt:asked in 4704) [ClassicSimilarity], result of:
           0.06806227 = score(doc=4704,freq=1.0), product of:
             0.17543037 = queryWeight, product of:
               1.6293178 = boost
               6.2075696 = idf(docFreq=233, maxDocs=42740)
               0.017345123 = queryNorm
             0.3879731 = fieldWeight in 4704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2075696 = idf(docFreq=233, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.028642416 = weight(abstract_txt:were in 4704) [ClassicSimilarity], result of:
           0.028642416 = score(doc=4704,freq=1.0), product of:
             0.12412243 = queryWeight, product of:
               1.9381775 = boost
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.017345123 = queryNorm
             0.23075938 = fieldWeight in 4704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.045915175 = weight(abstract_txt:users in 4704) [ClassicSimilarity], result of:
           0.045915175 = score(doc=4704,freq=2.0), product of:
             0.14535882 = queryWeight, product of:
               2.3450067 = boost
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.017345123 = queryNorm
             0.31587473 = fieldWeight in 4704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.090206 = weight(abstract_txt:results in 4704) [ClassicSimilarity], result of:
           0.090206 = score(doc=4704,freq=6.0), product of:
             0.16800186 = queryWeight, product of:
               2.7616656 = boost
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.017345123 = queryNorm
             0.5369345 = fieldWeight in 4704, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.11980648 = weight(abstract_txt:engines in 4704) [ClassicSimilarity], result of:
           0.11980648 = score(doc=4704,freq=2.0), product of:
             0.25575298 = queryWeight, product of:
               2.7821386 = boost
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.017345123 = queryNorm
             0.46844608 = fieldWeight in 4704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
         0.1649414 = weight(abstract_txt:search in 4704) [ClassicSimilarity], result of:
           0.1649414 = score(doc=4704,freq=7.0), product of:
             0.27316505 = queryWeight, product of:
               4.312928 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.017345123 = queryNorm
             0.6038159 = fieldWeight in 4704, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.0625 = fieldNorm(doc=4704)
       0.48 = coord(12/25)
   

4. Vaughan, L.: New measurements for search engine evaluation proposed and tested (2004) 0.38

   0.37557966 = sum of:
     0.37557966 = product of:
       1.0432768 = sum of:
         0.011721782 = weight(abstract_txt:that in 3536) [ClassicSimilarity], result of:
           0.011721782 = score(doc=3536,freq=1.0), product of:
             0.052213017 = queryWeight, product of:
               1.2570652 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.017345123 = queryNorm
             0.22449924 = fieldWeight in 3536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.09375 = fieldNorm(doc=3536)
         0.14330727 = weight(abstract_txt:engine in 3536) [ClassicSimilarity], result of:
           0.14330727 = score(doc=3536,freq=4.0), product of:
             0.13854744 = queryWeight, product of:
               1.4479469 = boost
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.017345123 = queryNorm
             1.0343553 = fieldWeight in 3536, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.09375 = fieldNorm(doc=3536)
         0.07785915 = weight(abstract_txt:experiment in 3536) [ClassicSimilarity], result of:
           0.07785915 = score(doc=3536,freq=1.0), product of:
             0.14643541 = queryWeight, product of:
               1.4885947 = boost
               5.671426 = idf(docFreq=399, maxDocs=42740)
               0.017345123 = queryNorm
             0.5316962 = fieldWeight in 3536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.671426 = idf(docFreq=399, maxDocs=42740)
               0.09375 = fieldNorm(doc=3536)
         0.030474262 = weight(abstract_txt:which in 3536) [ClassicSimilarity], result of:
           0.030474262 = score(doc=3536,freq=2.0), product of:
             0.07835411 = queryWeight, product of:
               1.539924 = boost
               2.9334934 = idf(docFreq=6181, maxDocs=42740)
               0.017345123 = queryNorm
             0.38892996 = fieldWeight in 3536, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.9334934 = idf(docFreq=6181, maxDocs=42740)
               0.09375 = fieldNorm(doc=3536)
         0.042963624 = weight(abstract_txt:were in 3536) [ClassicSimilarity], result of:
           0.042963624 = score(doc=3536,freq=1.0), product of:
             0.12412243 = queryWeight, product of:
               1.9381775 = boost
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.017345123 = queryNorm
             0.34613907 = fieldWeight in 3536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.09375 = fieldNorm(doc=3536)
         0.055239663 = weight(abstract_txt:results in 3536) [ClassicSimilarity], result of:
           0.055239663 = score(doc=3536,freq=1.0), product of:
             0.16800186 = queryWeight, product of:
               2.7616656 = boost
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.017345123 = queryNorm
             0.32880387 = fieldWeight in 3536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.09375 = fieldNorm(doc=3536)
         0.12707397 = weight(abstract_txt:engines in 3536) [ClassicSimilarity], result of:
           0.12707397 = score(doc=3536,freq=1.0), product of:
             0.25575298 = queryWeight, product of:
               2.7821386 = boost
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.017345123 = queryNorm
             0.4968621 = fieldWeight in 3536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.09375 = fieldNorm(doc=3536)
         0.20910141 = weight(abstract_txt:search in 3536) [ClassicSimilarity], result of:
           0.20910141 = score(doc=3536,freq=5.0), product of:
             0.27316505 = queryWeight, product of:
               4.312928 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.017345123 = queryNorm
             0.76547647 = fieldWeight in 3536, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.09375 = fieldNorm(doc=3536)
         0.3455357 = weight(abstract_txt:rankings in 3536) [ClassicSimilarity], result of:
           0.3455357 = score(doc=3536,freq=1.0), product of:
             0.53672063 = queryWeight, product of:
               4.506066 = boost
               6.8671 = idf(docFreq=120, maxDocs=42740)
               0.017345123 = queryNorm
             0.6437906 = fieldWeight in 3536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8671 = idf(docFreq=120, maxDocs=42740)
               0.09375 = fieldNorm(doc=3536)
       0.36 = coord(9/25)
   

5. Spink, A.; Jansen, B.J.; Blakely, C.; Koshman, S.: ¬A study of results overlap and uniqueness among major Web search engines (2006) 0.33

   0.33291137 = sum of:
     0.33291137 = product of:
       0.9247538 = sum of:
         0.0068377065 = weight(abstract_txt:that in 2994) [ClassicSimilarity], result of:
           0.0068377065 = score(doc=2994,freq=1.0), product of:
             0.052213017 = queryWeight, product of:
               1.2570652 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.017345123 = queryNorm
             0.13095789 = fieldWeight in 2994, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2994)
         0.09282092 = weight(abstract_txt:queries in 2994) [ClassicSimilarity], result of:
           0.09282092 = score(doc=2994,freq=8.0), product of:
             0.117913194 = queryWeight, product of:
               1.335779 = boost
               5.0892105 = idf(docFreq=715, maxDocs=42740)
               0.017345123 = queryNorm
             0.78719705 = fieldWeight in 2994, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.0892105 = idf(docFreq=715, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2994)
         0.059111234 = weight(abstract_txt:engine in 2994) [ClassicSimilarity], result of:
           0.059111234 = score(doc=2994,freq=2.0), product of:
             0.13854744 = queryWeight, product of:
               1.4479469 = boost
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.017345123 = queryNorm
             0.42664978 = fieldWeight in 2994, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5165615 = idf(docFreq=466, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2994)
         0.06535964 = weight(abstract_txt:retrieved in 2994) [ClassicSimilarity], result of:
           0.06535964 = score(doc=2994,freq=2.0), product of:
             0.14814655 = queryWeight, product of:
               1.4972668 = boost
               5.704466 = idf(docFreq=386, maxDocs=42740)
               0.017345123 = queryNorm
             0.4411823 = fieldWeight in 2994, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.704466 = idf(docFreq=386, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2994)
         0.066243544 = weight(abstract_txt:rank in 2994) [ClassicSimilarity], result of:
           0.066243544 = score(doc=2994,freq=1.0), product of:
             0.18833202 = queryWeight, product of:
               1.6881673 = boost
               6.431782 = idf(docFreq=186, maxDocs=42740)
               0.017345123 = queryNorm
             0.35173807 = fieldWeight in 2994, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.431782 = idf(docFreq=186, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2994)
         0.03544318 = weight(abstract_txt:were in 2994) [ClassicSimilarity], result of:
           0.03544318 = score(doc=2994,freq=2.0), product of:
             0.12412243 = queryWeight, product of:
               1.9381775 = boost
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.017345123 = queryNorm
             0.28555015 = fieldWeight in 2994, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.69215 = idf(docFreq=2894, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2994)
         0.09666941 = weight(abstract_txt:results in 2994) [ClassicSimilarity], result of:
           0.09666941 = score(doc=2994,freq=9.0), product of:
             0.16800186 = queryWeight, product of:
               2.7616656 = boost
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.017345123 = queryNorm
             0.5754068 = fieldWeight in 2994, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2994)
         0.2773559 = weight(abstract_txt:engines in 2994) [ClassicSimilarity], result of:
           0.2773559 = score(doc=2994,freq=14.0), product of:
             0.25575298 = queryWeight, product of:
               2.7821386 = boost
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.017345123 = queryNorm
             1.0844679 = fieldWeight in 2994, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.2998624 = idf(docFreq=579, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2994)
         0.22491229 = weight(abstract_txt:search in 2994) [ClassicSimilarity], result of:
           0.22491229 = score(doc=2994,freq=17.0), product of:
             0.27316505 = queryWeight, product of:
               4.312928 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.017345123 = queryNorm
             0.82335675 = fieldWeight in 2994, product of:
               4.1231055 = tf(freq=17.0), with freq of:
                 17.0 = termFreq=17.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2994)
       0.36 = coord(9/25)