Document (#34704)

Author

Bar-Ilan, J.
Keenoy, K.
Levene, M.
Yaari, E.

Title

Presentation bias is significant in determining user preference for search results : a user study

Source

Journal of the American Society for Information Science and Technology. 60(2009) no.1, S.135-149

Year

2009

Abstract

We describe the results of an experiment designed to study user preferences for different orderings of search results from three major search engines. In the experiment, 65 users were asked to choose the best ordering from two different orderings of the same set of search results: Each pair consisted of the search engine's original top-10 ordering and a synthetic ordering created from the same top-10 results retrieved by the search engine. This process was repeated for 12 queries and nine different synthetic orderings. The results show that there is a slight overall preference for the search engines' original orderings, but the preference is rarely significant. Users' choice of the best result from each of the different orderings indicates that placement on the page (i.e., whether the result appears near the top) is the most important factor used in determining the quality of the result, not the actual content displayed in the top-10 snippets. In addition to the placement bias, we detected a small bias due to the reputation of the sites appearing in the search results.

Similar documents (author)

1. Bar-Ilan, J.; Levene, M.: ¬The hw-rank : an h-index variant for ranking web pages (2015) 5.41

   5.40834 = sum of:
     5.40834 = sum of:
       2.1058996 = weight(author_txt:ilan in 1694) [ClassicSimilarity], result of:
         2.1058996 = score(doc=1694,freq=1.0), product of:
           0.5952885 = queryWeight, product of:
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.07361993 = queryNorm
           3.5376115 = fieldWeight in 1694, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.4375 = fieldNorm(doc=1694)
       3.3024404 = weight(author_txt:levene in 1694) [ClassicSimilarity], result of:
         3.3024404 = score(doc=1694,freq=1.0), product of:
           0.80351204 = queryWeight, product of:
             1.1618029 = boost
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07361993 = queryNorm
           4.1100073 = fieldWeight in 1694, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.4375 = fieldNorm(doc=1694)
   

2. Bar-Ilan, J.; Levene, M.; Mat-Hassan, M.: Methods for evaluating dynamic changes in search engine rankings : a case study (2006) 3.86

   3.8630998 = sum of:
     3.8630998 = sum of:
       1.5042138 = weight(author_txt:ilan in 616) [ClassicSimilarity], result of:
         1.5042138 = score(doc=616,freq=1.0), product of:
           0.5952885 = queryWeight, product of:
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.07361993 = queryNorm
           2.5268652 = fieldWeight in 616, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.3125 = fieldNorm(doc=616)
       2.358886 = weight(author_txt:levene in 616) [ClassicSimilarity], result of:
         2.358886 = score(doc=616,freq=1.0), product of:
           0.80351204 = queryWeight, product of:
             1.1618029 = boost
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07361993 = queryNorm
           2.9357195 = fieldWeight in 616, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.3125 = fieldNorm(doc=616)
   

3. Bar-Ilan, J.; Keenoy, K.; Yaari, E.; Levene, M.: User rankings of search engine results (2007) 3.86

   3.8630998 = sum of:
     3.8630998 = sum of:
       1.5042138 = weight(author_txt:ilan in 470) [ClassicSimilarity], result of:
         1.5042138 = score(doc=470,freq=1.0), product of:
           0.5952885 = queryWeight, product of:
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.07361993 = queryNorm
           2.5268652 = fieldWeight in 470, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.3125 = fieldNorm(doc=470)
       2.358886 = weight(author_txt:levene in 470) [ClassicSimilarity], result of:
         2.358886 = score(doc=470,freq=1.0), product of:
           0.80351204 = queryWeight, product of:
             1.1618029 = boost
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07361993 = queryNorm
           2.9357195 = fieldWeight in 470, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.3125 = fieldNorm(doc=470)
   

4. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016) 3.86

   3.8630998 = sum of:
     3.8630998 = sum of:
       1.5042138 = weight(author_txt:ilan in 3071) [ClassicSimilarity], result of:
         1.5042138 = score(doc=3071,freq=1.0), product of:
           0.5952885 = queryWeight, product of:
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.07361993 = queryNorm
           2.5268652 = fieldWeight in 3071, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.3125 = fieldNorm(doc=3071)
       2.358886 = weight(author_txt:levene in 3071) [ClassicSimilarity], result of:
         2.358886 = score(doc=3071,freq=1.0), product of:
           0.80351204 = queryWeight, product of:
             1.1618029 = boost
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07361993 = queryNorm
           2.9357195 = fieldWeight in 3071, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.3125 = fieldNorm(doc=3071)
   

5. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Analysis of change in users' assessment of search results over time (2017) 3.86

   3.8630998 = sum of:
     3.8630998 = sum of:
       1.5042138 = weight(author_txt:ilan in 3593) [ClassicSimilarity], result of:
         1.5042138 = score(doc=3593,freq=1.0), product of:
           0.5952885 = queryWeight, product of:
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.07361993 = queryNorm
           2.5268652 = fieldWeight in 3593, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.085969 = idf(docFreq=36, maxDocs=44218)
             0.3125 = fieldNorm(doc=3593)
       2.358886 = weight(author_txt:levene in 3593) [ClassicSimilarity], result of:
         2.358886 = score(doc=3593,freq=1.0), product of:
           0.80351204 = queryWeight, product of:
             1.1618029 = boost
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07361993 = queryNorm
           2.9357195 = fieldWeight in 3593, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.3125 = fieldNorm(doc=3593)
   

Similar documents (content)

1. Losee, R.M.: When information retrieval measures agree about the relative quality of document rankings (2000) 0.17

   0.1680087 = sum of:
     0.1680087 = product of:
       0.8400435 = sum of:
         0.037998386 = weight(abstract_txt:engines in 4860) [ClassicSimilarity], result of:
           0.037998386 = score(doc=4860,freq=1.0), product of:
             0.09174154 = queryWeight, product of:
               1.3620342 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0127048325 = queryNorm
             0.41418952 = fieldWeight in 4860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.078125 = fieldNorm(doc=4860)
         0.025117027 = weight(abstract_txt:different in 4860) [ClassicSimilarity], result of:
           0.025117027 = score(doc=4860,freq=1.0), product of:
             0.08770912 = queryWeight, product of:
               1.8833991 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0127048325 = queryNorm
             0.28636733 = fieldWeight in 4860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.078125 = fieldNorm(doc=4860)
         0.1777864 = weight(abstract_txt:ordering in 4860) [ClassicSimilarity], result of:
           0.1777864 = score(doc=4860,freq=2.0), product of:
             0.23317146 = queryWeight, product of:
               2.6594286 = boost
               6.901097 = idf(docFreq=120, maxDocs=44218)
               0.0127048325 = queryNorm
             0.76247066 = fieldWeight in 4860, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.901097 = idf(docFreq=120, maxDocs=44218)
               0.078125 = fieldNorm(doc=4860)
         0.07060943 = weight(abstract_txt:search in 4860) [ClassicSimilarity], result of:
           0.07060943 = score(doc=4860,freq=2.0), product of:
             0.17470597 = queryWeight, product of:
               3.759143 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0127048325 = queryNorm
             0.4041615 = fieldWeight in 4860, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=4860)
         0.52853227 = weight(abstract_txt:orderings in 4860) [ClassicSimilarity], result of:
           0.52853227 = score(doc=4860,freq=1.0), product of:
             0.72014 = queryWeight, product of:
               6.0336967 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0127048325 = queryNorm
             0.7339299 = fieldWeight in 4860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.078125 = fieldNorm(doc=4860)
       0.2 = coord(5/25)
   

2. Spina, D.; Trippas, J.R.; Cavedon, L.; Sanderson, M.: Extracting audio summaries to support effective spoken document search (2017) 0.16

   0.16362314 = sum of:
     0.16362314 = product of:
       0.4545087 = sum of:
         0.0926016 = weight(abstract_txt:snippets in 3788) [ClassicSimilarity], result of:
           0.0926016 = score(doc=3788,freq=1.0), product of:
             0.1318636 = queryWeight, product of:
               1.1546556 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.0127048325 = queryNorm
             0.7022529 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.027178701 = weight(abstract_txt:same in 3788) [ClassicSimilarity], result of:
           0.027178701 = score(doc=3788,freq=1.0), product of:
             0.07337392 = queryWeight, product of:
               1.2180802 = boost
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.0127048325 = queryNorm
             0.37041363 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.027629595 = weight(abstract_txt:significant in 3788) [ClassicSimilarity], result of:
           0.027629595 = score(doc=3788,freq=1.0), product of:
             0.07418321 = queryWeight, product of:
               1.2247792 = boost
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.0127048325 = queryNorm
             0.3724508 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.019117313 = weight(abstract_txt:user in 3788) [ClassicSimilarity], result of:
           0.019117313 = score(doc=3788,freq=1.0), product of:
             0.06643102 = queryWeight, product of:
               1.4195023 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0127048325 = queryNorm
             0.2877769 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.021535588 = weight(abstract_txt:from in 3788) [ClassicSimilarity], result of:
           0.021535588 = score(doc=3788,freq=4.0), product of:
             0.049867444 = queryWeight, product of:
               1.4201314 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0127048325 = queryNorm
             0.43185666 = fieldWeight in 3788, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.046271194 = weight(abstract_txt:experiment in 3788) [ClassicSimilarity], result of:
           0.046271194 = score(doc=3788,freq=1.0), product of:
             0.10461559 = queryWeight, product of:
               1.4544648 = boost
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.0127048325 = queryNorm
             0.4422973 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.1325542 = weight(abstract_txt:preference in 3788) [ClassicSimilarity], result of:
           0.1325542 = score(doc=3788,freq=1.0), product of:
             0.24155463 = queryWeight, product of:
               2.7068133 = boost
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.0127048325 = queryNorm
             0.5487546 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.037692092 = weight(abstract_txt:results in 3788) [ClassicSimilarity], result of:
           0.037692092 = score(doc=3788,freq=1.0), product of:
             0.13854115 = queryWeight, product of:
               3.131327 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0127048325 = queryNorm
             0.27206424 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.049928404 = weight(abstract_txt:search in 3788) [ClassicSimilarity], result of:
           0.049928404 = score(doc=3788,freq=1.0), product of:
             0.17470597 = queryWeight, product of:
               3.759143 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0127048325 = queryNorm
             0.28578535 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
       0.36 = coord(9/25)
   

3. Bar-Ilan, J.; Keenoy, K.; Yaari, E.; Levene, M.: User rankings of search engine results (2007) 0.15

   0.1539122 = sum of:
     0.1539122 = product of:
       0.42753386 = sum of:
         0.014253505 = weight(abstract_txt:each in 470) [ClassicSimilarity], result of:
           0.014253505 = score(doc=470,freq=1.0), product of:
             0.055370323 = queryWeight, product of:
               1.058141 = boost
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.0127048325 = queryNorm
             0.25742137 = fieldWeight in 470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.07408127 = weight(abstract_txt:snippets in 470) [ClassicSimilarity], result of:
           0.07408127 = score(doc=470,freq=1.0), product of:
             0.1318636 = queryWeight, product of:
               1.1546556 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.0127048325 = queryNorm
             0.5618023 = fieldWeight in 470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.02174296 = weight(abstract_txt:same in 470) [ClassicSimilarity], result of:
           0.02174296 = score(doc=470,freq=1.0), product of:
             0.07337392 = queryWeight, product of:
               1.2180802 = boost
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.0127048325 = queryNorm
             0.2963309 = fieldWeight in 470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.060797412 = weight(abstract_txt:engines in 470) [ClassicSimilarity], result of:
           0.060797412 = score(doc=470,freq=4.0), product of:
             0.09174154 = queryWeight, product of:
               1.3620342 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0127048325 = queryNorm
             0.6627032 = fieldWeight in 470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.015293851 = weight(abstract_txt:user in 470) [ClassicSimilarity], result of:
           0.015293851 = score(doc=470,freq=1.0), product of:
             0.06643102 = queryWeight, product of:
               1.4195023 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0127048325 = queryNorm
             0.23022151 = fieldWeight in 470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.008614236 = weight(abstract_txt:from in 470) [ClassicSimilarity], result of:
           0.008614236 = score(doc=470,freq=1.0), product of:
             0.049867444 = queryWeight, product of:
               1.4201314 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0127048325 = queryNorm
             0.17274266 = fieldWeight in 470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.05234988 = weight(abstract_txt:experiment in 470) [ClassicSimilarity], result of:
           0.05234988 = score(doc=470,freq=2.0), product of:
             0.10461559 = queryWeight, product of:
               1.4544648 = boost
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.0127048325 = queryNorm
             0.5004023 = fieldWeight in 470, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.06742566 = weight(abstract_txt:results in 470) [ClassicSimilarity], result of:
           0.06742566 = score(doc=470,freq=5.0), product of:
             0.13854115 = queryWeight, product of:
               3.131327 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0127048325 = queryNorm
             0.48668328 = fieldWeight in 470, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.11297508 = weight(abstract_txt:search in 470) [ClassicSimilarity], result of:
           0.11297508 = score(doc=470,freq=8.0), product of:
             0.17470597 = queryWeight, product of:
               3.759143 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0127048325 = queryNorm
             0.6466584 = fieldWeight in 470, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
       0.36 = coord(9/25)
   

4. Spink, A.; Jansen, B.J.; Blakely, C.; Koshman, S.: ¬A study of results overlap and uniqueness among major Web search engines (2006) 0.14

   0.14049374 = sum of:
     0.14049374 = product of:
       0.43904296 = sum of:
         0.026905539 = weight(abstract_txt:same in 993) [ClassicSimilarity], result of:
           0.026905539 = score(doc=993,freq=2.0), product of:
             0.07337392 = queryWeight, product of:
               1.2180802 = boost
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.0127048325 = queryNorm
             0.36669075 = fieldWeight in 993, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.027351905 = weight(abstract_txt:significant in 993) [ClassicSimilarity], result of:
           0.027351905 = score(doc=993,freq=2.0), product of:
             0.07418321 = queryWeight, product of:
               1.2247792 = boost
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.0127048325 = queryNorm
             0.36870748 = fieldWeight in 993, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.09952386 = weight(abstract_txt:engines in 993) [ClassicSimilarity], result of:
           0.09952386 = score(doc=993,freq=14.0), product of:
             0.09174154 = queryWeight, product of:
               1.3620342 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0127048325 = queryNorm
             1.0848287 = fieldWeight in 993, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.013382119 = weight(abstract_txt:user in 993) [ClassicSimilarity], result of:
           0.013382119 = score(doc=993,freq=1.0), product of:
             0.06643102 = queryWeight, product of:
               1.4195023 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0127048325 = queryNorm
             0.20144382 = fieldWeight in 993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.013055257 = weight(abstract_txt:from in 993) [ClassicSimilarity], result of:
           0.013055257 = score(doc=993,freq=3.0), product of:
             0.049867444 = queryWeight, product of:
               1.4201314 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0127048325 = queryNorm
             0.2617992 = fieldWeight in 993, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.035568826 = weight(abstract_txt:result in 993) [ClassicSimilarity], result of:
           0.035568826 = score(doc=993,freq=1.0), product of:
             0.12746786 = queryWeight, product of:
               1.9663054 = boost
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.0127048325 = queryNorm
             0.27904153 = fieldWeight in 993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.07915339 = weight(abstract_txt:results in 993) [ClassicSimilarity], result of:
           0.07915339 = score(doc=993,freq=9.0), product of:
             0.13854115 = queryWeight, product of:
               3.131327 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0127048325 = queryNorm
             0.5713349 = fieldWeight in 993, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.14410207 = weight(abstract_txt:search in 993) [ClassicSimilarity], result of:
           0.14410207 = score(doc=993,freq=17.0), product of:
             0.17470597 = queryWeight, product of:
               3.759143 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0127048325 = queryNorm
             0.82482624 = fieldWeight in 993, product of:
               4.1231055 = tf(freq=17.0), with freq of:
                 17.0 = termFreq=17.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
       0.32 = coord(8/25)
   

5. Losee, R.M.: Improving collection browsing : small world networking and Gray code ordering (2017) 0.14

   0.13544385 = sum of:
     0.13544385 = product of:
       0.6772193 = sum of:
         0.021628771 = weight(abstract_txt:user in 5148) [ClassicSimilarity], result of:
           0.021628771 = score(doc=5148,freq=2.0), product of:
             0.06643102 = queryWeight, product of:
               1.4195023 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0127048325 = queryNorm
             0.32558239 = fieldWeight in 5148, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=5148)
         0.02841667 = weight(abstract_txt:different in 5148) [ClassicSimilarity], result of:
           0.02841667 = score(doc=5148,freq=2.0), product of:
             0.08770912 = queryWeight, product of:
               1.8833991 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0127048325 = queryNorm
             0.32398763 = fieldWeight in 5148, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=5148)
         0.17419438 = weight(abstract_txt:ordering in 5148) [ClassicSimilarity], result of:
           0.17419438 = score(doc=5148,freq=3.0), product of:
             0.23317146 = queryWeight, product of:
               2.6594286 = boost
               6.901097 = idf(docFreq=120, maxDocs=44218)
               0.0127048325 = queryNorm
             0.7470656 = fieldWeight in 5148, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.901097 = idf(docFreq=120, maxDocs=44218)
               0.0625 = fieldNorm(doc=5148)
         0.030153671 = weight(abstract_txt:results in 5148) [ClassicSimilarity], result of:
           0.030153671 = score(doc=5148,freq=1.0), product of:
             0.13854115 = queryWeight, product of:
               3.131327 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0127048325 = queryNorm
             0.21765138 = fieldWeight in 5148, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=5148)
         0.42282578 = weight(abstract_txt:orderings in 5148) [ClassicSimilarity], result of:
           0.42282578 = score(doc=5148,freq=1.0), product of:
             0.72014 = queryWeight, product of:
               6.0336967 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0127048325 = queryNorm
             0.5871439 = fieldWeight in 5148, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0625 = fieldNorm(doc=5148)
       0.2 = coord(5/25)