Document (#40146)

Author
Schaer, P.
Mayr, P.
Sünkler, S.
Lewandowski, D.
Title
How relevant is the long tail? : a relevance assessment study on million short
Source
https://arxiv.org/abs/1606.06081
Year
2016
Abstract
Users of web search engines are known to mostly focus on the top ranked results of the search engine result page. While many studies support this well known information seeking pattern only few studies concentrate on the question what users are missing by neglecting lower ranked results. To learn more about the relevance distributions in the so-called long tail we conducted a relevance assessment study with the Million Short long-tail web search engine. While we see a clear difference in the content between the head and the tail of the search engine result list we see no statistical significant differences in the binary relevance judgments and weak significant differences when using graded relevance. The tail contains different but still valuable results. We argue that the long tail can be a rich source for the diversification of web search engine result lists but it needs more evaluation to clearly describe the differences.
Content
Die Studie wurde auf der diesjährigen CLEF-Konferenz mit dem Best Poster Award ausgezeichnet.
Footnote
To appear in Experimental IR Meets Multilinguality, Multimodality, and Interaction. 7th International Conference of the CLEF Association, CLEF 2016, \'Evora, Portugal, September 5-8, 2016.
Theme
Suchmaschinen
Retrievalstudien

Similar documents (author)

  1. Lewandowski, D.; Sünkler, S.: ¬Das Relevance Assessment Tool : eine modulare Software zur Unterstützung bei der Durchführung vielfältiger Studien mit Suchmaschinen (2019) 2.10
    2.1011984 = sum of:
      2.1011984 = product of:
        4.202397 = sum of:
          1.5363363 = weight(author_txt:lewandowski in 1945) [ClassicSimilarity], result of:
            1.5363363 = score(doc=1945,freq=1.0), product of:
              0.39897376 = queryWeight, product of:
                7.7014403 = idf(docFreq=51, maxDocs=42306)
                0.051805083 = queryNorm
              3.8507202 = fieldWeight in 1945, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.7014403 = idf(docFreq=51, maxDocs=42306)
                0.5 = fieldNorm(doc=1945)
          2.6660607 = weight(author_txt:sünkler in 1945) [ClassicSimilarity], result of:
            2.6660607 = score(doc=1945,freq=1.0), product of:
              0.57614726 = queryWeight, product of:
                1.2016959 = boost
                9.254789 = idf(docFreq=10, maxDocs=42306)
                0.051805083 = queryNorm
              4.6273947 = fieldWeight in 1945, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.254789 = idf(docFreq=10, maxDocs=42306)
                0.5 = fieldNorm(doc=1945)
        0.5 = coord(2/4)
    
  2. Lewandowski, D.; Mayr, P.: Exploring the academic invisible Web (2006) 1.64
    1.6427386 = sum of:
      1.6427386 = product of:
        3.2854772 = sum of:
          1.5363363 = weight(author_txt:lewandowski in 4753) [ClassicSimilarity], result of:
            1.5363363 = score(doc=4753,freq=1.0), product of:
              0.39897376 = queryWeight, product of:
                7.7014403 = idf(docFreq=51, maxDocs=42306)
                0.051805083 = queryNorm
              3.8507202 = fieldWeight in 4753, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.7014403 = idf(docFreq=51, maxDocs=42306)
                0.5 = fieldNorm(doc=4753)
          1.7491407 = weight(author_txt:mayr in 4753) [ClassicSimilarity], result of:
            1.7491407 = score(doc=4753,freq=1.0), product of:
              0.43501407 = queryWeight, product of:
                1.0441899 = boost
                8.041766 = idf(docFreq=36, maxDocs=42306)
                0.051805083 = queryNorm
              4.020883 = fieldWeight in 4753, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.041766 = idf(docFreq=36, maxDocs=42306)
                0.5 = fieldNorm(doc=4753)
        0.5 = coord(2/4)
    
  3. Lewandowski, D.; Mayr, P.: Exploring the academic invisible Web (2006) 1.64
    1.6427386 = sum of:
      1.6427386 = product of:
        3.2854772 = sum of:
          1.5363363 = weight(author_txt:lewandowski in 400) [ClassicSimilarity], result of:
            1.5363363 = score(doc=400,freq=1.0), product of:
              0.39897376 = queryWeight, product of:
                7.7014403 = idf(docFreq=51, maxDocs=42306)
                0.051805083 = queryNorm
              3.8507202 = fieldWeight in 400, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.7014403 = idf(docFreq=51, maxDocs=42306)
                0.5 = fieldNorm(doc=400)
          1.7491407 = weight(author_txt:mayr in 400) [ClassicSimilarity], result of:
            1.7491407 = score(doc=400,freq=1.0), product of:
              0.43501407 = queryWeight, product of:
                1.0441899 = boost
                8.041766 = idf(docFreq=36, maxDocs=42306)
                0.051805083 = queryNorm
              4.020883 = fieldWeight in 400, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.041766 = idf(docFreq=36, maxDocs=42306)
                0.5 = fieldNorm(doc=400)
        0.5 = coord(2/4)
    
  4. Mayr, P.; Schaer, P.; Mutschke, P.: ¬A science model driven retrieval prototype (2011) 1.63
    1.6277659 = sum of:
      1.6277659 = product of:
        3.2555318 = sum of:
          1.3118554 = weight(author_txt:mayr in 2650) [ClassicSimilarity], result of:
            1.3118554 = score(doc=2650,freq=1.0), product of:
              0.43501407 = queryWeight, product of:
                1.0441899 = boost
                8.041766 = idf(docFreq=36, maxDocs=42306)
                0.051805083 = queryNorm
              3.0156622 = fieldWeight in 2650, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.041766 = idf(docFreq=36, maxDocs=42306)
                0.375 = fieldNorm(doc=2650)
          1.9436765 = weight(author_txt:schaer in 2650) [ClassicSimilarity], result of:
            1.9436765 = score(doc=2650,freq=1.0), product of:
              0.5653646 = queryWeight, product of:
                1.1903979 = boost
                9.167778 = idf(docFreq=11, maxDocs=42306)
                0.051805083 = queryNorm
              3.4379168 = fieldWeight in 2650, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.167778 = idf(docFreq=11, maxDocs=42306)
                0.375 = fieldNorm(doc=2650)
        0.5 = coord(2/4)
    
  5. Lewandowski, D.; Sünkler, S.; Kerkmann, F.: Are ads on Google search engine results pages labeled clearly enough? : the influence of knowledge on search ads on users' selection behaviour (2017) 1.58
    1.5758989 = sum of:
      1.5758989 = product of:
        3.1517978 = sum of:
          1.1522522 = weight(author_txt:lewandowski in 486) [ClassicSimilarity], result of:
            1.1522522 = score(doc=486,freq=1.0), product of:
              0.39897376 = queryWeight, product of:
                7.7014403 = idf(docFreq=51, maxDocs=42306)
                0.051805083 = queryNorm
              2.88804 = fieldWeight in 486, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.7014403 = idf(docFreq=51, maxDocs=42306)
                0.375 = fieldNorm(doc=486)
          1.9995456 = weight(author_txt:sünkler in 486) [ClassicSimilarity], result of:
            1.9995456 = score(doc=486,freq=1.0), product of:
              0.57614726 = queryWeight, product of:
                1.2016959 = boost
                9.254789 = idf(docFreq=10, maxDocs=42306)
                0.051805083 = queryNorm
              3.470546 = fieldWeight in 486, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.254789 = idf(docFreq=10, maxDocs=42306)
                0.375 = fieldNorm(doc=486)
        0.5 = coord(2/4)
    

Similar documents (content)

  1. Li, X.; Schijvenaars, B.J.A.; Rijke, M.de: Investigating queries and search failures in academic search (2017) 0.22
    0.21965306 = sum of:
      0.21965306 = product of:
        0.6864158 = sum of:
          0.0121469125 = weight(abstract_txt:users in 1952) [ClassicSimilarity], result of:
            0.0121469125 = score(doc=1952,freq=2.0), product of:
              0.043891504 = queryWeight, product of:
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.012265862 = queryNorm
              0.2767486 = fieldWeight in 1952, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.0546875 = fieldNorm(doc=1952)
          0.020861197 = weight(abstract_txt:significant in 1952) [ClassicSimilarity], result of:
            0.020861197 = score(doc=1952,freq=1.0), product of:
              0.07930599 = queryWeight, product of:
                1.3441966 = boost
                4.810001 = idf(docFreq=936, maxDocs=42306)
                0.012265862 = queryNorm
              0.26304692 = fieldWeight in 1952, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.810001 = idf(docFreq=936, maxDocs=42306)
                0.0546875 = fieldNorm(doc=1952)
          0.02703525 = weight(abstract_txt:known in 1952) [ClassicSimilarity], result of:
            0.02703525 = score(doc=1952,freq=1.0), product of:
              0.09426854 = queryWeight, product of:
                1.4655248 = boost
                5.2441554 = idf(docFreq=606, maxDocs=42306)
                0.012265862 = queryNorm
              0.28678975 = fieldWeight in 1952, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2441554 = idf(docFreq=606, maxDocs=42306)
                0.0546875 = fieldNorm(doc=1952)
          0.035009142 = weight(abstract_txt:differences in 1952) [ClassicSimilarity], result of:
            0.035009142 = score(doc=1952,freq=1.0), product of:
              0.12820292 = queryWeight, product of:
                2.0931692 = boost
                4.99339 = idf(docFreq=779, maxDocs=42306)
                0.012265862 = queryNorm
              0.27307603 = fieldWeight in 1952, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.99339 = idf(docFreq=779, maxDocs=42306)
                0.0546875 = fieldNorm(doc=1952)
          0.038106117 = weight(abstract_txt:result in 1952) [ClassicSimilarity], result of:
            0.038106117 = score(doc=1952,freq=1.0), product of:
              0.13565633 = queryWeight, product of:
                2.1531556 = boost
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.012265862 = queryNorm
              0.28090188 = fieldWeight in 1952, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.0546875 = fieldNorm(doc=1952)
          0.08566773 = weight(abstract_txt:search in 1952) [ClassicSimilarity], result of:
            0.08566773 = score(doc=1952,freq=14.0), product of:
              0.11452369 = queryWeight, product of:
                2.5540385 = boost
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.012265862 = queryNorm
              0.748035 = fieldWeight in 1952, product of:
                3.7416575 = tf(freq=14.0), with freq of:
                  14.0 = termFreq=14.0
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.0546875 = fieldNorm(doc=1952)
          0.089250356 = weight(abstract_txt:engine in 1952) [ClassicSimilarity], result of:
            0.089250356 = score(doc=1952,freq=2.0), product of:
              0.2090033 = queryWeight, product of:
                3.0860386 = boost
                5.5214577 = idf(docFreq=459, maxDocs=42306)
                0.012265862 = queryNorm
              0.42702845 = fieldWeight in 1952, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.5214577 = idf(docFreq=459, maxDocs=42306)
                0.0546875 = fieldNorm(doc=1952)
          0.37833914 = weight(abstract_txt:tail in 1952) [ClassicSimilarity], result of:
            0.37833914 = score(doc=1952,freq=1.0), product of:
              0.7895406 = queryWeight, product of:
                7.346113 = boost
                8.762313 = idf(docFreq=17, maxDocs=42306)
                0.012265862 = queryNorm
              0.47918898 = fieldWeight in 1952, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.762313 = idf(docFreq=17, maxDocs=42306)
                0.0546875 = fieldNorm(doc=1952)
        0.32 = coord(8/25)
    
  2. Crystal, A.; Greenberg, J.: Relevance criteria identified by health information users during Web searches (2006) 0.19
    0.19310011 = sum of:
      0.19310011 = product of:
        0.8045838 = sum of:
          0.031041512 = weight(abstract_txt:users in 910) [ClassicSimilarity], result of:
            0.031041512 = score(doc=910,freq=10.0), product of:
              0.043891504 = queryWeight, product of:
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.012265862 = queryNorm
              0.70723283 = fieldWeight in 910, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.045321655 = weight(abstract_txt:search in 910) [ClassicSimilarity], result of:
            0.045321655 = score(doc=910,freq=3.0), product of:
              0.11452369 = queryWeight, product of:
                2.5540385 = boost
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.012265862 = queryNorm
              0.39574045 = fieldWeight in 910, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.06462285 = weight(abstract_txt:long in 910) [ClassicSimilarity], result of:
            0.06462285 = score(doc=910,freq=1.0), product of:
              0.19424625 = queryWeight, product of:
                2.9750967 = boost
                5.322963 = idf(docFreq=560, maxDocs=42306)
                0.012265862 = queryNorm
              0.3326852 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.322963 = idf(docFreq=560, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.10200041 = weight(abstract_txt:engine in 910) [ClassicSimilarity], result of:
            0.10200041 = score(doc=910,freq=2.0), product of:
              0.2090033 = queryWeight, product of:
                3.0860386 = boost
                5.5214577 = idf(docFreq=459, maxDocs=42306)
                0.012265862 = queryNorm
              0.48803252 = fieldWeight in 910, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.5214577 = idf(docFreq=459, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.12920979 = weight(abstract_txt:relevance in 910) [ClassicSimilarity], result of:
            0.12920979 = score(doc=910,freq=4.0), product of:
              0.20920666 = queryWeight, product of:
                3.4519742 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.012265862 = queryNorm
              0.61761796 = fieldWeight in 910, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.4323876 = weight(abstract_txt:tail in 910) [ClassicSimilarity], result of:
            0.4323876 = score(doc=910,freq=1.0), product of:
              0.7895406 = queryWeight, product of:
                7.346113 = boost
                8.762313 = idf(docFreq=17, maxDocs=42306)
                0.012265862 = queryNorm
              0.54764456 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.762313 = idf(docFreq=17, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
        0.24 = coord(6/25)
    
  3. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016) 0.17
    0.16834712 = sum of:
      0.16834712 = product of:
        0.4208678 = sum of:
          0.01487687 = weight(abstract_txt:users in 72) [ClassicSimilarity], result of:
            0.01487687 = score(doc=72,freq=3.0), product of:
              0.043891504 = queryWeight, product of:
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.012265862 = queryNorm
              0.33894646 = fieldWeight in 72, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
          0.015171588 = weight(abstract_txt:studies in 72) [ClassicSimilarity], result of:
            0.015171588 = score(doc=72,freq=1.0), product of:
              0.064135805 = queryWeight, product of:
                1.2088156 = boost
                4.325561 = idf(docFreq=1520, maxDocs=42306)
                0.012265862 = queryNorm
              0.23655412 = fieldWeight in 72, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.325561 = idf(docFreq=1520, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
          0.03823362 = weight(abstract_txt:known in 72) [ClassicSimilarity], result of:
            0.03823362 = score(doc=72,freq=2.0), product of:
              0.09426854 = queryWeight, product of:
                1.4655248 = boost
                5.2441554 = idf(docFreq=606, maxDocs=42306)
                0.012265862 = queryNorm
              0.40558195 = fieldWeight in 72, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.2441554 = idf(docFreq=606, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
          0.02112461 = weight(abstract_txt:results in 72) [ClassicSimilarity], result of:
            0.02112461 = score(doc=72,freq=3.0), product of:
              0.06347397 = queryWeight, product of:
                1.472832 = boost
                3.5135355 = idf(docFreq=3425, maxDocs=42306)
                0.012265862 = queryNorm
              0.33280745 = fieldWeight in 72, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.5135355 = idf(docFreq=3425, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
          0.03674847 = weight(abstract_txt:assessment in 72) [ClassicSimilarity], result of:
            0.03674847 = score(doc=72,freq=1.0), product of:
              0.11567496 = queryWeight, product of:
                1.6234145 = boost
                5.8091397 = idf(docFreq=344, maxDocs=42306)
                0.012265862 = queryNorm
              0.31768733 = fieldWeight in 72, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.8091397 = idf(docFreq=344, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
          0.035009142 = weight(abstract_txt:differences in 72) [ClassicSimilarity], result of:
            0.035009142 = score(doc=72,freq=1.0), product of:
              0.12820292 = queryWeight, product of:
                2.0931692 = boost
                4.99339 = idf(docFreq=779, maxDocs=42306)
                0.012265862 = queryNorm
              0.27307603 = fieldWeight in 72, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.99339 = idf(docFreq=779, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
          0.038106117 = weight(abstract_txt:result in 72) [ClassicSimilarity], result of:
            0.038106117 = score(doc=72,freq=1.0), product of:
              0.13565633 = queryWeight, product of:
                2.1531556 = boost
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.012265862 = queryNorm
              0.28090188 = fieldWeight in 72, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
          0.060576223 = weight(abstract_txt:search in 72) [ClassicSimilarity], result of:
            0.060576223 = score(doc=72,freq=7.0), product of:
              0.11452369 = queryWeight, product of:
                2.5540385 = boost
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.012265862 = queryNorm
              0.52894056 = fieldWeight in 72, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
          0.06310953 = weight(abstract_txt:engine in 72) [ClassicSimilarity], result of:
            0.06310953 = score(doc=72,freq=1.0), product of:
              0.2090033 = queryWeight, product of:
                3.0860386 = boost
                5.5214577 = idf(docFreq=459, maxDocs=42306)
                0.012265862 = queryNorm
              0.30195472 = fieldWeight in 72, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5214577 = idf(docFreq=459, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
          0.09791159 = weight(abstract_txt:relevance in 72) [ClassicSimilarity], result of:
            0.09791159 = score(doc=72,freq=3.0), product of:
              0.20920666 = queryWeight, product of:
                3.4519742 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.012265862 = queryNorm
              0.46801373 = fieldWeight in 72, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0546875 = fieldNorm(doc=72)
        0.4 = coord(10/25)
    
  4. Peters, I.; Stock, W.G.: Power tags in information retrieval (2010) 0.15
    0.14883679 = sum of:
      0.14883679 = product of:
        0.6201533 = sum of:
          0.019796802 = weight(abstract_txt:while in 2866) [ClassicSimilarity], result of:
            0.019796802 = score(doc=2866,freq=1.0), product of:
              0.0700619 = queryWeight, product of:
                1.2634287 = boost
                4.5209856 = idf(docFreq=1250, maxDocs=42306)
                0.012265862 = queryNorm
              0.2825616 = fieldWeight in 2866, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5209856 = idf(docFreq=1250, maxDocs=42306)
                0.0625 = fieldNorm(doc=2866)
          0.03089743 = weight(abstract_txt:known in 2866) [ClassicSimilarity], result of:
            0.03089743 = score(doc=2866,freq=1.0), product of:
              0.09426854 = queryWeight, product of:
                1.4655248 = boost
                5.2441554 = idf(docFreq=606, maxDocs=42306)
                0.012265862 = queryNorm
              0.3277597 = fieldWeight in 2866, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2441554 = idf(docFreq=606, maxDocs=42306)
                0.0625 = fieldNorm(doc=2866)
          0.013938628 = weight(abstract_txt:results in 2866) [ClassicSimilarity], result of:
            0.013938628 = score(doc=2866,freq=1.0), product of:
              0.06347397 = queryWeight, product of:
                1.472832 = boost
                3.5135355 = idf(docFreq=3425, maxDocs=42306)
                0.012265862 = queryNorm
              0.21959597 = fieldWeight in 2866, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.5135355 = idf(docFreq=3425, maxDocs=42306)
                0.0625 = fieldNorm(doc=2866)
          0.05851001 = weight(abstract_txt:search in 2866) [ClassicSimilarity], result of:
            0.05851001 = score(doc=2866,freq=5.0), product of:
              0.11452369 = queryWeight, product of:
                2.5540385 = boost
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.012265862 = queryNorm
              0.51089877 = fieldWeight in 2866, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.0625 = fieldNorm(doc=2866)
          0.06462285 = weight(abstract_txt:long in 2866) [ClassicSimilarity], result of:
            0.06462285 = score(doc=2866,freq=1.0), product of:
              0.19424625 = queryWeight, product of:
                2.9750967 = boost
                5.322963 = idf(docFreq=560, maxDocs=42306)
                0.012265862 = queryNorm
              0.3326852 = fieldWeight in 2866, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.322963 = idf(docFreq=560, maxDocs=42306)
                0.0625 = fieldNorm(doc=2866)
          0.4323876 = weight(abstract_txt:tail in 2866) [ClassicSimilarity], result of:
            0.4323876 = score(doc=2866,freq=1.0), product of:
              0.7895406 = queryWeight, product of:
                7.346113 = boost
                8.762313 = idf(docFreq=17, maxDocs=42306)
                0.012265862 = queryNorm
              0.54764456 = fieldWeight in 2866, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.762313 = idf(docFreq=17, maxDocs=42306)
                0.0625 = fieldNorm(doc=2866)
        0.24 = coord(6/25)
    
  5. Can, F.; Nuray, R.; Sevdik, A.B.: Automatic performance evaluation of Web search engines (2004) 0.14
    0.14397 = sum of:
      0.14397 = product of:
        0.44990623 = sum of:
          0.012270235 = weight(abstract_txt:users in 3571) [ClassicSimilarity], result of:
            0.012270235 = score(doc=3571,freq=1.0), product of:
              0.043891504 = queryWeight, product of:
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.012265862 = queryNorm
              0.27955833 = fieldWeight in 3571, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.078125 = fieldNorm(doc=3571)
          0.05343218 = weight(abstract_txt:binary in 3571) [ClassicSimilarity], result of:
            0.05343218 = score(doc=3571,freq=1.0), product of:
              0.09289745 = queryWeight, product of:
                1.0287188 = boost
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.012265862 = queryNorm
              0.5751738 = fieldWeight in 3571, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.078125 = fieldNorm(doc=3571)
          0.029801711 = weight(abstract_txt:significant in 3571) [ClassicSimilarity], result of:
            0.029801711 = score(doc=3571,freq=1.0), product of:
              0.07930599 = queryWeight, product of:
                1.3441966 = boost
                4.810001 = idf(docFreq=936, maxDocs=42306)
                0.012265862 = queryNorm
              0.37578133 = fieldWeight in 3571, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.810001 = idf(docFreq=936, maxDocs=42306)
                0.078125 = fieldNorm(doc=3571)
          0.017423283 = weight(abstract_txt:results in 3571) [ClassicSimilarity], result of:
            0.017423283 = score(doc=3571,freq=1.0), product of:
              0.06347397 = queryWeight, product of:
                1.472832 = boost
                3.5135355 = idf(docFreq=3425, maxDocs=42306)
                0.012265862 = queryNorm
              0.27449495 = fieldWeight in 3571, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.5135355 = idf(docFreq=3425, maxDocs=42306)
                0.078125 = fieldNorm(doc=3571)
          0.05249781 = weight(abstract_txt:assessment in 3571) [ClassicSimilarity], result of:
            0.05249781 = score(doc=3571,freq=1.0), product of:
              0.11567496 = queryWeight, product of:
                1.6234145 = boost
                5.8091397 = idf(docFreq=344, maxDocs=42306)
                0.012265862 = queryNorm
              0.45383903 = fieldWeight in 3571, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.8091397 = idf(docFreq=344, maxDocs=42306)
                0.078125 = fieldNorm(doc=3571)
          0.080118135 = weight(abstract_txt:search in 3571) [ClassicSimilarity], result of:
            0.080118135 = score(doc=3571,freq=6.0), product of:
              0.11452369 = queryWeight, product of:
                2.5540385 = boost
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.012265862 = queryNorm
              0.699577 = fieldWeight in 3571, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                3.6556938 = idf(docFreq=2971, maxDocs=42306)
                0.078125 = fieldNorm(doc=3571)
          0.09015647 = weight(abstract_txt:engine in 3571) [ClassicSimilarity], result of:
            0.09015647 = score(doc=3571,freq=1.0), product of:
              0.2090033 = queryWeight, product of:
                3.0860386 = boost
                5.5214577 = idf(docFreq=459, maxDocs=42306)
                0.012265862 = queryNorm
              0.43136388 = fieldWeight in 3571, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5214577 = idf(docFreq=459, maxDocs=42306)
                0.078125 = fieldNorm(doc=3571)
          0.114206396 = weight(abstract_txt:relevance in 3571) [ClassicSimilarity], result of:
            0.114206396 = score(doc=3571,freq=2.0), product of:
              0.20920666 = queryWeight, product of:
                3.4519742 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.012265862 = queryNorm
              0.5459023 = fieldWeight in 3571, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.078125 = fieldNorm(doc=3571)
        0.32 = coord(8/25)