Document (#27572)

Author
Can, F.
Nuray, R.
Sevdik, A.B.
Title
Automatic performance evaluation of Web search engines
Source
Information processing and management. 40(2004) no.3, S.495-514
Year
2004
Abstract
Measuring the information retrieval effectiveness of World Wide Web search engines is costly because of human relevance judgments involved. However, both for business enterprises and people it is important to know the most effective Web search engines, since such search engines help their users find higher number of relevant Web pages with less effort. Furthermore, this information can be used for several practical purposes. In this study we introduce automatic Web search engine evaluation method as an efficient and effective assessment tool of such systems. The experiments based on eight Web search engines, 25 queries, and binary user relevance judgments show that our method provides results consistent with human-based evaluations. It is shown that the observed consistencies are statistically significant. This indicates that the new method can be successfully used in the evaluation of Web search engines.
Theme
Suchmaschinen

Similar documents (content)

  1. Jones, S.; Paynter, G.W.: Automatic extractionof document keyphrases for use in digital libraries : evaluations and applications (2002) 0.36
    0.3621992 = sum of:
      0.3621992 = product of:
        0.75458163 = sum of:
          0.01365167 = weight(abstract_txt:based in 2602) [ClassicSimilarity], result of:
            0.01365167 = score(doc=2602,freq=1.0), product of:
              0.06821525 = queryWeight, product of:
                1.0420847 = boost
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.020443449 = queryNorm
              0.20012636 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.06028111 = weight(abstract_txt:measuring in 2602) [ClassicSimilarity], result of:
            0.06028111 = score(doc=2602,freq=1.0), product of:
              0.14572535 = queryWeight, product of:
                1.0769979 = boost
                6.6185994 = idf(docFreq=156, maxDocs=43254)
                0.020443449 = queryNorm
              0.41366246 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6185994 = idf(docFreq=156, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.062479846 = weight(abstract_txt:evaluations in 2602) [ClassicSimilarity], result of:
            0.062479846 = score(doc=2602,freq=1.0), product of:
              0.14924768 = queryWeight, product of:
                1.0899361 = boost
                6.698111 = idf(docFreq=144, maxDocs=43254)
                0.020443449 = queryNorm
              0.41863194 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.698111 = idf(docFreq=144, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.022464532 = weight(abstract_txt:used in 2602) [ClassicSimilarity], result of:
            0.022464532 = score(doc=2602,freq=2.0), product of:
              0.07546505 = queryWeight, product of:
                1.0960623 = boost
                3.3678792 = idf(docFreq=4051, maxDocs=43254)
                0.020443449 = queryNorm
              0.29768127 = fieldWeight in 2602, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3678792 = idf(docFreq=4051, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.02394648 = weight(abstract_txt:that in 2602) [ClassicSimilarity], result of:
            0.02394648 = score(doc=2602,freq=8.0), product of:
              0.05678747 = queryWeight, product of:
                1.1644857 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.020443449 = queryNorm
              0.421686 = fieldWeight in 2602, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.017932212 = weight(abstract_txt:this in 2602) [ClassicSimilarity], result of:
            0.017932212 = score(doc=2602,freq=4.0), product of:
              0.05900072 = queryWeight, product of:
                1.1869613 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.020443449 = queryNorm
              0.3039321 = fieldWeight in 2602, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.09726169 = weight(abstract_txt:costly in 2602) [ClassicSimilarity], result of:
            0.09726169 = score(doc=2602,freq=1.0), product of:
              0.20046666 = queryWeight, product of:
                1.2631891 = boost
                7.762822 = idf(docFreq=49, maxDocs=43254)
                0.020443449 = queryNorm
              0.48517638 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.762822 = idf(docFreq=49, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.061921 = weight(abstract_txt:human in 2602) [ClassicSimilarity], result of:
            0.061921 = score(doc=2602,freq=2.0), product of:
              0.1483564 = queryWeight, product of:
                1.5367931 = boost
                4.7221165 = idf(docFreq=1045, maxDocs=43254)
                0.020443449 = queryNorm
              0.41738006 = fieldWeight in 2602, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.7221165 = idf(docFreq=1045, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.047105137 = weight(abstract_txt:effective in 2602) [ClassicSimilarity], result of:
            0.047105137 = score(doc=2602,freq=1.0), product of:
              0.15576497 = queryWeight, product of:
                1.5746976 = boost
                4.838586 = idf(docFreq=930, maxDocs=43254)
                0.020443449 = queryNorm
              0.30241162 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.838586 = idf(docFreq=930, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.08251244 = weight(abstract_txt:automatic in 2602) [ClassicSimilarity], result of:
            0.08251244 = score(doc=2602,freq=2.0), product of:
              0.17965001 = queryWeight, product of:
                1.6911258 = boost
                5.1963353 = idf(docFreq=650, maxDocs=43254)
                0.020443449 = queryNorm
              0.45929548 = fieldWeight in 2602, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.1963353 = idf(docFreq=650, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.079858445 = weight(abstract_txt:evaluation in 2602) [ClassicSimilarity], result of:
            0.079858445 = score(doc=2602,freq=2.0), product of:
              0.2012142 = queryWeight, product of:
                2.1919832 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.020443449 = queryNorm
              0.39688274 = fieldWeight in 2602, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
          0.18516707 = weight(abstract_txt:engines in 2602) [ClassicSimilarity], result of:
            0.18516707 = score(doc=2602,freq=1.0), product of:
              0.55955213 = queryWeight, product of:
                5.1694365 = boost
                5.2947226 = idf(docFreq=589, maxDocs=43254)
                0.020443449 = queryNorm
              0.33092016 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2947226 = idf(docFreq=589, maxDocs=43254)
                0.0625 = fieldNorm(doc=2602)
        0.48 = coord(12/25)
    
  2. Kutlu, M.; Elsayed, T.; Lease, M.: Intelligent topic selection for low-cost information retrieval evaluation : a new perspective on deep vs. shallow judging (2018) 0.32
    0.31612256 = sum of:
      0.31612256 = product of:
        0.7184604 = sum of:
          0.010238753 = weight(abstract_txt:based in 93) [ClassicSimilarity], result of:
            0.010238753 = score(doc=93,freq=1.0), product of:
              0.06821525 = queryWeight, product of:
                1.0420847 = boost
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.020443449 = queryNorm
              0.15009478 = fieldWeight in 93, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.01269954 = weight(abstract_txt:that in 93) [ClassicSimilarity], result of:
            0.01269954 = score(doc=93,freq=4.0), product of:
              0.05678747 = queryWeight, product of:
                1.1644857 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.020443449 = queryNorm
              0.22363278 = fieldWeight in 93, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.011647314 = weight(abstract_txt:this in 93) [ClassicSimilarity], result of:
            0.011647314 = score(doc=93,freq=3.0), product of:
              0.05900072 = queryWeight, product of:
                1.1869613 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.020443449 = queryNorm
              0.19740969 = fieldWeight in 93, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.07294627 = weight(abstract_txt:costly in 93) [ClassicSimilarity], result of:
            0.07294627 = score(doc=93,freq=1.0), product of:
              0.20046666 = queryWeight, product of:
                1.2631891 = boost
                7.762822 = idf(docFreq=49, maxDocs=43254)
                0.020443449 = queryNorm
              0.3638823 = fieldWeight in 93, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.762822 = idf(docFreq=49, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.05687807 = weight(abstract_txt:human in 93) [ClassicSimilarity], result of:
            0.05687807 = score(doc=93,freq=3.0), product of:
              0.1483564 = queryWeight, product of:
                1.5367931 = boost
                4.7221165 = idf(docFreq=1045, maxDocs=43254)
                0.020443449 = queryNorm
              0.38338807 = fieldWeight in 93, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.7221165 = idf(docFreq=1045, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.061191365 = weight(abstract_txt:effective in 93) [ClassicSimilarity], result of:
            0.061191365 = score(doc=93,freq=3.0), product of:
              0.15576497 = queryWeight, product of:
                1.5746976 = boost
                4.838586 = idf(docFreq=930, maxDocs=43254)
                0.020443449 = queryNorm
              0.3928442 = fieldWeight in 93, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.838586 = idf(docFreq=930, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.052949343 = weight(abstract_txt:relevance in 93) [ClassicSimilarity], result of:
            0.052949343 = score(doc=93,freq=2.0), product of:
              0.16191255 = queryWeight, product of:
                1.6054713 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.020443449 = queryNorm
              0.32702434 = fieldWeight in 93, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.09470047 = weight(abstract_txt:evaluation in 93) [ClassicSimilarity], result of:
            0.09470047 = score(doc=93,freq=5.0), product of:
              0.2012142 = queryWeight, product of:
                2.1919832 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.020443449 = queryNorm
              0.47064507 = fieldWeight in 93, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.08596702 = weight(abstract_txt:method in 93) [ClassicSimilarity], result of:
            0.08596702 = score(doc=93,freq=4.0), product of:
              0.20321158 = queryWeight, product of:
                2.2028358 = boost
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.020443449 = queryNorm
              0.42304194 = fieldWeight in 93, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.20603542 = weight(abstract_txt:judgments in 93) [ClassicSimilarity], result of:
            0.20603542 = score(doc=93,freq=4.0), product of:
              0.317925 = queryWeight, product of:
                2.2497 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.020443449 = queryNorm
              0.64806294 = fieldWeight in 93, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
          0.05320679 = weight(abstract_txt:search in 93) [ClassicSimilarity], result of:
            0.05320679 = score(doc=93,freq=1.0), product of:
              0.3107307 = queryWeight, product of:
                4.1609106 = boost
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.020443449 = queryNorm
              0.1712312 = fieldWeight in 93, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.046875 = fieldNorm(doc=93)
        0.44 = coord(11/25)
    
  3. Moghaddam, A.I.; Parirokh, M.: ¬A comparative study on overlapping of search results in metasearch engines and their common underlying search engines (2006) 0.30
    0.3015428 = sum of:
      0.3015428 = product of:
        0.68532455 = sum of:
          0.04222258 = weight(abstract_txt:furthermore in 742) [ClassicSimilarity], result of:
            0.04222258 = score(doc=742,freq=1.0), product of:
              0.1256335 = queryWeight, product of:
                6.145416 = idf(docFreq=251, maxDocs=43254)
                0.020443449 = queryNorm
              0.33607742 = fieldWeight in 742, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.145416 = idf(docFreq=251, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.01689308 = weight(abstract_txt:based in 742) [ClassicSimilarity], result of:
            0.01689308 = score(doc=742,freq=2.0), product of:
              0.06821525 = queryWeight, product of:
                1.0420847 = boost
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.020443449 = queryNorm
              0.24764374 = fieldWeight in 742, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.2020218 = idf(docFreq=4782, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.01389922 = weight(abstract_txt:used in 742) [ClassicSimilarity], result of:
            0.01389922 = score(doc=742,freq=1.0), product of:
              0.07546505 = queryWeight, product of:
                1.0960623 = boost
                3.3678792 = idf(docFreq=4051, maxDocs=43254)
                0.020443449 = queryNorm
              0.18418089 = fieldWeight in 742, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3678792 = idf(docFreq=4051, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.007408065 = weight(abstract_txt:that in 742) [ClassicSimilarity], result of:
            0.007408065 = score(doc=742,freq=1.0), product of:
              0.05678747 = queryWeight, product of:
                1.1644857 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.020443449 = queryNorm
              0.13045245 = fieldWeight in 742, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.02218998 = weight(abstract_txt:this in 742) [ClassicSimilarity], result of:
            0.02218998 = score(doc=742,freq=8.0), product of:
              0.05900072 = queryWeight, product of:
                1.1869613 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.020443449 = queryNorm
              0.37609679 = fieldWeight in 742, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.05828963 = weight(abstract_txt:effective in 742) [ClassicSimilarity], result of:
            0.05828963 = score(doc=742,freq=2.0), product of:
              0.15576497 = queryWeight, product of:
                1.5746976 = boost
                4.838586 = idf(docFreq=930, maxDocs=43254)
                0.020443449 = queryNorm
              0.37421528 = fieldWeight in 742, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.838586 = idf(docFreq=930, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.04368098 = weight(abstract_txt:relevance in 742) [ClassicSimilarity], result of:
            0.04368098 = score(doc=742,freq=1.0), product of:
              0.16191255 = queryWeight, product of:
                1.6054713 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.020443449 = queryNorm
              0.26978132 = fieldWeight in 742, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.049409892 = weight(abstract_txt:evaluation in 742) [ClassicSimilarity], result of:
            0.049409892 = score(doc=742,freq=1.0), product of:
              0.2012142 = queryWeight, product of:
                2.1919832 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.020443449 = queryNorm
              0.24555868 = fieldWeight in 742, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.05014743 = weight(abstract_txt:method in 742) [ClassicSimilarity], result of:
            0.05014743 = score(doc=742,freq=1.0), product of:
              0.20321158 = queryWeight, product of:
                2.2028358 = boost
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.020443449 = queryNorm
              0.24677446 = fieldWeight in 742, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.15205108 = weight(abstract_txt:search in 742) [ClassicSimilarity], result of:
            0.15205108 = score(doc=742,freq=6.0), product of:
              0.3107307 = queryWeight, product of:
                4.1609106 = boost
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.020443449 = queryNorm
              0.48933393 = fieldWeight in 742, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
          0.22913256 = weight(abstract_txt:engines in 742) [ClassicSimilarity], result of:
            0.22913256 = score(doc=742,freq=2.0), product of:
              0.55955213 = queryWeight, product of:
                5.1694365 = boost
                5.2947226 = idf(docFreq=589, maxDocs=43254)
                0.020443449 = queryNorm
              0.4094928 = fieldWeight in 742, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.2947226 = idf(docFreq=589, maxDocs=43254)
                0.0546875 = fieldNorm(doc=742)
        0.44 = coord(11/25)
    
  4. Schaer, P.; Mayr, P.; Sünkler, S.; Lewandowski, D.: How relevant is the long tail? : a relevance assessment study on million short (2016) 0.29
    0.29472688 = sum of:
      0.29472688 = product of:
        0.9210215 = sum of:
          0.010582949 = weight(abstract_txt:that in 4609) [ClassicSimilarity], result of:
            0.010582949 = score(doc=4609,freq=1.0), product of:
              0.05678747 = queryWeight, product of:
                1.1644857 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.020443449 = queryNorm
              0.18636064 = fieldWeight in 4609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.078125 = fieldNorm(doc=4609)
          0.011207633 = weight(abstract_txt:this in 4609) [ClassicSimilarity], result of:
            0.011207633 = score(doc=4609,freq=1.0), product of:
              0.05900072 = queryWeight, product of:
                1.1869613 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.020443449 = queryNorm
              0.18995756 = fieldWeight in 4609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.078125 = fieldNorm(doc=4609)
          0.10239755 = weight(abstract_txt:binary in 4609) [ClassicSimilarity], result of:
            0.10239755 = score(doc=4609,freq=1.0), product of:
              0.1787862 = queryWeight, product of:
                1.1929282 = boost
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.020443449 = queryNorm
              0.57273746 = fieldWeight in 4609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.078125 = fieldNorm(doc=4609)
          0.1248028 = weight(abstract_txt:relevance in 4609) [ClassicSimilarity], result of:
            0.1248028 = score(doc=4609,freq=4.0), product of:
              0.16191255 = queryWeight, product of:
                1.6054713 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.020443449 = queryNorm
              0.77080375 = fieldWeight in 4609, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.078125 = fieldNorm(doc=4609)
          0.07058556 = weight(abstract_txt:evaluation in 4609) [ClassicSimilarity], result of:
            0.07058556 = score(doc=4609,freq=1.0), product of:
              0.2012142 = queryWeight, product of:
                2.1919832 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.020443449 = queryNorm
              0.3507981 = fieldWeight in 4609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.078125 = fieldNorm(doc=4609)
          0.17169617 = weight(abstract_txt:judgments in 4609) [ClassicSimilarity], result of:
            0.17169617 = score(doc=4609,freq=1.0), product of:
              0.317925 = queryWeight, product of:
                2.2497 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.020443449 = queryNorm
              0.5400524 = fieldWeight in 4609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.078125 = fieldNorm(doc=4609)
          0.19828999 = weight(abstract_txt:search in 4609) [ClassicSimilarity], result of:
            0.19828999 = score(doc=4609,freq=5.0), product of:
              0.3107307 = queryWeight, product of:
                4.1609106 = boost
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.020443449 = queryNorm
              0.638141 = fieldWeight in 4609, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.078125 = fieldNorm(doc=4609)
          0.23145886 = weight(abstract_txt:engines in 4609) [ClassicSimilarity], result of:
            0.23145886 = score(doc=4609,freq=1.0), product of:
              0.55955213 = queryWeight, product of:
                5.1694365 = boost
                5.2947226 = idf(docFreq=589, maxDocs=43254)
                0.020443449 = queryNorm
              0.4136502 = fieldWeight in 4609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2947226 = idf(docFreq=589, maxDocs=43254)
                0.078125 = fieldNorm(doc=4609)
        0.32 = coord(8/25)
    
  5. Lewandowski, D.; Spree, U.: Ranking of Wikipedia articles in search engines revisited : fair ranking for reasonable quality? (2011) 0.28
    0.2845419 = sum of:
      0.2845419 = product of:
        0.8891935 = sum of:
          0.008466359 = weight(abstract_txt:that in 1909) [ClassicSimilarity], result of:
            0.008466359 = score(doc=1909,freq=1.0), product of:
              0.05678747 = queryWeight, product of:
                1.1644857 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.020443449 = queryNorm
              0.14908852 = fieldWeight in 1909, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.0625 = fieldNorm(doc=1909)
          0.0126799885 = weight(abstract_txt:this in 1909) [ClassicSimilarity], result of:
            0.0126799885 = score(doc=1909,freq=2.0), product of:
              0.05900072 = queryWeight, product of:
                1.1869613 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.020443449 = queryNorm
              0.21491244 = fieldWeight in 1909, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.0625 = fieldNorm(doc=1909)
          0.08646592 = weight(abstract_txt:relevance in 1909) [ClassicSimilarity], result of:
            0.08646592 = score(doc=1909,freq=3.0), product of:
              0.16191255 = queryWeight, product of:
                1.6054713 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.020443449 = queryNorm
              0.53402853 = fieldWeight in 1909, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0625 = fieldNorm(doc=1909)
          0.12626728 = weight(abstract_txt:evaluation in 1909) [ClassicSimilarity], result of:
            0.12626728 = score(doc=1909,freq=5.0), product of:
              0.2012142 = queryWeight, product of:
                2.1919832 = boost
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.020443449 = queryNorm
              0.62752676 = fieldWeight in 1909, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.490216 = idf(docFreq=1318, maxDocs=43254)
                0.0625 = fieldNorm(doc=1909)
          0.057311345 = weight(abstract_txt:method in 1909) [ClassicSimilarity], result of:
            0.057311345 = score(doc=1909,freq=1.0), product of:
              0.20321158 = queryWeight, product of:
                2.2028358 = boost
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.020443449 = queryNorm
              0.28202796 = fieldWeight in 1909, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.0625 = fieldNorm(doc=1909)
          0.19425204 = weight(abstract_txt:judgments in 1909) [ClassicSimilarity], result of:
            0.19425204 = score(doc=1909,freq=2.0), product of:
              0.317925 = queryWeight, product of:
                2.2497 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.020443449 = queryNorm
              0.6109996 = fieldWeight in 1909, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.0625 = fieldNorm(doc=1909)
          0.14188477 = weight(abstract_txt:search in 1909) [ClassicSimilarity], result of:
            0.14188477 = score(doc=1909,freq=4.0), product of:
              0.3107307 = queryWeight, product of:
                4.1609106 = boost
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.020443449 = queryNorm
              0.45661652 = fieldWeight in 1909, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.0625 = fieldNorm(doc=1909)
          0.2618658 = weight(abstract_txt:engines in 1909) [ClassicSimilarity], result of:
            0.2618658 = score(doc=1909,freq=2.0), product of:
              0.55955213 = queryWeight, product of:
                5.1694365 = boost
                5.2947226 = idf(docFreq=589, maxDocs=43254)
                0.020443449 = queryNorm
              0.46799177 = fieldWeight in 1909, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.2947226 = idf(docFreq=589, maxDocs=43254)
                0.0625 = fieldNorm(doc=1909)
        0.32 = coord(8/25)