Document (#38857)

Author

Ozdemiray, A.M.
Altingovde, I.S.

Title

Explicit search result diversification using score and rank aggregation methods

Source

Journal of the Association for Information Science and Technology. 66(2015) no.6, S.1212-1228

Year

2015

Abstract

Search result diversification is one of the key techniques to cope with the ambiguous and underspecified information needs of web users. In the last few years, strategies that are based on the explicit knowledge of query aspects emerged as highly effective ways of diversifying search results. Our contributions in this article are two-fold. First, we extensively evaluate the performance of a state-of-the-art explicit diversification strategy and pin-point its potential weaknesses. We propose basic yet novel optimizations to remedy these weaknesses and boost the performance of this algorithm. As a second contribution, inspired by the success of the current diversification strategies that exploit the relevance of the candidate documents to individual query aspects, we cast the diversification problem into the problem of ranking aggregation. To this end, we propose to materialize the re-rankings of the candidate documents for each query aspect and then merge these rankings by adapting the score(-based) and rank(-based) aggregation methods. Our extensive experimental evaluations show that certain ranking aggregation methods are superior to existing explicit diversification strategies in terms of diversification effectiveness. Furthermore, these ranking aggregation methods have lower computational complexity than the state-of-the-art diversification strategies.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23259/abstract.

Theme

Retrievalalgorithmen

Similar documents (author)

1. Sengor Altingovde, I. => Altingovde, I.S.: 5.95

   5.950491 = sum of:
     5.950491 = weight(author_txt:altingovde in 154) [ClassicSimilarity], result of:
       5.950491 = fieldWeight in 154, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.4375 = fieldNorm(doc=154)
   

2. Altingovde, I. Sengor => Sengor Altingovde, I.: 5.10

   5.100421 = sum of:
     5.100421 = weight(author_txt:altingovde in 135) [ClassicSimilarity], result of:
       5.100421 = fieldWeight in 135, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.375 = fieldNorm(doc=135)
   

3. Ozcan, R.; Altingovde, I.S.; Ulusoy, O.: Exploiting navigational queries for result presentation and caching in Web search engines (2011) 3.61

   3.606542 = sum of:
     3.606542 = weight(author_txt:altingovde in 4364) [ClassicSimilarity], result of:
       3.606542 = fieldWeight in 4364, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.375 = fieldNorm(doc=4364)
   

4. Yilmaz, T.; Ozcan, R.; Altingovde, I.S.; Ulusoy, Ö.: Improving educational web search for question-like queries through subject classification (2019) 3.01

   3.005452 = sum of:
     3.005452 = weight(author_txt:altingovde in 5041) [ClassicSimilarity], result of:
       3.005452 = fieldWeight in 5041, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.3125 = fieldNorm(doc=5041)
   

5. Sarigil, E.; Sengor Altingovde, I.; Blanco, R.; Barla Cambazoglu, B.; Ozcan, R.; Ulusoy, Ö.: Characterizing, predicting, and handling web search queries that match very few or no results (2018) 2.40

   2.4043615 = sum of:
     2.4043615 = weight(author_txt:altingovde in 4039) [ClassicSimilarity], result of:
       2.4043615 = fieldWeight in 4039, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.25 = fieldNorm(doc=4039)
   

Similar documents (content)

1. He, J.; Meij, E.; Rijke, M. de: Result diversification based on query-specific cluster ranking (2011) 0.56

   0.5564872 = sum of:
     0.5564872 = product of:
       1.5457977 = sum of:
         0.028254846 = weight(abstract_txt:performance in 4355) [ClassicSimilarity], result of:
           0.028254846 = score(doc=4355,freq=3.0), product of:
             0.056367908 = queryWeight, product of:
               1.0816978 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.011253964 = queryNorm
             0.50125766 = fieldWeight in 4355, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=4355)
         0.01129283 = weight(abstract_txt:based in 4355) [ClassicSimilarity], result of:
           0.01129283 = score(doc=4355,freq=2.0), product of:
             0.04007738 = queryWeight, product of:
               1.1170827 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.011253964 = queryNorm
             0.28177565 = fieldWeight in 4355, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=4355)
         0.011294972 = weight(abstract_txt:these in 4355) [ClassicSimilarity], result of:
           0.011294972 = score(doc=4355,freq=2.0), product of:
             0.040082447 = queryWeight, product of:
               1.1171533 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.011253964 = queryNorm
             0.28179348 = fieldWeight in 4355, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=4355)
         0.037807163 = weight(abstract_txt:result in 4355) [ClassicSimilarity], result of:
           0.037807163 = score(doc=4355,freq=3.0), product of:
             0.068446726 = queryWeight, product of:
               1.1919729 = boost
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.011253964 = queryNorm
             0.552359 = fieldWeight in 4355, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.0625 = fieldNorm(doc=4355)
         0.022426208 = weight(abstract_txt:propose in 4355) [ClassicSimilarity], result of:
           0.022426208 = score(doc=4355,freq=1.0), product of:
             0.06969168 = queryWeight, product of:
               1.2027642 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.011253964 = queryNorm
             0.32179177 = fieldWeight in 4355, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=4355)
         0.037444703 = weight(abstract_txt:query in 4355) [ClassicSimilarity], result of:
           0.037444703 = score(doc=4355,freq=2.0), product of:
             0.08911642 = queryWeight, product of:
               1.6657679 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.011253964 = queryNorm
             0.4201774 = fieldWeight in 4355, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=4355)
         0.02343286 = weight(abstract_txt:methods in 4355) [ClassicSimilarity], result of:
           0.02343286 = score(doc=4355,freq=1.0), product of:
             0.09041432 = queryWeight, product of:
               1.9374193 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.011253964 = queryNorm
             0.259172 = fieldWeight in 4355, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=4355)
         0.07492227 = weight(abstract_txt:ranking in 4355) [ClassicSimilarity], result of:
           0.07492227 = score(doc=4355,freq=3.0), product of:
             0.1236159 = queryWeight, product of:
               1.9618818 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.011253964 = queryNorm
             0.6060893 = fieldWeight in 4355, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=4355)
         1.2989218 = weight(abstract_txt:diversification in 4355) [ClassicSimilarity], result of:
           1.2989218 = score(doc=4355,freq=9.0), product of:
             0.79616827 = queryWeight, product of:
               8.130597 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.011253964 = queryNorm
             1.6314665 = fieldWeight in 4355, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0625 = fieldNorm(doc=4355)
       0.36 = coord(9/25)
   

2. Yanovsky, S.; Hoernle, N.; Lev, O.; Gal, K.: One size does not fit all : a study of badge behavior in stack overflow (2021) 0.33

   0.32958212 = sum of:
     0.32958212 = product of:
       1.0299442 = sum of:
         0.0145826265 = weight(abstract_txt:problem in 151) [ClassicSimilarity], result of:
           0.0145826265 = score(doc=151,freq=1.0), product of:
             0.05230793 = queryWeight, product of:
               1.0420146 = boost
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.011253964 = queryNorm
             0.27878425 = fieldWeight in 151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.0625 = fieldNorm(doc=151)
         0.024902482 = weight(abstract_txt:aspects in 151) [ClassicSimilarity], result of:
           0.024902482 = score(doc=151,freq=2.0), product of:
             0.05931467 = queryWeight, product of:
               1.1096119 = boost
               4.7499113 = idf(docFreq=1039, maxDocs=44218)
               0.011253964 = queryNorm
             0.41983682 = fieldWeight in 151, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7499113 = idf(docFreq=1039, maxDocs=44218)
               0.0625 = fieldNorm(doc=151)
         0.01129283 = weight(abstract_txt:based in 151) [ClassicSimilarity], result of:
           0.01129283 = score(doc=151,freq=2.0), product of:
             0.04007738 = queryWeight, product of:
               1.1170827 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.011253964 = queryNorm
             0.28177565 = fieldWeight in 151, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=151)
         0.037807163 = weight(abstract_txt:result in 151) [ClassicSimilarity], result of:
           0.037807163 = score(doc=151,freq=3.0), product of:
             0.068446726 = queryWeight, product of:
               1.1919729 = boost
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.011253964 = queryNorm
             0.552359 = fieldWeight in 151, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.0625 = fieldNorm(doc=151)
         0.022426208 = weight(abstract_txt:propose in 151) [ClassicSimilarity], result of:
           0.022426208 = score(doc=151,freq=1.0), product of:
             0.06969168 = queryWeight, product of:
               1.2027642 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.011253964 = queryNorm
             0.32179177 = fieldWeight in 151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=151)
         0.029552061 = weight(abstract_txt:search in 151) [ClassicSimilarity], result of:
           0.029552061 = score(doc=151,freq=6.0), product of:
             0.052769404 = queryWeight, product of:
               1.2818191 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.011253964 = queryNorm
             0.56002265 = fieldWeight in 151, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=151)
         0.02343286 = weight(abstract_txt:methods in 151) [ClassicSimilarity], result of:
           0.02343286 = score(doc=151,freq=1.0), product of:
             0.09041432 = queryWeight, product of:
               1.9374193 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.011253964 = queryNorm
             0.259172 = fieldWeight in 151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=151)
         0.8659479 = weight(abstract_txt:diversification in 151) [ClassicSimilarity], result of:
           0.8659479 = score(doc=151,freq=4.0), product of:
             0.79616827 = queryWeight, product of:
               8.130597 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.011253964 = queryNorm
             1.0876443 = fieldWeight in 151, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0625 = fieldNorm(doc=151)
       0.32 = coord(8/25)
   

3. Yigit-Sert, S.; Altingovde, I.S.; Macdonald, C.; Ounis, I.; Ulusoy, Ö,: Explicit diversification of search results across multiple dimensions for educational search (2021) 0.33

   0.32958212 = sum of:
     0.32958212 = product of:
       1.0299442 = sum of:
         0.0145826265 = weight(abstract_txt:problem in 156) [ClassicSimilarity], result of:
           0.0145826265 = score(doc=156,freq=1.0), product of:
             0.05230793 = queryWeight, product of:
               1.0420146 = boost
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.011253964 = queryNorm
             0.27878425 = fieldWeight in 156, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.0625 = fieldNorm(doc=156)
         0.024902482 = weight(abstract_txt:aspects in 156) [ClassicSimilarity], result of:
           0.024902482 = score(doc=156,freq=2.0), product of:
             0.05931467 = queryWeight, product of:
               1.1096119 = boost
               4.7499113 = idf(docFreq=1039, maxDocs=44218)
               0.011253964 = queryNorm
             0.41983682 = fieldWeight in 156, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7499113 = idf(docFreq=1039, maxDocs=44218)
               0.0625 = fieldNorm(doc=156)
         0.01129283 = weight(abstract_txt:based in 156) [ClassicSimilarity], result of:
           0.01129283 = score(doc=156,freq=2.0), product of:
             0.04007738 = queryWeight, product of:
               1.1170827 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.011253964 = queryNorm
             0.28177565 = fieldWeight in 156, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=156)
         0.037807163 = weight(abstract_txt:result in 156) [ClassicSimilarity], result of:
           0.037807163 = score(doc=156,freq=3.0), product of:
             0.068446726 = queryWeight, product of:
               1.1919729 = boost
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.011253964 = queryNorm
             0.552359 = fieldWeight in 156, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1024737 = idf(docFreq=730, maxDocs=44218)
               0.0625 = fieldNorm(doc=156)
         0.022426208 = weight(abstract_txt:propose in 156) [ClassicSimilarity], result of:
           0.022426208 = score(doc=156,freq=1.0), product of:
             0.06969168 = queryWeight, product of:
               1.2027642 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.011253964 = queryNorm
             0.32179177 = fieldWeight in 156, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=156)
         0.029552061 = weight(abstract_txt:search in 156) [ClassicSimilarity], result of:
           0.029552061 = score(doc=156,freq=6.0), product of:
             0.052769404 = queryWeight, product of:
               1.2818191 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.011253964 = queryNorm
             0.56002265 = fieldWeight in 156, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=156)
         0.02343286 = weight(abstract_txt:methods in 156) [ClassicSimilarity], result of:
           0.02343286 = score(doc=156,freq=1.0), product of:
             0.09041432 = queryWeight, product of:
               1.9374193 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.011253964 = queryNorm
             0.259172 = fieldWeight in 156, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=156)
         0.8659479 = weight(abstract_txt:diversification in 156) [ClassicSimilarity], result of:
           0.8659479 = score(doc=156,freq=4.0), product of:
             0.79616827 = queryWeight, product of:
               8.130597 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.011253964 = queryNorm
             1.0876443 = fieldWeight in 156, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0625 = fieldNorm(doc=156)
       0.32 = coord(8/25)
   

4. Wei, F.; Li, W.; Liu, S.: iRANK: a rank-learn-combine framework for unsupervised ensemble ranking (2010) 0.29

   0.2858874 = sum of:
     0.2858874 = product of:
       0.6497441 = sum of:
         0.052362647 = weight(abstract_txt:boost in 3472) [ClassicSimilarity], result of:
           0.052362647 = score(doc=3472,freq=1.0), product of:
             0.09735272 = queryWeight, product of:
               1.0051922 = boost
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.011253964 = queryNorm
             0.5378653 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.020622948 = weight(abstract_txt:problem in 3472) [ClassicSimilarity], result of:
           0.020622948 = score(doc=3472,freq=2.0), product of:
             0.05230793 = queryWeight, product of:
               1.0420146 = boost
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.011253964 = queryNorm
             0.39426047 = fieldWeight in 3472, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.023069985 = weight(abstract_txt:performance in 3472) [ClassicSimilarity], result of:
           0.023069985 = score(doc=3472,freq=2.0), product of:
             0.056367908 = queryWeight, product of:
               1.0816978 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.011253964 = queryNorm
             0.40927517 = fieldWeight in 3472, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.007985237 = weight(abstract_txt:based in 3472) [ClassicSimilarity], result of:
           0.007985237 = score(doc=3472,freq=1.0), product of:
             0.04007738 = queryWeight, product of:
               1.1170827 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.011253964 = queryNorm
             0.19924548 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.022426208 = weight(abstract_txt:propose in 3472) [ClassicSimilarity], result of:
           0.022426208 = score(doc=3472,freq=1.0), product of:
             0.06969168 = queryWeight, product of:
               1.2027642 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.011253964 = queryNorm
             0.32179177 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.08711541 = weight(abstract_txt:rank in 3472) [ClassicSimilarity], result of:
           0.08711541 = score(doc=3472,freq=4.0), product of:
             0.10848933 = queryWeight, product of:
               1.5006642 = boost
               6.4238877 = idf(docFreq=194, maxDocs=44218)
               0.011253964 = queryNorm
             0.80298597 = fieldWeight in 3472, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.4238877 = idf(docFreq=194, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.05649316 = weight(abstract_txt:score in 3472) [ClassicSimilarity], result of:
           0.05649316 = score(doc=3472,freq=1.0), product of:
             0.12902512 = queryWeight, product of:
               1.636542 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.011253964 = queryNorm
             0.4378462 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.026477404 = weight(abstract_txt:query in 3472) [ClassicSimilarity], result of:
           0.026477404 = score(doc=3472,freq=1.0), product of:
             0.08911642 = queryWeight, product of:
               1.6657679 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.011253964 = queryNorm
             0.2971103 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.14984454 = weight(abstract_txt:ranking in 3472) [ClassicSimilarity], result of:
           0.14984454 = score(doc=3472,freq=12.0), product of:
             0.1236159 = queryWeight, product of:
               1.9618818 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.011253964 = queryNorm
             1.2121786 = fieldWeight in 3472, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.044190295 = weight(abstract_txt:strategies in 3472) [ClassicSimilarity], result of:
           0.044190295 = score(doc=3472,freq=1.0), product of:
             0.13800822 = queryWeight, product of:
               2.3936327 = boost
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.011253964 = queryNorm
             0.32020044 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
         0.15915628 = weight(abstract_txt:aggregation in 3472) [ClassicSimilarity], result of:
           0.15915628 = score(doc=3472,freq=1.0), product of:
             0.34930614 = queryWeight, product of:
               4.257583 = boost
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.011253964 = queryNorm
             0.4556355 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.0625 = fieldNorm(doc=3472)
       0.44 = coord(11/25)
   

5. Xu, B.; Lin, H.; Lin, Y.: Assessment of learning to rank methods for query expansion (2016) 0.16

   0.15520553 = sum of:
     0.15520553 = product of:
       0.43112645 = sum of:
         0.028254846 = weight(abstract_txt:performance in 2929) [ClassicSimilarity], result of:
           0.028254846 = score(doc=2929,freq=3.0), product of:
             0.056367908 = queryWeight, product of:
               1.0816978 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.011253964 = queryNorm
             0.50125766 = fieldWeight in 2929, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=2929)
         0.018513994 = weight(abstract_txt:state in 2929) [ClassicSimilarity], result of:
           0.018513994 = score(doc=2929,freq=1.0), product of:
             0.061330583 = queryWeight, product of:
               1.1283103 = boost
               4.829954 = idf(docFreq=959, maxDocs=44218)
               0.011253964 = queryNorm
             0.30187213 = fieldWeight in 2929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.829954 = idf(docFreq=959, maxDocs=44218)
               0.0625 = fieldNorm(doc=2929)
         0.022426208 = weight(abstract_txt:propose in 2929) [ClassicSimilarity], result of:
           0.022426208 = score(doc=2929,freq=1.0), product of:
             0.06969168 = queryWeight, product of:
               1.2027642 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.011253964 = queryNorm
             0.32179177 = fieldWeight in 2929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=2929)
         0.08711541 = weight(abstract_txt:rank in 2929) [ClassicSimilarity], result of:
           0.08711541 = score(doc=2929,freq=4.0), product of:
             0.10848933 = queryWeight, product of:
               1.5006642 = boost
               6.4238877 = idf(docFreq=194, maxDocs=44218)
               0.011253964 = queryNorm
             0.80298597 = fieldWeight in 2929, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.4238877 = idf(docFreq=194, maxDocs=44218)
               0.0625 = fieldNorm(doc=2929)
         0.037444703 = weight(abstract_txt:query in 2929) [ClassicSimilarity], result of:
           0.037444703 = score(doc=2929,freq=2.0), product of:
             0.08911642 = queryWeight, product of:
               1.6657679 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.011253964 = queryNorm
             0.4201774 = fieldWeight in 2929, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=2929)
         0.09142033 = weight(abstract_txt:candidate in 2929) [ClassicSimilarity], result of:
           0.09142033 = score(doc=2929,freq=2.0), product of:
             0.14115477 = queryWeight, product of:
               1.71174 = boost
               7.3274393 = idf(docFreq=78, maxDocs=44218)
               0.011253964 = queryNorm
             0.64766026 = fieldWeight in 2929, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3274393 = idf(docFreq=78, maxDocs=44218)
               0.0625 = fieldNorm(doc=2929)
         0.040586904 = weight(abstract_txt:methods in 2929) [ClassicSimilarity], result of:
           0.040586904 = score(doc=2929,freq=3.0), product of:
             0.09041432 = queryWeight, product of:
               1.9374193 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.011253964 = queryNorm
             0.44889906 = fieldWeight in 2929, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=2929)
         0.061173778 = weight(abstract_txt:ranking in 2929) [ClassicSimilarity], result of:
           0.061173778 = score(doc=2929,freq=2.0), product of:
             0.1236159 = queryWeight, product of:
               1.9618818 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.011253964 = queryNorm
             0.49486983 = fieldWeight in 2929, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=2929)
         0.044190295 = weight(abstract_txt:strategies in 2929) [ClassicSimilarity], result of:
           0.044190295 = score(doc=2929,freq=1.0), product of:
             0.13800822 = queryWeight, product of:
               2.3936327 = boost
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.011253964 = queryNorm
             0.32020044 = fieldWeight in 2929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.0625 = fieldNorm(doc=2929)
       0.36 = coord(9/25)