Document (#41038)

Author

Sarigil, E.
Sengor Altingovde, I.
Blanco, R.
Barla Cambazoglu, B.
Ozcan, R.
Ulusoy, Ö.

Title

Characterizing, predicting, and handling web search queries that match very few or no results

Source

Journal of the Association for Information Science and Technology. 69(2018) no.2, S.256-270

Year

2018

Abstract

A non-negligible fraction of user queries end up with very few or even no matching results in leading commercial web search engines. In this work, we provide a detailed characterization of such queries and show that search engines try to improve such queries by showing the results of related queries. Through a user study, we show that these query suggestions are usually perceived as relevant. Also, through a query log analysis, we show that the users are dissatisfied after submitting a query that match no results at least 88.5% of the time. As a first step towards solving these no-answer queries, we devised a large number of features that can be used to identify such queries and built machine-learning models. These models can be useful for scenarios such as the mobile- or meta-search, where identifying a query that will retrieve no results at the client device (i.e., even before submitting it to the search engine) may yield gains in terms of the bandwidth usage, power consumption, and/or monetary costs. Experiments over query logs indicate that, despite the heavy skew in class sizes, our models achieve good prediction quality, with accuracy (in terms of area under the curve) up to 0.95.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23955/full.

Theme

Retrievalstudien
Suchmaschinen

Similar documents (author)

1. Ozcan, R.; Altingovde, I.S.; Ulusoy, O.: Exploiting navigational queries for result presentation and caching in Web search engines (2011) 1.88

   1.878263 = sum of:
     1.878263 = product of:
       3.756526 = sum of:
         1.7951494 = weight(author_txt:altingovde in 1362) [ClassicSimilarity], result of:
           1.7951494 = score(doc=1362,freq=1.0), product of:
             0.49852997 = queryWeight, product of:
               1.0440872 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.04972519 = queryNorm
             3.6008856 = fieldWeight in 1362, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.375 = fieldNorm(doc=1362)
         1.9613764 = weight(author_txt:ulusoy in 1362) [ClassicSimilarity], result of:
           1.9613764 = score(doc=1362,freq=1.0), product of:
             0.52884877 = queryWeight, product of:
               1.0753675 = boost
               9.890043 = idf(docFreq=5, maxDocs=43556)
               0.04972519 = queryNorm
             3.7087662 = fieldWeight in 1362, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.890043 = idf(docFreq=5, maxDocs=43556)
               0.375 = fieldNorm(doc=1362)
       0.5 = coord(2/4)
   

2. Yilmaz, T.; Ozcan, R.; Altingovde, I.S.; Ulusoy, Ö.: Improving educational web search for question-like queries through subject classification (2019) 1.57

   1.5652192 = sum of:
     1.5652192 = product of:
       3.1304383 = sum of:
         1.4959579 = weight(author_txt:altingovde in 1327) [ClassicSimilarity], result of:
           1.4959579 = score(doc=1327,freq=1.0), product of:
             0.49852997 = queryWeight, product of:
               1.0440872 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.04972519 = queryNorm
             3.0007381 = fieldWeight in 1327, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.3125 = fieldNorm(doc=1327)
         1.6344805 = weight(author_txt:ulusoy in 1327) [ClassicSimilarity], result of:
           1.6344805 = score(doc=1327,freq=1.0), product of:
             0.52884877 = queryWeight, product of:
               1.0753675 = boost
               9.890043 = idf(docFreq=5, maxDocs=43556)
               0.04972519 = queryNorm
             3.0906386 = fieldWeight in 1327, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.890043 = idf(docFreq=5, maxDocs=43556)
               0.3125 = fieldNorm(doc=1327)
       0.5 = coord(2/4)
   

3. Yigit-Sert, S.; Altingovde, I.S.; Macdonald, C.; Ounis, I.; Ulusoy, Ö,: Explicit diversification of search results across multiple dimensions for educational search (2021) 1.25

   1.2521753 = sum of:
     1.2521753 = product of:
       2.5043507 = sum of:
         1.1967663 = weight(author_txt:altingovde in 2443) [ClassicSimilarity], result of:
           1.1967663 = score(doc=2443,freq=1.0), product of:
             0.49852997 = queryWeight, product of:
               1.0440872 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.04972519 = queryNorm
             2.4005904 = fieldWeight in 2443, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.25 = fieldNorm(doc=2443)
         1.3075843 = weight(author_txt:ulusoy in 2443) [ClassicSimilarity], result of:
           1.3075843 = score(doc=2443,freq=1.0), product of:
             0.52884877 = queryWeight, product of:
               1.0753675 = boost
               9.890043 = idf(docFreq=5, maxDocs=43556)
               0.04972519 = queryNorm
             2.4725108 = fieldWeight in 2443, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.890043 = idf(docFreq=5, maxDocs=43556)
               0.25 = fieldNorm(doc=2443)
       0.5 = coord(2/4)
   

4. Sengor Altingovde, I. => Altingovde, I.S.: 0.74

   0.74046135 = sum of:
     0.74046135 = product of:
       2.9618454 = sum of:
         2.9618454 = weight(author_txt:altingovde in 2441) [ClassicSimilarity], result of:
           2.9618454 = score(doc=2441,freq=2.0), product of:
             0.49852997 = queryWeight, product of:
               1.0440872 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.04972519 = queryNorm
             5.9411583 = fieldWeight in 2441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.4375 = fieldNorm(doc=2441)
       0.25 = coord(1/4)
   

5. Cambazoglu, B. Barla => Barla Cambazoglu, B.: 0.66

   0.66152877 = sum of:
     0.66152877 = product of:
       2.646115 = sum of:
         2.646115 = weight(author_txt:cambazoglu in 2506) [ClassicSimilarity], result of:
           2.646115 = score(doc=2506,freq=2.0), product of:
             0.5124915 = queryWeight, product of:
               1.0586063 = boost
               9.735892 = idf(docFreq=6, maxDocs=43556)
               0.04972519 = queryNorm
             5.1632366 = fieldWeight in 2506, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.735892 = idf(docFreq=6, maxDocs=43556)
               0.375 = fieldNorm(doc=2506)
       0.25 = coord(1/4)
   

Similar documents (content)

1. Yeganova, L.; Comeau, D.C.; Kim, W.; Wilbur, W.J.: How to interpret PubMed queries and why it matters (2009) 0.41

   0.40841088 = sum of:
     0.40841088 = product of:
       0.92820656 = sum of:
         0.05422682 = weight(abstract_txt:terms in 4710) [ClassicSimilarity], result of:
           0.05422682 = score(doc=4710,freq=7.0), product of:
             0.080886066 = queryWeight, product of:
               1.0206925 = boost
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.019546427 = queryNorm
             0.6704099 = fieldWeight in 4710, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.08341487 = weight(abstract_txt:fraction in 4710) [ClassicSimilarity], result of:
           0.08341487 = score(doc=4710,freq=1.0), product of:
             0.16364998 = queryWeight, product of:
               1.0265994 = boost
               8.155442 = idf(docFreq=33, maxDocs=43556)
               0.019546427 = queryNorm
             0.50971514 = fieldWeight in 4710, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.155442 = idf(docFreq=33, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.02142118 = weight(abstract_txt:these in 4710) [ClassicSimilarity], result of:
           0.02142118 = score(doc=4710,freq=2.0), product of:
             0.075685546 = queryWeight, product of:
               1.2092335 = boost
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.019546427 = queryNorm
             0.28302866 = fieldWeight in 4710, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.045657262 = weight(abstract_txt:engines in 4710) [ClassicSimilarity], result of:
           0.045657262 = score(doc=4710,freq=1.0), product of:
             0.1379654 = queryWeight, product of:
               1.3330399 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.019546427 = queryNorm
             0.3309327 = fieldWeight in 4710, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.05687575 = weight(abstract_txt:show in 4710) [ClassicSimilarity], result of:
           0.05687575 = score(doc=4710,freq=2.0), product of:
             0.14512274 = queryWeight, product of:
               1.6744471 = boost
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.019546427 = queryNorm
             0.3919148 = fieldWeight in 4710, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.050084557 = weight(abstract_txt:such in 4710) [ClassicSimilarity], result of:
           0.050084557 = score(doc=4710,freq=4.0), product of:
             0.11647235 = queryWeight, product of:
               1.7321459 = boost
               3.4400995 = idf(docFreq=3795, maxDocs=43556)
               0.019546427 = queryNorm
             0.43001243 = fieldWeight in 4710, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4400995 = idf(docFreq=3795, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.032850806 = weight(abstract_txt:results in 4710) [ClassicSimilarity], result of:
           0.032850806 = score(doc=4710,freq=1.0), product of:
             0.15035145 = queryWeight, product of:
               2.2002997 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.019546427 = queryNorm
             0.21849345 = fieldWeight in 4710, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.053079177 = weight(abstract_txt:search in 4710) [ClassicSimilarity], result of:
           0.053079177 = score(doc=4710,freq=2.0), product of:
             0.1643172 = queryWeight, product of:
               2.300221 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.019546427 = queryNorm
             0.3230287 = fieldWeight in 4710, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.037165865 = weight(abstract_txt:that in 4710) [ClassicSimilarity], result of:
           0.037165865 = score(doc=4710,freq=5.0), product of:
             0.11165798 = queryWeight, product of:
               2.3984625 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.019546427 = queryNorm
             0.33285454 = fieldWeight in 4710, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.11599023 = weight(abstract_txt:query in 4710) [ClassicSimilarity], result of:
           0.11599023 = score(doc=4710,freq=2.0), product of:
             0.27670345 = queryWeight, product of:
               2.9849381 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.019546427 = queryNorm
             0.41918606 = fieldWeight in 4710, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
         0.37744004 = weight(abstract_txt:queries in 4710) [ClassicSimilarity], result of:
           0.37744004 = score(doc=4710,freq=7.0), product of:
             0.44769847 = queryWeight, product of:
               4.492467 = boost
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.019546427 = queryNorm
             0.8430675 = fieldWeight in 4710, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.0625 = fieldNorm(doc=4710)
       0.44 = coord(11/25)
   

2. Ozcan, R.; Altingovde, I.S.; Ulusoy, O.: Exploiting navigational queries for result presentation and caching in Web search engines (2011) 0.34

   0.33951545 = sum of:
     0.33951545 = product of:
       0.8487886 = sum of:
         0.028985457 = weight(abstract_txt:terms in 1362) [ClassicSimilarity], result of:
           0.028985457 = score(doc=1362,freq=2.0), product of:
             0.080886066 = queryWeight, product of:
               1.0206925 = boost
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.019546427 = queryNorm
             0.3583492 = fieldWeight in 1362, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
         0.12348157 = weight(abstract_txt:bandwidth in 1362) [ClassicSimilarity], result of:
           0.12348157 = score(doc=1362,freq=2.0), product of:
             0.16871163 = queryWeight, product of:
               1.0423548 = boost
               8.280605 = idf(docFreq=29, maxDocs=43556)
               0.019546427 = queryNorm
             0.73190904 = fieldWeight in 1362, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.280605 = idf(docFreq=29, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
         0.045657262 = weight(abstract_txt:engines in 1362) [ClassicSimilarity], result of:
           0.045657262 = score(doc=1362,freq=1.0), product of:
             0.1379654 = queryWeight, product of:
               1.3330399 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.019546427 = queryNorm
             0.3309327 = fieldWeight in 1362, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
         0.04021723 = weight(abstract_txt:show in 1362) [ClassicSimilarity], result of:
           0.04021723 = score(doc=1362,freq=1.0), product of:
             0.14512274 = queryWeight, product of:
               1.6744471 = boost
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.019546427 = queryNorm
             0.27712563 = fieldWeight in 1362, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
         0.047031473 = weight(abstract_txt:models in 1362) [ClassicSimilarity], result of:
           0.047031473 = score(doc=1362,freq=1.0), product of:
             0.16108425 = queryWeight, product of:
               1.7641286 = boost
               4.6714907 = idf(docFreq=1107, maxDocs=43556)
               0.019546427 = queryNorm
             0.29196817 = fieldWeight in 1362, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6714907 = idf(docFreq=1107, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
         0.080467716 = weight(abstract_txt:results in 1362) [ClassicSimilarity], result of:
           0.080467716 = score(doc=1362,freq=6.0), product of:
             0.15035145 = queryWeight, product of:
               2.2002997 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.019546427 = queryNorm
             0.5351975 = fieldWeight in 1362, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
         0.06500845 = weight(abstract_txt:search in 1362) [ClassicSimilarity], result of:
           0.06500845 = score(doc=1362,freq=3.0), product of:
             0.1643172 = queryWeight, product of:
               2.300221 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.019546427 = queryNorm
             0.39562774 = fieldWeight in 1362, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
         0.028788552 = weight(abstract_txt:that in 1362) [ClassicSimilarity], result of:
           0.028788552 = score(doc=1362,freq=3.0), product of:
             0.11165798 = queryWeight, product of:
               2.3984625 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.019546427 = queryNorm
             0.257828 = fieldWeight in 1362, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
         0.14205843 = weight(abstract_txt:query in 1362) [ClassicSimilarity], result of:
           0.14205843 = score(doc=1362,freq=3.0), product of:
             0.27670345 = queryWeight, product of:
               2.9849381 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.019546427 = queryNorm
             0.51339597 = fieldWeight in 1362, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
         0.24709252 = weight(abstract_txt:queries in 1362) [ClassicSimilarity], result of:
           0.24709252 = score(doc=1362,freq=3.0), product of:
             0.44769847 = queryWeight, product of:
               4.492467 = boost
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.019546427 = queryNorm
             0.55191725 = fieldWeight in 1362, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.0625 = fieldNorm(doc=1362)
       0.4 = coord(10/25)
   

3. Falchi, F.; Lucchese, C.; Orlando, S.; Perego, R.; Rabitti, F.: Similarity caching in large-scale image retrieval (2012) 0.32

   0.32189122 = sum of:
     0.32189122 = product of:
       0.73157096 = sum of:
         0.07298801 = weight(abstract_txt:fraction in 4727) [ClassicSimilarity], result of:
           0.07298801 = score(doc=4727,freq=1.0), product of:
             0.16364998 = queryWeight, product of:
               1.0265994 = boost
               8.155442 = idf(docFreq=33, maxDocs=43556)
               0.019546427 = queryNorm
             0.44600075 = fieldWeight in 4727, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.155442 = idf(docFreq=33, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.013253678 = weight(abstract_txt:these in 4727) [ClassicSimilarity], result of:
           0.013253678 = score(doc=4727,freq=1.0), product of:
             0.075685546 = queryWeight, product of:
               1.2092335 = boost
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.019546427 = queryNorm
             0.17511505 = fieldWeight in 4727, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.045493163 = weight(abstract_txt:very in 4727) [ClassicSimilarity], result of:
           0.045493163 = score(doc=4727,freq=2.0), product of:
             0.119411364 = queryWeight, product of:
               1.240169 = boost
               4.926034 = idf(docFreq=858, maxDocs=43556)
               0.019546427 = queryNorm
             0.3809785 = fieldWeight in 4727, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.926034 = idf(docFreq=858, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.03598744 = weight(abstract_txt:even in 4727) [ClassicSimilarity], result of:
           0.03598744 = score(doc=4727,freq=1.0), product of:
             0.1286843 = queryWeight, product of:
               1.2874217 = boost
               5.1137247 = idf(docFreq=711, maxDocs=43556)
               0.019546427 = queryNorm
             0.27965683 = fieldWeight in 4727, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1137247 = idf(docFreq=711, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.035190076 = weight(abstract_txt:show in 4727) [ClassicSimilarity], result of:
           0.035190076 = score(doc=4727,freq=1.0), product of:
             0.14512274 = queryWeight, product of:
               1.6744471 = boost
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.019546427 = queryNorm
             0.24248493 = fieldWeight in 4727, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.037952688 = weight(abstract_txt:such in 4727) [ClassicSimilarity], result of:
           0.037952688 = score(doc=4727,freq=3.0), product of:
             0.11647235 = queryWeight, product of:
               1.7321459 = boost
               3.4400995 = idf(docFreq=3795, maxDocs=43556)
               0.019546427 = queryNorm
             0.32585147 = fieldWeight in 4727, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4400995 = idf(docFreq=3795, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.05748891 = weight(abstract_txt:results in 4727) [ClassicSimilarity], result of:
           0.05748891 = score(doc=4727,freq=4.0), product of:
             0.15035145 = queryWeight, product of:
               2.2002997 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.019546427 = queryNorm
             0.38236353 = fieldWeight in 4727, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.05688239 = weight(abstract_txt:search in 4727) [ClassicSimilarity], result of:
           0.05688239 = score(doc=4727,freq=3.0), product of:
             0.1643172 = queryWeight, product of:
               2.300221 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.019546427 = queryNorm
             0.34617427 = fieldWeight in 4727, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.025189983 = weight(abstract_txt:that in 4727) [ClassicSimilarity], result of:
           0.025189983 = score(doc=4727,freq=3.0), product of:
             0.11165798 = queryWeight, product of:
               2.3984625 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.019546427 = queryNorm
             0.2255995 = fieldWeight in 4727, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.101491444 = weight(abstract_txt:query in 4727) [ClassicSimilarity], result of:
           0.101491444 = score(doc=4727,freq=2.0), product of:
             0.27670345 = queryWeight, product of:
               2.9849381 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.019546427 = queryNorm
             0.3667878 = fieldWeight in 4727, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
         0.24965315 = weight(abstract_txt:queries in 4727) [ClassicSimilarity], result of:
           0.24965315 = score(doc=4727,freq=4.0), product of:
             0.44769847 = queryWeight, product of:
               4.492467 = boost
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.019546427 = queryNorm
             0.5576368 = fieldWeight in 4727, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.0546875 = fieldNorm(doc=4727)
       0.44 = coord(11/25)
   

4. Kajanan, S.; Bao, Y.; Datta, A.; VanderMeer, D.; Dutta, K.: Efficient automatic search query formulation using phrase-level analysis (2014) 0.31

   0.3140337 = sum of:
     0.3140337 = product of:
       0.71371293 = sum of:
         0.026144557 = weight(abstract_txt:through in 3262) [ClassicSimilarity], result of:
           0.026144557 = score(doc=3262,freq=3.0), product of:
             0.07991038 = queryWeight, product of:
               1.0145178 = boost
               4.029732 = idf(docFreq=2104, maxDocs=43556)
               0.019546427 = queryNorm
             0.32717347 = fieldWeight in 3262, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.029732 = idf(docFreq=2104, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.026624842 = weight(abstract_txt:terms in 3262) [ClassicSimilarity], result of:
           0.026624842 = score(doc=3262,freq=3.0), product of:
             0.080886066 = queryWeight, product of:
               1.0206925 = boost
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.019546427 = queryNorm
             0.32916474 = fieldWeight in 3262, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.027573021 = weight(abstract_txt:very in 3262) [ClassicSimilarity], result of:
           0.027573021 = score(doc=3262,freq=1.0), product of:
             0.119411364 = queryWeight, product of:
               1.240169 = boost
               4.926034 = idf(docFreq=858, maxDocs=43556)
               0.019546427 = queryNorm
             0.23090784 = fieldWeight in 3262, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.926034 = idf(docFreq=858, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.034242947 = weight(abstract_txt:engines in 3262) [ClassicSimilarity], result of:
           0.034242947 = score(doc=3262,freq=1.0), product of:
             0.1379654 = queryWeight, product of:
               1.3330399 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.019546427 = queryNorm
             0.24819952 = fieldWeight in 3262, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.030162923 = weight(abstract_txt:show in 3262) [ClassicSimilarity], result of:
           0.030162923 = score(doc=3262,freq=1.0), product of:
             0.14512274 = queryWeight, product of:
               1.6744471 = boost
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.019546427 = queryNorm
             0.20784423 = fieldWeight in 3262, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.018781709 = weight(abstract_txt:such in 3262) [ClassicSimilarity], result of:
           0.018781709 = score(doc=3262,freq=1.0), product of:
             0.11647235 = queryWeight, product of:
               1.7321459 = boost
               3.4400995 = idf(docFreq=3795, maxDocs=43556)
               0.019546427 = queryNorm
             0.16125466 = fieldWeight in 3262, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4400995 = idf(docFreq=3795, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.06968708 = weight(abstract_txt:results in 3262) [ClassicSimilarity], result of:
           0.06968708 = score(doc=3262,freq=8.0), product of:
             0.15035145 = queryWeight, product of:
               2.2002997 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.019546427 = queryNorm
             0.46349457 = fieldWeight in 3262, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.09336127 = weight(abstract_txt:search in 3262) [ClassicSimilarity], result of:
           0.09336127 = score(doc=3262,freq=11.0), product of:
             0.1643172 = queryWeight, product of:
               2.300221 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.019546427 = queryNorm
             0.5681771 = fieldWeight in 3262, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.04134441 = weight(abstract_txt:that in 3262) [ClassicSimilarity], result of:
           0.04134441 = score(doc=3262,freq=11.0), product of:
             0.11165798 = queryWeight, product of:
               2.3984625 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.019546427 = queryNorm
             0.3702773 = fieldWeight in 3262, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.106543824 = weight(abstract_txt:query in 3262) [ClassicSimilarity], result of:
           0.106543824 = score(doc=3262,freq=3.0), product of:
             0.27670345 = queryWeight, product of:
               2.9849381 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.019546427 = queryNorm
             0.38504696 = fieldWeight in 3262, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
         0.23924632 = weight(abstract_txt:queries in 3262) [ClassicSimilarity], result of:
           0.23924632 = score(doc=3262,freq=5.0), product of:
             0.44769847 = queryWeight, product of:
               4.492467 = boost
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.019546427 = queryNorm
             0.53439164 = fieldWeight in 3262, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.046875 = fieldNorm(doc=3262)
       0.44 = coord(11/25)
   

5. Song, R.; Luo, Z.; Nie, J.-Y.; Yu, Y.; Hon, H.-W.: Identification of ambiguous queries in web search (2009) 0.30

   0.29751807 = sum of:
     0.29751807 = product of:
       0.929744 = sum of:
         0.018933825 = weight(abstract_txt:these in 4439) [ClassicSimilarity], result of:
           0.018933825 = score(doc=4439,freq=1.0), product of:
             0.075685546 = queryWeight, product of:
               1.2092335 = boost
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.019546427 = queryNorm
             0.25016436 = fieldWeight in 4439, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.078125 = fieldNorm(doc=4439)
         0.057071578 = weight(abstract_txt:engines in 4439) [ClassicSimilarity], result of:
           0.057071578 = score(doc=4439,freq=1.0), product of:
             0.1379654 = queryWeight, product of:
               1.3330399 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.019546427 = queryNorm
             0.4136659 = fieldWeight in 4439, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.078125 = fieldNorm(doc=4439)
         0.050271537 = weight(abstract_txt:show in 4439) [ClassicSimilarity], result of:
           0.050271537 = score(doc=4439,freq=1.0), product of:
             0.14512274 = queryWeight, product of:
               1.6744471 = boost
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.019546427 = queryNorm
             0.34640703 = fieldWeight in 4439, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.43401 = idf(docFreq=1404, maxDocs=43556)
               0.078125 = fieldNorm(doc=4439)
         0.05807257 = weight(abstract_txt:results in 4439) [ClassicSimilarity], result of:
           0.05807257 = score(doc=4439,freq=2.0), product of:
             0.15035145 = queryWeight, product of:
               2.2002997 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.019546427 = queryNorm
             0.3862455 = fieldWeight in 4439, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.078125 = fieldNorm(doc=4439)
         0.06634897 = weight(abstract_txt:search in 4439) [ClassicSimilarity], result of:
           0.06634897 = score(doc=4439,freq=2.0), product of:
             0.1643172 = queryWeight, product of:
               2.300221 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.019546427 = queryNorm
             0.40378588 = fieldWeight in 4439, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.078125 = fieldNorm(doc=4439)
         0.041552696 = weight(abstract_txt:that in 4439) [ClassicSimilarity], result of:
           0.041552696 = score(doc=4439,freq=4.0), product of:
             0.11165798 = queryWeight, product of:
               2.3984625 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.019546427 = queryNorm
             0.37214267 = fieldWeight in 4439, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.078125 = fieldNorm(doc=4439)
         0.10252185 = weight(abstract_txt:query in 4439) [ClassicSimilarity], result of:
           0.10252185 = score(doc=4439,freq=1.0), product of:
             0.27670345 = queryWeight, product of:
               2.9849381 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.019546427 = queryNorm
             0.37051165 = fieldWeight in 4439, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.078125 = fieldNorm(doc=4439)
         0.534971 = weight(abstract_txt:queries in 4439) [ClassicSimilarity], result of:
           0.534971 = score(doc=4439,freq=9.0), product of:
             0.44769847 = queryWeight, product of:
               4.492467 = boost
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.019546427 = queryNorm
             1.1949359 = fieldWeight in 4439, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.078125 = fieldNorm(doc=4439)
       0.32 = coord(8/25)