Document (#42040)

Author

Yilmaz, T.
Ozcan, R.
Altingovde, I.S.
Ulusoy, Ö.

Title

Improving educational web search for question-like queries through subject classification

Source

Information processing and management. 56(2019) no.1, S.228-246

Year

2019

Abstract

Students use general web search engines as their primary source of research while trying to find answers to school-related questions. Although search engines are highly relevant for the general population, they may return results that are out of educational context. Another rising trend; social community question answering websites are the second choice for students who try to get answers from other peers online. We attempt discovering possible improvements in educational search by leveraging both of these information sources. For this purpose, we first implement a classifier for educational questions. This classifier is built by an ensemble method that employs several regular learning algorithms and retrieval based approaches that utilize external resources. We also build a query expander to facilitate classification. We further improve the classification using search engine results and obtain 83.5% accuracy. Although our work is entirely based on the Turkish language, the features could easily be mapped to other languages as well. In order to find out whether search engine ranking can be improved in the education domain using the classification model, we collect and label a set of query results retrieved from a general web search engine. We propose five ad-hoc methods to improve search ranking based on the idea that the query-document category relation is an indicator of relevance. We evaluate these methods for overall performance, varying query length and based on factoid and non-factoid queries. We show that some of the methods significantly improve the rankings in the education domain.

Content

Vgl.: https://doi.org/10.1016/j.ipm.2018.10.013.

Theme

Automatisches Klassifizieren

Similar documents (author)

1. Ozcan, R.; Altingovde, I.S.; Ulusoy, O.: Exploiting navigational queries for result presentation and caching in Web search engines (2011) 5.17

   5.168705 = sum of:
     5.168705 = sum of:
       2.4699943 = weight(author_txt:altingovde in 1362) [ClassicSimilarity], result of:
         2.4699943 = score(doc=1362,freq=1.0), product of:
           0.6859408 = queryWeight, product of:
             9.602362 = idf(docFreq=7, maxDocs=43556)
             0.071434595 = queryNorm
           3.6008856 = fieldWeight in 1362, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.602362 = idf(docFreq=7, maxDocs=43556)
             0.375 = fieldNorm(doc=1362)
       2.698711 = weight(author_txt:ulusoy in 1362) [ClassicSimilarity], result of:
         2.698711 = score(doc=1362,freq=1.0), product of:
           0.7276573 = queryWeight, product of:
             1.0299594 = boost
             9.890043 = idf(docFreq=5, maxDocs=43556)
             0.071434595 = queryNorm
           3.7087662 = fieldWeight in 1362, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.890043 = idf(docFreq=5, maxDocs=43556)
             0.375 = fieldNorm(doc=1362)
   

2. Sarigil, E.; Sengor Altingovde, I.; Blanco, R.; Barla Cambazoglu, B.; Ozcan, R.; Ulusoy, Ö.: Characterizing, predicting, and handling web search queries that match very few or no results (2018) 3.45

   3.4458036 = sum of:
     3.4458036 = sum of:
       1.646663 = weight(author_txt:altingovde in 325) [ClassicSimilarity], result of:
         1.646663 = score(doc=325,freq=1.0), product of:
           0.6859408 = queryWeight, product of:
             9.602362 = idf(docFreq=7, maxDocs=43556)
             0.071434595 = queryNorm
           2.4005904 = fieldWeight in 325, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.602362 = idf(docFreq=7, maxDocs=43556)
             0.25 = fieldNorm(doc=325)
       1.7991406 = weight(author_txt:ulusoy in 325) [ClassicSimilarity], result of:
         1.7991406 = score(doc=325,freq=1.0), product of:
           0.7276573 = queryWeight, product of:
             1.0299594 = boost
             9.890043 = idf(docFreq=5, maxDocs=43556)
             0.071434595 = queryNorm
           2.4725108 = fieldWeight in 325, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.890043 = idf(docFreq=5, maxDocs=43556)
             0.25 = fieldNorm(doc=325)
   

3. Yigit-Sert, S.; Altingovde, I.S.; Macdonald, C.; Ounis, I.; Ulusoy, Ö,: Explicit diversification of search results across multiple dimensions for educational search (2021) 3.45

   3.4458036 = sum of:
     3.4458036 = sum of:
       1.646663 = weight(author_txt:altingovde in 2443) [ClassicSimilarity], result of:
         1.646663 = score(doc=2443,freq=1.0), product of:
           0.6859408 = queryWeight, product of:
             9.602362 = idf(docFreq=7, maxDocs=43556)
             0.071434595 = queryNorm
           2.4005904 = fieldWeight in 2443, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.602362 = idf(docFreq=7, maxDocs=43556)
             0.25 = fieldNorm(doc=2443)
       1.7991406 = weight(author_txt:ulusoy in 2443) [ClassicSimilarity], result of:
         1.7991406 = score(doc=2443,freq=1.0), product of:
           0.7276573 = queryWeight, product of:
             1.0299594 = boost
             9.890043 = idf(docFreq=5, maxDocs=43556)
             0.071434595 = queryNorm
           2.4725108 = fieldWeight in 2443, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.890043 = idf(docFreq=5, maxDocs=43556)
             0.25 = fieldNorm(doc=2443)
   

4. Sengor Altingovde, I. => Altingovde, I.S.: 2.04

   2.0376415 = sum of:
     2.0376415 = product of:
       4.075283 = sum of:
         4.075283 = weight(author_txt:altingovde in 2441) [ClassicSimilarity], result of:
           4.075283 = score(doc=2441,freq=2.0), product of:
             0.6859408 = queryWeight, product of:
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.071434595 = queryNorm
             5.9411583 = fieldWeight in 2441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.4375 = fieldNorm(doc=2441)
       0.5 = coord(1/2)
   

5. Altingovde, I. Sengor => Sengor Altingovde, I.: 1.75

   1.7465498 = sum of:
     1.7465498 = product of:
       3.4930997 = sum of:
         3.4930997 = weight(author_txt:altingovde in 135) [ClassicSimilarity], result of:
           3.4930997 = score(doc=135,freq=2.0), product of:
             0.6859408 = queryWeight, product of:
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.071434595 = queryNorm
             5.0924215 = fieldWeight in 135, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.375 = fieldNorm(doc=135)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Spink, A.; Ozmultu, H.C.: Characteristics of question format web queries : an exploratory study (2002) 0.44

   0.43763593 = sum of:
     0.43763593 = product of:
       0.9946271 = sum of:
         0.041381266 = weight(abstract_txt:find in 4908) [ClassicSimilarity], result of:
           0.041381266 = score(doc=4908,freq=1.0), product of:
             0.13513324 = queryWeight, product of:
               1.0998974 = boost
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.025075436 = queryNorm
             0.30622566 = fieldWeight in 4908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.041525487 = weight(abstract_txt:questions in 4908) [ClassicSimilarity], result of:
           0.041525487 = score(doc=4908,freq=1.0), product of:
             0.13544704 = queryWeight, product of:
               1.1011736 = boost
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.025075436 = queryNorm
             0.306581 = fieldWeight in 4908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.1744549 = weight(abstract_txt:queries in 4908) [ClassicSimilarity], result of:
           0.1744549 = score(doc=4908,freq=14.0), product of:
             0.1463207 = queryWeight, product of:
               1.1445215 = boost
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.025075436 = queryNorm
             1.1922777 = fieldWeight in 4908, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.1938473 = weight(abstract_txt:question in 4908) [ClassicSimilarity], result of:
           0.1938473 = score(doc=4908,freq=15.0), product of:
             0.15340367 = queryWeight, product of:
               1.1718956 = boost
               5.2203345 = idf(docFreq=639, maxDocs=43556)
               0.025075436 = queryNorm
             1.2636418 = fieldWeight in 4908, product of:
               3.8729835 = tf(freq=15.0), with freq of:
                 15.0 = termFreq=15.0
               5.2203345 = idf(docFreq=639, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.022546833 = weight(abstract_txt:results in 4908) [ClassicSimilarity], result of:
           0.022546833 = score(doc=4908,freq=1.0), product of:
             0.10319226 = queryWeight, product of:
               1.1771729 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.025075436 = queryNorm
             0.21849345 = fieldWeight in 4908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.07386065 = weight(abstract_txt:engines in 4908) [ClassicSimilarity], result of:
           0.07386065 = score(doc=4908,freq=2.0), product of:
             0.1578187 = queryWeight, product of:
               1.1886399 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.025075436 = queryNorm
             0.4680095 = fieldWeight in 4908, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.016805153 = weight(abstract_txt:that in 4908) [ClassicSimilarity], result of:
           0.016805153 = score(doc=4908,freq=2.0), product of:
             0.07982851 = queryWeight, product of:
               1.3366573 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.025075436 = queryNorm
             0.2105157 = fieldWeight in 4908, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.043149445 = weight(abstract_txt:general in 4908) [ClassicSimilarity], result of:
           0.043149445 = score(doc=4908,freq=1.0), product of:
             0.15906462 = queryWeight, product of:
               1.4615157 = boost
               4.3403187 = idf(docFreq=1542, maxDocs=43556)
               0.025075436 = queryNorm
             0.27126992 = fieldWeight in 4908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3403187 = idf(docFreq=1542, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.088790834 = weight(abstract_txt:engine in 4908) [ClassicSimilarity], result of:
           0.088790834 = score(doc=4908,freq=1.0), product of:
             0.25733697 = queryWeight, product of:
               1.8589504 = boost
               5.5205956 = idf(docFreq=473, maxDocs=43556)
               0.025075436 = queryNorm
             0.34503722 = fieldWeight in 4908, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5205956 = idf(docFreq=473, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.13000053 = weight(abstract_txt:query in 4908) [ClassicSimilarity], result of:
           0.13000053 = score(doc=4908,freq=3.0), product of:
             0.2532169 = queryWeight, product of:
               2.1292782 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.025075436 = queryNorm
             0.51339597 = fieldWeight in 4908, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
         0.1682647 = weight(abstract_txt:search in 4908) [ClassicSimilarity], result of:
           0.1682647 = score(doc=4908,freq=6.0), product of:
             0.30074006 = queryWeight, product of:
               3.2816834 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.025075436 = queryNorm
             0.5595021 = fieldWeight in 4908, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0625 = fieldNorm(doc=4908)
       0.44 = coord(11/25)
   

2. Radev, D.; Fan, W.; Qu, H.; Wu, H.; Grewal, A.: Probabilistic question answering on the Web (2005) 0.38

   0.3832216 = sum of:
     0.3832216 = product of:
       0.87095815 = sum of:
         0.05190686 = weight(abstract_txt:questions in 4453) [ClassicSimilarity], result of:
           0.05190686 = score(doc=4453,freq=1.0), product of:
             0.13544704 = queryWeight, product of:
               1.1011736 = boost
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.025075436 = queryNorm
             0.38322625 = fieldWeight in 4453, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.10836393 = weight(abstract_txt:question in 4453) [ClassicSimilarity], result of:
           0.10836393 = score(doc=4453,freq=3.0), product of:
             0.15340367 = queryWeight, product of:
               1.1718956 = boost
               5.2203345 = idf(docFreq=639, maxDocs=43556)
               0.025075436 = queryNorm
             0.70639724 = fieldWeight in 4453, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2203345 = idf(docFreq=639, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.02818354 = weight(abstract_txt:results in 4453) [ClassicSimilarity], result of:
           0.02818354 = score(doc=4453,freq=1.0), product of:
             0.10319226 = queryWeight, product of:
               1.1771729 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.025075436 = queryNorm
             0.2731168 = fieldWeight in 4453, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.11307557 = weight(abstract_txt:engines in 4453) [ClassicSimilarity], result of:
           0.11307557 = score(doc=4453,freq=3.0), product of:
             0.1578187 = queryWeight, product of:
               1.1886399 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.025075436 = queryNorm
             0.71649027 = fieldWeight in 4453, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.07740353 = weight(abstract_txt:ranking in 4453) [ClassicSimilarity], result of:
           0.07740353 = score(doc=4453,freq=1.0), product of:
             0.17679101 = queryWeight, product of:
               1.2580594 = boost
               5.6041603 = idf(docFreq=435, maxDocs=43556)
               0.025075436 = queryNorm
             0.43782502 = fieldWeight in 4453, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6041603 = idf(docFreq=435, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.025727531 = weight(abstract_txt:that in 4453) [ClassicSimilarity], result of:
           0.025727531 = score(doc=4453,freq=3.0), product of:
             0.07982851 = queryWeight, product of:
               1.3366573 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.025075436 = queryNorm
             0.322285 = fieldWeight in 4453, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.047432337 = weight(abstract_txt:methods in 4453) [ClassicSimilarity], result of:
           0.047432337 = score(doc=4453,freq=1.0), product of:
             0.14600457 = queryWeight, product of:
               1.4002317 = boost
               4.1583214 = idf(docFreq=1850, maxDocs=43556)
               0.025075436 = queryNorm
             0.32486886 = fieldWeight in 4453, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1583214 = idf(docFreq=1850, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.10864099 = weight(abstract_txt:answers in 4453) [ClassicSimilarity], result of:
           0.10864099 = score(doc=4453,freq=1.0), product of:
             0.22162333 = queryWeight, product of:
               1.4085711 = boost
               6.274631 = idf(docFreq=222, maxDocs=43556)
               0.025075436 = queryNorm
             0.49020556 = fieldWeight in 4453, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.274631 = idf(docFreq=222, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.0288162 = weight(abstract_txt:based in 4453) [ClassicSimilarity], result of:
           0.0288162 = score(doc=4453,freq=1.0), product of:
             0.1152712 = queryWeight, product of:
               1.4366351 = boost
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.025075436 = queryNorm
             0.24998613 = fieldWeight in 4453, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.13268124 = weight(abstract_txt:query in 4453) [ClassicSimilarity], result of:
           0.13268124 = score(doc=4453,freq=2.0), product of:
             0.2532169 = queryWeight, product of:
               2.1292782 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.025075436 = queryNorm
             0.5239826 = fieldWeight in 4453, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
         0.14872639 = weight(abstract_txt:search in 4453) [ClassicSimilarity], result of:
           0.14872639 = score(doc=4453,freq=3.0), product of:
             0.30074006 = queryWeight, product of:
               3.2816834 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.025075436 = queryNorm
             0.49453467 = fieldWeight in 4453, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.078125 = fieldNorm(doc=4453)
       0.44 = coord(11/25)
   

3. Li, X.; Schijvenaars, B.J.A.; Rijke, M.de: Investigating queries and search failures in academic search (2017) 0.38

   0.37972185 = sum of:
     0.37972185 = product of:
       0.9493046 = sum of:
         0.033142 = weight(abstract_txt:domain in 1319) [ClassicSimilarity], result of:
           0.033142 = score(doc=1319,freq=1.0), product of:
             0.12739141 = queryWeight, product of:
               1.0679259 = boost
               4.75719 = idf(docFreq=1016, maxDocs=43556)
               0.025075436 = queryNorm
             0.26015884 = fieldWeight in 1319, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.75719 = idf(docFreq=1016, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
         0.07241721 = weight(abstract_txt:find in 1319) [ClassicSimilarity], result of:
           0.07241721 = score(doc=1319,freq=4.0), product of:
             0.13513324 = queryWeight, product of:
               1.0998974 = boost
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.025075436 = queryNorm
             0.5358949 = fieldWeight in 1319, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
         0.13530803 = weight(abstract_txt:queries in 1319) [ClassicSimilarity], result of:
           0.13530803 = score(doc=1319,freq=11.0), product of:
             0.1463207 = queryWeight, product of:
               1.1445215 = boost
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.025075436 = queryNorm
             0.924736 = fieldWeight in 1319, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
         0.023249872 = weight(abstract_txt:that in 1319) [ClassicSimilarity], result of:
           0.023249872 = score(doc=1319,freq=5.0), product of:
             0.07982851 = queryWeight, product of:
               1.3366573 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.025075436 = queryNorm
             0.29124773 = fieldWeight in 1319, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
         0.020171342 = weight(abstract_txt:based in 1319) [ClassicSimilarity], result of:
           0.020171342 = score(doc=1319,freq=1.0), product of:
             0.1152712 = queryWeight, product of:
               1.4366351 = boost
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.025075436 = queryNorm
             0.1749903 = fieldWeight in 1319, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
         0.037755765 = weight(abstract_txt:general in 1319) [ClassicSimilarity], result of:
           0.037755765 = score(doc=1319,freq=1.0), product of:
             0.15906462 = queryWeight, product of:
               1.4615157 = boost
               4.3403187 = idf(docFreq=1542, maxDocs=43556)
               0.025075436 = queryNorm
             0.23736118 = fieldWeight in 1319, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3403187 = idf(docFreq=1542, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
         0.055696856 = weight(abstract_txt:classification in 1319) [ClassicSimilarity], result of:
           0.055696856 = score(doc=1319,freq=2.0), product of:
             0.18007003 = queryWeight, product of:
               1.7955884 = boost
               3.9993203 = idf(docFreq=2169, maxDocs=43556)
               0.025075436 = queryNorm
             0.30930665 = fieldWeight in 1319, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9993203 = idf(docFreq=2169, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
         0.10987305 = weight(abstract_txt:engine in 1319) [ClassicSimilarity], result of:
           0.10987305 = score(doc=1319,freq=2.0), product of:
             0.25733697 = queryWeight, product of:
               1.8589504 = boost
               5.5205956 = idf(docFreq=473, maxDocs=43556)
               0.025075436 = queryNorm
             0.42696178 = fieldWeight in 1319, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5205956 = idf(docFreq=473, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
         0.23679048 = weight(abstract_txt:query in 1319) [ClassicSimilarity], result of:
           0.23679048 = score(doc=1319,freq=13.0), product of:
             0.2532169 = queryWeight, product of:
               2.1292782 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.025075436 = queryNorm
             0.93512905 = fieldWeight in 1319, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
         0.2249 = weight(abstract_txt:search in 1319) [ClassicSimilarity], result of:
           0.2249 = score(doc=1319,freq=14.0), product of:
             0.30074006 = queryWeight, product of:
               3.2816834 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.025075436 = queryNorm
             0.7478219 = fieldWeight in 1319, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0546875 = fieldNorm(doc=1319)
       0.4 = coord(10/25)
   

4. Vidinli, I.B.; Ozcan, R.: New query suggestion framework and algorithms : a case study for an educational search engine (2016) 0.38

   0.3785297 = sum of:
     0.3785297 = product of:
       1.0514714 = sum of:
         0.052981663 = weight(abstract_txt:students in 183) [ClassicSimilarity], result of:
           0.052981663 = score(doc=183,freq=1.0), product of:
             0.13731039 = queryWeight, product of:
               1.1087222 = boost
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.025075436 = queryNorm
             0.3858533 = fieldWeight in 183, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.078125 = fieldNorm(doc=183)
         0.08242219 = weight(abstract_txt:queries in 183) [ClassicSimilarity], result of:
           0.08242219 = score(doc=183,freq=2.0), product of:
             0.1463207 = queryWeight, product of:
               1.1445215 = boost
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.025075436 = queryNorm
             0.5632982 = fieldWeight in 183, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.078125 = fieldNorm(doc=183)
         0.065284215 = weight(abstract_txt:engines in 183) [ClassicSimilarity], result of:
           0.065284215 = score(doc=183,freq=1.0), product of:
             0.1578187 = queryWeight, product of:
               1.1886399 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.025075436 = queryNorm
             0.4136659 = fieldWeight in 183, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.078125 = fieldNorm(doc=183)
         0.014853797 = weight(abstract_txt:that in 183) [ClassicSimilarity], result of:
           0.014853797 = score(doc=183,freq=1.0), product of:
             0.07982851 = queryWeight, product of:
               1.3366573 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.025075436 = queryNorm
             0.18607134 = fieldWeight in 183, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.078125 = fieldNorm(doc=183)
         0.05393681 = weight(abstract_txt:general in 183) [ClassicSimilarity], result of:
           0.05393681 = score(doc=183,freq=1.0), product of:
             0.15906462 = queryWeight, product of:
               1.4615157 = boost
               4.3403187 = idf(docFreq=1542, maxDocs=43556)
               0.025075436 = queryNorm
             0.3390874 = fieldWeight in 183, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3403187 = idf(docFreq=1542, maxDocs=43556)
               0.078125 = fieldNorm(doc=183)
         0.11098854 = weight(abstract_txt:engine in 183) [ClassicSimilarity], result of:
           0.11098854 = score(doc=183,freq=1.0), product of:
             0.25733697 = queryWeight, product of:
               1.8589504 = boost
               5.5205956 = idf(docFreq=473, maxDocs=43556)
               0.025075436 = queryNorm
             0.43129653 = fieldWeight in 183, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5205956 = idf(docFreq=473, maxDocs=43556)
               0.078125 = fieldNorm(doc=183)
         0.26536247 = weight(abstract_txt:query in 183) [ClassicSimilarity], result of:
           0.26536247 = score(doc=183,freq=8.0), product of:
             0.2532169 = queryWeight, product of:
               2.1292782 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.025075436 = queryNorm
             1.0479652 = fieldWeight in 183, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.078125 = fieldNorm(doc=183)
         0.28420714 = weight(abstract_txt:educational in 183) [ClassicSimilarity], result of:
           0.28420714 = score(doc=183,freq=2.0), product of:
             0.42076826 = queryWeight, product of:
               2.74478 = boost
               6.113458 = idf(docFreq=261, maxDocs=43556)
               0.025075436 = queryNorm
             0.6754481 = fieldWeight in 183, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.113458 = idf(docFreq=261, maxDocs=43556)
               0.078125 = fieldNorm(doc=183)
         0.12143459 = weight(abstract_txt:search in 183) [ClassicSimilarity], result of:
           0.12143459 = score(doc=183,freq=2.0), product of:
             0.30074006 = queryWeight, product of:
               3.2816834 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.025075436 = queryNorm
             0.40378588 = fieldWeight in 183, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.078125 = fieldNorm(doc=183)
       0.36 = coord(9/25)
   

5. Lorigo, L.; Pan, B.; Hembrooke, H.; Joachims, T.; Granka, L.; Gay, G.: ¬The influence of task and gender on search and evaluation behavior using Google (2006) 0.34

   0.33814907 = sum of:
     0.33814907 = product of:
       0.76852065 = sum of:
         0.041381266 = weight(abstract_txt:find in 2976) [ClassicSimilarity], result of:
           0.041381266 = score(doc=2976,freq=1.0), product of:
             0.13513324 = queryWeight, product of:
               1.0998974 = boost
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.025075436 = queryNorm
             0.30622566 = fieldWeight in 2976, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.046625033 = weight(abstract_txt:queries in 2976) [ClassicSimilarity], result of:
           0.046625033 = score(doc=2976,freq=1.0), product of:
             0.1463207 = queryWeight, product of:
               1.1445215 = boost
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.025075436 = queryNorm
             0.3186496 = fieldWeight in 2976, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0983934 = idf(docFreq=722, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.022546833 = weight(abstract_txt:results in 2976) [ClassicSimilarity], result of:
           0.022546833 = score(doc=2976,freq=1.0), product of:
             0.10319226 = queryWeight, product of:
               1.1771729 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.025075436 = queryNorm
             0.21849345 = fieldWeight in 2976, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.07386065 = weight(abstract_txt:engines in 2976) [ClassicSimilarity], result of:
           0.07386065 = score(doc=2976,freq=2.0), product of:
             0.1578187 = queryWeight, product of:
               1.1886399 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.025075436 = queryNorm
             0.4680095 = fieldWeight in 2976, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.061922822 = weight(abstract_txt:ranking in 2976) [ClassicSimilarity], result of:
           0.061922822 = score(doc=2976,freq=1.0), product of:
             0.17679101 = queryWeight, product of:
               1.2580594 = boost
               5.6041603 = idf(docFreq=435, maxDocs=43556)
               0.025075436 = queryNorm
             0.35026002 = fieldWeight in 2976, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6041603 = idf(docFreq=435, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.020582024 = weight(abstract_txt:that in 2976) [ClassicSimilarity], result of:
           0.020582024 = score(doc=2976,freq=3.0), product of:
             0.07982851 = queryWeight, product of:
               1.3366573 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.025075436 = queryNorm
             0.257828 = fieldWeight in 2976, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.02305296 = weight(abstract_txt:based in 2976) [ClassicSimilarity], result of:
           0.02305296 = score(doc=2976,freq=1.0), product of:
             0.1152712 = queryWeight, product of:
               1.4366351 = boost
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.025075436 = queryNorm
             0.1999889 = fieldWeight in 2976, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1998224 = idf(docFreq=4826, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.06546232 = weight(abstract_txt:improve in 2976) [ClassicSimilarity], result of:
           0.06546232 = score(doc=2976,freq=1.0), product of:
             0.21001536 = queryWeight, product of:
               1.6793538 = boost
               4.987241 = idf(docFreq=807, maxDocs=43556)
               0.025075436 = queryNorm
             0.31170255 = fieldWeight in 2976, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.987241 = idf(docFreq=807, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.088790834 = weight(abstract_txt:engine in 2976) [ClassicSimilarity], result of:
           0.088790834 = score(doc=2976,freq=1.0), product of:
             0.25733697 = queryWeight, product of:
               1.8589504 = boost
               5.5205956 = idf(docFreq=473, maxDocs=43556)
               0.025075436 = queryNorm
             0.34503722 = fieldWeight in 2976, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5205956 = idf(docFreq=473, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.13000053 = weight(abstract_txt:query in 2976) [ClassicSimilarity], result of:
           0.13000053 = score(doc=2976,freq=3.0), product of:
             0.2532169 = queryWeight, product of:
               2.1292782 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.025075436 = queryNorm
             0.51339597 = fieldWeight in 2976, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
         0.19429535 = weight(abstract_txt:search in 2976) [ClassicSimilarity], result of:
           0.19429535 = score(doc=2976,freq=8.0), product of:
             0.30074006 = queryWeight, product of:
               3.2816834 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.025075436 = queryNorm
             0.6460574 = fieldWeight in 2976, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0625 = fieldNorm(doc=2976)
       0.44 = coord(11/25)