Document (#42042)

Author

Yilmaz, T.
Ozcan, R.
Altingovde, I.S.
Ulusoy, Ö.

Title

Improving educational web search for question-like queries through subject classification

Source

Information processing and management. 56(2019) no.1, S.228-246

Year

2019

Abstract

Students use general web search engines as their primary source of research while trying to find answers to school-related questions. Although search engines are highly relevant for the general population, they may return results that are out of educational context. Another rising trend; social community question answering websites are the second choice for students who try to get answers from other peers online. We attempt discovering possible improvements in educational search by leveraging both of these information sources. For this purpose, we first implement a classifier for educational questions. This classifier is built by an ensemble method that employs several regular learning algorithms and retrieval based approaches that utilize external resources. We also build a query expander to facilitate classification. We further improve the classification using search engine results and obtain 83.5% accuracy. Although our work is entirely based on the Turkish language, the features could easily be mapped to other languages as well. In order to find out whether search engine ranking can be improved in the education domain using the classification model, we collect and label a set of query results retrieved from a general web search engine. We propose five ad-hoc methods to improve search ranking based on the idea that the query-document category relation is an indicator of relevance. We evaluate these methods for overall performance, varying query length and based on factoid and non-factoid queries. We show that some of the methods significantly improve the rankings in the education domain.

Content

Vgl.: https://doi.org/10.1016/j.ipm.2018.10.013.

Theme

Automatisches Klassifizieren

Similar documents (author)

1. Ozcan, R.; Altingovde, I.S.; Ulusoy, O.: Exploiting navigational queries for result presentation and caching in Web search engines (2011) 5.18

   5.176705 = sum of:
     5.176705 = sum of:
       2.473994 = weight(author_txt:altingovde in 4364) [ClassicSimilarity], result of:
         2.473994 = score(doc=4364,freq=1.0), product of:
           0.685974 = queryWeight, product of:
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.071326 = queryNorm
           3.606542 = fieldWeight in 4364, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.375 = fieldNorm(doc=4364)
       2.7027109 = weight(author_txt:ulusoy in 4364) [ClassicSimilarity], result of:
         2.7027109 = score(doc=4364,freq=1.0), product of:
           0.7276261 = queryWeight, product of:
             1.0299125 = boost
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.071326 = queryNorm
           3.7144227 = fieldWeight in 4364, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.375 = fieldNorm(doc=4364)
   

2. Sarigil, E.; Sengor Altingovde, I.; Blanco, R.; Barla Cambazoglu, B.; Ozcan, R.; Ulusoy, Ö.: Characterizing, predicting, and handling web search queries that match very few or no results (2018) 3.45

   3.4511366 = sum of:
     3.4511366 = sum of:
       1.6493294 = weight(author_txt:altingovde in 4039) [ClassicSimilarity], result of:
         1.6493294 = score(doc=4039,freq=1.0), product of:
           0.685974 = queryWeight, product of:
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.071326 = queryNorm
           2.4043615 = fieldWeight in 4039, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.25 = fieldNorm(doc=4039)
       1.8018073 = weight(author_txt:ulusoy in 4039) [ClassicSimilarity], result of:
         1.8018073 = score(doc=4039,freq=1.0), product of:
           0.7276261 = queryWeight, product of:
             1.0299125 = boost
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.071326 = queryNorm
           2.476282 = fieldWeight in 4039, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.25 = fieldNorm(doc=4039)
   

3. Yigit-Sert, S.; Altingovde, I.S.; Macdonald, C.; Ounis, I.; Ulusoy, Ö,: Explicit diversification of search results across multiple dimensions for educational search (2021) 3.45

   3.4511366 = sum of:
     3.4511366 = sum of:
       1.6493294 = weight(author_txt:altingovde in 156) [ClassicSimilarity], result of:
         1.6493294 = score(doc=156,freq=1.0), product of:
           0.685974 = queryWeight, product of:
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.071326 = queryNorm
           2.4043615 = fieldWeight in 156, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.25 = fieldNorm(doc=156)
       1.8018073 = weight(author_txt:ulusoy in 156) [ClassicSimilarity], result of:
         1.8018073 = score(doc=156,freq=1.0), product of:
           0.7276261 = queryWeight, product of:
             1.0299125 = boost
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.071326 = queryNorm
           2.476282 = fieldWeight in 156, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.25 = fieldNorm(doc=156)
   

4. Sengor Altingovde, I. => Altingovde, I.S.: 2.04

   2.040941 = sum of:
     2.040941 = product of:
       4.081882 = sum of:
         4.081882 = weight(author_txt:altingovde in 154) [ClassicSimilarity], result of:
           4.081882 = score(doc=154,freq=2.0), product of:
             0.685974 = queryWeight, product of:
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.071326 = queryNorm
             5.950491 = fieldWeight in 154, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.4375 = fieldNorm(doc=154)
       0.5 = coord(1/2)
   

5. Altingovde, I. Sengor => Sengor Altingovde, I.: 1.75

   1.7493781 = sum of:
     1.7493781 = product of:
       3.4987562 = sum of:
         3.4987562 = weight(author_txt:altingovde in 135) [ClassicSimilarity], result of:
           3.4987562 = score(doc=135,freq=2.0), product of:
             0.685974 = queryWeight, product of:
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.071326 = queryNorm
             5.100421 = fieldWeight in 135, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.375 = fieldNorm(doc=135)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Spink, A.; Ozmultu, H.C.: Characteristics of question format web queries : an exploratory study (2002) 0.44

   0.43899664 = sum of:
     0.43899664 = product of:
       0.99771965 = sum of:
         0.04120407 = weight(abstract_txt:find in 3910) [ClassicSimilarity], result of:
           0.04120407 = score(doc=3910,freq=1.0), product of:
             0.1348784 = queryWeight, product of:
               1.1100526 = boost
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.024858857 = queryNorm
             0.3054905 = fieldWeight in 3910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.04137234 = weight(abstract_txt:questions in 3910) [ClassicSimilarity], result of:
           0.04137234 = score(doc=3910,freq=1.0), product of:
             0.13524537 = queryWeight, product of:
               1.1115617 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.024858857 = queryNorm
             0.3059058 = fieldWeight in 3910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.17580977 = weight(abstract_txt:queries in 3910) [ClassicSimilarity], result of:
           0.17580977 = score(doc=3910,freq=14.0), product of:
             0.1472205 = queryWeight, product of:
               1.159729 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.024858857 = queryNorm
             1.1941935 = fieldWeight in 3910, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.19300392 = weight(abstract_txt:question in 3910) [ClassicSimilarity], result of:
           0.19300392 = score(doc=3910,freq=15.0), product of:
             0.15310733 = queryWeight, product of:
               1.1826885 = boost
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.024858857 = queryNorm
             1.2605792 = fieldWeight in 3910, product of:
               3.8729835 = tf(freq=15.0), with freq of:
                 15.0 = termFreq=15.0
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.022352315 = weight(abstract_txt:results in 3910) [ClassicSimilarity], result of:
           0.022352315 = score(doc=3910,freq=1.0), product of:
             0.10269779 = queryWeight, product of:
               1.186311 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.024858857 = queryNorm
             0.21765138 = fieldWeight in 3910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.07435826 = weight(abstract_txt:engines in 3910) [ClassicSimilarity], result of:
           0.07435826 = score(doc=3910,freq=2.0), product of:
             0.15868108 = queryWeight, product of:
               1.2040235 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.024858857 = queryNorm
             0.46860194 = fieldWeight in 3910, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.016595813 = weight(abstract_txt:that in 3910) [ClassicSimilarity], result of:
           0.016595813 = score(doc=3910,freq=2.0), product of:
             0.07924125 = queryWeight, product of:
               1.3452966 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.024858857 = queryNorm
             0.20943399 = fieldWeight in 3910, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.043113027 = weight(abstract_txt:general in 3910) [ClassicSimilarity], result of:
           0.043113027 = score(doc=3910,freq=1.0), product of:
             0.15912989 = queryWeight, product of:
               1.4767054 = boost
               4.3348765 = idf(docFreq=1574, maxDocs=44218)
               0.024858857 = queryNorm
             0.27092978 = fieldWeight in 3910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3348765 = idf(docFreq=1574, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.08937414 = weight(abstract_txt:engine in 3910) [ClassicSimilarity], result of:
           0.08937414 = score(doc=3910,freq=1.0), product of:
             0.25871444 = queryWeight, product of:
               1.8829046 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.024858857 = queryNorm
             0.34545478 = fieldWeight in 3910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.13130784 = weight(abstract_txt:query in 3910) [ClassicSimilarity], result of:
           0.13130784 = score(doc=3910,freq=3.0), product of:
             0.25515985 = queryWeight, product of:
               2.1592033 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.024858857 = queryNorm
             0.5146101 = fieldWeight in 3910, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
         0.16922809 = weight(abstract_txt:search in 3910) [ClassicSimilarity], result of:
           0.16922809 = score(doc=3910,freq=6.0), product of:
             0.3021808 = queryWeight, product of:
               3.3230417 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.024858857 = queryNorm
             0.56002265 = fieldWeight in 3910, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=3910)
       0.44 = coord(11/25)
   

2. Radev, D.; Fan, W.; Qu, H.; Wu, H.; Grewal, A.: Probabilistic question answering on the Web (2005) 0.38

   0.38384137 = sum of:
     0.38384137 = product of:
       0.8723667 = sum of:
         0.051715426 = weight(abstract_txt:questions in 3455) [ClassicSimilarity], result of:
           0.051715426 = score(doc=3455,freq=1.0), product of:
             0.13524537 = queryWeight, product of:
               1.1115617 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.024858857 = queryNorm
             0.38238224 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.10789246 = weight(abstract_txt:question in 3455) [ClassicSimilarity], result of:
           0.10789246 = score(doc=3455,freq=3.0), product of:
             0.15310733 = queryWeight, product of:
               1.1826885 = boost
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.024858857 = queryNorm
             0.70468515 = fieldWeight in 3455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.027940396 = weight(abstract_txt:results in 3455) [ClassicSimilarity], result of:
           0.027940396 = score(doc=3455,freq=1.0), product of:
             0.10269779 = queryWeight, product of:
               1.186311 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.024858857 = queryNorm
             0.27206424 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.113837376 = weight(abstract_txt:engines in 3455) [ClassicSimilarity], result of:
           0.113837376 = score(doc=3455,freq=3.0), product of:
             0.15868108 = queryWeight, product of:
               1.2040235 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.024858857 = queryNorm
             0.7173973 = fieldWeight in 3455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.07740784 = weight(abstract_txt:ranking in 3455) [ClassicSimilarity], result of:
           0.07740784 = score(doc=3455,freq=1.0), product of:
             0.17696972 = queryWeight, product of:
               1.2715161 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.024858857 = queryNorm
             0.43740726 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.025407044 = weight(abstract_txt:that in 3455) [ClassicSimilarity], result of:
           0.025407044 = score(doc=3455,freq=3.0), product of:
             0.07924125 = queryWeight, product of:
               1.3452966 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.024858857 = queryNorm
             0.320629 = fieldWeight in 3455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.04717506 = weight(abstract_txt:methods in 3455) [ClassicSimilarity], result of:
           0.04717506 = score(doc=3455,freq=1.0), product of:
             0.14561778 = queryWeight, product of:
               1.4126196 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.024858857 = queryNorm
             0.32396498 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.10881837 = weight(abstract_txt:answers in 3455) [ClassicSimilarity], result of:
           0.10881837 = score(doc=3455,freq=1.0), product of:
             0.22208051 = queryWeight, product of:
               1.4243857 = boost
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.024858857 = queryNorm
             0.48999512 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.028579356 = weight(abstract_txt:based in 3455) [ClassicSimilarity], result of:
           0.028579356 = score(doc=3455,freq=1.0), product of:
             0.11475033 = queryWeight, product of:
               1.4479859 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.024858857 = queryNorm
             0.24905685 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.13401552 = weight(abstract_txt:query in 3455) [ClassicSimilarity], result of:
           0.13401552 = score(doc=3455,freq=2.0), product of:
             0.25515985 = queryWeight, product of:
               2.1592033 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.024858857 = queryNorm
             0.52522177 = fieldWeight in 3455, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.14957792 = weight(abstract_txt:search in 3455) [ClassicSimilarity], result of:
           0.14957792 = score(doc=3455,freq=3.0), product of:
             0.3021808 = queryWeight, product of:
               3.3230417 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.024858857 = queryNorm
             0.49499476 = fieldWeight in 3455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
       0.44 = coord(11/25)
   

3. Li, X.; Schijvenaars, B.J.A.; Rijke, M.de: Investigating queries and search failures in academic search (2017) 0.38

   0.38138193 = sum of:
     0.38138193 = product of:
       0.9534548 = sum of:
         0.032788217 = weight(abstract_txt:domain in 5033) [ClassicSimilarity], result of:
           0.032788217 = score(doc=5033,freq=1.0), product of:
             0.12660636 = queryWeight, product of:
               1.0754745 = boost
               4.7355914 = idf(docFreq=1054, maxDocs=44218)
               0.024858857 = queryNorm
             0.25897765 = fieldWeight in 5033, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7355914 = idf(docFreq=1054, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
         0.07210712 = weight(abstract_txt:find in 5033) [ClassicSimilarity], result of:
           0.07210712 = score(doc=5033,freq=4.0), product of:
             0.1348784 = queryWeight, product of:
               1.1100526 = boost
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.024858857 = queryNorm
             0.53460836 = fieldWeight in 5033, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
         0.13635887 = weight(abstract_txt:queries in 5033) [ClassicSimilarity], result of:
           0.13635887 = score(doc=5033,freq=11.0), product of:
             0.1472205 = queryWeight, product of:
               1.159729 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.024858857 = queryNorm
             0.92622197 = fieldWeight in 5033, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
         0.022960246 = weight(abstract_txt:that in 5033) [ClassicSimilarity], result of:
           0.022960246 = score(doc=5033,freq=5.0), product of:
             0.07924125 = queryWeight, product of:
               1.3452966 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.024858857 = queryNorm
             0.28975117 = fieldWeight in 5033, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
         0.02000555 = weight(abstract_txt:based in 5033) [ClassicSimilarity], result of:
           0.02000555 = score(doc=5033,freq=1.0), product of:
             0.11475033 = queryWeight, product of:
               1.4479859 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.024858857 = queryNorm
             0.1743398 = fieldWeight in 5033, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
         0.0377239 = weight(abstract_txt:general in 5033) [ClassicSimilarity], result of:
           0.0377239 = score(doc=5033,freq=1.0), product of:
             0.15912989 = queryWeight, product of:
               1.4767054 = boost
               4.3348765 = idf(docFreq=1574, maxDocs=44218)
               0.024858857 = queryNorm
             0.23706356 = fieldWeight in 5033, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3348765 = idf(docFreq=1574, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
         0.05555667 = weight(abstract_txt:classification in 5033) [ClassicSimilarity], result of:
           0.05555667 = score(doc=5033,freq=2.0), product of:
             0.17994279 = queryWeight, product of:
               1.8132371 = boost
               3.9920752 = idf(docFreq=2218, maxDocs=44218)
               0.024858857 = queryNorm
             0.3087463 = fieldWeight in 5033, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9920752 = idf(docFreq=2218, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
         0.11059485 = weight(abstract_txt:engine in 5033) [ClassicSimilarity], result of:
           0.11059485 = score(doc=5033,freq=2.0), product of:
             0.25871444 = queryWeight, product of:
               1.8829046 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.024858857 = queryNorm
             0.42747846 = fieldWeight in 5033, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
         0.2391717 = weight(abstract_txt:query in 5033) [ClassicSimilarity], result of:
           0.2391717 = score(doc=5033,freq=13.0), product of:
             0.25515985 = queryWeight, product of:
               2.1592033 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.024858857 = queryNorm
             0.9373406 = fieldWeight in 5033, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
         0.22618766 = weight(abstract_txt:search in 5033) [ClassicSimilarity], result of:
           0.22618766 = score(doc=5033,freq=14.0), product of:
             0.3021808 = queryWeight, product of:
               3.3230417 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.024858857 = queryNorm
             0.74851763 = fieldWeight in 5033, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5033)
       0.4 = coord(10/25)
   

4. Vidinli, I.B.; Ozcan, R.: New query suggestion framework and algorithms : a case study for an educational search engine (2016) 0.38

   0.38030928 = sum of:
     0.38030928 = product of:
       1.0564146 = sum of:
         0.053207494 = weight(abstract_txt:students in 3185) [ClassicSimilarity], result of:
           0.053207494 = score(doc=3185,freq=1.0), product of:
             0.13783437 = queryWeight, product of:
               1.1221505 = boost
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.024858857 = queryNorm
             0.38602486 = fieldWeight in 3185, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.078125 = fieldNorm(doc=3185)
         0.083062306 = weight(abstract_txt:queries in 3185) [ClassicSimilarity], result of:
           0.083062306 = score(doc=3185,freq=2.0), product of:
             0.1472205 = queryWeight, product of:
               1.159729 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.024858857 = queryNorm
             0.5642034 = fieldWeight in 3185, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.078125 = fieldNorm(doc=3185)
         0.06572404 = weight(abstract_txt:engines in 3185) [ClassicSimilarity], result of:
           0.06572404 = score(doc=3185,freq=1.0), product of:
             0.15868108 = queryWeight, product of:
               1.2040235 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.024858857 = queryNorm
             0.41418952 = fieldWeight in 3185, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.078125 = fieldNorm(doc=3185)
         0.014668765 = weight(abstract_txt:that in 3185) [ClassicSimilarity], result of:
           0.014668765 = score(doc=3185,freq=1.0), product of:
             0.07924125 = queryWeight, product of:
               1.3452966 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.024858857 = queryNorm
             0.18511525 = fieldWeight in 3185, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=3185)
         0.053891283 = weight(abstract_txt:general in 3185) [ClassicSimilarity], result of:
           0.053891283 = score(doc=3185,freq=1.0), product of:
             0.15912989 = queryWeight, product of:
               1.4767054 = boost
               4.3348765 = idf(docFreq=1574, maxDocs=44218)
               0.024858857 = queryNorm
             0.33866224 = fieldWeight in 3185, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3348765 = idf(docFreq=1574, maxDocs=44218)
               0.078125 = fieldNorm(doc=3185)
         0.11171768 = weight(abstract_txt:engine in 3185) [ClassicSimilarity], result of:
           0.11171768 = score(doc=3185,freq=1.0), product of:
             0.25871444 = queryWeight, product of:
               1.8829046 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.024858857 = queryNorm
             0.4318185 = fieldWeight in 3185, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.078125 = fieldNorm(doc=3185)
         0.26803103 = weight(abstract_txt:query in 3185) [ClassicSimilarity], result of:
           0.26803103 = score(doc=3185,freq=8.0), product of:
             0.25515985 = queryWeight, product of:
               2.1592033 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.024858857 = queryNorm
             1.0504435 = fieldWeight in 3185, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=3185)
         0.28398225 = weight(abstract_txt:educational in 3185) [ClassicSimilarity], result of:
           0.28398225 = score(doc=3185,freq=2.0), product of:
             0.42095575 = queryWeight, product of:
               2.7733557 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.024858857 = queryNorm
             0.67461306 = fieldWeight in 3185, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.078125 = fieldNorm(doc=3185)
         0.12212985 = weight(abstract_txt:search in 3185) [ClassicSimilarity], result of:
           0.12212985 = score(doc=3185,freq=2.0), product of:
             0.3021808 = queryWeight, product of:
               3.3230417 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.024858857 = queryNorm
             0.4041615 = fieldWeight in 3185, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=3185)
       0.36 = coord(9/25)
   

5. Lorigo, L.; Pan, B.; Hembrooke, H.; Joachims, T.; Granka, L.; Gay, G.: ¬The influence of task and gender on search and evaluation behavior using Google (2006) 0.34

   0.3391025 = sum of:
     0.3391025 = product of:
       0.7706875 = sum of:
         0.04120407 = weight(abstract_txt:find in 978) [ClassicSimilarity], result of:
           0.04120407 = score(doc=978,freq=1.0), product of:
             0.1348784 = queryWeight, product of:
               1.1100526 = boost
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.024858857 = queryNorm
             0.3054905 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.046987135 = weight(abstract_txt:queries in 978) [ClassicSimilarity], result of:
           0.046987135 = score(doc=978,freq=1.0), product of:
             0.1472205 = queryWeight, product of:
               1.159729 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.024858857 = queryNorm
             0.31916162 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.022352315 = weight(abstract_txt:results in 978) [ClassicSimilarity], result of:
           0.022352315 = score(doc=978,freq=1.0), product of:
             0.10269779 = queryWeight, product of:
               1.186311 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.024858857 = queryNorm
             0.21765138 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.07435826 = weight(abstract_txt:engines in 978) [ClassicSimilarity], result of:
           0.07435826 = score(doc=978,freq=2.0), product of:
             0.15868108 = queryWeight, product of:
               1.2040235 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.024858857 = queryNorm
             0.46860194 = fieldWeight in 978, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.061926275 = weight(abstract_txt:ranking in 978) [ClassicSimilarity], result of:
           0.061926275 = score(doc=978,freq=1.0), product of:
             0.17696972 = queryWeight, product of:
               1.2715161 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.024858857 = queryNorm
             0.34992582 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.020325635 = weight(abstract_txt:that in 978) [ClassicSimilarity], result of:
           0.020325635 = score(doc=978,freq=3.0), product of:
             0.07924125 = queryWeight, product of:
               1.3452966 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.024858857 = queryNorm
             0.2565032 = fieldWeight in 978, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.022863485 = weight(abstract_txt:based in 978) [ClassicSimilarity], result of:
           0.022863485 = score(doc=978,freq=1.0), product of:
             0.11475033 = queryWeight, product of:
               1.4479859 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.024858857 = queryNorm
             0.19924548 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.06458066 = weight(abstract_txt:improve in 978) [ClassicSimilarity], result of:
           0.06458066 = score(doc=978,freq=1.0), product of:
             0.20832804 = queryWeight, product of:
               1.6896309 = boost
               4.9599204 = idf(docFreq=842, maxDocs=44218)
               0.024858857 = queryNorm
             0.30999503 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9599204 = idf(docFreq=842, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.08937414 = weight(abstract_txt:engine in 978) [ClassicSimilarity], result of:
           0.08937414 = score(doc=978,freq=1.0), product of:
             0.25871444 = queryWeight, product of:
               1.8829046 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.024858857 = queryNorm
             0.34545478 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.13130784 = weight(abstract_txt:query in 978) [ClassicSimilarity], result of:
           0.13130784 = score(doc=978,freq=3.0), product of:
             0.25515985 = queryWeight, product of:
               2.1592033 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.024858857 = queryNorm
             0.5146101 = fieldWeight in 978, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
         0.19540776 = weight(abstract_txt:search in 978) [ClassicSimilarity], result of:
           0.19540776 = score(doc=978,freq=8.0), product of:
             0.3021808 = queryWeight, product of:
               3.3230417 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.024858857 = queryNorm
             0.6466584 = fieldWeight in 978, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=978)
       0.44 = coord(11/25)