Document (#37688)

Author

Lin, Y.
Lin, H.
Xu, K.
Sun, X.

Title

Learning to rank using smoothing methods for language modeling

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.4, S.818-828

Year

2013

Abstract

The central issue in language model estimation is smoothing, which is a technique for avoiding zero probability estimation problem and overcoming data sparsity. There are three representative smoothing methods: Jelinek-Mercer (JM) method; Bayesian smoothing using Dirichlet priors (Dir) method; and absolute discounting (Dis) method, whose parameters are usually estimated empirically. Previous research in information retrieval (IR) on smoothing parameter estimation tends to select a single value from optional values for the collection, but it may not be appropriate for all the queries. The effectiveness of all the optional values should be considered to improve the ranking performance. Recently, learning to rank has become an effective approach to optimize the ranking accuracy by merging the existing retrieval methods. In this article, the smoothing methods for language modeling in information retrieval (LMIR) with different parameters are treated as different retrieval methods, then a learning to rank approach to learn a ranking model based on the features extracted by smoothing methods is presented. In the process of learning, the effectiveness of all the optional smoothing parameters is taken into account for all queries. The experimental results on the Learning to Rank for Information Retrieval (LETOR) LETOR3.0 and LETOR4.0 data sets show that our approach is effective in improving the performance of LMIR.

Similar documents (content)

1. Aksoy, C.; Can, F.; Kocberber, S.: Novelty detection for topic tracking (2012) 0.44

   0.44046995 = sum of:
     0.44046995 = product of:
       1.2235276 = sum of:
         0.009403493 = weight(abstract_txt:model in 51) [ClassicSimilarity], result of:
           0.009403493 = score(doc=51,freq=1.0), product of:
             0.03774387 = queryWeight, product of:
               1.0016648 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.009452817 = queryNorm
             0.24913962 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.041876312 = weight(abstract_txt:dirichlet in 51) [ClassicSimilarity], result of:
           0.041876312 = score(doc=51,freq=1.0), product of:
             0.08108787 = queryWeight, product of:
               1.0381548 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.009452817 = queryNorm
             0.5164313 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.02084381 = weight(abstract_txt:performance in 51) [ClassicSimilarity], result of:
           0.02084381 = score(doc=51,freq=2.0), product of:
             0.050928596 = queryWeight, product of:
               1.1635365 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.009452817 = queryNorm
             0.40927517 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.016545378 = weight(abstract_txt:approach in 51) [ClassicSimilarity], result of:
           0.016545378 = score(doc=51,freq=2.0), product of:
             0.049979493 = queryWeight, product of:
               1.4116945 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.009452817 = queryNorm
             0.33104333 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.01628814 = weight(abstract_txt:language in 51) [ClassicSimilarity], result of:
           0.01628814 = score(doc=51,freq=1.0), product of:
             0.06231583 = queryWeight, product of:
               1.5763186 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.009452817 = queryNorm
             0.26138046 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.04973708 = weight(abstract_txt:method in 51) [ClassicSimilarity], result of:
           0.04973708 = score(doc=51,freq=6.0), product of:
             0.07218059 = queryWeight, product of:
               1.6965046 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.009452817 = queryNorm
             0.68906444 = fieldWeight in 51, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.068932146 = weight(abstract_txt:learning in 51) [ClassicSimilarity], result of:
           0.068932146 = score(doc=51,freq=3.0), product of:
             0.13403177 = queryWeight, product of:
               2.9845102 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.009452817 = queryNorm
             0.51429707 = fieldWeight in 51, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.044911884 = weight(abstract_txt:methods in 51) [ClassicSimilarity], result of:
           0.044911884 = score(doc=51,freq=2.0), product of:
             0.122534454 = queryWeight, product of:
               3.1259997 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.009452817 = queryNorm
             0.36652455 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.9549893 = weight(abstract_txt:smoothing in 51) [ClassicSimilarity], result of:
           0.9549893 = score(doc=51,freq=4.0), product of:
             0.82158524 = queryWeight, product of:
               9.34664 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.009452817 = queryNorm
             1.162374 = fieldWeight in 51, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
       0.36 = coord(9/25)
   

2. Huang, X.; Peng, F,; An, A.; Schuurmans, D.: Dynamic Web log session identification with statistical language models (2004) 0.43

   0.43322098 = sum of:
     0.43322098 = product of:
       1.2033916 = sum of:
         0.016623184 = weight(abstract_txt:model in 3096) [ClassicSimilarity], result of:
           0.016623184 = score(doc=3096,freq=2.0), product of:
             0.03774387 = queryWeight, product of:
               1.0016648 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.009452817 = queryNorm
             0.44042078 = fieldWeight in 3096, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.078125 = fieldNorm(doc=3096)
         0.031910434 = weight(abstract_txt:performance in 3096) [ClassicSimilarity], result of:
           0.031910434 = score(doc=3096,freq=3.0), product of:
             0.050928596 = queryWeight, product of:
               1.1635365 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.009452817 = queryNorm
             0.6265721 = fieldWeight in 3096, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.078125 = fieldNorm(doc=3096)
         0.03270068 = weight(abstract_txt:approach in 3096) [ClassicSimilarity], result of:
           0.03270068 = score(doc=3096,freq=5.0), product of:
             0.049979493 = queryWeight, product of:
               1.4116945 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.009452817 = queryNorm
             0.6542819 = fieldWeight in 3096, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=3096)
         0.06988948 = weight(abstract_txt:modeling in 3096) [ClassicSimilarity], result of:
           0.06988948 = score(doc=3096,freq=3.0), product of:
             0.085891016 = queryWeight, product of:
               1.5110298 = boost
               6.0133076 = idf(docFreq=293, maxDocs=44218)
               0.009452817 = queryNorm
             0.8136995 = fieldWeight in 3096, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.0133076 = idf(docFreq=293, maxDocs=44218)
               0.078125 = fieldNorm(doc=3096)
         0.04552674 = weight(abstract_txt:language in 3096) [ClassicSimilarity], result of:
           0.04552674 = score(doc=3096,freq=5.0), product of:
             0.06231583 = queryWeight, product of:
               1.5763186 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.009452817 = queryNorm
             0.7305806 = fieldWeight in 3096, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=3096)
         0.056754418 = weight(abstract_txt:method in 3096) [ClassicSimilarity], result of:
           0.056754418 = score(doc=3096,freq=5.0), product of:
             0.07218059 = queryWeight, product of:
               1.6965046 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.009452817 = queryNorm
             0.7862836 = fieldWeight in 3096, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.078125 = fieldNorm(doc=3096)
         0.049747497 = weight(abstract_txt:learning in 3096) [ClassicSimilarity], result of:
           0.049747497 = score(doc=3096,freq=1.0), product of:
             0.13403177 = queryWeight, product of:
               2.9845102 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.009452817 = queryNorm
             0.37116197 = fieldWeight in 3096, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.078125 = fieldNorm(doc=3096)
         0.056139857 = weight(abstract_txt:methods in 3096) [ClassicSimilarity], result of:
           0.056139857 = score(doc=3096,freq=2.0), product of:
             0.122534454 = queryWeight, product of:
               3.1259997 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.009452817 = queryNorm
             0.4581557 = fieldWeight in 3096, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.078125 = fieldNorm(doc=3096)
         0.8440992 = weight(abstract_txt:smoothing in 3096) [ClassicSimilarity], result of:
           0.8440992 = score(doc=3096,freq=2.0), product of:
             0.82158524 = queryWeight, product of:
               9.34664 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.009452817 = queryNorm
             1.0274031 = fieldWeight in 3096, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.078125 = fieldNorm(doc=3096)
       0.36 = coord(9/25)
   

3. Keikha, M.; Crestani, F.; Carman, M.J.: Employing document dependency in blog search (2012) 0.38

   0.3760954 = sum of:
     0.3760954 = product of:
       1.1752982 = sum of:
         0.02084381 = weight(abstract_txt:performance in 4987) [ClassicSimilarity], result of:
           0.02084381 = score(doc=4987,freq=2.0), product of:
             0.050928596 = queryWeight, product of:
               1.1635365 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.009452817 = queryNorm
             0.40927517 = fieldWeight in 4987, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=4987)
         0.01169935 = weight(abstract_txt:approach in 4987) [ClassicSimilarity], result of:
           0.01169935 = score(doc=4987,freq=1.0), product of:
             0.049979493 = queryWeight, product of:
               1.4116945 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.009452817 = queryNorm
             0.234083 = fieldWeight in 4987, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=4987)
         0.032280568 = weight(abstract_txt:modeling in 4987) [ClassicSimilarity], result of:
           0.032280568 = score(doc=4987,freq=1.0), product of:
             0.085891016 = queryWeight, product of:
               1.5110298 = boost
               6.0133076 = idf(docFreq=293, maxDocs=44218)
               0.009452817 = queryNorm
             0.37583172 = fieldWeight in 4987, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0133076 = idf(docFreq=293, maxDocs=44218)
               0.0625 = fieldNorm(doc=4987)
         0.01628814 = weight(abstract_txt:language in 4987) [ClassicSimilarity], result of:
           0.01628814 = score(doc=4987,freq=1.0), product of:
             0.06231583 = queryWeight, product of:
               1.5763186 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.009452817 = queryNorm
             0.26138046 = fieldWeight in 4987, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=4987)
         0.015576059 = weight(abstract_txt:retrieval in 4987) [ClassicSimilarity], result of:
           0.015576059 = score(doc=4987,freq=1.0), product of:
             0.07171423 = queryWeight, product of:
               2.183091 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.009452817 = queryNorm
             0.21719621 = fieldWeight in 4987, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=4987)
         0.044911884 = weight(abstract_txt:methods in 4987) [ClassicSimilarity], result of:
           0.044911884 = score(doc=4987,freq=2.0), product of:
             0.122534454 = queryWeight, product of:
               3.1259997 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.009452817 = queryNorm
             0.36652455 = fieldWeight in 4987, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=4987)
         0.07870906 = weight(abstract_txt:rank in 4987) [ClassicSimilarity], result of:
           0.07870906 = score(doc=4987,freq=1.0), product of:
             0.19604093 = queryWeight, product of:
               3.2284017 = boost
               6.4238877 = idf(docFreq=194, maxDocs=44218)
               0.009452817 = queryNorm
             0.40149298 = fieldWeight in 4987, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4238877 = idf(docFreq=194, maxDocs=44218)
               0.0625 = fieldNorm(doc=4987)
         0.9549893 = weight(abstract_txt:smoothing in 4987) [ClassicSimilarity], result of:
           0.9549893 = score(doc=4987,freq=4.0), product of:
             0.82158524 = queryWeight, product of:
               9.34664 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.009452817 = queryNorm
             1.162374 = fieldWeight in 4987, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.0625 = fieldNorm(doc=4987)
       0.32 = coord(8/25)
   

4. Wang, Y.; Lee, J.-S.; Choi, I.-C.: Indexing by Latent Dirichlet Allocation and an Ensemble Model (2016) 0.26

   0.26155248 = sum of:
     0.26155248 = product of:
       0.8173515 = sum of:
         0.011754367 = weight(abstract_txt:model in 3019) [ClassicSimilarity], result of:
           0.011754367 = score(doc=3019,freq=1.0), product of:
             0.03774387 = queryWeight, product of:
               1.0016648 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.009452817 = queryNorm
             0.31142452 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.078125 = fieldNorm(doc=3019)
         0.05234539 = weight(abstract_txt:dirichlet in 3019) [ClassicSimilarity], result of:
           0.05234539 = score(doc=3019,freq=1.0), product of:
             0.08108787 = queryWeight, product of:
               1.0381548 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.009452817 = queryNorm
             0.6455391 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.078125 = fieldNorm(doc=3019)
         0.02605476 = weight(abstract_txt:performance in 3019) [ClassicSimilarity], result of:
           0.02605476 = score(doc=3019,freq=2.0), product of:
             0.050928596 = queryWeight, product of:
               1.1635365 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.009452817 = queryNorm
             0.51159394 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.078125 = fieldNorm(doc=3019)
         0.04035071 = weight(abstract_txt:modeling in 3019) [ClassicSimilarity], result of:
           0.04035071 = score(doc=3019,freq=1.0), product of:
             0.085891016 = queryWeight, product of:
               1.5110298 = boost
               6.0133076 = idf(docFreq=293, maxDocs=44218)
               0.009452817 = queryNorm
             0.46978965 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0133076 = idf(docFreq=293, maxDocs=44218)
               0.078125 = fieldNorm(doc=3019)
         0.020360176 = weight(abstract_txt:language in 3019) [ClassicSimilarity], result of:
           0.020360176 = score(doc=3019,freq=1.0), product of:
             0.06231583 = queryWeight, product of:
               1.5763186 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.009452817 = queryNorm
             0.32672557 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=3019)
         0.03589464 = weight(abstract_txt:method in 3019) [ClassicSimilarity], result of:
           0.03589464 = score(doc=3019,freq=2.0), product of:
             0.07218059 = queryWeight, product of:
               1.6965046 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.009452817 = queryNorm
             0.49728936 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.078125 = fieldNorm(doc=3019)
         0.033723157 = weight(abstract_txt:retrieval in 3019) [ClassicSimilarity], result of:
           0.033723157 = score(doc=3019,freq=3.0), product of:
             0.07171423 = queryWeight, product of:
               2.183091 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.009452817 = queryNorm
             0.47024357 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=3019)
         0.59686834 = weight(abstract_txt:smoothing in 3019) [ClassicSimilarity], result of:
           0.59686834 = score(doc=3019,freq=1.0), product of:
             0.82158524 = queryWeight, product of:
               9.34664 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.009452817 = queryNorm
             0.72648376 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.078125 = fieldNorm(doc=3019)
       0.32 = coord(8/25)
   

5. Wu, H.C.; Luk, R.W.P.; Wong, K.F,; Kwok, K.L.: ¬A retrospective study of a hybrid document-context based retrieval model (2007) 0.25

   0.24772811 = sum of:
     0.24772811 = product of:
       0.6881336 = sum of:
         0.0327484 = weight(abstract_txt:zero in 936) [ClassicSimilarity], result of:
           0.0327484 = score(doc=936,freq=1.0), product of:
             0.07523703 = queryWeight, product of:
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.009452817 = queryNorm
             0.4352697 = fieldWeight in 936, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.0546875 = fieldNorm(doc=936)
         0.02468417 = weight(abstract_txt:model in 936) [ClassicSimilarity], result of:
           0.02468417 = score(doc=936,freq=9.0), product of:
             0.03774387 = queryWeight, product of:
               1.0016648 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.009452817 = queryNorm
             0.6539915 = fieldWeight in 936, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0546875 = fieldNorm(doc=936)
         0.020779878 = weight(abstract_txt:effective in 936) [ClassicSimilarity], result of:
           0.020779878 = score(doc=936,freq=2.0), product of:
             0.055556335 = queryWeight, product of:
               1.215251 = boost
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.009452817 = queryNorm
             0.37403256 = fieldWeight in 936, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.0546875 = fieldNorm(doc=936)
         0.024345577 = weight(abstract_txt:effectiveness in 936) [ClassicSimilarity], result of:
           0.024345577 = score(doc=936,freq=2.0), product of:
             0.061742608 = queryWeight, product of:
               1.2811254 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.009452817 = queryNorm
             0.39430755 = fieldWeight in 936, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0546875 = fieldNorm(doc=936)
         0.014252123 = weight(abstract_txt:language in 936) [ClassicSimilarity], result of:
           0.014252123 = score(doc=936,freq=1.0), product of:
             0.06231583 = queryWeight, product of:
               1.5763186 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.009452817 = queryNorm
             0.22870791 = fieldWeight in 936, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0546875 = fieldNorm(doc=936)
         0.034197006 = weight(abstract_txt:ranking in 936) [ClassicSimilarity], result of:
           0.034197006 = score(doc=936,freq=1.0), product of:
             0.11168737 = queryWeight, product of:
               2.110313 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.009452817 = queryNorm
             0.3061851 = fieldWeight in 936, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0546875 = fieldNorm(doc=936)
         0.02360621 = weight(abstract_txt:retrieval in 936) [ClassicSimilarity], result of:
           0.02360621 = score(doc=936,freq=3.0), product of:
             0.07171423 = queryWeight, product of:
               2.183091 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.009452817 = queryNorm
             0.3291705 = fieldWeight in 936, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0546875 = fieldNorm(doc=936)
         0.09571243 = weight(abstract_txt:estimation in 936) [ClassicSimilarity], result of:
           0.09571243 = score(doc=936,freq=1.0), product of:
             0.22181499 = queryWeight, product of:
               2.9739952 = boost
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.009452817 = queryNorm
             0.43149668 = fieldWeight in 936, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.0546875 = fieldNorm(doc=936)
         0.41780782 = weight(abstract_txt:smoothing in 936) [ClassicSimilarity], result of:
           0.41780782 = score(doc=936,freq=1.0), product of:
             0.82158524 = queryWeight, product of:
               9.34664 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.009452817 = queryNorm
             0.5085386 = fieldWeight in 936, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.0546875 = fieldNorm(doc=936)
       0.36 = coord(9/25)