Document (#27573)

Author

Crouch, C.J.
Crouch, D.B.
Chen, Q.
Holtz, S.J.

Title

Improving the retrieval effectiveness of very short queries

Source

Information processing and management. 38(2002) no.1, S.1-36

Year

2002

Abstract

This paper describes an automatic approach designed to improve the retrieval effectiveness of very short queries such as those used in web searching. The method is based on the observation that stemming, which is designed to maximize recall, often results in depressed precision. Our approach is based on pseudo-feedback and attempts to increase the number of relevant documents in the pseudo-relevant set by reranking those documents based on the presence of unstemmed query terms in the document text. The original experiments underlying this work were carried out using Smart 11.0 and the lnc.ltc weighting scheme on three sets of documents from the TREC collection with corresponding TREC (title only) topics as queries. (The average length of these queries after stoplisting ranges from 2.4 to 4.5 terms.) Results, evaluated in terms of P@20 and non-interpolated average precision, showed clearly that pseudo-feedback (PF) based on this approach was effective in increasing the number of relevant documents in the top ranks. Subsequent experiments, performed on the same data sets using Smart 13.0 and the improved Lnu.ltu weighting scheme, indicate that these results hold up even over the much higher baseline provided by the new weights. Query drift analysis presents a more detailed picture of the improvements produced by this process.

Theme

Retrievalalgorithmen

Object

TREC

Similar documents (author)

1. Chen, Y.N.; Chen, S.J.: ¬A metadata practice of the OFLA FRBR model : a case study for the National Palace Museum in Taipai (2004) 4.35

   4.3499155 = sum of:
     4.3499155 = weight(author_txt:chen in 3384) [ClassicSimilarity], result of:
       4.3499155 = fieldWeight in 3384, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         6.1517096 = idf(docFreq=255, maxDocs=44218)
         0.5 = fieldNorm(doc=3384)
   

2. Chen, C.C.; Chen, H.H.; Chen, K.H.: ¬The design of the XML/Metadata management system (2000) 4.00

   3.9956524 = sum of:
     3.9956524 = weight(author_txt:chen in 4633) [ClassicSimilarity], result of:
       3.9956524 = fieldWeight in 4633, product of:
         1.7320508 = tf(freq=3.0), with freq of:
           3.0 = termFreq=3.0
         6.1517096 = idf(docFreq=255, maxDocs=44218)
         0.375 = fieldNorm(doc=4633)
   

3. Chen, W.Y.: Observations on cataloguing and classification (1991) 3.84

   3.8448186 = sum of:
     3.8448186 = weight(author_txt:chen in 4184) [ClassicSimilarity], result of:
       3.8448186 = fieldWeight in 4184, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.1517096 = idf(docFreq=255, maxDocs=44218)
         0.625 = fieldNorm(doc=4184)
   

4. Chen, H.: Knowledge-based document retrieval : framework and design (1992) 3.84

   3.8448186 = sum of:
     3.8448186 = weight(author_txt:chen in 5283) [ClassicSimilarity], result of:
       3.8448186 = fieldWeight in 5283, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.1517096 = idf(docFreq=255, maxDocs=44218)
         0.625 = fieldNorm(doc=5283)
   

5. Chen, P.S.: On inference rules of logic-based information retrieval systems (1994) 3.84

   3.8448186 = sum of:
     3.8448186 = weight(author_txt:chen in 6731) [ClassicSimilarity], result of:
       3.8448186 = fieldWeight in 6731, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.1517096 = idf(docFreq=255, maxDocs=44218)
         0.625 = fieldNorm(doc=6731)
   

Similar documents (content)

1. Karisani, P.; Rahgozar, M.; Oroumchian, F.: Transforming LSA space dimensions into a rubric for an automatic assessment and feedback system (2016) 0.63

   0.62550944 = sum of:
     0.62550944 = product of:
       1.3031447 = sum of:
         0.09864 = weight(abstract_txt:query in 2970) [ClassicSimilarity], result of:
           0.09864 = score(doc=2970,freq=8.0), product of:
             0.117378995 = queryWeight, product of:
               1.0120528 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.024397736 = queryNorm
             0.8403548 = fieldWeight in 2970, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.012900943 = weight(abstract_txt:this in 2970) [ClassicSimilarity], result of:
           0.012900943 = score(doc=2970,freq=2.0), product of:
             0.060487546 = queryWeight, product of:
               1.0274388 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.024397736 = queryNorm
             0.21328263 = fieldWeight in 2970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.029083423 = weight(abstract_txt:results in 2970) [ClassicSimilarity], result of:
           0.029083423 = score(doc=2970,freq=2.0), product of:
             0.094486356 = queryWeight, product of:
               1.1120855 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.024397736 = queryNorm
             0.30780554 = fieldWeight in 2970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.06324157 = weight(abstract_txt:short in 2970) [ClassicSimilarity], result of:
           0.06324157 = score(doc=2970,freq=1.0), product of:
             0.17455009 = queryWeight, product of:
               1.2341502 = boost
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.024397736 = queryNorm
             0.36231187 = fieldWeight in 2970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.11810301 = weight(abstract_txt:feedback in 2970) [ClassicSimilarity], result of:
           0.11810301 = score(doc=2970,freq=3.0), product of:
             0.18353486 = queryWeight, product of:
               1.2655149 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.024397736 = queryNorm
             0.6434909 = fieldWeight in 2970, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.06440309 = weight(abstract_txt:terms in 2970) [ClassicSimilarity], result of:
           0.06440309 = score(doc=2970,freq=4.0), product of:
             0.12740892 = queryWeight, product of:
               1.2913784 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.024397736 = queryNorm
             0.5054833 = fieldWeight in 2970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.021035384 = weight(abstract_txt:based in 2970) [ClassicSimilarity], result of:
           0.021035384 = score(doc=2970,freq=1.0), product of:
             0.10557521 = queryWeight, product of:
               1.3573878 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.024397736 = queryNorm
             0.19924548 = fieldWeight in 2970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.06859712 = weight(abstract_txt:relevant in 2970) [ClassicSimilarity], result of:
           0.06859712 = score(doc=2970,freq=2.0), product of:
             0.16742077 = queryWeight, product of:
               1.480329 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.024397736 = queryNorm
             0.40972885 = fieldWeight in 2970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.22064315 = weight(abstract_txt:weighting in 2970) [ClassicSimilarity], result of:
           0.22064315 = score(doc=2970,freq=4.0), product of:
             0.25294453 = queryWeight, product of:
               1.485664 = boost
               6.9783883 = idf(docFreq=111, maxDocs=44218)
               0.024397736 = queryNorm
             0.87229854 = fieldWeight in 2970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.9783883 = idf(docFreq=111, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.09089888 = weight(abstract_txt:documents in 2970) [ClassicSimilarity], result of:
           0.09089888 = score(doc=2970,freq=4.0), product of:
             0.17644688 = queryWeight, product of:
               1.7548094 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.024397736 = queryNorm
             0.5151628 = fieldWeight in 2970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.086460344 = weight(abstract_txt:queries in 2970) [ClassicSimilarity], result of:
           0.086460344 = score(doc=2970,freq=1.0), product of:
             0.2708983 = queryWeight, product of:
               2.1743333 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.024397736 = queryNorm
             0.31916162 = fieldWeight in 2970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
         0.4291377 = weight(abstract_txt:pseudo in 2970) [ClassicSimilarity], result of:
           0.4291377 = score(doc=2970,freq=3.0), product of:
             0.4965612 = queryWeight, product of:
               2.5494118 = boost
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.024397736 = queryNorm
             0.8642192 = fieldWeight in 2970, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.0625 = fieldNorm(doc=2970)
       0.48 = coord(12/25)
   

2. Yang, L.; Ji, D.; Leong, M.: Document reranking by term distribution and maximal marginal relevance for chinese information retrieval (2007) 0.49

   0.48876926 = sum of:
     0.48876926 = product of:
       1.0182693 = sum of:
         0.23789407 = weight(abstract_txt:reranking in 907) [ClassicSimilarity], result of:
           0.23789407 = score(doc=907,freq=2.0), product of:
             0.22919971 = queryWeight, product of:
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.024397736 = queryNorm
             1.0379336 = fieldWeight in 907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.01140293 = weight(abstract_txt:this in 907) [ClassicSimilarity], result of:
           0.01140293 = score(doc=907,freq=1.0), product of:
             0.060487546 = queryWeight, product of:
               1.0274388 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.024397736 = queryNorm
             0.18851699 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.048373014 = weight(abstract_txt:very in 907) [ClassicSimilarity], result of:
           0.048373014 = score(doc=907,freq=1.0), product of:
             0.1258096 = queryWeight, product of:
               1.0477673 = boost
               4.921521 = idf(docFreq=875, maxDocs=44218)
               0.024397736 = queryNorm
             0.38449383 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.921521 = idf(docFreq=875, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.09455914 = weight(abstract_txt:scheme in 907) [ClassicSimilarity], result of:
           0.09455914 = score(doc=907,freq=2.0), product of:
             0.15611237 = queryWeight, product of:
               1.1671499 = boost
               5.4822793 = idf(docFreq=499, maxDocs=44218)
               0.024397736 = queryNorm
             0.605712 = fieldWeight in 907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4822793 = idf(docFreq=499, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.06844565 = weight(abstract_txt:precision in 907) [ClassicSimilarity], result of:
           0.06844565 = score(doc=907,freq=1.0), product of:
             0.15856557 = queryWeight, product of:
               1.1762846 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.024397736 = queryNorm
             0.4316552 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.083765514 = weight(abstract_txt:average in 907) [ClassicSimilarity], result of:
           0.083765514 = score(doc=907,freq=1.0), product of:
             0.18142138 = queryWeight, product of:
               1.2582073 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.024397736 = queryNorm
             0.46171796 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.08523351 = weight(abstract_txt:feedback in 907) [ClassicSimilarity], result of:
           0.08523351 = score(doc=907,freq=1.0), product of:
             0.18353486 = queryWeight, product of:
               1.2655149 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.024397736 = queryNorm
             0.46439958 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.04025193 = weight(abstract_txt:terms in 907) [ClassicSimilarity], result of:
           0.04025193 = score(doc=907,freq=1.0), product of:
             0.12740892 = queryWeight, product of:
               1.2913784 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.024397736 = queryNorm
             0.3159271 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.02629423 = weight(abstract_txt:based in 907) [ClassicSimilarity], result of:
           0.02629423 = score(doc=907,freq=1.0), product of:
             0.10557521 = queryWeight, product of:
               1.3573878 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.024397736 = queryNorm
             0.24905685 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.08574641 = weight(abstract_txt:relevant in 907) [ClassicSimilarity], result of:
           0.08574641 = score(doc=907,freq=2.0), product of:
             0.16742077 = queryWeight, product of:
               1.480329 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.024397736 = queryNorm
             0.5121611 = fieldWeight in 907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.13790196 = weight(abstract_txt:weighting in 907) [ClassicSimilarity], result of:
           0.13790196 = score(doc=907,freq=1.0), product of:
             0.25294453 = queryWeight, product of:
               1.485664 = boost
               6.9783883 = idf(docFreq=111, maxDocs=44218)
               0.024397736 = queryNorm
             0.5451866 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9783883 = idf(docFreq=111, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
         0.09840091 = weight(abstract_txt:documents in 907) [ClassicSimilarity], result of:
           0.09840091 = score(doc=907,freq=3.0), product of:
             0.17644688 = queryWeight, product of:
               1.7548094 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.024397736 = queryNorm
             0.5576801 = fieldWeight in 907, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=907)
       0.48 = coord(12/25)
   

3. Pan, M.; Huang, J.X.; He, T.; Mao, Z.; Ying, Z.; Tu, X.: ¬A simple kernel co-occurrence-based enhancement for pseudo-relevance feedback (2020) 0.47

   0.4686859 = sum of:
     0.4686859 = product of:
       0.9013191 = sum of:
         0.06974901 = weight(abstract_txt:query in 5678) [ClassicSimilarity], result of:
           0.06974901 = score(doc=5678,freq=4.0), product of:
             0.117378995 = queryWeight, product of:
               1.0120528 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.024397736 = queryNorm
             0.5942206 = fieldWeight in 5678, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.009122345 = weight(abstract_txt:this in 5678) [ClassicSimilarity], result of:
           0.009122345 = score(doc=5678,freq=1.0), product of:
             0.060487546 = queryWeight, product of:
               1.0274388 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.024397736 = queryNorm
             0.1508136 = fieldWeight in 5678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.07838584 = weight(abstract_txt:sets in 5678) [ClassicSimilarity], result of:
           0.07838584 = score(doc=5678,freq=3.0), product of:
             0.13964851 = queryWeight, product of:
               1.1038908 = boost
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.024397736 = queryNorm
             0.5613081 = fieldWeight in 5678, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.029083423 = weight(abstract_txt:results in 5678) [ClassicSimilarity], result of:
           0.029083423 = score(doc=5678,freq=2.0), product of:
             0.094486356 = queryWeight, product of:
               1.1120855 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.024397736 = queryNorm
             0.30780554 = fieldWeight in 5678, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.049167544 = weight(abstract_txt:experiments in 5678) [ClassicSimilarity], result of:
           0.049167544 = score(doc=5678,freq=1.0), product of:
             0.14758334 = queryWeight, product of:
               1.134819 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.024397736 = queryNorm
             0.33315104 = fieldWeight in 5678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.054756522 = weight(abstract_txt:precision in 5678) [ClassicSimilarity], result of:
           0.054756522 = score(doc=5678,freq=1.0), product of:
             0.15856557 = queryWeight, product of:
               1.1762846 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.024397736 = queryNorm
             0.34532416 = fieldWeight in 5678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.06701241 = weight(abstract_txt:average in 5678) [ClassicSimilarity], result of:
           0.06701241 = score(doc=5678,freq=1.0), product of:
             0.18142138 = queryWeight, product of:
               1.2582073 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.024397736 = queryNorm
             0.36937436 = fieldWeight in 5678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.068186805 = weight(abstract_txt:feedback in 5678) [ClassicSimilarity], result of:
           0.068186805 = score(doc=5678,freq=1.0), product of:
             0.18353486 = queryWeight, product of:
               1.2655149 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.024397736 = queryNorm
             0.37151965 = fieldWeight in 5678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.07887735 = weight(abstract_txt:terms in 5678) [ClassicSimilarity], result of:
           0.07887735 = score(doc=5678,freq=6.0), product of:
             0.12740892 = queryWeight, product of:
               1.2913784 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.024397736 = queryNorm
             0.6190881 = fieldWeight in 5678, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.036434352 = weight(abstract_txt:based in 5678) [ClassicSimilarity], result of:
           0.036434352 = score(doc=5678,freq=3.0), product of:
             0.10557521 = queryWeight, product of:
               1.3573878 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.024397736 = queryNorm
             0.3451033 = fieldWeight in 5678, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.048505493 = weight(abstract_txt:relevant in 5678) [ClassicSimilarity], result of:
           0.048505493 = score(doc=5678,freq=1.0), product of:
             0.16742077 = queryWeight, product of:
               1.480329 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.024397736 = queryNorm
             0.28972206 = fieldWeight in 5678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.06427521 = weight(abstract_txt:documents in 5678) [ClassicSimilarity], result of:
           0.06427521 = score(doc=5678,freq=2.0), product of:
             0.17644688 = queryWeight, product of:
               1.7548094 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.024397736 = queryNorm
             0.36427513 = fieldWeight in 5678, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
         0.24776278 = weight(abstract_txt:pseudo in 5678) [ClassicSimilarity], result of:
           0.24776278 = score(doc=5678,freq=1.0), product of:
             0.4965612 = queryWeight, product of:
               2.5494118 = boost
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.024397736 = queryNorm
             0.4989572 = fieldWeight in 5678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.0625 = fieldNorm(doc=5678)
       0.52 = coord(13/25)
   

4. Wong, W.S.; Luk, R.W.P.; Leong, H.V.; Ho, K.S.; Lee, D.L.: Re-examining the effects of adding relevance information in a relevance feedback environment (2008) 0.45

   0.44916585 = sum of:
     0.44916585 = product of:
       0.9357622 = sum of:
         0.04932 = weight(abstract_txt:query in 2084) [ClassicSimilarity], result of:
           0.04932 = score(doc=2084,freq=2.0), product of:
             0.117378995 = queryWeight, product of:
               1.0120528 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.024397736 = queryNorm
             0.4201774 = fieldWeight in 2084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.015800362 = weight(abstract_txt:this in 2084) [ClassicSimilarity], result of:
           0.015800362 = score(doc=2084,freq=3.0), product of:
             0.060487546 = queryWeight, product of:
               1.0274388 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.024397736 = queryNorm
             0.2612168 = fieldWeight in 2084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.074516386 = weight(abstract_txt:effectiveness in 2084) [ClassicSimilarity], result of:
           0.074516386 = score(doc=2084,freq=3.0), product of:
             0.13501409 = queryWeight, product of:
               1.0854192 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.024397736 = queryNorm
             0.55191565 = fieldWeight in 2084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.08516068 = weight(abstract_txt:experiments in 2084) [ClassicSimilarity], result of:
           0.08516068 = score(doc=2084,freq=3.0), product of:
             0.14758334 = queryWeight, product of:
               1.134819 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.024397736 = queryNorm
             0.57703453 = fieldWeight in 2084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.054756522 = weight(abstract_txt:precision in 2084) [ClassicSimilarity], result of:
           0.054756522 = score(doc=2084,freq=1.0), product of:
             0.15856557 = queryWeight, product of:
               1.1762846 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.024397736 = queryNorm
             0.34532416 = fieldWeight in 2084, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.09476985 = weight(abstract_txt:average in 2084) [ClassicSimilarity], result of:
           0.09476985 = score(doc=2084,freq=2.0), product of:
             0.18142138 = queryWeight, product of:
               1.2582073 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.024397736 = queryNorm
             0.5223742 = fieldWeight in 2084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.11810301 = weight(abstract_txt:feedback in 2084) [ClassicSimilarity], result of:
           0.11810301 = score(doc=2084,freq=3.0), product of:
             0.18353486 = queryWeight, product of:
               1.2655149 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.024397736 = queryNorm
             0.6434909 = fieldWeight in 2084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.055774707 = weight(abstract_txt:terms in 2084) [ClassicSimilarity], result of:
           0.055774707 = score(doc=2084,freq=3.0), product of:
             0.12740892 = queryWeight, product of:
               1.2913784 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.024397736 = queryNorm
             0.4377614 = fieldWeight in 2084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.13806108 = weight(abstract_txt:trec in 2084) [ClassicSimilarity], result of:
           0.13806108 = score(doc=2084,freq=2.0), product of:
             0.23314306 = queryWeight, product of:
               1.4263273 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.024397736 = queryNorm
             0.5921732 = fieldWeight in 2084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.048505493 = weight(abstract_txt:relevant in 2084) [ClassicSimilarity], result of:
           0.048505493 = score(doc=2084,freq=1.0), product of:
             0.16742077 = queryWeight, product of:
               1.480329 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.024397736 = queryNorm
             0.28972206 = fieldWeight in 2084, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.07872073 = weight(abstract_txt:documents in 2084) [ClassicSimilarity], result of:
           0.07872073 = score(doc=2084,freq=3.0), product of:
             0.17644688 = queryWeight, product of:
               1.7548094 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.024397736 = queryNorm
             0.44614407 = fieldWeight in 2084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
         0.12227339 = weight(abstract_txt:queries in 2084) [ClassicSimilarity], result of:
           0.12227339 = score(doc=2084,freq=2.0), product of:
             0.2708983 = queryWeight, product of:
               2.1743333 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.024397736 = queryNorm
             0.4513627 = fieldWeight in 2084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=2084)
       0.48 = coord(12/25)
   

5. Li, X.: ¬A new robust relevance model in the language model framework (2008) 0.43

   0.42661485 = sum of:
     0.42661485 = product of:
       0.9695792 = sum of:
         0.034874506 = weight(abstract_txt:query in 2076) [ClassicSimilarity], result of:
           0.034874506 = score(doc=2076,freq=1.0), product of:
             0.117378995 = queryWeight, product of:
               1.0120528 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.024397736 = queryNorm
             0.2971103 = fieldWeight in 2076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.009122345 = weight(abstract_txt:this in 2076) [ClassicSimilarity], result of:
           0.009122345 = score(doc=2076,freq=1.0), product of:
             0.060487546 = queryWeight, product of:
               1.0274388 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.024397736 = queryNorm
             0.1508136 = fieldWeight in 2076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.020565085 = weight(abstract_txt:results in 2076) [ClassicSimilarity], result of:
           0.020565085 = score(doc=2076,freq=1.0), product of:
             0.094486356 = queryWeight, product of:
               1.1120855 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.024397736 = queryNorm
             0.21765138 = fieldWeight in 2076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.054756522 = weight(abstract_txt:precision in 2076) [ClassicSimilarity], result of:
           0.054756522 = score(doc=2076,freq=1.0), product of:
             0.15856557 = queryWeight, product of:
               1.1762846 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.024397736 = queryNorm
             0.34532416 = fieldWeight in 2076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.06324157 = weight(abstract_txt:short in 2076) [ClassicSimilarity], result of:
           0.06324157 = score(doc=2076,freq=1.0), product of:
             0.17455009 = queryWeight, product of:
               1.2341502 = boost
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.024397736 = queryNorm
             0.36231187 = fieldWeight in 2076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.06701241 = weight(abstract_txt:average in 2076) [ClassicSimilarity], result of:
           0.06701241 = score(doc=2076,freq=1.0), product of:
             0.18142138 = queryWeight, product of:
               1.2582073 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.024397736 = queryNorm
             0.36937436 = fieldWeight in 2076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.11810301 = weight(abstract_txt:feedback in 2076) [ClassicSimilarity], result of:
           0.11810301 = score(doc=2076,freq=3.0), product of:
             0.18353486 = queryWeight, product of:
               1.2655149 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.024397736 = queryNorm
             0.6434909 = fieldWeight in 2076, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.04553986 = weight(abstract_txt:terms in 2076) [ClassicSimilarity], result of:
           0.04553986 = score(doc=2076,freq=2.0), product of:
             0.12740892 = queryWeight, product of:
               1.2913784 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.024397736 = queryNorm
             0.3574307 = fieldWeight in 2076, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.048505493 = weight(abstract_txt:relevant in 2076) [ClassicSimilarity], result of:
           0.048505493 = score(doc=2076,freq=1.0), product of:
             0.16742077 = queryWeight, product of:
               1.480329 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.024397736 = queryNorm
             0.28972206 = fieldWeight in 2076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.07872073 = weight(abstract_txt:documents in 2076) [ClassicSimilarity], result of:
           0.07872073 = score(doc=2076,freq=3.0), product of:
             0.17644688 = queryWeight, product of:
               1.7548094 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.024397736 = queryNorm
             0.44614407 = fieldWeight in 2076, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
         0.4291377 = weight(abstract_txt:pseudo in 2076) [ClassicSimilarity], result of:
           0.4291377 = score(doc=2076,freq=3.0), product of:
             0.4965612 = queryWeight, product of:
               2.5494118 = boost
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.024397736 = queryNorm
             0.8642192 = fieldWeight in 2076, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.0625 = fieldNorm(doc=2076)
       0.44 = coord(11/25)