Document (#19153)

Author

Bartell, B.T.
Cottrell, G.W.
Belew, R.K.

Title

Optimizing similarity using multi-query relevance feedback

Source

Journal of the American Society for Information Science. 49(1998) no.8, S.742-761

Year

1998

Abstract

We propose a novel method for automatically adjusting paprameters in ranked-output text retrieval systems to improve retrieval performance. A renaked-output text retrieval system implements a ranking function which orders documents, placing documents estimated to be more relevant to the user's query before less relevant ones. The systems adjusts its parameters to maximize the match between the systems's document ordering and a target ordering. The target ordering is typically given by user feedback on a set of sample queries, but is more generally any document preference relation. We demonstrate the utility of the approach by using it to estimate a similarity measure (scoring the relevance of documents to queries) in a vector space model of information retrieval. Experimental results using several collections indicate that the approach automatically finds a simimilarity measure which performs equivalently to or better that all 'classic' similarity measures studied. It also performs within 1% of an estimated optimal measure (found by exhaustive sampling of the similarity measures). The method is compared to two alternative methods: a perceptron learning rule motivated by Wong and Yao's (1990) Query Formulation method, and a Least Squared learning rule, motivated by Fuhr and Buckley's (1991) Probabilisitc Learning approach. Though both alternatives have useful characteristics, we demonstrate empirically that neither can be used to estimate the parameters of the optimal similarity measure

Similar documents (content)

1. Vechtomova, O.; Robertson, S.E.: ¬A domain-independent approach to finding related entities (2012) 0.31

   0.31115672 = sum of:
     0.31115672 = product of:
       0.77789176 = sum of:
         0.022049338 = weight(abstract_txt:using in 2733) [ClassicSimilarity], result of:
           0.022049338 = score(doc=2733,freq=1.0), product of:
             0.08149634 = queryWeight, product of:
               1.0488867 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.022435833 = queryNorm
             0.27055615 = fieldWeight in 2733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
         0.055270847 = weight(abstract_txt:demonstrate in 2733) [ClassicSimilarity], result of:
           0.055270847 = score(doc=2733,freq=1.0), product of:
             0.1313736 = queryWeight, product of:
               1.0873464 = boost
               5.3851523 = idf(docFreq=550, maxDocs=44218)
               0.022435833 = queryNorm
             0.42071503 = fieldWeight in 2733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3851523 = idf(docFreq=550, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
         0.027890924 = weight(abstract_txt:approach in 2733) [ClassicSimilarity], result of:
           0.027890924 = score(doc=2733,freq=1.0), product of:
             0.095319785 = queryWeight, product of:
               1.1343603 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.022435833 = queryNorm
             0.29260373 = fieldWeight in 2733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
         0.037161816 = weight(abstract_txt:documents in 2733) [ClassicSimilarity], result of:
           0.037161816 = score(doc=2733,freq=1.0), product of:
             0.11541769 = queryWeight, product of:
               1.2482331 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.022435833 = queryNorm
             0.32197678 = fieldWeight in 2733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
         0.14174767 = weight(abstract_txt:target in 2733) [ClassicSimilarity], result of:
           0.14174767 = score(doc=2733,freq=2.0), product of:
             0.19536404 = queryWeight, product of:
               1.3259776 = boost
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.022435833 = queryNorm
             0.72555655 = fieldWeight in 2733, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
         0.048406754 = weight(abstract_txt:method in 2733) [ClassicSimilarity], result of:
           0.048406754 = score(doc=2733,freq=1.0), product of:
             0.13766126 = queryWeight, product of:
               1.3632182 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.022435833 = queryNorm
             0.3516367 = fieldWeight in 2733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
         0.029706318 = weight(abstract_txt:retrieval in 2733) [ClassicSimilarity], result of:
           0.029706318 = score(doc=2733,freq=1.0), product of:
             0.109417446 = queryWeight, product of:
               1.4033699 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.022435833 = queryNorm
             0.27149525 = fieldWeight in 2733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
         0.12752384 = weight(abstract_txt:query in 2733) [ClassicSimilarity], result of:
           0.12752384 = score(doc=2733,freq=5.0), product of:
             0.1535602 = queryWeight, product of:
               1.4397889 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.022435833 = queryNorm
             0.8304485 = fieldWeight in 2733, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
         0.11378459 = weight(abstract_txt:measure in 2733) [ClassicSimilarity], result of:
           0.11378459 = score(doc=2733,freq=1.0), product of:
             0.2678611 = queryWeight, product of:
               2.195754 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.022435833 = queryNorm
             0.42478952 = fieldWeight in 2733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
         0.17434967 = weight(abstract_txt:similarity in 2733) [ClassicSimilarity], result of:
           0.17434967 = score(doc=2733,freq=1.0), product of:
             0.38350537 = queryWeight, product of:
               2.937444 = boost
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.022435833 = queryNorm
             0.4546212 = fieldWeight in 2733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.078125 = fieldNorm(doc=2733)
       0.4 = coord(10/25)
   

2. Vechtomova, O.: ¬A method for automatic extraction of multiword units representing business aspects from user reviews (2014) 0.26

   0.26398966 = sum of:
     0.26398966 = product of:
       0.82496774 = sum of:
         0.022049338 = weight(abstract_txt:using in 1304) [ClassicSimilarity], result of:
           0.022049338 = score(doc=1304,freq=1.0), product of:
             0.08149634 = queryWeight, product of:
               1.0488867 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.022435833 = queryNorm
             0.27055615 = fieldWeight in 1304, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.078125 = fieldNorm(doc=1304)
         0.05683235 = weight(abstract_txt:measures in 1304) [ClassicSimilarity], result of:
           0.05683235 = score(doc=1304,freq=1.0), product of:
             0.13383645 = queryWeight, product of:
               1.0974913 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.022435833 = queryNorm
             0.4246403 = fieldWeight in 1304, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.078125 = fieldNorm(doc=1304)
         0.027890924 = weight(abstract_txt:approach in 1304) [ClassicSimilarity], result of:
           0.027890924 = score(doc=1304,freq=1.0), product of:
             0.095319785 = queryWeight, product of:
               1.1343603 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.022435833 = queryNorm
             0.29260373 = fieldWeight in 1304, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=1304)
         0.14174767 = weight(abstract_txt:target in 1304) [ClassicSimilarity], result of:
           0.14174767 = score(doc=1304,freq=2.0), product of:
             0.19536404 = queryWeight, product of:
               1.3259776 = boost
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.022435833 = queryNorm
             0.72555655 = fieldWeight in 1304, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.078125 = fieldNorm(doc=1304)
         0.083842956 = weight(abstract_txt:method in 1304) [ClassicSimilarity], result of:
           0.083842956 = score(doc=1304,freq=3.0), product of:
             0.13766126 = queryWeight, product of:
               1.3632182 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.022435833 = queryNorm
             0.60905266 = fieldWeight in 1304, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.078125 = fieldNorm(doc=1304)
         0.029706318 = weight(abstract_txt:retrieval in 1304) [ClassicSimilarity], result of:
           0.029706318 = score(doc=1304,freq=1.0), product of:
             0.109417446 = queryWeight, product of:
               1.4033699 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.022435833 = queryNorm
             0.27149525 = fieldWeight in 1304, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=1304)
         0.16091572 = weight(abstract_txt:measure in 1304) [ClassicSimilarity], result of:
           0.16091572 = score(doc=1304,freq=2.0), product of:
             0.2678611 = queryWeight, product of:
               2.195754 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.022435833 = queryNorm
             0.6007431 = fieldWeight in 1304, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.078125 = fieldNorm(doc=1304)
         0.30198246 = weight(abstract_txt:similarity in 1304) [ClassicSimilarity], result of:
           0.30198246 = score(doc=1304,freq=3.0), product of:
             0.38350537 = queryWeight, product of:
               2.937444 = boost
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.022435833 = queryNorm
             0.78742695 = fieldWeight in 1304, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.078125 = fieldNorm(doc=1304)
       0.32 = coord(8/25)
   

3. Mehtre, B.M.; Kankanhalli, M.S.; Lee, W.F.: Shape measures for content based image retrieval : a comparison (1997) 0.26

   0.26221824 = sum of:
     0.26221824 = product of:
       0.819432 = sum of:
         0.07998164 = weight(abstract_txt:queries in 3472) [ClassicSimilarity], result of:
           0.07998164 = score(doc=3472,freq=2.0), product of:
             0.11813359 = queryWeight, product of:
               1.0310994 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.022435833 = queryNorm
             0.67704403 = fieldWeight in 3472, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.09375 = fieldNorm(doc=3472)
         0.026459202 = weight(abstract_txt:using in 3472) [ClassicSimilarity], result of:
           0.026459202 = score(doc=3472,freq=1.0), product of:
             0.08149634 = queryWeight, product of:
               1.0488867 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.022435833 = queryNorm
             0.32466736 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.09375 = fieldNorm(doc=3472)
         0.118123814 = weight(abstract_txt:measures in 3472) [ClassicSimilarity], result of:
           0.118123814 = score(doc=3472,freq=3.0), product of:
             0.13383645 = queryWeight, product of:
               1.0974913 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.022435833 = queryNorm
             0.8825982 = fieldWeight in 3472, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.09375 = fieldNorm(doc=3472)
         0.07131186 = weight(abstract_txt:automatically in 3472) [ClassicSimilarity], result of:
           0.07131186 = score(doc=3472,freq=1.0), product of:
             0.13787887 = queryWeight, product of:
               1.1139424 = boost
               5.5168705 = idf(docFreq=482, maxDocs=44218)
               0.022435833 = queryNorm
             0.5172066 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5168705 = idf(docFreq=482, maxDocs=44218)
               0.09375 = fieldNorm(doc=3472)
         0.08794266 = weight(abstract_txt:output in 3472) [ClassicSimilarity], result of:
           0.08794266 = score(doc=3472,freq=1.0), product of:
             0.15855852 = queryWeight, product of:
               1.1945618 = boost
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.022435833 = queryNorm
             0.5546385 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.09375 = fieldNorm(doc=3472)
         0.071295165 = weight(abstract_txt:retrieval in 3472) [ClassicSimilarity], result of:
           0.071295165 = score(doc=3472,freq=4.0), product of:
             0.109417446 = queryWeight, product of:
               1.4033699 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.022435833 = queryNorm
             0.6515886 = fieldWeight in 3472, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=3472)
         0.06843647 = weight(abstract_txt:query in 3472) [ClassicSimilarity], result of:
           0.06843647 = score(doc=3472,freq=1.0), product of:
             0.1535602 = queryWeight, product of:
               1.4397889 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.022435833 = queryNorm
             0.44566542 = fieldWeight in 3472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.09375 = fieldNorm(doc=3472)
         0.2958812 = weight(abstract_txt:similarity in 3472) [ClassicSimilarity], result of:
           0.2958812 = score(doc=3472,freq=2.0), product of:
             0.38350537 = queryWeight, product of:
               2.937444 = boost
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.022435833 = queryNorm
             0.77151775 = fieldWeight in 3472, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.09375 = fieldNorm(doc=3472)
       0.32 = coord(8/25)
   

4. Huang, L.; Milne, D.; Frank, E.; Witten, I.H.: Learning a concept-based document similarity measure (2012) 0.25

   0.24993008 = sum of:
     0.24993008 = product of:
       0.78103155 = sum of:
         0.022049338 = weight(abstract_txt:using in 372) [ClassicSimilarity], result of:
           0.022049338 = score(doc=372,freq=1.0), product of:
             0.08149634 = queryWeight, product of:
               1.0488867 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.022435833 = queryNorm
             0.27055615 = fieldWeight in 372, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.078125 = fieldNorm(doc=372)
         0.08037308 = weight(abstract_txt:measures in 372) [ClassicSimilarity], result of:
           0.08037308 = score(doc=372,freq=2.0), product of:
             0.13383645 = queryWeight, product of:
               1.0974913 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.022435833 = queryNorm
             0.60053205 = fieldWeight in 372, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.078125 = fieldNorm(doc=372)
         0.05255474 = weight(abstract_txt:documents in 372) [ClassicSimilarity], result of:
           0.05255474 = score(doc=372,freq=2.0), product of:
             0.11541769 = queryWeight, product of:
               1.2482331 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.022435833 = queryNorm
             0.4553439 = fieldWeight in 372, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=372)
         0.029706318 = weight(abstract_txt:retrieval in 372) [ClassicSimilarity], result of:
           0.029706318 = score(doc=372,freq=1.0), product of:
             0.109417446 = queryWeight, product of:
               1.4033699 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.022435833 = queryNorm
             0.27149525 = fieldWeight in 372, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=372)
         0.056926396 = weight(abstract_txt:learning in 372) [ClassicSimilarity], result of:
           0.056926396 = score(doc=372,freq=1.0), product of:
             0.15337346 = queryWeight, product of:
               1.4389132 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.022435833 = queryNorm
             0.37116197 = fieldWeight in 372, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.078125 = fieldNorm(doc=372)
         0.13193826 = weight(abstract_txt:estimate in 372) [ClassicSimilarity], result of:
           0.13193826 = score(doc=372,freq=1.0), product of:
             0.23465213 = queryWeight, product of:
               1.4532025 = boost
               7.1970778 = idf(docFreq=89, maxDocs=44218)
               0.022435833 = queryNorm
             0.5622717 = fieldWeight in 372, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1970778 = idf(docFreq=89, maxDocs=44218)
               0.078125 = fieldNorm(doc=372)
         0.16091572 = weight(abstract_txt:measure in 372) [ClassicSimilarity], result of:
           0.16091572 = score(doc=372,freq=2.0), product of:
             0.2678611 = queryWeight, product of:
               2.195754 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.022435833 = queryNorm
             0.6007431 = fieldWeight in 372, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.078125 = fieldNorm(doc=372)
         0.24656767 = weight(abstract_txt:similarity in 372) [ClassicSimilarity], result of:
           0.24656767 = score(doc=372,freq=2.0), product of:
             0.38350537 = queryWeight, product of:
               2.937444 = boost
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.022435833 = queryNorm
             0.64293146 = fieldWeight in 372, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.078125 = fieldNorm(doc=372)
       0.32 = coord(8/25)
   

5. Bodoff, D.; Wu, B.; Wong, K.Y.M.: Relevance data for language models using maximum likelihood (2003) 0.25

   0.24859826 = sum of:
     0.24859826 = product of:
       0.6905507 = sum of:
         0.05655556 = weight(abstract_txt:queries in 1822) [ClassicSimilarity], result of:
           0.05655556 = score(doc=1822,freq=1.0), product of:
             0.11813359 = queryWeight, product of:
               1.0310994 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.022435833 = queryNorm
             0.47874242 = fieldWeight in 1822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.09375 = fieldNorm(doc=1822)
         0.026459202 = weight(abstract_txt:using in 1822) [ClassicSimilarity], result of:
           0.026459202 = score(doc=1822,freq=1.0), product of:
             0.08149634 = queryWeight, product of:
               1.0488867 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.022435833 = queryNorm
             0.32466736 = fieldWeight in 1822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.09375 = fieldNorm(doc=1822)
         0.03346911 = weight(abstract_txt:approach in 1822) [ClassicSimilarity], result of:
           0.03346911 = score(doc=1822,freq=1.0), product of:
             0.095319785 = queryWeight, product of:
               1.1343603 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.022435833 = queryNorm
             0.3511245 = fieldWeight in 1822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.09375 = fieldNorm(doc=1822)
         0.044594176 = weight(abstract_txt:documents in 1822) [ClassicSimilarity], result of:
           0.044594176 = score(doc=1822,freq=1.0), product of:
             0.11541769 = queryWeight, product of:
               1.2482331 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.022435833 = queryNorm
             0.38637212 = fieldWeight in 1822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.09375 = fieldNorm(doc=1822)
         0.100611545 = weight(abstract_txt:method in 1822) [ClassicSimilarity], result of:
           0.100611545 = score(doc=1822,freq=3.0), product of:
             0.13766126 = queryWeight, product of:
               1.3632182 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.022435833 = queryNorm
             0.73086315 = fieldWeight in 1822, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.09375 = fieldNorm(doc=1822)
         0.13810383 = weight(abstract_txt:parameters in 1822) [ClassicSimilarity], result of:
           0.13810383 = score(doc=1822,freq=1.0), product of:
             0.21422017 = queryWeight, product of:
               1.3884941 = boost
               6.8766055 = idf(docFreq=123, maxDocs=44218)
               0.022435833 = queryNorm
             0.64468175 = fieldWeight in 1822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8766055 = idf(docFreq=123, maxDocs=44218)
               0.09375 = fieldNorm(doc=1822)
         0.035647582 = weight(abstract_txt:retrieval in 1822) [ClassicSimilarity], result of:
           0.035647582 = score(doc=1822,freq=1.0), product of:
             0.109417446 = queryWeight, product of:
               1.4033699 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.022435833 = queryNorm
             0.3257943 = fieldWeight in 1822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=1822)
         0.09678379 = weight(abstract_txt:query in 1822) [ClassicSimilarity], result of:
           0.09678379 = score(doc=1822,freq=2.0), product of:
             0.1535602 = queryWeight, product of:
               1.4397889 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.022435833 = queryNorm
             0.6302661 = fieldWeight in 1822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.09375 = fieldNorm(doc=1822)
         0.1583259 = weight(abstract_txt:estimate in 1822) [ClassicSimilarity], result of:
           0.1583259 = score(doc=1822,freq=1.0), product of:
             0.23465213 = queryWeight, product of:
               1.4532025 = boost
               7.1970778 = idf(docFreq=89, maxDocs=44218)
               0.022435833 = queryNorm
             0.674726 = fieldWeight in 1822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1970778 = idf(docFreq=89, maxDocs=44218)
               0.09375 = fieldNorm(doc=1822)
       0.36 = coord(9/25)