Document (#26455)

Author

Alemayehu, N.

Title

Analysis of performance variation using quey expansion

Source

Journal of the American Society for Information Science and technology. 54(2003) no.5, S.379-391

Year

2003

Abstract

Information retrieval performance evaluation is commonly made based an the classical recall and precision based figures or graphs. However, important information indicating causes for variation may remain hidden under the average recall and precision figures. Identifying significant causes for variation can help researchers and developers to focus an opportunities for improvement that underlay the averages. This article presents a case study showing the potential of a statistical repeated measures analysis of variance for testing the significance of factors in retrieval performance variation. The TREC-9 Query Track performance data is used as a case study and the factors studied are retrieval method, topic, and their interaction. The results show that retrieval method, topic, and their interaction are all significant. A topic level analysis is also made to see the nature of variation in the performance of retrieval methods across topics. The observed retrieval performances of expansion runs are truly significant improvements for most of the topics. Analyses of the effect of query expansion an document ranking confirm that expansion affects ranking positively.

Theme

Retrievalstudien

Object

TREC-9

Similar documents (content)

1. Järvelin, A.; Keskustalo, H.; Sormunen, E.; Saastamoinen, M.; Kettunen, K.: Information retrieval from historical newspaper collections in highly inflectional languages : a query expansion approach (2016) 0.31

   0.31042606 = sum of:
     0.31042606 = product of:
       0.97008145 = sum of:
         0.08234444 = weight(abstract_txt:query in 3223) [ClassicSimilarity], result of:
           0.08234444 = score(doc=3223,freq=7.0), product of:
             0.10475327 = queryWeight, product of:
               1.2788894 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.017230462 = queryNorm
             0.78607994 = fieldWeight in 3223, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=3223)
         0.02119371 = weight(abstract_txt:analysis in 3223) [ClassicSimilarity], result of:
           0.02119371 = score(doc=3223,freq=1.0), product of:
             0.09281378 = queryWeight, product of:
               1.4743515 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.017230462 = queryNorm
             0.22834657 = fieldWeight in 3223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=3223)
         0.04886671 = weight(abstract_txt:precision in 3223) [ClassicSimilarity], result of:
           0.04886671 = score(doc=3223,freq=1.0), product of:
             0.14150968 = queryWeight, product of:
               1.4864225 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017230462 = queryNorm
             0.34532416 = fieldWeight in 3223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0625 = fieldNorm(doc=3223)
         0.056376137 = weight(abstract_txt:topic in 3223) [ClassicSimilarity], result of:
           0.056376137 = score(doc=3223,freq=1.0), product of:
             0.17818509 = queryWeight, product of:
               2.042822 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.017230462 = queryNorm
             0.31639087 = fieldWeight in 3223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.0625 = fieldNorm(doc=3223)
         0.051585205 = weight(abstract_txt:retrieval in 3223) [ClassicSimilarity], result of:
           0.051585205 = score(doc=3223,freq=2.0), product of:
             0.16794147 = queryWeight, product of:
               2.8047154 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017230462 = queryNorm
             0.3071618 = fieldWeight in 3223, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3223)
         0.07190738 = weight(abstract_txt:performance in 3223) [ClassicSimilarity], result of:
           0.07190738 = score(doc=3223,freq=1.0), product of:
             0.24846947 = queryWeight, product of:
               3.1142662 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.017230462 = queryNorm
             0.28940126 = fieldWeight in 3223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=3223)
         0.29494184 = weight(abstract_txt:expansion in 3223) [ClassicSimilarity], result of:
           0.29494184 = score(doc=3223,freq=5.0), product of:
             0.34563813 = queryWeight, product of:
               3.2853 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.017230462 = queryNorm
             0.85332555 = fieldWeight in 3223, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.0625 = fieldNorm(doc=3223)
         0.34286603 = weight(abstract_txt:variation in 3223) [ClassicSimilarity], result of:
           0.34286603 = score(doc=3223,freq=2.0), product of:
             0.5586808 = queryWeight, product of:
               4.66983 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017230462 = queryNorm
             0.6137065 = fieldWeight in 3223, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0625 = fieldNorm(doc=3223)
       0.32 = coord(8/25)
   

2. Nelson, M.J.: ¬The effect of query characteristics on retrieval results in the TREC retrieval tests (1995) 0.30

   0.29760137 = sum of:
     0.29760137 = product of:
       0.8266704 = sum of:
         0.088203534 = weight(abstract_txt:variance in 3608) [ClassicSimilarity], result of:
           0.088203534 = score(doc=3608,freq=1.0), product of:
             0.14348881 = queryWeight, product of:
               1.058384 = boost
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.017230462 = queryNorm
             0.6147067 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.078125 = fieldNorm(doc=3608)
         0.038904093 = weight(abstract_txt:query in 3608) [ClassicSimilarity], result of:
           0.038904093 = score(doc=3608,freq=1.0), product of:
             0.10475327 = queryWeight, product of:
               1.2788894 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.017230462 = queryNorm
             0.37138787 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=3608)
         0.04764972 = weight(abstract_txt:topics in 3608) [ClassicSimilarity], result of:
           0.04764972 = score(doc=3608,freq=1.0), product of:
             0.11991613 = queryWeight, product of:
               1.3683211 = boost
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.017230462 = queryNorm
             0.3973587 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.078125 = fieldNorm(doc=3608)
         0.026492136 = weight(abstract_txt:analysis in 3608) [ClassicSimilarity], result of:
           0.026492136 = score(doc=3608,freq=1.0), product of:
             0.09281378 = queryWeight, product of:
               1.4743515 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.017230462 = queryNorm
             0.2854332 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.078125 = fieldNorm(doc=3608)
         0.08638496 = weight(abstract_txt:precision in 3608) [ClassicSimilarity], result of:
           0.08638496 = score(doc=3608,freq=2.0), product of:
             0.14150968 = queryWeight, product of:
               1.4864225 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017230462 = queryNorm
             0.61045265 = fieldWeight in 3608, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.078125 = fieldNorm(doc=3608)
         0.06355798 = weight(abstract_txt:ranking in 3608) [ClassicSimilarity], result of:
           0.06355798 = score(doc=3608,freq=1.0), product of:
             0.1453062 = queryWeight, product of:
               1.50623 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.017230462 = queryNorm
             0.43740726 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.078125 = fieldNorm(doc=3608)
         0.07047017 = weight(abstract_txt:topic in 3608) [ClassicSimilarity], result of:
           0.07047017 = score(doc=3608,freq=1.0), product of:
             0.17818509 = queryWeight, product of:
               2.042822 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.017230462 = queryNorm
             0.3954886 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.078125 = fieldNorm(doc=3608)
         0.10195422 = weight(abstract_txt:retrieval in 3608) [ClassicSimilarity], result of:
           0.10195422 = score(doc=3608,freq=5.0), product of:
             0.16794147 = queryWeight, product of:
               2.8047154 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017230462 = queryNorm
             0.6070819 = fieldWeight in 3608, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=3608)
         0.30305362 = weight(abstract_txt:variation in 3608) [ClassicSimilarity], result of:
           0.30305362 = score(doc=3608,freq=1.0), product of:
             0.5586808 = queryWeight, product of:
               4.66983 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017230462 = queryNorm
             0.54244506 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.078125 = fieldNorm(doc=3608)
       0.36 = coord(9/25)
   

3. Wu, I.-C.; Liu, D.-R.; Chang, P.-C.: Learning dynamic information needs : a collaborative topic variation inspection approach (2009) 0.26

   0.2633012 = sum of:
     0.2633012 = product of:
       0.82281625 = sum of:
         0.02641708 = weight(abstract_txt:method in 3293) [ClassicSimilarity], result of:
           0.02641708 = score(doc=3293,freq=1.0), product of:
             0.09390757 = queryWeight, product of:
               1.2108755 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.017230462 = queryNorm
             0.28130937 = fieldWeight in 3293, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.0625 = fieldNorm(doc=3293)
         0.038119774 = weight(abstract_txt:topics in 3293) [ClassicSimilarity], result of:
           0.038119774 = score(doc=3293,freq=1.0), product of:
             0.11991613 = queryWeight, product of:
               1.3683211 = boost
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.017230462 = queryNorm
             0.31788695 = fieldWeight in 3293, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.0625 = fieldNorm(doc=3293)
         0.04886671 = weight(abstract_txt:precision in 3293) [ClassicSimilarity], result of:
           0.04886671 = score(doc=3293,freq=1.0), product of:
             0.14150968 = queryWeight, product of:
               1.4864225 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017230462 = queryNorm
             0.34532416 = fieldWeight in 3293, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0625 = fieldNorm(doc=3293)
         0.055044718 = weight(abstract_txt:recall in 3293) [ClassicSimilarity], result of:
           0.055044718 = score(doc=3293,freq=1.0), product of:
             0.1531985 = queryWeight, product of:
               1.5465945 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017230462 = queryNorm
             0.35930327 = fieldWeight in 3293, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0625 = fieldNorm(doc=3293)
         0.12606087 = weight(abstract_txt:topic in 3293) [ClassicSimilarity], result of:
           0.12606087 = score(doc=3293,freq=5.0), product of:
             0.17818509 = queryWeight, product of:
               2.042822 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.017230462 = queryNorm
             0.7074715 = fieldWeight in 3293, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.0625 = fieldNorm(doc=3293)
         0.03647625 = weight(abstract_txt:retrieval in 3293) [ClassicSimilarity], result of:
           0.03647625 = score(doc=3293,freq=1.0), product of:
             0.16794147 = queryWeight, product of:
               2.8047154 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017230462 = queryNorm
             0.21719621 = fieldWeight in 3293, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3293)
         0.07190738 = weight(abstract_txt:performance in 3293) [ClassicSimilarity], result of:
           0.07190738 = score(doc=3293,freq=1.0), product of:
             0.24846947 = queryWeight, product of:
               3.1142662 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.017230462 = queryNorm
             0.28940126 = fieldWeight in 3293, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=3293)
         0.41992342 = weight(abstract_txt:variation in 3293) [ClassicSimilarity], result of:
           0.41992342 = score(doc=3293,freq=3.0), product of:
             0.5586808 = queryWeight, product of:
               4.66983 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017230462 = queryNorm
             0.75163394 = fieldWeight in 3293, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0625 = fieldNorm(doc=3293)
       0.32 = coord(8/25)
   

4. Fernández-Reyes, F.C.; Hermosillo-Valadez, J.; Montes-y-Gómez, M.: ¬A prospect-guided global query expansion strategy using word embeddings (2018) 0.25

   0.24943493 = sum of:
     0.24943493 = product of:
       0.6928748 = sum of:
         0.05907039 = weight(abstract_txt:method in 5090) [ClassicSimilarity], result of:
           0.05907039 = score(doc=5090,freq=5.0), product of:
             0.09390757 = queryWeight, product of:
               1.2108755 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.017230462 = queryNorm
             0.6290269 = fieldWeight in 5090, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.0625 = fieldNorm(doc=5090)
         0.08802991 = weight(abstract_txt:query in 5090) [ClassicSimilarity], result of:
           0.08802991 = score(doc=5090,freq=8.0), product of:
             0.10475327 = queryWeight, product of:
               1.2788894 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.017230462 = queryNorm
             0.8403548 = fieldWeight in 5090, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=5090)
         0.038119774 = weight(abstract_txt:topics in 5090) [ClassicSimilarity], result of:
           0.038119774 = score(doc=5090,freq=1.0), product of:
             0.11991613 = queryWeight, product of:
               1.3683211 = boost
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.017230462 = queryNorm
             0.31788695 = fieldWeight in 5090, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.0625 = fieldNorm(doc=5090)
         0.04886671 = weight(abstract_txt:precision in 5090) [ClassicSimilarity], result of:
           0.04886671 = score(doc=5090,freq=1.0), product of:
             0.14150968 = queryWeight, product of:
               1.4864225 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017230462 = queryNorm
             0.34532416 = fieldWeight in 5090, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0625 = fieldNorm(doc=5090)
         0.055044718 = weight(abstract_txt:recall in 5090) [ClassicSimilarity], result of:
           0.055044718 = score(doc=5090,freq=1.0), product of:
             0.1531985 = queryWeight, product of:
               1.5465945 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017230462 = queryNorm
             0.35930327 = fieldWeight in 5090, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0625 = fieldNorm(doc=5090)
         0.047086906 = weight(abstract_txt:significant in 5090) [ClassicSimilarity], result of:
           0.047086906 = score(doc=5090,freq=1.0), product of:
             0.15803063 = queryWeight, product of:
               1.9238245 = boost
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.017230462 = queryNorm
             0.29796064 = fieldWeight in 5090, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.0625 = fieldNorm(doc=5090)
         0.056376137 = weight(abstract_txt:topic in 5090) [ClassicSimilarity], result of:
           0.056376137 = score(doc=5090,freq=1.0), product of:
             0.17818509 = queryWeight, product of:
               2.042822 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.017230462 = queryNorm
             0.31639087 = fieldWeight in 5090, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.0625 = fieldNorm(doc=5090)
         0.03647625 = weight(abstract_txt:retrieval in 5090) [ClassicSimilarity], result of:
           0.03647625 = score(doc=5090,freq=1.0), product of:
             0.16794147 = queryWeight, product of:
               2.8047154 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017230462 = queryNorm
             0.21719621 = fieldWeight in 5090, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=5090)
         0.263804 = weight(abstract_txt:expansion in 5090) [ClassicSimilarity], result of:
           0.263804 = score(doc=5090,freq=4.0), product of:
             0.34563813 = queryWeight, product of:
               3.2853 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.017230462 = queryNorm
             0.76323754 = fieldWeight in 5090, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.0625 = fieldNorm(doc=5090)
       0.36 = coord(9/25)
   

5. Hull, D.A.: Stemming algorithms : a case study for detailed evaluation (1996) 0.20

   0.20486434 = sum of:
     0.20486434 = product of:
       0.6402011 = sum of:
         0.041477356 = weight(abstract_txt:made in 2999) [ClassicSimilarity], result of:
           0.041477356 = score(doc=2999,freq=1.0), product of:
             0.096810825 = queryWeight, product of:
               1.2294508 = boost
               4.5699964 = idf(docFreq=1244, maxDocs=44218)
               0.017230462 = queryNorm
             0.42843717 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5699964 = idf(docFreq=1244, maxDocs=44218)
               0.09375 = fieldNorm(doc=2999)
         0.048279867 = weight(abstract_txt:case in 2999) [ClassicSimilarity], result of:
           0.048279867 = score(doc=2999,freq=1.0), product of:
             0.10712577 = queryWeight, product of:
               1.2932907 = boost
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.017230462 = queryNorm
             0.45068398 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.09375 = fieldNorm(doc=2999)
         0.031790562 = weight(abstract_txt:analysis in 2999) [ClassicSimilarity], result of:
           0.031790562 = score(doc=2999,freq=1.0), product of:
             0.09281378 = queryWeight, product of:
               1.4743515 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.017230462 = queryNorm
             0.34251985 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.09375 = fieldNorm(doc=2999)
         0.07330007 = weight(abstract_txt:precision in 2999) [ClassicSimilarity], result of:
           0.07330007 = score(doc=2999,freq=1.0), product of:
             0.14150968 = queryWeight, product of:
               1.4864225 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.017230462 = queryNorm
             0.51798624 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.09375 = fieldNorm(doc=2999)
         0.08256708 = weight(abstract_txt:recall in 2999) [ClassicSimilarity], result of:
           0.08256708 = score(doc=2999,freq=1.0), product of:
             0.1531985 = queryWeight, product of:
               1.5465945 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.017230462 = queryNorm
             0.5389549 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.09375 = fieldNorm(doc=2999)
         0.1775473 = weight(abstract_txt:figures in 2999) [ClassicSimilarity], result of:
           0.1775473 = score(doc=2999,freq=1.0), product of:
             0.2552266 = queryWeight, product of:
               1.9962374 = boost
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.017230462 = queryNorm
             0.69564575 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.09375 = fieldNorm(doc=2999)
         0.0773778 = weight(abstract_txt:retrieval in 2999) [ClassicSimilarity], result of:
           0.0773778 = score(doc=2999,freq=2.0), product of:
             0.16794147 = queryWeight, product of:
               2.8047154 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017230462 = queryNorm
             0.4607427 = fieldWeight in 2999, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=2999)
         0.107861064 = weight(abstract_txt:performance in 2999) [ClassicSimilarity], result of:
           0.107861064 = score(doc=2999,freq=1.0), product of:
             0.24846947 = queryWeight, product of:
               3.1142662 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.017230462 = queryNorm
             0.43410188 = fieldWeight in 2999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.09375 = fieldNorm(doc=2999)
       0.32 = coord(8/25)