Document (#7960)

Author

Su, L.T.

Title

Is relevance an adequate criterion for retrieval system evaluation : an empirical enquiry into the user's evaluation

Source

Integrating technologies - converging professions: proceedings of the 56th Annual Meeting of the American Society for Information Science, Columbus, OH, 24-28 October 1993. Ed.: S. Bonzi

Imprint

Medford, NJ : Learned Information

Year

1993

Pages

S.93-104

Abstract

Considers whether relevance is an adequate criterion for retrieval system evaluation. Addresses this question by providing a brief review of the information retrieval literature and by presenting some empirical evidence collected in an earlier study concerning user's assessment of retrieval system performance. Identifies a total of 26 success dimensions through content analysis of 203 users' reasons for system success. The user's judgement of system performance is a multi-dimensional assessment. Although relevance is an important criterion, there are many other considerations affecting assessments of the system success. Discusses dimensions or categories of success related to as well as those not related to relevance. Compares the results from content analysis of verbal data with those from factor analysis of quantitative data. Discusses implications and future research

Similar documents (content)

1. Su, L.T.: ¬The relevance of recall and precision in user evaluation (1994) 0.48

   0.48221418 = sum of:
     0.48221418 = product of:
       1.0046129 = sum of:
         0.022769934 = weight(abstract_txt:data in 6933) [ClassicSimilarity], result of:
           0.022769934 = score(doc=6933,freq=4.0), product of:
             0.062398244 = queryWeight, product of:
               1.0250702 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01824515 = queryNorm
             0.36491305 = fieldWeight in 6933, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.07482392 = weight(abstract_txt:verbal in 6933) [ClassicSimilarity], result of:
           0.07482392 = score(doc=6933,freq=2.0), product of:
             0.13791923 = queryWeight, product of:
               1.077618 = boost
               7.014756 = idf(docFreq=107, maxDocs=44218)
               0.01824515 = queryNorm
             0.54251987 = fieldWeight in 6933, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.014756 = idf(docFreq=107, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.022388171 = weight(abstract_txt:content in 6933) [ClassicSimilarity], result of:
           0.022388171 = score(doc=6933,freq=1.0), product of:
             0.09794079 = queryWeight, product of:
               1.284249 = boost
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.01824515 = queryNorm
             0.22858883 = fieldWeight in 6933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.022788612 = weight(abstract_txt:related in 6933) [ClassicSimilarity], result of:
           0.022788612 = score(doc=6933,freq=1.0), product of:
             0.0991052 = queryWeight, product of:
               1.2918606 = boost
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.01824515 = queryNorm
             0.22994366 = fieldWeight in 6933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.030435398 = weight(abstract_txt:performance in 6933) [ClassicSimilarity], result of:
           0.030435398 = score(doc=6933,freq=1.0), product of:
             0.120190606 = queryWeight, product of:
               1.4226651 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.01824515 = queryNorm
             0.2532261 = fieldWeight in 6933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.038843025 = weight(abstract_txt:analysis in 6933) [ClassicSimilarity], result of:
           0.038843025 = score(doc=6933,freq=3.0), product of:
             0.112240575 = queryWeight, product of:
               1.6837902 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.01824515 = queryNorm
             0.34606937 = fieldWeight in 6933, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.07190637 = weight(abstract_txt:evaluation in 6933) [ClassicSimilarity], result of:
           0.07190637 = score(doc=6933,freq=3.0), product of:
             0.16922043 = queryWeight, product of:
               2.067471 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.01824515 = queryNorm
             0.42492726 = fieldWeight in 6933, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.036389776 = weight(abstract_txt:retrieval in 6933) [ClassicSimilarity], result of:
           0.036389776 = score(doc=6933,freq=2.0), product of:
             0.13539547 = queryWeight, product of:
               2.1354258 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.01824515 = queryNorm
             0.26876658 = fieldWeight in 6933, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.20290883 = weight(abstract_txt:user's in 6933) [ClassicSimilarity], result of:
           0.20290883 = score(doc=6933,freq=5.0), product of:
             0.2850092 = queryWeight, product of:
               2.6831348 = boost
               5.8219566 = idf(docFreq=355, maxDocs=44218)
               0.01824515 = queryNorm
             0.7119378 = fieldWeight in 6933, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.8219566 = idf(docFreq=355, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.07354902 = weight(abstract_txt:relevance in 6933) [ClassicSimilarity], result of:
           0.07354902 = score(doc=6933,freq=1.0), product of:
             0.2726962 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01824515 = queryNorm
             0.26971045 = fieldWeight in 6933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.1972295 = weight(abstract_txt:success in 6933) [ClassicSimilarity], result of:
           0.1972295 = score(doc=6933,freq=3.0), product of:
             0.36495167 = queryWeight, product of:
               3.5059047 = boost
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.01824515 = queryNorm
             0.5404264 = fieldWeight in 6933, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.21058035 = weight(abstract_txt:criterion in 6933) [ClassicSimilarity], result of:
           0.21058035 = score(doc=6933,freq=1.0), product of:
             0.49956673 = queryWeight, product of:
               3.5523014 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.01824515 = queryNorm
             0.42152596 = fieldWeight in 6933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
       0.48 = coord(12/25)
   

2. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 0.25

   0.25194773 = sum of:
     0.25194773 = product of:
       0.7873367 = sum of:
         0.02604413 = weight(abstract_txt:related in 4435) [ClassicSimilarity], result of:
           0.02604413 = score(doc=4435,freq=1.0), product of:
             0.0991052 = queryWeight, product of:
               1.2918606 = boost
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.01824515 = queryNorm
             0.26279277 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.028095037 = weight(abstract_txt:those in 4435) [ClassicSimilarity], result of:
           0.028095037 = score(doc=4435,freq=1.0), product of:
             0.10424205 = queryWeight, product of:
               1.3249177 = boost
               4.312277 = idf(docFreq=1610, maxDocs=44218)
               0.01824515 = queryNorm
             0.2695173 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.312277 = idf(docFreq=1610, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.025629751 = weight(abstract_txt:analysis in 4435) [ClassicSimilarity], result of:
           0.025629751 = score(doc=4435,freq=1.0), product of:
             0.112240575 = queryWeight, product of:
               1.6837902 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.01824515 = queryNorm
             0.22834657 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.047445904 = weight(abstract_txt:evaluation in 4435) [ClassicSimilarity], result of:
           0.047445904 = score(doc=4435,freq=1.0), product of:
             0.16922043 = queryWeight, product of:
               2.067471 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.01824515 = queryNorm
             0.2803793 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.11887315 = weight(abstract_txt:relevance in 4435) [ClassicSimilarity], result of:
           0.11887315 = score(doc=4435,freq=2.0), product of:
             0.2726962 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01824515 = queryNorm
             0.43591788 = fieldWeight in 4435, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.040310003 = weight(abstract_txt:system in 4435) [ClassicSimilarity], result of:
           0.040310003 = score(doc=4435,freq=1.0), product of:
             0.1912518 = queryWeight, product of:
               3.1083565 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.01824515 = queryNorm
             0.21076928 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.26027545 = weight(abstract_txt:success in 4435) [ClassicSimilarity], result of:
           0.26027545 = score(doc=4435,freq=4.0), product of:
             0.36495167 = queryWeight, product of:
               3.5059047 = boost
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.01824515 = queryNorm
             0.71317786 = fieldWeight in 4435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.24066326 = weight(abstract_txt:criterion in 4435) [ClassicSimilarity], result of:
           0.24066326 = score(doc=4435,freq=1.0), product of:
             0.49956673 = queryWeight, product of:
               3.5523014 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.01824515 = queryNorm
             0.48174396 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
       0.32 = coord(8/25)
   

3. Brooks, T.A.: Relevance auras : macro patterns and micro scatter (2001) 0.22

   0.22306699 = sum of:
     0.22306699 = product of:
       0.69708437 = sum of:
         0.01301139 = weight(abstract_txt:data in 1591) [ClassicSimilarity], result of:
           0.01301139 = score(doc=1591,freq=1.0), product of:
             0.062398244 = queryWeight, product of:
               1.0250702 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01824515 = queryNorm
             0.20852174 = fieldWeight in 1591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=1591)
         0.078122035 = weight(abstract_txt:dimensional in 1591) [ClassicSimilarity], result of:
           0.078122035 = score(doc=1591,freq=2.0), product of:
             0.12985308 = queryWeight, product of:
               1.0456313 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.01824515 = queryNorm
             0.60161865 = fieldWeight in 1591, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.0625 = fieldNorm(doc=1591)
         0.10821678 = weight(abstract_txt:assessments in 1591) [ClassicSimilarity], result of:
           0.10821678 = score(doc=1591,freq=3.0), product of:
             0.14096215 = queryWeight, product of:
               1.089441 = boost
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.01824515 = queryNorm
             0.7677009 = fieldWeight in 1591, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.0625 = fieldNorm(doc=1591)
         0.03683196 = weight(abstract_txt:related in 1591) [ClassicSimilarity], result of:
           0.03683196 = score(doc=1591,freq=2.0), product of:
             0.0991052 = queryWeight, product of:
               1.2918606 = boost
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.01824515 = queryNorm
             0.3716451 = fieldWeight in 1591, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.0625 = fieldNorm(doc=1591)
         0.04956835 = weight(abstract_txt:empirical in 1591) [ClassicSimilarity], result of:
           0.04956835 = score(doc=1591,freq=1.0), product of:
             0.15220405 = queryWeight, product of:
               1.6009601 = boost
               5.2107263 = idf(docFreq=655, maxDocs=44218)
               0.01824515 = queryNorm
             0.3256704 = fieldWeight in 1591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2107263 = idf(docFreq=655, maxDocs=44218)
               0.0625 = fieldNorm(doc=1591)
         0.025629751 = weight(abstract_txt:analysis in 1591) [ClassicSimilarity], result of:
           0.025629751 = score(doc=1591,freq=1.0), product of:
             0.112240575 = queryWeight, product of:
               1.6837902 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.01824515 = queryNorm
             0.22834657 = fieldWeight in 1591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=1591)
         0.094525516 = weight(abstract_txt:assessment in 1591) [ClassicSimilarity], result of:
           0.094525516 = score(doc=1591,freq=2.0), product of:
             0.18577157 = queryWeight, product of:
               1.7687117 = boost
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.01824515 = queryNorm
             0.5088266 = fieldWeight in 1591, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.0625 = fieldNorm(doc=1591)
         0.29117858 = weight(abstract_txt:relevance in 1591) [ClassicSimilarity], result of:
           0.29117858 = score(doc=1591,freq=12.0), product of:
             0.2726962 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01824515 = queryNorm
             1.0677764 = fieldWeight in 1591, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=1591)
       0.32 = coord(8/25)
   

4. White, H.D.: Relevance in theory (2009) 0.22

   0.22179107 = sum of:
     0.22179107 = product of:
       0.6930971 = sum of:
         0.05125062 = weight(abstract_txt:considerations in 3872) [ClassicSimilarity], result of:
           0.05125062 = score(doc=3872,freq=2.0), product of:
             0.11876683 = queryWeight, product of:
               6.5095015 = idf(docFreq=178, maxDocs=44218)
               0.01824515 = queryNorm
             0.43152303 = fieldWeight in 3872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.5095015 = idf(docFreq=178, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.07731239 = weight(abstract_txt:dimensions in 3872) [ClassicSimilarity], result of:
           0.07731239 = score(doc=3872,freq=2.0), product of:
             0.19682115 = queryWeight, product of:
               1.820553 = boost
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.01824515 = queryNorm
             0.39280528 = fieldWeight in 3872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.035584427 = weight(abstract_txt:evaluation in 3872) [ClassicSimilarity], result of:
           0.035584427 = score(doc=3872,freq=1.0), product of:
             0.16922043 = queryWeight, product of:
               2.067471 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.01824515 = queryNorm
             0.21028447 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.022055537 = weight(abstract_txt:retrieval in 3872) [ClassicSimilarity], result of:
           0.022055537 = score(doc=3872,freq=1.0), product of:
             0.13539547 = queryWeight, product of:
               2.1354258 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.01824515 = queryNorm
             0.16289715 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.07778022 = weight(abstract_txt:user's in 3872) [ClassicSimilarity], result of:
           0.07778022 = score(doc=3872,freq=1.0), product of:
             0.2850092 = queryWeight, product of:
               2.6831348 = boost
               5.8219566 = idf(docFreq=355, maxDocs=44218)
               0.01824515 = queryNorm
             0.27290422 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8219566 = idf(docFreq=355, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.21838394 = weight(abstract_txt:relevance in 3872) [ClassicSimilarity], result of:
           0.21838394 = score(doc=3872,freq=12.0), product of:
             0.2726962 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01824515 = queryNorm
             0.80083233 = fieldWeight in 3872, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.030232502 = weight(abstract_txt:system in 3872) [ClassicSimilarity], result of:
           0.030232502 = score(doc=3872,freq=1.0), product of:
             0.1912518 = queryWeight, product of:
               3.1083565 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.01824515 = queryNorm
             0.15807696 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.18049745 = weight(abstract_txt:criterion in 3872) [ClassicSimilarity], result of:
           0.18049745 = score(doc=3872,freq=1.0), product of:
             0.49956673 = queryWeight, product of:
               3.5523014 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.01824515 = queryNorm
             0.36130798 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
       0.32 = coord(8/25)
   

5. Maglaughlin, K.L.; Sonnenwald, D.H.: User perspectives an relevance criteria : a comparison among relevant, partially relevant, and not-relevant judgements (2002) 0.22

   0.22178009 = sum of:
     0.22178009 = product of:
       0.9240837 = sum of:
         0.15341876 = weight(abstract_txt:judgement in 5201) [ClassicSimilarity], result of:
           0.15341876 = score(doc=5201,freq=2.0), product of:
             0.17548858 = queryWeight, product of:
               1.2155613 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.01824515 = queryNorm
             0.8742379 = fieldWeight in 5201, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.078125 = fieldNorm(doc=5201)
         0.031983104 = weight(abstract_txt:content in 5201) [ClassicSimilarity], result of:
           0.031983104 = score(doc=5201,freq=1.0), product of:
             0.09794079 = queryWeight, product of:
               1.284249 = boost
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.01824515 = queryNorm
             0.3265555 = fieldWeight in 5201, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.078125 = fieldNorm(doc=5201)
         0.032555163 = weight(abstract_txt:related in 5201) [ClassicSimilarity], result of:
           0.032555163 = score(doc=5201,freq=1.0), product of:
             0.0991052 = queryWeight, product of:
               1.2918606 = boost
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.01824515 = queryNorm
             0.32849097 = fieldWeight in 5201, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.078125 = fieldNorm(doc=5201)
         0.13209875 = weight(abstract_txt:adequate in 5201) [ClassicSimilarity], result of:
           0.13209875 = score(doc=5201,freq=1.0), product of:
             0.25212488 = queryWeight, product of:
               2.0605125 = boost
               6.7064548 = idf(docFreq=146, maxDocs=44218)
               0.01824515 = queryNorm
             0.52394176 = fieldWeight in 5201, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7064548 = idf(docFreq=146, maxDocs=44218)
               0.078125 = fieldNorm(doc=5201)
         0.14859144 = weight(abstract_txt:relevance in 5201) [ClassicSimilarity], result of:
           0.14859144 = score(doc=5201,freq=2.0), product of:
             0.2726962 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01824515 = queryNorm
             0.5448974 = fieldWeight in 5201, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=5201)
         0.42543653 = weight(abstract_txt:criterion in 5201) [ClassicSimilarity], result of:
           0.42543653 = score(doc=5201,freq=2.0), product of:
             0.49956673 = queryWeight, product of:
               3.5523014 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.01824515 = queryNorm
             0.851611 = fieldWeight in 5201, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.078125 = fieldNorm(doc=5201)
       0.24 = coord(6/25)