Document (#27883)

Author

Vakkari, P.
Sormunen, E.

Title

¬The influence of relevance levels an the effectiveness of interactive information retrieval

Source

Journal of the American Society for Information Science and Technology. 55(2004) no.11, S.963-969

Year

2004

Abstract

In this paper, we focus an the effect of graded relevance an the results of interactive information retrieval (IR) experiments based an assigned search tasks in a test collection. A group of 26 subjects searched for four Text REtrieval Conference (TREC) topics using automatic and interactive query expansion based an relevance feedback. The TREC- and user-suggested pools of relevant documents were reassessed an a four-level relevance scale. The results show that the users could identify nearly all highly relevant documents and about half of the marginal ones. Users also selected a fair number of irrelevant documents for query expansion. The findings suggest that the effectiveness of query expansion is closely related to the searchers' success in retrieving and identifying highly relevant documents for feedback. The implications of the results an interpreting the findings of past experiments with liberal relevance thresholds are also discussed.

Theme

Retrievalstudien

Object

TREC

Similar documents (author)

1. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 3.90

   3.896612 = sum of:
     3.896612 = sum of:
       1.6409125 = weight(author_txt:vakkari in 433) [ClassicSimilarity], result of:
         1.6409125 = score(doc=433,freq=1.0), product of:
           0.628883 = queryWeight, product of:
             8.349598 = idf(docFreq=27, maxDocs=43556)
             0.075318955 = queryNorm
           2.6092494 = fieldWeight in 433, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.349598 = idf(docFreq=27, maxDocs=43556)
             0.3125 = fieldNorm(doc=433)
       2.2556994 = weight(author_txt:sormunen in 433) [ClassicSimilarity], result of:
         2.2556994 = score(doc=433,freq=1.0), product of:
           0.7775 = queryWeight, product of:
             1.1118988 = boost
             9.283908 = idf(docFreq=10, maxDocs=43556)
             0.075318955 = queryNorm
           2.9012213 = fieldWeight in 433, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.283908 = idf(docFreq=10, maxDocs=43556)
             0.3125 = fieldNorm(doc=433)
   

2. Sormunen, E.: Free-text searching in full-text databases : probing system limits (1993) 2.26

   2.2556994 = sum of:
     2.2556994 = product of:
       4.511399 = sum of:
         4.511399 = weight(author_txt:sormunen in 7117) [ClassicSimilarity], result of:
           4.511399 = score(doc=7117,freq=1.0), product of:
             0.7775 = queryWeight, product of:
               1.1118988 = boost
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.075318955 = queryNorm
             5.8024426 = fieldWeight in 7117, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.625 = fieldNorm(doc=7117)
       0.5 = coord(1/2)
   

3. Halttunen, K.; Sormunen, E.: Learning information retrieval through an educational game : is gaming sufficient for learning? (2000) 1.80

   1.8045596 = sum of:
     1.8045596 = product of:
       3.6091192 = sum of:
         3.6091192 = weight(author_txt:sormunen in 4863) [ClassicSimilarity], result of:
           3.6091192 = score(doc=4863,freq=1.0), product of:
             0.7775 = queryWeight, product of:
               1.1118988 = boost
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.075318955 = queryNorm
             4.641954 = fieldWeight in 4863, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.5 = fieldNorm(doc=4863)
       0.5 = coord(1/2)
   

4. Alkula, R.; Sormunen, E.: Problems and guidelines for database descriptions (1989) 1.80

   1.8045596 = sum of:
     1.8045596 = product of:
       3.6091192 = sum of:
         3.6091192 = weight(author_txt:sormunen in 4395) [ClassicSimilarity], result of:
           3.6091192 = score(doc=4395,freq=1.0), product of:
             0.7775 = queryWeight, product of:
               1.1118988 = boost
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.075318955 = queryNorm
             4.641954 = fieldWeight in 4395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.5 = fieldNorm(doc=4395)
       0.5 = coord(1/2)
   

5. Vakkari, P.: Information seeking in context : a challenging metatheory (1997) 1.64

   1.6409125 = sum of:
     1.6409125 = product of:
       3.281825 = sum of:
         3.281825 = weight(author_txt:vakkari in 1300) [ClassicSimilarity], result of:
           3.281825 = score(doc=1300,freq=1.0), product of:
             0.628883 = queryWeight, product of:
               8.349598 = idf(docFreq=27, maxDocs=43556)
               0.075318955 = queryNorm
             5.2184987 = fieldWeight in 1300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.349598 = idf(docFreq=27, maxDocs=43556)
               0.625 = fieldNorm(doc=1300)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 0.70

   0.7021774 = sum of:
     0.7021774 = product of:
       1.3503412 = sum of:
         0.03646314 = weight(abstract_txt:users in 433) [ClassicSimilarity], result of:
           0.03646314 = score(doc=433,freq=5.0), product of:
             0.07304332 = queryWeight, product of:
               1.0464007 = boost
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.01954222 = queryNorm
             0.49919888 = fieldWeight in 433, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.121560395 = weight(abstract_txt:liberal in 433) [ClassicSimilarity], result of:
           0.121560395 = score(doc=433,freq=1.0), product of:
             0.22123432 = queryWeight, product of:
               1.2877128 = boost
               8.791431 = idf(docFreq=17, maxDocs=43556)
               0.01954222 = queryNorm
             0.54946446 = fieldWeight in 433, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.791431 = idf(docFreq=17, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.050495002 = weight(abstract_txt:four in 433) [ClassicSimilarity], result of:
           0.050495002 = score(doc=433,freq=1.0), product of:
             0.15517914 = queryWeight, product of:
               1.5251918 = boost
               5.20637 = idf(docFreq=648, maxDocs=43556)
               0.01954222 = queryNorm
             0.32539812 = fieldWeight in 433, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.20637 = idf(docFreq=648, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.022930302 = weight(abstract_txt:results in 433) [ClassicSimilarity], result of:
           0.022930302 = score(doc=433,freq=1.0), product of:
             0.10494732 = queryWeight, product of:
               1.5361693 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.01954222 = queryNorm
             0.21849345 = fieldWeight in 433, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.058215242 = weight(abstract_txt:highly in 433) [ClassicSimilarity], result of:
           0.058215242 = score(doc=433,freq=1.0), product of:
             0.17061828 = queryWeight, product of:
               1.5992655 = boost
               5.4592266 = idf(docFreq=503, maxDocs=43556)
               0.01954222 = queryNorm
             0.34120166 = fieldWeight in 433, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4592266 = idf(docFreq=503, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.075310804 = weight(abstract_txt:feedback in 433) [ClassicSimilarity], result of:
           0.075310804 = score(doc=433,freq=1.0), product of:
             0.20256883 = queryWeight, product of:
               1.7425855 = boost
               5.9484615 = idf(docFreq=308, maxDocs=43556)
               0.01954222 = queryNorm
             0.37177885 = fieldWeight in 433, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9484615 = idf(docFreq=308, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.15160148 = weight(abstract_txt:trec in 433) [ClassicSimilarity], result of:
           0.15160148 = score(doc=433,freq=2.0), product of:
             0.25632644 = queryWeight, product of:
               1.9602185 = boost
               6.69137 = idf(docFreq=146, maxDocs=43556)
               0.01954222 = queryNorm
             0.5914391 = fieldWeight in 433, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.69137 = idf(docFreq=146, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.10768418 = weight(abstract_txt:relevant in 433) [ClassicSimilarity], result of:
           0.10768418 = score(doc=433,freq=4.0), product of:
             0.1854013 = queryWeight, product of:
               2.041784 = boost
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.01954222 = queryNorm
             0.58081675 = fieldWeight in 433, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.09915867 = weight(abstract_txt:query in 433) [ClassicSimilarity], result of:
           0.09915867 = score(doc=433,freq=3.0), product of:
             0.19314267 = queryWeight, product of:
               2.083975 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.01954222 = queryNorm
             0.51339597 = fieldWeight in 433, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.070810124 = weight(abstract_txt:documents in 433) [ClassicSimilarity], result of:
           0.070810124 = score(doc=433,freq=2.0), product of:
             0.1944157 = queryWeight, product of:
               2.4142845 = boost
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.01954222 = queryNorm
             0.3642202 = fieldWeight in 433, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.15934256 = weight(abstract_txt:interactive in 433) [ClassicSimilarity], result of:
           0.15934256 = score(doc=433,freq=3.0), product of:
             0.2649795 = queryWeight, product of:
               2.4409537 = boost
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.01954222 = queryNorm
             0.60133916 = fieldWeight in 433, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.24480106 = weight(abstract_txt:expansion in 433) [ClassicSimilarity], result of:
           0.24480106 = score(doc=433,freq=4.0), product of:
             0.32054356 = queryWeight, product of:
               2.6847072 = boost
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.01954222 = queryNorm
             0.7637061 = fieldWeight in 433, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
         0.15196823 = weight(abstract_txt:relevance in 433) [ClassicSimilarity], result of:
           0.15196823 = score(doc=433,freq=2.0), product of:
             0.34844932 = queryWeight, product of:
               3.6136625 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.01954222 = queryNorm
             0.4361272 = fieldWeight in 433, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.0625 = fieldNorm(doc=433)
       0.52 = coord(13/25)
   

2. Efthimiadis, E.N.: Interactive query expansion : a user-based evaluation in a relevance feedback environment (2000) 0.65

   0.65211195 = sum of:
     0.65211195 = product of:
       1.3585666 = sum of:
         0.028536923 = weight(abstract_txt:users in 699) [ClassicSimilarity], result of:
           0.028536923 = score(doc=699,freq=4.0), product of:
             0.07304332 = queryWeight, product of:
               1.0464007 = boost
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.01954222 = queryNorm
             0.39068493 = fieldWeight in 699, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.05911036 = weight(abstract_txt:effectiveness in 699) [ClassicSimilarity], result of:
           0.05911036 = score(doc=699,freq=2.0), product of:
             0.14954141 = queryWeight, product of:
               1.4972299 = boost
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.01954222 = queryNorm
             0.39527753 = fieldWeight in 699, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.03409876 = weight(abstract_txt:retrieval in 699) [ClassicSimilarity], result of:
           0.03409876 = score(doc=699,freq=3.0), product of:
             0.10362824 = queryWeight, product of:
               1.5264847 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.01954222 = queryNorm
             0.3290489 = fieldWeight in 699, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.034751892 = weight(abstract_txt:results in 699) [ClassicSimilarity], result of:
           0.034751892 = score(doc=699,freq=3.0), product of:
             0.10494732 = queryWeight, product of:
               1.5361693 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.01954222 = queryNorm
             0.33113652 = fieldWeight in 699, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.07203769 = weight(abstract_txt:highly in 699) [ClassicSimilarity], result of:
           0.07203769 = score(doc=699,freq=2.0), product of:
             0.17061828 = queryWeight, product of:
               1.5992655 = boost
               5.4592266 = idf(docFreq=503, maxDocs=43556)
               0.01954222 = queryNorm
             0.42221552 = fieldWeight in 699, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4592266 = idf(docFreq=503, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.06589695 = weight(abstract_txt:feedback in 699) [ClassicSimilarity], result of:
           0.06589695 = score(doc=699,freq=1.0), product of:
             0.20256883 = queryWeight, product of:
               1.7425855 = boost
               5.9484615 = idf(docFreq=308, maxDocs=43556)
               0.01954222 = queryNorm
             0.32530648 = fieldWeight in 699, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9484615 = idf(docFreq=308, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.06662619 = weight(abstract_txt:relevant in 699) [ClassicSimilarity], result of:
           0.06662619 = score(doc=699,freq=2.0), product of:
             0.1854013 = queryWeight, product of:
               2.041784 = boost
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.01954222 = queryNorm
             0.35936204 = fieldWeight in 699, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.20653923 = weight(abstract_txt:query in 699) [ClassicSimilarity], result of:
           0.20653923 = score(doc=699,freq=17.0), product of:
             0.19314267 = queryWeight, product of:
               2.083975 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.01954222 = queryNorm
             1.069361 = fieldWeight in 699, product of:
               4.1231055 = tf(freq=17.0), with freq of:
                 17.0 = termFreq=17.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.06195886 = weight(abstract_txt:documents in 699) [ClassicSimilarity], result of:
           0.06195886 = score(doc=699,freq=2.0), product of:
             0.1944157 = queryWeight, product of:
               2.4142845 = boost
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.01954222 = queryNorm
             0.31869268 = fieldWeight in 699, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.17999658 = weight(abstract_txt:interactive in 699) [ClassicSimilarity], result of:
           0.17999658 = score(doc=699,freq=5.0), product of:
             0.2649795 = queryWeight, product of:
               2.4409537 = boost
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.01954222 = queryNorm
             0.6792849 = fieldWeight in 699, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.38615623 = weight(abstract_txt:expansion in 699) [ClassicSimilarity], result of:
           0.38615623 = score(doc=699,freq=13.0), product of:
             0.32054356 = queryWeight, product of:
               2.6847072 = boost
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.01954222 = queryNorm
             1.2046919 = fieldWeight in 699, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
         0.16285701 = weight(abstract_txt:relevance in 699) [ClassicSimilarity], result of:
           0.16285701 = score(doc=699,freq=3.0), product of:
             0.34844932 = queryWeight, product of:
               3.6136625 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.01954222 = queryNorm
             0.46737647 = fieldWeight in 699, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.0546875 = fieldNorm(doc=699)
       0.48 = coord(12/25)
   

3. Ruthven, T.; Lalmas, M.; Rijsbergen, K.van: Incorporating user research behavior into relevance feedback (2003) 0.54

   0.53768814 = sum of:
     0.53768814 = product of:
       1.2220185 = sum of:
         0.0675547 = weight(abstract_txt:effectiveness in 167) [ClassicSimilarity], result of:
           0.0675547 = score(doc=167,freq=2.0), product of:
             0.14954141 = queryWeight, product of:
               1.4972299 = boost
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.01954222 = queryNorm
             0.45174575 = fieldWeight in 167, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.022499347 = weight(abstract_txt:retrieval in 167) [ClassicSimilarity], result of:
           0.022499347 = score(doc=167,freq=1.0), product of:
             0.10362824 = queryWeight, product of:
               1.5264847 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.01954222 = queryNorm
             0.21711598 = fieldWeight in 167, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.07711418 = weight(abstract_txt:experiments in 167) [ClassicSimilarity], result of:
           0.07711418 = score(doc=167,freq=2.0), product of:
             0.1633355 = queryWeight, product of:
               1.5647613 = boost
               5.3414435 = idf(docFreq=566, maxDocs=43556)
               0.01954222 = queryNorm
             0.47212136 = fieldWeight in 167, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3414435 = idf(docFreq=566, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.10650556 = weight(abstract_txt:feedback in 167) [ClassicSimilarity], result of:
           0.10650556 = score(doc=167,freq=2.0), product of:
             0.20256883 = queryWeight, product of:
               1.7425855 = boost
               5.9484615 = idf(docFreq=308, maxDocs=43556)
               0.01954222 = queryNorm
             0.52577466 = fieldWeight in 167, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9484615 = idf(docFreq=308, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.15160148 = weight(abstract_txt:trec in 167) [ClassicSimilarity], result of:
           0.15160148 = score(doc=167,freq=2.0), product of:
             0.25632644 = queryWeight, product of:
               1.9602185 = boost
               6.69137 = idf(docFreq=146, maxDocs=43556)
               0.01954222 = queryNorm
             0.5914391 = fieldWeight in 167, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.69137 = idf(docFreq=146, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.09325723 = weight(abstract_txt:relevant in 167) [ClassicSimilarity], result of:
           0.09325723 = score(doc=167,freq=3.0), product of:
             0.1854013 = queryWeight, product of:
               2.041784 = boost
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.01954222 = queryNorm
             0.50300205 = fieldWeight in 167, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.08096271 = weight(abstract_txt:query in 167) [ClassicSimilarity], result of:
           0.08096271 = score(doc=167,freq=2.0), product of:
             0.19314267 = queryWeight, product of:
               2.083975 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.01954222 = queryNorm
             0.41918606 = fieldWeight in 167, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.070810124 = weight(abstract_txt:documents in 167) [ClassicSimilarity], result of:
           0.070810124 = score(doc=167,freq=2.0), product of:
             0.1944157 = queryWeight, product of:
               2.4142845 = boost
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.01954222 = queryNorm
             0.3642202 = fieldWeight in 167, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.091996476 = weight(abstract_txt:interactive in 167) [ClassicSimilarity], result of:
           0.091996476 = score(doc=167,freq=1.0), product of:
             0.2649795 = queryWeight, product of:
               2.4409537 = boost
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.01954222 = queryNorm
             0.34718335 = fieldWeight in 167, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.24480106 = weight(abstract_txt:expansion in 167) [ClassicSimilarity], result of:
           0.24480106 = score(doc=167,freq=4.0), product of:
             0.32054356 = queryWeight, product of:
               2.6847072 = boost
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.01954222 = queryNorm
             0.7637061 = fieldWeight in 167, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
         0.21491553 = weight(abstract_txt:relevance in 167) [ClassicSimilarity], result of:
           0.21491553 = score(doc=167,freq=4.0), product of:
             0.34844932 = queryWeight, product of:
               3.6136625 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.01954222 = queryNorm
             0.616777 = fieldWeight in 167, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.0625 = fieldNorm(doc=167)
       0.44 = coord(11/25)
   

4. He, D.; Wu, D.: Enhancing query translation with relevance feedback in translingual information retrieval : a study of the medication process (2011) 0.47

   0.47237396 = sum of:
     0.47237396 = product of:
       1.0735772 = sum of:
         0.014232298 = weight(abstract_txt:also in 1242) [ClassicSimilarity], result of:
           0.014232298 = score(doc=1242,freq=1.0), product of:
             0.066709004 = queryWeight, product of:
               3.4135838 = idf(docFreq=3897, maxDocs=43556)
               0.01954222 = queryNorm
             0.21334898 = fieldWeight in 1242, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4135838 = idf(docFreq=3897, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.047768384 = weight(abstract_txt:effectiveness in 1242) [ClassicSimilarity], result of:
           0.047768384 = score(doc=1242,freq=1.0), product of:
             0.14954141 = queryWeight, product of:
               1.4972299 = boost
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.01954222 = queryNorm
             0.3194325 = fieldWeight in 1242, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.03181888 = weight(abstract_txt:retrieval in 1242) [ClassicSimilarity], result of:
           0.03181888 = score(doc=1242,freq=2.0), product of:
             0.10362824 = queryWeight, product of:
               1.5264847 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.01954222 = queryNorm
             0.30704835 = fieldWeight in 1242, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.022930302 = weight(abstract_txt:results in 1242) [ClassicSimilarity], result of:
           0.022930302 = score(doc=1242,freq=1.0), product of:
             0.10494732 = queryWeight, product of:
               1.5361693 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.01954222 = queryNorm
             0.21849345 = fieldWeight in 1242, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.16840008 = weight(abstract_txt:feedback in 1242) [ClassicSimilarity], result of:
           0.16840008 = score(doc=1242,freq=5.0), product of:
             0.20256883 = queryWeight, product of:
               1.7425855 = boost
               5.9484615 = idf(docFreq=308, maxDocs=43556)
               0.01954222 = queryNorm
             0.8313228 = fieldWeight in 1242, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.9484615 = idf(docFreq=308, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.05384209 = weight(abstract_txt:relevant in 1242) [ClassicSimilarity], result of:
           0.05384209 = score(doc=1242,freq=1.0), product of:
             0.1854013 = queryWeight, product of:
               2.041784 = boost
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.01954222 = queryNorm
             0.29040837 = fieldWeight in 1242, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.14023153 = weight(abstract_txt:query in 1242) [ClassicSimilarity], result of:
           0.14023153 = score(doc=1242,freq=6.0), product of:
             0.19314267 = queryWeight, product of:
               2.083975 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.01954222 = queryNorm
             0.72605157 = fieldWeight in 1242, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.050070323 = weight(abstract_txt:documents in 1242) [ClassicSimilarity], result of:
           0.050070323 = score(doc=1242,freq=1.0), product of:
             0.1944157 = queryWeight, product of:
               2.4142845 = boost
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.01954222 = queryNorm
             0.25754258 = fieldWeight in 1242, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.091996476 = weight(abstract_txt:interactive in 1242) [ClassicSimilarity], result of:
           0.091996476 = score(doc=1242,freq=1.0), product of:
             0.2649795 = queryWeight, product of:
               2.4409537 = boost
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.01954222 = queryNorm
             0.34718335 = fieldWeight in 1242, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.21200395 = weight(abstract_txt:expansion in 1242) [ClassicSimilarity], result of:
           0.21200395 = score(doc=1242,freq=3.0), product of:
             0.32054356 = queryWeight, product of:
               2.6847072 = boost
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.01954222 = queryNorm
             0.6613889 = fieldWeight in 1242, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
         0.24028286 = weight(abstract_txt:relevance in 1242) [ClassicSimilarity], result of:
           0.24028286 = score(doc=1242,freq=5.0), product of:
             0.34844932 = queryWeight, product of:
               3.6136625 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.01954222 = queryNorm
             0.68957764 = fieldWeight in 1242, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.0625 = fieldNorm(doc=1242)
       0.44 = coord(11/25)
   

5. Kekäläinen, J.; Järvelin, K.: Using graded relevance assessments in IR evaluation (2002) 0.45

   0.4526771 = sum of:
     0.4526771 = product of:
       1.0288116 = sum of:
         0.099221386 = weight(abstract_txt:marginal in 223) [ClassicSimilarity], result of:
           0.099221386 = score(doc=223,freq=1.0), product of:
             0.1932241 = queryWeight, product of:
               1.2034372 = boost
               8.216067 = idf(docFreq=31, maxDocs=43556)
               0.01954222 = queryNorm
             0.5135042 = fieldWeight in 223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.216067 = idf(docFreq=31, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.11527746 = weight(abstract_txt:graded in 223) [ClassicSimilarity], result of:
           0.11527746 = score(doc=223,freq=1.0), product of:
             0.213544 = queryWeight, product of:
               1.2651339 = boost
               8.63728 = idf(docFreq=20, maxDocs=43556)
               0.01954222 = queryNorm
             0.53983 = fieldWeight in 223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.63728 = idf(docFreq=20, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.071410716 = weight(abstract_txt:four in 223) [ClassicSimilarity], result of:
           0.071410716 = score(doc=223,freq=2.0), product of:
             0.15517914 = queryWeight, product of:
               1.5251918 = boost
               5.20637 = idf(docFreq=648, maxDocs=43556)
               0.01954222 = queryNorm
             0.46018243 = fieldWeight in 223, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.20637 = idf(docFreq=648, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.022499347 = weight(abstract_txt:retrieval in 223) [ClassicSimilarity], result of:
           0.022499347 = score(doc=223,freq=1.0), product of:
             0.10362824 = queryWeight, product of:
               1.5264847 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.01954222 = queryNorm
             0.21711598 = fieldWeight in 223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.032428343 = weight(abstract_txt:results in 223) [ClassicSimilarity], result of:
           0.032428343 = score(doc=223,freq=2.0), product of:
             0.10494732 = queryWeight, product of:
               1.5361693 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.01954222 = queryNorm
             0.30899638 = fieldWeight in 223, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.058215242 = weight(abstract_txt:highly in 223) [ClassicSimilarity], result of:
           0.058215242 = score(doc=223,freq=1.0), product of:
             0.17061828 = queryWeight, product of:
               1.5992655 = boost
               5.4592266 = idf(docFreq=503, maxDocs=43556)
               0.01954222 = queryNorm
             0.34120166 = fieldWeight in 223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4592266 = idf(docFreq=503, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.05384209 = weight(abstract_txt:relevant in 223) [ClassicSimilarity], result of:
           0.05384209 = score(doc=223,freq=1.0), product of:
             0.1854013 = queryWeight, product of:
               2.041784 = boost
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.01954222 = queryNorm
             0.29040837 = fieldWeight in 223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.646534 = idf(docFreq=1135, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.057249285 = weight(abstract_txt:query in 223) [ClassicSimilarity], result of:
           0.057249285 = score(doc=223,freq=1.0), product of:
             0.19314267 = queryWeight, product of:
               2.083975 = boost
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.01954222 = queryNorm
             0.2964093 = fieldWeight in 223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.742549 = idf(docFreq=1031, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.11196065 = weight(abstract_txt:documents in 223) [ClassicSimilarity], result of:
           0.11196065 = score(doc=223,freq=5.0), product of:
             0.1944157 = queryWeight, product of:
               2.4142845 = boost
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.01954222 = queryNorm
             0.57588273 = fieldWeight in 223, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.12240053 = weight(abstract_txt:expansion in 223) [ClassicSimilarity], result of:
           0.12240053 = score(doc=223,freq=1.0), product of:
             0.32054356 = queryWeight, product of:
               2.6847072 = boost
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.01954222 = queryNorm
             0.38185304 = fieldWeight in 223, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1096487 = idf(docFreq=262, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
         0.28430653 = weight(abstract_txt:relevance in 223) [ClassicSimilarity], result of:
           0.28430653 = score(doc=223,freq=7.0), product of:
             0.34844932 = queryWeight, product of:
               3.6136625 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.01954222 = queryNorm
             0.8159193 = fieldWeight in 223, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.0625 = fieldNorm(doc=223)
       0.44 = coord(11/25)