Document (#29550)

Author

Borlund, P.

Title

Experimental components for the evaluation of interactive information retrieval systems

Source

Journal of documentation. 56(2000) no.1, S.71-90

Year

2000

Abstract

This paper presents a set of basic components which constitutes the experimental setting intended for the evaluation of interactive information retrieval (IIR) systems, the aim of which is to facilitate evaluation of IIR systems in a way which is as close as possible to realistic IR processes. The experimental settings consists of 3 components: (1) the involvement of potential users as test persons; (2) the application of dynamic and individual information needs; and (3) the use of multidimensionsal and dynamic relevance judgements. Hidden under the information need component is the essential central sub-component, the simulated work task situation, the tool that triggers the (simulated) dynamic information need. This paper also reports on the empirical findings of the meta-evaluation of the application of this sub-component, the purpose of which is to discover whether the application of simulated work task situations to future evaluation of IIR systems can be recommended. Investigations are carried out to dertermine whether any search behavioural differences exist between test persons' treatment of their own real information needs versus simulated information needs. The hypothesis is that if no difference exist one can correctly substitute real information needs with simulated information needs through the application of simulated work task situations. The empirical results of the meta-evaluation provide positive evidence for the application of simulated work task situations to the evaluation of IIR systems. The results also indicate that tailoring work task situations to the group of test persons is important in motivating them. Furthermore, the results of the evaluation show that different versions of semantic openness of the simulated situations make no difference to the test persons' search treatment

Content

Vgl. unter: http://www.emeraldinsight.com/10.1108/EUM0000000007110.

Theme

Retrievalstudien

Similar documents (author)

1. Borlund, P.: ¬The IIR evaluation model : a framework for evaluation of interactive information retrieval systems (2003) 5.58

   5.5776863 = sum of:
     5.5776863 = weight(author_txt:borlund in 922) [ClassicSimilarity], result of:
       5.5776863 = fieldWeight in 922, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.625 = fieldNorm(doc=922)
   

2. Borlund, P.: ¬The concept of relevance in IR (2003) 5.58

   5.5776863 = sum of:
     5.5776863 = weight(author_txt:borlund in 1798) [ClassicSimilarity], result of:
       5.5776863 = fieldWeight in 1798, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.625 = fieldNorm(doc=1798)
   

3. Borlund, P.: Evaluation of interactive information retrieval systems (2000) 5.58

   5.5776863 = sum of:
     5.5776863 = weight(author_txt:borlund in 2556) [ClassicSimilarity], result of:
       5.5776863 = fieldWeight in 2556, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.625 = fieldNorm(doc=2556)
   

4. Borlund, P.: ¬A study of the use of simulated work task situations in interactive information retrieval evaluations : a meta-evaluation (2016) 5.58

   5.5776863 = sum of:
     5.5776863 = weight(author_txt:borlund in 2880) [ClassicSimilarity], result of:
       5.5776863 = fieldWeight in 2880, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.625 = fieldNorm(doc=2880)
   

5. Borlund, P.; Ingwersen, P.: ¬The development of a method for the evaluation of interactive information retrieval systems (1997) 4.46

   4.462149 = sum of:
     4.462149 = weight(author_txt:borlund in 7469) [ClassicSimilarity], result of:
       4.462149 = fieldWeight in 7469, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.5 = fieldNorm(doc=7469)
   

Similar documents (content)

1. Borlund, P.: ¬A study of the use of simulated work task situations in interactive information retrieval evaluations : a meta-evaluation (2016) 0.69

   0.68710214 = sum of:
     0.68710214 = product of:
       1.7177553 = sum of:
         0.02509624 = weight(abstract_txt:whether in 2880) [ClassicSimilarity], result of:
           0.02509624 = score(doc=2880,freq=2.0), product of:
             0.06700898 = queryWeight, product of:
               4.8425326 = idf(docFreq=947, maxDocs=44218)
               0.01383759 = queryNorm
             0.37452054 = fieldWeight in 2880, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8425326 = idf(docFreq=947, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
         0.02210908 = weight(abstract_txt:empirical in 2880) [ClassicSimilarity], result of:
           0.02210908 = score(doc=2880,freq=1.0), product of:
             0.07758618 = queryWeight, product of:
               1.0760332 = boost
               5.2107263 = idf(docFreq=655, maxDocs=44218)
               0.01383759 = queryNorm
             0.28496158 = fieldWeight in 2880, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2107263 = idf(docFreq=655, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
         0.026785078 = weight(abstract_txt:interactive in 2880) [ClassicSimilarity], result of:
           0.026785078 = score(doc=2880,freq=1.0), product of:
             0.08817237 = queryWeight, product of:
               1.1470959 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.01383759 = queryNorm
             0.30378085 = fieldWeight in 2880, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
         0.0674909 = weight(abstract_txt:work in 2880) [ClassicSimilarity], result of:
           0.0674909 = score(doc=2880,freq=10.0), product of:
             0.102852315 = queryWeight, product of:
               1.9588921 = boost
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.01383759 = queryNorm
             0.6561923 = fieldWeight in 2880, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
         0.09839665 = weight(abstract_txt:test in 2880) [ClassicSimilarity], result of:
           0.09839665 = score(doc=2880,freq=6.0), product of:
             0.14555162 = queryWeight, product of:
               2.0842845 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.01383759 = queryNorm
             0.6760258 = fieldWeight in 2880, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
         0.014111039 = weight(abstract_txt:information in 2880) [ClassicSimilarity], result of:
           0.014111039 = score(doc=2880,freq=2.0), product of:
             0.075365186 = queryWeight, product of:
               2.2497027 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01383759 = queryNorm
             0.18723552 = fieldWeight in 2880, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
         0.033933938 = weight(abstract_txt:needs in 2880) [ClassicSimilarity], result of:
           0.033933938 = score(doc=2880,freq=1.0), product of:
             0.14011139 = queryWeight, product of:
               2.286337 = boost
               4.428664 = idf(docFreq=1433, maxDocs=44218)
               0.01383759 = queryNorm
             0.24219257 = fieldWeight in 2880, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.428664 = idf(docFreq=1433, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
         0.14635424 = weight(abstract_txt:task in 2880) [ClassicSimilarity], result of:
           0.14635424 = score(doc=2880,freq=10.0), product of:
             0.17231409 = queryWeight, product of:
               2.5355017 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.01383759 = queryNorm
             0.84934574 = fieldWeight in 2880, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
         0.30419174 = weight(abstract_txt:situations in 2880) [ClassicSimilarity], result of:
           0.30419174 = score(doc=2880,freq=9.0), product of:
             0.29067078 = queryWeight, product of:
               3.2930944 = boost
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.01383759 = queryNorm
             1.0465164 = fieldWeight in 2880, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
         0.9792864 = weight(abstract_txt:simulated in 2880) [ClassicSimilarity], result of:
           0.9792864 = score(doc=2880,freq=10.0), product of:
             0.71564406 = queryWeight, product of:
               6.536 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.01383759 = queryNorm
             1.3683987 = fieldWeight in 2880, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2880)
       0.4 = coord(10/25)
   

2. Borlund, P.; Ingwersen, P.: ¬The development of a method for the evaluation of interactive information retrieval systems (1997) 0.63

   0.6256252 = sum of:
     0.6256252 = product of:
       1.4218755 = sum of:
         0.056669172 = weight(abstract_txt:real in 7469) [ClassicSimilarity], result of:
           0.056669172 = score(doc=7469,freq=2.0), product of:
             0.08051986 = queryWeight, product of:
               1.096188 = boost
               5.308326 = idf(docFreq=594, maxDocs=44218)
               0.01383759 = queryNorm
             0.7037912 = fieldWeight in 7469, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.308326 = idf(docFreq=594, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.045917273 = weight(abstract_txt:interactive in 7469) [ClassicSimilarity], result of:
           0.045917273 = score(doc=7469,freq=1.0), product of:
             0.08817237 = queryWeight, product of:
               1.1470959 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.01383759 = queryNorm
             0.52076715 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.026599886 = weight(abstract_txt:systems in 7469) [ClassicSimilarity], result of:
           0.026599886 = score(doc=7469,freq=1.0), product of:
             0.083160095 = queryWeight, product of:
               1.7614121 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.01383759 = queryNorm
             0.3198636 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.036587138 = weight(abstract_txt:work in 7469) [ClassicSimilarity], result of:
           0.036587138 = score(doc=7469,freq=1.0), product of:
             0.102852315 = queryWeight, product of:
               1.9588921 = boost
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.01383759 = queryNorm
             0.355725 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.06886331 = weight(abstract_txt:test in 7469) [ClassicSimilarity], result of:
           0.06886331 = score(doc=7469,freq=1.0), product of:
             0.14555162 = queryWeight, product of:
               2.0842845 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.01383759 = queryNorm
             0.4731195 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.024190355 = weight(abstract_txt:information in 7469) [ClassicSimilarity], result of:
           0.024190355 = score(doc=7469,freq=2.0), product of:
             0.075365186 = queryWeight, product of:
               2.2497027 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01383759 = queryNorm
             0.32097518 = fieldWeight in 7469, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.058172464 = weight(abstract_txt:needs in 7469) [ClassicSimilarity], result of:
           0.058172464 = score(doc=7469,freq=1.0), product of:
             0.14011139 = queryWeight, product of:
               2.286337 = boost
               4.428664 = idf(docFreq=1433, maxDocs=44218)
               0.01383759 = queryNorm
             0.41518727 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.428664 = idf(docFreq=1433, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.079339325 = weight(abstract_txt:task in 7469) [ClassicSimilarity], result of:
           0.079339325 = score(doc=7469,freq=1.0), product of:
             0.17231409 = queryWeight, product of:
               2.5355017 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.01383759 = queryNorm
             0.46043435 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.17802244 = weight(abstract_txt:persons in 7469) [ClassicSimilarity], result of:
           0.17802244 = score(doc=7469,freq=1.0), product of:
             0.27416265 = queryWeight, product of:
               2.8605704 = boost
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.01383759 = queryNorm
             0.6493315 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.09674242 = weight(abstract_txt:evaluation in 7469) [ClassicSimilarity], result of:
           0.09674242 = score(doc=7469,freq=1.0), product of:
             0.2300275 = queryWeight, product of:
               3.705556 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.01383759 = queryNorm
             0.42056894 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.7507717 = weight(abstract_txt:simulated in 7469) [ClassicSimilarity], result of:
           0.7507717 = score(doc=7469,freq=2.0), product of:
             0.71564406 = queryWeight, product of:
               6.536 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.01383759 = queryNorm
             1.0490854 = fieldWeight in 7469, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
       0.44 = coord(11/25)
   

3. Li, Y.; Belkin, N.J.: ¬An exploration of the relationships between work task and interactive information search behavior (2010) 0.30

   0.30183375 = sum of:
     0.30183375 = product of:
       0.838427 = sum of:
         0.025267523 = weight(abstract_txt:empirical in 3980) [ClassicSimilarity], result of:
           0.025267523 = score(doc=3980,freq=1.0), product of:
             0.07758618 = queryWeight, product of:
               1.0760332 = boost
               5.2107263 = idf(docFreq=655, maxDocs=44218)
               0.01383759 = queryNorm
             0.3256704 = fieldWeight in 3980, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2107263 = idf(docFreq=655, maxDocs=44218)
               0.0625 = fieldNorm(doc=3980)
         0.015999943 = weight(abstract_txt:results in 3980) [ClassicSimilarity], result of:
           0.015999943 = score(doc=3980,freq=2.0), product of:
             0.051980685 = queryWeight, product of:
               1.0786986 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01383759 = queryNorm
             0.30780554 = fieldWeight in 3980, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=3980)
         0.04329122 = weight(abstract_txt:interactive in 3980) [ClassicSimilarity], result of:
           0.04329122 = score(doc=3980,freq=2.0), product of:
             0.08817237 = queryWeight, product of:
               1.1470959 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.01383759 = queryNorm
             0.49098396 = fieldWeight in 3980, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0625 = fieldNorm(doc=3980)
         0.025078615 = weight(abstract_txt:systems in 3980) [ClassicSimilarity], result of:
           0.025078615 = score(doc=3980,freq=2.0), product of:
             0.083160095 = queryWeight, product of:
               1.7614121 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.01383759 = queryNorm
             0.3015703 = fieldWeight in 3980, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=3980)
         0.077132456 = weight(abstract_txt:work in 3980) [ClassicSimilarity], result of:
           0.077132456 = score(doc=3980,freq=10.0), product of:
             0.102852315 = queryWeight, product of:
               1.9588921 = boost
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.01383759 = queryNorm
             0.7499341 = fieldWeight in 3980, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.0625 = fieldNorm(doc=3980)
         0.032253806 = weight(abstract_txt:information in 3980) [ClassicSimilarity], result of:
           0.032253806 = score(doc=3980,freq=8.0), product of:
             0.075365186 = queryWeight, product of:
               2.2497027 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01383759 = queryNorm
             0.4279669 = fieldWeight in 3980, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3980)
         0.14960366 = weight(abstract_txt:task in 3980) [ClassicSimilarity], result of:
           0.14960366 = score(doc=3980,freq=8.0), product of:
             0.17231409 = queryWeight, product of:
               2.5355017 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.01383759 = queryNorm
             0.86820334 = fieldWeight in 3980, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0625 = fieldNorm(doc=3980)
         0.115882576 = weight(abstract_txt:situations in 3980) [ClassicSimilarity], result of:
           0.115882576 = score(doc=3980,freq=1.0), product of:
             0.29067078 = queryWeight, product of:
               3.2930944 = boost
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.01383759 = queryNorm
             0.39867294 = fieldWeight in 3980, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.0625 = fieldNorm(doc=3980)
         0.3539172 = weight(abstract_txt:simulated in 3980) [ClassicSimilarity], result of:
           0.3539172 = score(doc=3980,freq=1.0), product of:
             0.71564406 = queryWeight, product of:
               6.536 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.01383759 = queryNorm
             0.4945436 = fieldWeight in 3980, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0625 = fieldNorm(doc=3980)
       0.36 = coord(9/25)
   

4. Hansen, P.; Karlgren, J.: Effects of foreign language and task scenario on relevance assessment (2005) 0.28

   0.28476897 = sum of:
     0.28476897 = product of:
       0.6472022 = sum of:
         0.01774572 = weight(abstract_txt:whether in 4393) [ClassicSimilarity], result of:
           0.01774572 = score(doc=4393,freq=1.0), product of:
             0.06700898 = queryWeight, product of:
               4.8425326 = idf(docFreq=947, maxDocs=44218)
               0.01383759 = queryNorm
             0.264826 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8425326 = idf(docFreq=947, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.017146368 = weight(abstract_txt:results in 4393) [ClassicSimilarity], result of:
           0.017146368 = score(doc=4393,freq=3.0), product of:
             0.051980685 = queryWeight, product of:
               1.0786986 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01383759 = queryNorm
             0.32986036 = fieldWeight in 4393, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.026785078 = weight(abstract_txt:interactive in 4393) [ClassicSimilarity], result of:
           0.026785078 = score(doc=4393,freq=1.0), product of:
             0.08817237 = queryWeight, product of:
               1.1470959 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.01383759 = queryNorm
             0.30378085 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.03686811 = weight(abstract_txt:experimental in 4393) [ClassicSimilarity], result of:
           0.03686811 = score(doc=4393,freq=1.0), product of:
             0.124892086 = queryWeight, product of:
               1.6720396 = boost
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.01383759 = queryNorm
             0.29519972 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.015516601 = weight(abstract_txt:systems in 4393) [ClassicSimilarity], result of:
           0.015516601 = score(doc=4393,freq=1.0), product of:
             0.083160095 = queryWeight, product of:
               1.7614121 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.01383759 = queryNorm
             0.1865871 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.042684995 = weight(abstract_txt:work in 4393) [ClassicSimilarity], result of:
           0.042684995 = score(doc=4393,freq=4.0), product of:
             0.102852315 = queryWeight, product of:
               1.9588921 = boost
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.01383759 = queryNorm
             0.41501248 = fieldWeight in 4393, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.040170263 = weight(abstract_txt:test in 4393) [ClassicSimilarity], result of:
           0.040170263 = score(doc=4393,freq=1.0), product of:
             0.14555162 = queryWeight, product of:
               2.0842845 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.01383759 = queryNorm
             0.27598637 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.014111039 = weight(abstract_txt:information in 4393) [ClassicSimilarity], result of:
           0.014111039 = score(doc=4393,freq=2.0), product of:
             0.075365186 = queryWeight, product of:
               2.2497027 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01383759 = queryNorm
             0.18723552 = fieldWeight in 4393, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.033933938 = weight(abstract_txt:needs in 4393) [ClassicSimilarity], result of:
           0.033933938 = score(doc=4393,freq=1.0), product of:
             0.14011139 = queryWeight, product of:
               2.286337 = boost
               4.428664 = idf(docFreq=1433, maxDocs=44218)
               0.01383759 = queryNorm
             0.24219257 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.428664 = idf(docFreq=1433, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.09256255 = weight(abstract_txt:task in 4393) [ClassicSimilarity], result of:
           0.09256255 = score(doc=4393,freq=4.0), product of:
             0.17231409 = queryWeight, product of:
               2.5355017 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.01383759 = queryNorm
             0.5371734 = fieldWeight in 4393, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
         0.30967754 = weight(abstract_txt:simulated in 4393) [ClassicSimilarity], result of:
           0.30967754 = score(doc=4393,freq=1.0), product of:
             0.71564406 = queryWeight, product of:
               6.536 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.01383759 = queryNorm
             0.43272567 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4393)
       0.44 = coord(11/25)
   

5. Ruthven, T.; Lalmas, M.; Rijsbergen, K.van: Incorporating user research behavior into relevance feedback (2003) 0.24

   0.23812412 = sum of:
     0.23812412 = product of:
       0.7441379 = sum of:
         0.030611515 = weight(abstract_txt:interactive in 5169) [ClassicSimilarity], result of:
           0.030611515 = score(doc=5169,freq=1.0), product of:
             0.08817237 = queryWeight, product of:
               1.1470959 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.01383759 = queryNorm
             0.3471781 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.07297993 = weight(abstract_txt:experimental in 5169) [ClassicSimilarity], result of:
           0.07297993 = score(doc=5169,freq=3.0), product of:
             0.124892086 = queryWeight, product of:
               1.6720396 = boost
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.01383759 = queryNorm
             0.5843439 = fieldWeight in 5169, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.017733257 = weight(abstract_txt:systems in 5169) [ClassicSimilarity], result of:
           0.017733257 = score(doc=5169,freq=1.0), product of:
             0.083160095 = queryWeight, product of:
               1.7614121 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.01383759 = queryNorm
             0.2132424 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.024391424 = weight(abstract_txt:work in 5169) [ClassicSimilarity], result of:
           0.024391424 = score(doc=5169,freq=1.0), product of:
             0.102852315 = queryWeight, product of:
               1.9588921 = boost
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.01383759 = queryNorm
             0.23714998 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.016126903 = weight(abstract_txt:information in 5169) [ClassicSimilarity], result of:
           0.016126903 = score(doc=5169,freq=2.0), product of:
             0.075365186 = queryWeight, product of:
               2.2497027 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01383759 = queryNorm
             0.21398345 = fieldWeight in 5169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.1638827 = weight(abstract_txt:situations in 5169) [ClassicSimilarity], result of:
           0.1638827 = score(doc=5169,freq=2.0), product of:
             0.29067078 = queryWeight, product of:
               3.2930944 = boost
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.01383759 = queryNorm
             0.5638087 = fieldWeight in 5169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.064494945 = weight(abstract_txt:evaluation in 5169) [ClassicSimilarity], result of:
           0.064494945 = score(doc=5169,freq=1.0), product of:
             0.2300275 = queryWeight, product of:
               3.705556 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.01383759 = queryNorm
             0.2803793 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.3539172 = weight(abstract_txt:simulated in 5169) [ClassicSimilarity], result of:
           0.3539172 = score(doc=5169,freq=1.0), product of:
             0.71564406 = queryWeight, product of:
               6.536 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.01383759 = queryNorm
             0.4945436 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
       0.32 = coord(8/25)