Document (#39879)

Author

Borlund, P.

Title

¬A study of the use of simulated work task situations in interactive information retrieval evaluations : a meta-evaluation

Source

Journal of documentation. 72(2016) no.3, S.394-413

Year

2016

Abstract

Purpose - The purpose of this paper is to report a study of how the test instrument of a simulated work task situation is used in empirical evaluations of interactive information retrieval (IIR) and reported in the research literature. In particular, the author is interested to learn whether the requirements of how to employ simulated work task situations are followed, and whether these requirements call for further highlighting and refinement. Design/methodology/approach - In order to study how simulated work task situations are used, the research literature in question is identified. This is done partly via citation analysis by use of Web of Science®, and partly by systematic search of online repositories. On this basis, 67 individual publications were identified and they constitute the sample of analysis. Findings - The analysis reveals a need for clarifications of how to use simulated work task situations in IIR evaluations. In particular, with respect to the design and creation of realistic simulated work task situations. There is a lack of tailoring of the simulated work task situations to the test participants. Likewise, the requirement to include the test participants' personal information needs is neglected. Further, there is a need to add and emphasise a requirement to depict the used simulated work task situations when reporting the IIR studies. Research limitations/implications - Insight about the use of simulated work task situations has implications for test design of IIR studies and hence the knowledge base generated on the basis of such studies. Originality/value - Simulated work task situations are widely used in IIR studies, and the present study is the first comprehensive study of the intended and unintended use of this test instrument since its introduction in the late 1990's. The paper addresses the need to carefully design and tailor simulated work task situations to suit the test participants in order to obtain the intended authentic and realistic IIR under study.

Content

Vgl.: http://dx.doi.org/10.1108/JD-06-2015-0068.

Theme

Retrievalstudien

Similar documents (author)

1. Borlund, P.: ¬The IIR evaluation model : a framework for evaluation of interactive information retrieval systems (2003) 5.57

   5.568259 = sum of:
     5.568259 = weight(author_txt:borlund in 1920) [ClassicSimilarity], result of:
       5.568259 = fieldWeight in 1920, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.909214 = idf(docFreq=15, maxDocs=43556)
         0.625 = fieldNorm(doc=1920)
   

2. Borlund, P.: ¬The concept of relevance in IR (2003) 5.57

   5.568259 = sum of:
     5.568259 = weight(author_txt:borlund in 2796) [ClassicSimilarity], result of:
       5.568259 = fieldWeight in 2796, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.909214 = idf(docFreq=15, maxDocs=43556)
         0.625 = fieldNorm(doc=2796)
   

3. Borlund, P.: Evaluation of interactive information retrieval systems (2000) 5.57

   5.568259 = sum of:
     5.568259 = weight(author_txt:borlund in 3554) [ClassicSimilarity], result of:
       5.568259 = fieldWeight in 3554, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.909214 = idf(docFreq=15, maxDocs=43556)
         0.625 = fieldNorm(doc=3554)
   

4. Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems (2000) 5.57

   5.568259 = sum of:
     5.568259 = weight(author_txt:borlund in 547) [ClassicSimilarity], result of:
       5.568259 = fieldWeight in 547, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.909214 = idf(docFreq=15, maxDocs=43556)
         0.625 = fieldNorm(doc=547)
   

5. Borlund, P.; Ingwersen, P.: ¬The development of a method for the evaluation of interactive information retrieval systems (1997) 4.45

   4.454607 = sum of:
     4.454607 = weight(author_txt:borlund in 536) [ClassicSimilarity], result of:
       4.454607 = fieldWeight in 536, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.909214 = idf(docFreq=15, maxDocs=43556)
         0.5 = fieldNorm(doc=536)
   

Similar documents (content)

1. Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems (2000) 0.76

   0.7561324 = sum of:
     0.7561324 = product of:
       1.7184827 = sum of:
         0.01876011 = weight(abstract_txt:whether in 547) [ClassicSimilarity], result of:
           0.01876011 = score(doc=547,freq=2.0), product of:
             0.049982034 = queryWeight, product of:
               1.0144488 = boost
               4.853091 = idf(docFreq=923, maxDocs=43556)
               0.010152322 = queryNorm
             0.37533706 = fieldWeight in 547, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.853091 = idf(docFreq=923, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.0057504815 = weight(abstract_txt:this in 547) [ClassicSimilarity], result of:
           0.0057504815 = score(doc=547,freq=3.0), product of:
             0.02500956 = queryWeight, product of:
               1.014825 = boost
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.010152322 = queryNorm
             0.22993134 = fieldWeight in 547, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.019893069 = weight(abstract_txt:interactive in 547) [ClassicSimilarity], result of:
           0.019893069 = score(doc=547,freq=1.0), product of:
             0.06548394 = queryWeight, product of:
               1.1611559 = boost
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.010152322 = queryNorm
             0.30378544 = fieldWeight in 547, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.02491873 = weight(abstract_txt:intended in 547) [ClassicSimilarity], result of:
           0.02491873 = score(doc=547,freq=1.0), product of:
             0.07609409 = queryWeight, product of:
               1.2516953 = boost
               5.9880705 = idf(docFreq=296, maxDocs=43556)
               0.010152322 = queryNorm
             0.3274726 = fieldWeight in 547, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9880705 = idf(docFreq=296, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.018082948 = weight(abstract_txt:need in 547) [ClassicSimilarity], result of:
           0.018082948 = score(doc=547,freq=2.0), product of:
             0.055829905 = queryWeight, product of:
               1.3131133 = boost
               4.1879287 = idf(docFreq=1796, maxDocs=43556)
               0.010152322 = queryNorm
             0.32389358 = fieldWeight in 547, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1879287 = idf(docFreq=1796, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.050363127 = weight(abstract_txt:realistic in 547) [ClassicSimilarity], result of:
           0.050363127 = score(doc=547,freq=1.0), product of:
             0.12163973 = queryWeight, product of:
               1.5825624 = boost
               7.570929 = idf(docFreq=60, maxDocs=43556)
               0.010152322 = queryNorm
             0.41403517 = fieldWeight in 547, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.570929 = idf(docFreq=60, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.0898795 = weight(abstract_txt:test in 547) [ClassicSimilarity], result of:
           0.0898795 = score(doc=547,freq=4.0), product of:
             0.16260272 = queryWeight, product of:
               3.1691856 = boost
               5.0537615 = idf(docFreq=755, maxDocs=43556)
               0.010152322 = queryNorm
             0.5527552 = fieldWeight in 547, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.0537615 = idf(docFreq=755, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.07896886 = weight(abstract_txt:work in 547) [ClassicSimilarity], result of:
           0.07896886 = score(doc=547,freq=5.0), product of:
             0.1694735 = queryWeight, product of:
               4.38082 = boost
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.010152322 = queryNorm
             0.46596584 = fieldWeight in 547, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.17000787 = weight(abstract_txt:task in 547) [ClassicSimilarity], result of:
           0.17000787 = score(doc=547,freq=5.0), product of:
             0.28255993 = queryWeight, product of:
               5.6566563 = boost
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.010152322 = queryNorm
             0.60167015 = fieldWeight in 547, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.336725 = weight(abstract_txt:situations in 547) [ClassicSimilarity], result of:
           0.336725 = score(doc=547,freq=5.0), product of:
             0.43170184 = queryWeight, product of:
               6.666534 = boost
               6.3784976 = idf(docFreq=200, maxDocs=43556)
               0.010152322 = queryNorm
             0.77999437 = fieldWeight in 547, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.3784976 = idf(docFreq=200, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
         0.905133 = weight(abstract_txt:simulated in 547) [ClassicSimilarity], result of:
           0.905133 = score(doc=547,freq=8.0), product of:
             0.7366019 = queryWeight, product of:
               9.133157 = boost
               7.9441333 = idf(docFreq=41, maxDocs=43556)
               0.010152322 = queryNorm
             1.2287954 = fieldWeight in 547, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               7.9441333 = idf(docFreq=41, maxDocs=43556)
               0.0546875 = fieldNorm(doc=547)
       0.44 = coord(11/25)
   

2. Li, Y.; Belkin, N.J.: ¬An exploration of the relationships between work task and interactive information search behavior (2010) 0.32

   0.3225459 = sum of:
     0.3225459 = product of:
       1.0079559 = sum of:
         0.005365998 = weight(abstract_txt:this in 978) [ClassicSimilarity], result of:
           0.005365998 = score(doc=978,freq=2.0), product of:
             0.02500956 = queryWeight, product of:
               1.014825 = boost
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.010152322 = queryNorm
             0.21455789 = fieldWeight in 978, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.0625 = fieldNorm(doc=978)
         0.032152053 = weight(abstract_txt:interactive in 978) [ClassicSimilarity], result of:
           0.032152053 = score(doc=978,freq=2.0), product of:
             0.06548394 = queryWeight, product of:
               1.1611559 = boost
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.010152322 = queryNorm
             0.49099138 = fieldWeight in 978, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.0625 = fieldNorm(doc=978)
         0.031094044 = weight(abstract_txt:participants in 978) [ClassicSimilarity], result of:
           0.031094044 = score(doc=978,freq=1.0), product of:
             0.09236078 = queryWeight, product of:
               1.6889336 = boost
               5.3865366 = idf(docFreq=541, maxDocs=43556)
               0.010152322 = queryNorm
             0.33665854 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3865366 = idf(docFreq=541, maxDocs=43556)
               0.0625 = fieldNorm(doc=978)
         0.028115824 = weight(abstract_txt:study in 978) [ClassicSimilarity], result of:
           0.028115824 = score(doc=978,freq=3.0), product of:
             0.07544658 = queryWeight, product of:
               2.158756 = boost
               3.4424734 = idf(docFreq=3786, maxDocs=43556)
               0.010152322 = queryNorm
             0.37265867 = fieldWeight in 978, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4424734 = idf(docFreq=3786, maxDocs=43556)
               0.0625 = fieldNorm(doc=978)
         0.12763295 = weight(abstract_txt:work in 978) [ClassicSimilarity], result of:
           0.12763295 = score(doc=978,freq=10.0), product of:
             0.1694735 = queryWeight, product of:
               4.38082 = boost
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.010152322 = queryNorm
             0.7531145 = fieldWeight in 978, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.0625 = fieldNorm(doc=978)
         0.24576554 = weight(abstract_txt:task in 978) [ClassicSimilarity], result of:
           0.24576554 = score(doc=978,freq=8.0), product of:
             0.28255993 = queryWeight, product of:
               5.6566563 = boost
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.010152322 = queryNorm
             0.869782 = fieldWeight in 978, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.0625 = fieldNorm(doc=978)
         0.17210057 = weight(abstract_txt:situations in 978) [ClassicSimilarity], result of:
           0.17210057 = score(doc=978,freq=1.0), product of:
             0.43170184 = queryWeight, product of:
               6.666534 = boost
               6.3784976 = idf(docFreq=200, maxDocs=43556)
               0.010152322 = queryNorm
             0.3986561 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3784976 = idf(docFreq=200, maxDocs=43556)
               0.0625 = fieldNorm(doc=978)
         0.36572897 = weight(abstract_txt:simulated in 978) [ClassicSimilarity], result of:
           0.36572897 = score(doc=978,freq=1.0), product of:
             0.7366019 = queryWeight, product of:
               9.133157 = boost
               7.9441333 = idf(docFreq=41, maxDocs=43556)
               0.010152322 = queryNorm
             0.49650833 = fieldWeight in 978, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9441333 = idf(docFreq=41, maxDocs=43556)
               0.0625 = fieldNorm(doc=978)
       0.32 = coord(8/25)
   

3. Hansen, P.; Karlgren, J.: Effects of foreign language and task scenario on relevance assessment (2005) 0.30

   0.29706722 = sum of:
     0.29706722 = product of:
       0.6751528 = sum of:
         0.0056473874 = weight(abstract_txt:research in 391) [ClassicSimilarity], result of:
           0.0056473874 = score(doc=391,freq=1.0), product of:
             0.032378927 = queryWeight, product of:
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.010152322 = queryNorm
             0.17441551 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.013265401 = weight(abstract_txt:whether in 391) [ClassicSimilarity], result of:
           0.013265401 = score(doc=391,freq=1.0), product of:
             0.049982034 = queryWeight, product of:
               1.0144488 = boost
               4.853091 = idf(docFreq=923, maxDocs=43556)
               0.010152322 = queryNorm
             0.2654034 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.853091 = idf(docFreq=923, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.0057504815 = weight(abstract_txt:this in 391) [ClassicSimilarity], result of:
           0.0057504815 = score(doc=391,freq=3.0), product of:
             0.02500956 = queryWeight, product of:
               1.014825 = boost
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.010152322 = queryNorm
             0.22993134 = fieldWeight in 391, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.019893069 = weight(abstract_txt:interactive in 391) [ClassicSimilarity], result of:
           0.019893069 = score(doc=391,freq=1.0), product of:
             0.06548394 = queryWeight, product of:
               1.1611559 = boost
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.010152322 = queryNorm
             0.30378544 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.008851854 = weight(abstract_txt:used in 391) [ClassicSimilarity], result of:
           0.008851854 = score(doc=391,freq=1.0), product of:
             0.048087604 = queryWeight, product of:
               1.4071964 = boost
               3.3659916 = idf(docFreq=4087, maxDocs=43556)
               0.010152322 = queryNorm
             0.18407767 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3659916 = idf(docFreq=4087, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.01989684 = weight(abstract_txt:design in 391) [ClassicSimilarity], result of:
           0.01989684 = score(doc=391,freq=2.0), product of:
             0.06549222 = queryWeight, product of:
               1.6422262 = boost
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.010152322 = queryNorm
             0.30380464 = fieldWeight in 391, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.014203593 = weight(abstract_txt:study in 391) [ClassicSimilarity], result of:
           0.014203593 = score(doc=391,freq=1.0), product of:
             0.07544658 = queryWeight, product of:
               2.158756 = boost
               3.4424734 = idf(docFreq=3786, maxDocs=43556)
               0.010152322 = queryNorm
             0.18826026 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4424734 = idf(docFreq=3786, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.04493975 = weight(abstract_txt:test in 391) [ClassicSimilarity], result of:
           0.04493975 = score(doc=391,freq=1.0), product of:
             0.16260272 = queryWeight, product of:
               3.1691856 = boost
               5.0537615 = idf(docFreq=755, maxDocs=43556)
               0.010152322 = queryNorm
             0.2763776 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0537615 = idf(docFreq=755, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.0706319 = weight(abstract_txt:work in 391) [ClassicSimilarity], result of:
           0.0706319 = score(doc=391,freq=4.0), product of:
             0.1694735 = queryWeight, product of:
               4.38082 = boost
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.010152322 = queryNorm
             0.4167725 = fieldWeight in 391, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.15205966 = weight(abstract_txt:task in 391) [ClassicSimilarity], result of:
           0.15205966 = score(doc=391,freq=4.0), product of:
             0.28255993 = queryWeight, product of:
               5.6566563 = boost
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.010152322 = queryNorm
             0.53815013 = fieldWeight in 391, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
         0.32001284 = weight(abstract_txt:simulated in 391) [ClassicSimilarity], result of:
           0.32001284 = score(doc=391,freq=1.0), product of:
             0.7366019 = queryWeight, product of:
               9.133157 = boost
               7.9441333 = idf(docFreq=41, maxDocs=43556)
               0.010152322 = queryNorm
             0.4344448 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9441333 = idf(docFreq=41, maxDocs=43556)
               0.0546875 = fieldNorm(doc=391)
       0.44 = coord(11/25)
   

4. Tombros, A.; Ruthven, I.; Jose, J.M.: How users assess Web pages for information seeking (2005) 0.29

   0.28987196 = sum of:
     0.28987196 = product of:
       0.80519986 = sum of:
         0.006707498 = weight(abstract_txt:this in 253) [ClassicSimilarity], result of:
           0.006707498 = score(doc=253,freq=2.0), product of:
             0.02500956 = queryWeight, product of:
               1.014825 = boost
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.010152322 = queryNorm
             0.26819736 = fieldWeight in 253, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.078125 = fieldNorm(doc=253)
         0.020016966 = weight(abstract_txt:identified in 253) [ClassicSimilarity], result of:
           0.020016966 = score(doc=253,freq=1.0), product of:
             0.05183994 = queryWeight, product of:
               1.033131 = boost
               4.9424663 = idf(docFreq=844, maxDocs=43556)
               0.010152322 = queryNorm
             0.38613018 = fieldWeight in 253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9424663 = idf(docFreq=844, maxDocs=43556)
               0.078125 = fieldNorm(doc=253)
         0.021902658 = weight(abstract_txt:used in 253) [ClassicSimilarity], result of:
           0.021902658 = score(doc=253,freq=3.0), product of:
             0.048087604 = queryWeight, product of:
               1.4071964 = boost
               3.3659916 = idf(docFreq=4087, maxDocs=43556)
               0.010152322 = queryNorm
             0.4554741 = fieldWeight in 253, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3659916 = idf(docFreq=4087, maxDocs=43556)
               0.078125 = fieldNorm(doc=253)
         0.020098843 = weight(abstract_txt:design in 253) [ClassicSimilarity], result of:
           0.020098843 = score(doc=253,freq=1.0), product of:
             0.06549222 = queryWeight, product of:
               1.6422262 = boost
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.010152322 = queryNorm
             0.306889 = fieldWeight in 253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.078125 = fieldNorm(doc=253)
         0.054967027 = weight(abstract_txt:participants in 253) [ClassicSimilarity], result of:
           0.054967027 = score(doc=253,freq=2.0), product of:
             0.09236078 = queryWeight, product of:
               1.6889336 = boost
               5.3865366 = idf(docFreq=541, maxDocs=43556)
               0.010152322 = queryNorm
             0.59513384 = fieldWeight in 253, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3865366 = idf(docFreq=541, maxDocs=43556)
               0.078125 = fieldNorm(doc=253)
         0.02029085 = weight(abstract_txt:study in 253) [ClassicSimilarity], result of:
           0.02029085 = score(doc=253,freq=1.0), product of:
             0.07544658 = queryWeight, product of:
               2.158756 = boost
               3.4424734 = idf(docFreq=3786, maxDocs=43556)
               0.010152322 = queryNorm
             0.26894325 = fieldWeight in 253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4424734 = idf(docFreq=3786, maxDocs=43556)
               0.078125 = fieldNorm(doc=253)
         0.050451353 = weight(abstract_txt:work in 253) [ClassicSimilarity], result of:
           0.050451353 = score(doc=253,freq=1.0), product of:
             0.1694735 = queryWeight, product of:
               4.38082 = boost
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.010152322 = queryNorm
             0.29769465 = fieldWeight in 253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.078125 = fieldNorm(doc=253)
         0.15360346 = weight(abstract_txt:task in 253) [ClassicSimilarity], result of:
           0.15360346 = score(doc=253,freq=2.0), product of:
             0.28255993 = queryWeight, product of:
               5.6566563 = boost
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.010152322 = queryNorm
             0.54361373 = fieldWeight in 253, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.078125 = fieldNorm(doc=253)
         0.4571612 = weight(abstract_txt:simulated in 253) [ClassicSimilarity], result of:
           0.4571612 = score(doc=253,freq=1.0), product of:
             0.7366019 = queryWeight, product of:
               9.133157 = boost
               7.9441333 = idf(docFreq=41, maxDocs=43556)
               0.010152322 = queryNorm
             0.6206354 = fieldWeight in 253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9441333 = idf(docFreq=41, maxDocs=43556)
               0.078125 = fieldNorm(doc=253)
       0.36 = coord(9/25)
   

5. Li, Y.; Belkin, N.J.: ¬A faceted approach to conceptualizing tasks in information seeking (2008) 0.25

   0.24778442 = sum of:
     0.24778442 = product of:
       0.5631464 = sum of:
         0.006571979 = weight(abstract_txt:this in 4440) [ClassicSimilarity], result of:
           0.006571979 = score(doc=4440,freq=3.0), product of:
             0.02500956 = queryWeight, product of:
               1.014825 = boost
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.010152322 = queryNorm
             0.26277867 = fieldWeight in 4440, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4274454 = idf(docFreq=10449, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.016013572 = weight(abstract_txt:identified in 4440) [ClassicSimilarity], result of:
           0.016013572 = score(doc=4440,freq=1.0), product of:
             0.05183994 = queryWeight, product of:
               1.033131 = boost
               4.9424663 = idf(docFreq=844, maxDocs=43556)
               0.010152322 = queryNorm
             0.30890414 = fieldWeight in 4440, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9424663 = idf(docFreq=844, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.018488867 = weight(abstract_txt:requirements in 4440) [ClassicSimilarity], result of:
           0.018488867 = score(doc=4440,freq=1.0), product of:
             0.057053097 = queryWeight, product of:
               1.0838339 = boost
               5.1850276 = idf(docFreq=662, maxDocs=43556)
               0.010152322 = queryNorm
             0.32406422 = fieldWeight in 4440, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1850276 = idf(docFreq=662, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.009821992 = weight(abstract_txt:analysis in 4440) [ClassicSimilarity], result of:
           0.009821992 = score(doc=4440,freq=1.0), product of:
             0.042838655 = queryWeight, product of:
               1.1502353 = boost
               3.6684597 = idf(docFreq=3020, maxDocs=43556)
               0.010152322 = queryNorm
             0.22927873 = fieldWeight in 4440, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6684597 = idf(docFreq=3020, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.022734934 = weight(abstract_txt:interactive in 4440) [ClassicSimilarity], result of:
           0.022734934 = score(doc=4440,freq=1.0), product of:
             0.06548394 = queryWeight, product of:
               1.1611559 = boost
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.010152322 = queryNorm
             0.34718335 = fieldWeight in 4440, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5549335 = idf(docFreq=457, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.010116405 = weight(abstract_txt:used in 4440) [ClassicSimilarity], result of:
           0.010116405 = score(doc=4440,freq=1.0), product of:
             0.048087604 = queryWeight, product of:
               1.4071964 = boost
               3.3659916 = idf(docFreq=4087, maxDocs=43556)
               0.010152322 = queryNorm
             0.21037447 = fieldWeight in 4440, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3659916 = idf(docFreq=4087, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.016079074 = weight(abstract_txt:design in 4440) [ClassicSimilarity], result of:
           0.016079074 = score(doc=4440,freq=1.0), product of:
             0.06549222 = queryWeight, product of:
               1.6422262 = boost
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.010152322 = queryNorm
             0.2455112 = fieldWeight in 4440, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9281793 = idf(docFreq=2329, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.0296145 = weight(abstract_txt:studies in 4440) [ClassicSimilarity], result of:
           0.0296145 = score(doc=4440,freq=2.0), product of:
             0.07810436 = queryWeight, product of:
               1.7933943 = boost
               4.289771 = idf(docFreq=1622, maxDocs=43556)
               0.010152322 = queryNorm
             0.37916577 = fieldWeight in 4440, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.289771 = idf(docFreq=1622, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.016232679 = weight(abstract_txt:study in 4440) [ClassicSimilarity], result of:
           0.016232679 = score(doc=4440,freq=1.0), product of:
             0.07544658 = queryWeight, product of:
               2.158756 = boost
               3.4424734 = idf(docFreq=3786, maxDocs=43556)
               0.010152322 = queryNorm
             0.21515459 = fieldWeight in 4440, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4424734 = idf(docFreq=3786, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.06990745 = weight(abstract_txt:work in 4440) [ClassicSimilarity], result of:
           0.06990745 = score(doc=4440,freq=3.0), product of:
             0.1694735 = queryWeight, product of:
               4.38082 = boost
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.010152322 = queryNorm
             0.41249782 = fieldWeight in 4440, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.8104916 = idf(docFreq=2620, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
         0.34756497 = weight(abstract_txt:task in 4440) [ClassicSimilarity], result of:
           0.34756497 = score(doc=4440,freq=16.0), product of:
             0.28255993 = queryWeight, product of:
               5.6566563 = boost
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.010152322 = queryNorm
             1.2300575 = fieldWeight in 4440, product of:
               4.0 = tf(freq=16.0), with freq of:
                 16.0 = termFreq=16.0
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.0625 = fieldNorm(doc=4440)
       0.44 = coord(11/25)