Document (#37047)

Author

Vakkari, P.
Huuskonen, S.

Title

Search effort degrades search output but improves task outcome

Source

Journal of the American Society for Information Science and Technology. 63(2012) no.4, S.657-670

Year

2012

Abstract

We analyzed how effort in searching is associated with search output and task outcome. In a field study, we examined how students' search effort for an assigned learning task was associated with precision and relative recall, and how this was associated to the quality of learning outcome. The study subjects were 41 medical students writing essays for a class in medicine. Searching in Medline was part of their assignment. The data comprised students' search logs in Medline, their assessment of the usefulness of references retrieved, a questionnaire concerning the search process, and evaluation scores of the essays given by the teachers. Pearson correlation was calculated for answering the research questions. Finally, a path model for predicting task outcome was built. We found that effort in the search process degraded precision but improved task outcome. There were two major mechanisms reducing precision while enhancing task outcome. Effort in expanding Medical Subject Heading (MeSH) terms within search sessions and effort in assessing and exploring documents in the result list between the sessions degraded precision, but led to better task outcome. Thus, human effort compensated bad retrieval results on the way to good task outcome. Findings suggest that traditional effectiveness measures in information retrieval should be complemented with evaluation measures for search process and outcome.

Theme

Retrievalstudien
Suchtaktik

Similar documents (author)

1. Vakkari, P.: Information seeking in context : a challenging metatheory (1997) 5.16

   5.164313 = sum of:
     5.164313 = weight(author_txt:vakkari in 302) [ClassicSimilarity], result of:
       5.164313 = fieldWeight in 302, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.2629 = idf(docFreq=30, maxDocs=44218)
         0.625 = fieldNorm(doc=302)
   

2. Vakkari, P.: Task complexity, information types, search strategies and relevance : integrating studies on information retrieval and seeking (1999) 5.16

   5.164313 = sum of:
     5.164313 = weight(author_txt:vakkari in 299) [ClassicSimilarity], result of:
       5.164313 = fieldWeight in 299, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.2629 = idf(docFreq=30, maxDocs=44218)
         0.625 = fieldNorm(doc=299)
   

3. Vakkari, P.: Task-based information searching (2002) 5.16

   5.164313 = sum of:
     5.164313 = weight(author_txt:vakkari in 4288) [ClassicSimilarity], result of:
       5.164313 = fieldWeight in 4288, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.2629 = idf(docFreq=30, maxDocs=44218)
         0.625 = fieldNorm(doc=4288)
   

4. Vakkari, P.: ¬A theory of the task-based information retrieval process : a summary and generalisation of a longitudinal study (2001) 5.16

   5.164313 = sum of:
     5.164313 = weight(author_txt:vakkari in 4493) [ClassicSimilarity], result of:
       5.164313 = fieldWeight in 4493, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.2629 = idf(docFreq=30, maxDocs=44218)
         0.625 = fieldNorm(doc=4493)
   

5. Vakkari, P.: Perceived influence of the use of electronic information resources on scholarly work and publication productivity (2008) 5.16

   5.164313 = sum of:
     5.164313 = weight(author_txt:vakkari in 1380) [ClassicSimilarity], result of:
       5.164313 = fieldWeight in 1380, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.2629 = idf(docFreq=30, maxDocs=44218)
         0.625 = fieldNorm(doc=1380)
   

Similar documents (content)

1. Huuskonen, S.; Vakkari, P.: Students' search process and outcome in Medline in writing an essay for a class on evidence-based medicine (2008) 0.76

   0.75696784 = sum of:
     0.75696784 = product of:
       1.1827623 = sum of:
         0.016806476 = weight(abstract_txt:were in 1891) [ClassicSimilarity], result of:
           0.016806476 = score(doc=1891,freq=4.0), product of:
             0.041868266 = queryWeight, product of:
               1.006853 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0113304015 = queryNorm
             0.40141323 = fieldWeight in 1891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.007965778 = weight(abstract_txt:with in 1891) [ClassicSimilarity], result of:
           0.007965778 = score(doc=1891,freq=4.0), product of:
             0.029135093 = queryWeight, product of:
               1.0286732 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0113304015 = queryNorm
             0.27340835 = fieldWeight in 1891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.01891082 = weight(abstract_txt:searching in 1891) [ClassicSimilarity], result of:
           0.01891082 = score(doc=1891,freq=2.0), product of:
             0.05706688 = queryWeight, product of:
               1.1754811 = boost
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.0113304015 = queryNorm
             0.33137995 = fieldWeight in 1891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.055992067 = weight(abstract_txt:pearson in 1891) [ClassicSimilarity], result of:
           0.055992067 = score(doc=1891,freq=1.0), product of:
             0.11766886 = queryWeight, product of:
               1.1935465 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0113304015 = queryNorm
             0.47584438 = fieldWeight in 1891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.021703938 = weight(abstract_txt:evaluation in 1891) [ClassicSimilarity], result of:
           0.021703938 = score(doc=1891,freq=2.0), product of:
             0.06255609 = queryWeight, product of:
               1.2307175 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0113304015 = queryNorm
             0.34695166 = fieldWeight in 1891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.038604178 = weight(abstract_txt:measures in 1891) [ClassicSimilarity], result of:
           0.038604178 = score(doc=1891,freq=2.0), product of:
             0.09183328 = queryWeight, product of:
               1.4911579 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0113304015 = queryNorm
             0.42037243 = fieldWeight in 1891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.047167722 = weight(abstract_txt:medical in 1891) [ClassicSimilarity], result of:
           0.047167722 = score(doc=1891,freq=2.0), product of:
             0.10495597 = queryWeight, product of:
               1.5941426 = boost
               5.8107834 = idf(docFreq=359, maxDocs=44218)
               0.0113304015 = queryNorm
             0.44940484 = fieldWeight in 1891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8107834 = idf(docFreq=359, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.033902954 = weight(abstract_txt:process in 1891) [ClassicSimilarity], result of:
           0.033902954 = score(doc=1891,freq=4.0), product of:
             0.07651666 = queryWeight, product of:
               1.6670445 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0113304015 = queryNorm
             0.44307938 = fieldWeight in 1891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.09254025 = weight(abstract_txt:medline in 1891) [ClassicSimilarity], result of:
           0.09254025 = score(doc=1891,freq=3.0), product of:
             0.14369243 = queryWeight, product of:
               1.865265 = boost
               6.7990475 = idf(docFreq=133, maxDocs=44218)
               0.0113304015 = queryNorm
             0.64401615 = fieldWeight in 1891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7990475 = idf(docFreq=133, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.07534744 = weight(abstract_txt:students in 1891) [ClassicSimilarity], result of:
           0.07534744 = score(doc=1891,freq=6.0), product of:
             0.11383597 = queryWeight, product of:
               2.0333352 = boost
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.0113304015 = queryNorm
             0.6618948 = fieldWeight in 1891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.07496102 = weight(abstract_txt:associated in 1891) [ClassicSimilarity], result of:
           0.07496102 = score(doc=1891,freq=5.0), product of:
             0.12055483 = queryWeight, product of:
               2.092481 = boost
               5.084846 = idf(docFreq=743, maxDocs=44218)
               0.0113304015 = queryNorm
             0.62180024 = fieldWeight in 1891, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.084846 = idf(docFreq=743, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.08280557 = weight(abstract_txt:essays in 1891) [ClassicSimilarity], result of:
           0.08280557 = score(doc=1891,freq=1.0), product of:
             0.1924392 = queryWeight, product of:
               2.158591 = boost
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.0113304015 = queryNorm
             0.4302947 = fieldWeight in 1891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.14046635 = weight(abstract_txt:precision in 1891) [ClassicSimilarity], result of:
           0.14046635 = score(doc=1891,freq=6.0), product of:
             0.1897849 = queryWeight, product of:
               3.0315826 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0113304015 = queryNorm
             0.7401345 = fieldWeight in 1891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.064855784 = weight(abstract_txt:search in 1891) [ClassicSimilarity], result of:
           0.064855784 = score(doc=1891,freq=3.0), product of:
             0.18717597 = queryWeight, product of:
               4.51601 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0113304015 = queryNorm
             0.3464963 = fieldWeight in 1891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.16110356 = weight(abstract_txt:task in 1891) [ClassicSimilarity], result of:
           0.16110356 = score(doc=1891,freq=4.0), product of:
             0.2999098 = queryWeight, product of:
               5.3895054 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0113304015 = queryNorm
             0.5371734 = fieldWeight in 1891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.24962835 = weight(abstract_txt:outcome in 1891) [ClassicSimilarity], result of:
           0.24962835 = score(doc=1891,freq=1.0), product of:
             0.6630109 = queryWeight, product of:
               8.499437 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0113304015 = queryNorm
             0.37650716 = fieldWeight in 1891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
       0.64 = coord(16/25)
   

2. Vanopstal, K.; Stichele, R.Vander; Laureys, G.; Buysschaert, J.: PubMed searches by Dutch-speaking nursing students : the impact of language and system experience (2012) 0.22

   0.22028577 = sum of:
     0.22028577 = product of:
       0.55071443 = sum of:
         0.037635732 = weight(abstract_txt:mesh in 369) [ClassicSimilarity], result of:
           0.037635732 = score(doc=369,freq=1.0), product of:
             0.08260053 = queryWeight, product of:
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.0113304015 = queryNorm
             0.4556355 = fieldWeight in 369, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
         0.013581683 = weight(abstract_txt:were in 369) [ClassicSimilarity], result of:
           0.013581683 = score(doc=369,freq=2.0), product of:
             0.041868266 = queryWeight, product of:
               1.006853 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0113304015 = queryNorm
             0.32439086 = fieldWeight in 369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
         0.0064373203 = weight(abstract_txt:with in 369) [ClassicSimilarity], result of:
           0.0064373203 = score(doc=369,freq=2.0), product of:
             0.029135093 = queryWeight, product of:
               1.0286732 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0113304015 = queryNorm
             0.22094731 = fieldWeight in 369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
         0.038117275 = weight(abstract_txt:medical in 369) [ClassicSimilarity], result of:
           0.038117275 = score(doc=369,freq=1.0), product of:
             0.10495597 = queryWeight, product of:
               1.5941426 = boost
               5.8107834 = idf(docFreq=359, maxDocs=44218)
               0.0113304015 = queryNorm
             0.36317396 = fieldWeight in 369, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8107834 = idf(docFreq=359, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
         0.027397724 = weight(abstract_txt:process in 369) [ClassicSimilarity], result of:
           0.027397724 = score(doc=369,freq=2.0), product of:
             0.07651666 = queryWeight, product of:
               1.6670445 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0113304015 = queryNorm
             0.3580622 = fieldWeight in 369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
         0.06106073 = weight(abstract_txt:medline in 369) [ClassicSimilarity], result of:
           0.06106073 = score(doc=369,freq=1.0), product of:
             0.14369243 = queryWeight, product of:
               1.865265 = boost
               6.7990475 = idf(docFreq=133, maxDocs=44218)
               0.0113304015 = queryNorm
             0.42494047 = fieldWeight in 369, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7990475 = idf(docFreq=133, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
         0.04971641 = weight(abstract_txt:students in 369) [ClassicSimilarity], result of:
           0.04971641 = score(doc=369,freq=2.0), product of:
             0.11383597 = queryWeight, product of:
               2.0333352 = boost
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.0113304015 = queryNorm
             0.43673727 = fieldWeight in 369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
         0.06553731 = weight(abstract_txt:precision in 369) [ClassicSimilarity], result of:
           0.06553731 = score(doc=369,freq=1.0), product of:
             0.1897849 = queryWeight, product of:
               3.0315826 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0113304015 = queryNorm
             0.34532416 = fieldWeight in 369, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
         0.12103892 = weight(abstract_txt:search in 369) [ClassicSimilarity], result of:
           0.12103892 = score(doc=369,freq=8.0), product of:
             0.18717597 = queryWeight, product of:
               4.51601 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0113304015 = queryNorm
             0.6466584 = fieldWeight in 369, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
         0.13019134 = weight(abstract_txt:task in 369) [ClassicSimilarity], result of:
           0.13019134 = score(doc=369,freq=2.0), product of:
             0.2999098 = queryWeight, product of:
               5.3895054 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0113304015 = queryNorm
             0.43410167 = fieldWeight in 369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0625 = fieldNorm(doc=369)
       0.4 = coord(10/25)
   

3. Barsky, E.; Bar-Ilan, J.: ¬The impact of task phrasing on the choice of search keywords and on the search process and success (2012) 0.20

   0.20420566 = sum of:
     0.20420566 = product of:
       0.7293059 = sum of:
         0.013581683 = weight(abstract_txt:were in 455) [ClassicSimilarity], result of:
           0.013581683 = score(doc=455,freq=2.0), product of:
             0.041868266 = queryWeight, product of:
               1.006853 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0113304015 = queryNorm
             0.32439086 = fieldWeight in 455, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.010178297 = weight(abstract_txt:with in 455) [ClassicSimilarity], result of:
           0.010178297 = score(doc=455,freq=5.0), product of:
             0.029135093 = queryWeight, product of:
               1.0286732 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0113304015 = queryNorm
             0.34934837 = fieldWeight in 455, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.03355522 = weight(abstract_txt:process in 455) [ClassicSimilarity], result of:
           0.03355522 = score(doc=455,freq=3.0), product of:
             0.07651666 = queryWeight, product of:
               1.6670445 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0113304015 = queryNorm
             0.43853486 = fieldWeight in 455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.03831267 = weight(abstract_txt:associated in 455) [ClassicSimilarity], result of:
           0.03831267 = score(doc=455,freq=1.0), product of:
             0.12055483 = queryWeight, product of:
               2.092481 = boost
               5.084846 = idf(docFreq=743, maxDocs=44218)
               0.0113304015 = queryNorm
             0.31780288 = fieldWeight in 455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.084846 = idf(docFreq=743, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.104822785 = weight(abstract_txt:search in 455) [ClassicSimilarity], result of:
           0.104822785 = score(doc=455,freq=6.0), product of:
             0.18717597 = queryWeight, product of:
               4.51601 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0113304015 = queryNorm
             0.56002265 = fieldWeight in 455, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.24356571 = weight(abstract_txt:task in 455) [ClassicSimilarity], result of:
           0.24356571 = score(doc=455,freq=7.0), product of:
             0.2999098 = queryWeight, product of:
               5.3895054 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0113304015 = queryNorm
             0.81212986 = fieldWeight in 455, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.28528956 = weight(abstract_txt:outcome in 455) [ClassicSimilarity], result of:
           0.28528956 = score(doc=455,freq=1.0), product of:
             0.6630109 = queryWeight, product of:
               8.499437 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0113304015 = queryNorm
             0.43029392 = fieldWeight in 455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
       0.28 = coord(7/25)
   

4. Pennanen, M.; Vakkari, P.: Students' conceptual structure, search process, and outcome while preparing a research proposal : a longitudinal case study (2003) 0.19

   0.19134974 = sum of:
     0.19134974 = product of:
       0.6833919 = sum of:
         0.021474527 = weight(abstract_txt:were in 1682) [ClassicSimilarity], result of:
           0.021474527 = score(doc=1682,freq=5.0), product of:
             0.041868266 = queryWeight, product of:
               1.006853 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0113304015 = queryNorm
             0.512907 = fieldWeight in 1682, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=1682)
         0.027397724 = weight(abstract_txt:process in 1682) [ClassicSimilarity], result of:
           0.027397724 = score(doc=1682,freq=2.0), product of:
             0.07651666 = queryWeight, product of:
               1.6670445 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0113304015 = queryNorm
             0.3580622 = fieldWeight in 1682, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0625 = fieldNorm(doc=1682)
         0.082872756 = weight(abstract_txt:sessions in 1682) [ClassicSimilarity], result of:
           0.082872756 = score(doc=1682,freq=2.0), product of:
             0.13980535 = queryWeight, product of:
               1.839863 = boost
               6.7064548 = idf(docFreq=146, maxDocs=44218)
               0.0113304015 = queryNorm
             0.5927724 = fieldWeight in 1682, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.7064548 = idf(docFreq=146, maxDocs=44218)
               0.0625 = fieldNorm(doc=1682)
         0.07860855 = weight(abstract_txt:students in 1682) [ClassicSimilarity], result of:
           0.07860855 = score(doc=1682,freq=5.0), product of:
             0.11383597 = queryWeight, product of:
               2.0333352 = boost
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.0113304015 = queryNorm
             0.6905423 = fieldWeight in 1682, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.0625 = fieldNorm(doc=1682)
         0.09568967 = weight(abstract_txt:search in 1682) [ClassicSimilarity], result of:
           0.09568967 = score(doc=1682,freq=5.0), product of:
             0.18717597 = queryWeight, product of:
               4.51601 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0113304015 = queryNorm
             0.5112284 = fieldWeight in 1682, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=1682)
         0.09205918 = weight(abstract_txt:task in 1682) [ClassicSimilarity], result of:
           0.09205918 = score(doc=1682,freq=1.0), product of:
             0.2999098 = queryWeight, product of:
               5.3895054 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0113304015 = queryNorm
             0.30695623 = fieldWeight in 1682, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0625 = fieldNorm(doc=1682)
         0.28528956 = weight(abstract_txt:outcome in 1682) [ClassicSimilarity], result of:
           0.28528956 = score(doc=1682,freq=1.0), product of:
             0.6630109 = queryWeight, product of:
               8.499437 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0113304015 = queryNorm
             0.43029392 = fieldWeight in 1682, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=1682)
       0.28 = coord(7/25)
   

5. Su, L.T.: ¬The relevance of recall and precision in user evaluation (1994) 0.19

   0.18996798 = sum of:
     0.18996798 = product of:
       0.5936499 = sum of:
         0.016806476 = weight(abstract_txt:were in 6933) [ClassicSimilarity], result of:
           0.016806476 = score(doc=6933,freq=4.0), product of:
             0.041868266 = queryWeight, product of:
               1.006853 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0113304015 = queryNorm
             0.40141323 = fieldWeight in 6933, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.011948667 = weight(abstract_txt:with in 6933) [ClassicSimilarity], result of:
           0.011948667 = score(doc=6933,freq=9.0), product of:
             0.029135093 = queryWeight, product of:
               1.0286732 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0113304015 = queryNorm
             0.41011253 = fieldWeight in 6933, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.01337197 = weight(abstract_txt:searching in 6933) [ClassicSimilarity], result of:
           0.01337197 = score(doc=6933,freq=1.0), product of:
             0.05706688 = queryWeight, product of:
               1.1754811 = boost
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.0113304015 = queryNorm
             0.23432101 = fieldWeight in 6933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.026581787 = weight(abstract_txt:evaluation in 6933) [ClassicSimilarity], result of:
           0.026581787 = score(doc=6933,freq=3.0), product of:
             0.06255609 = queryWeight, product of:
               1.2307175 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0113304015 = queryNorm
             0.42492726 = fieldWeight in 6933, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.081891835 = weight(abstract_txt:measures in 6933) [ClassicSimilarity], result of:
           0.081891835 = score(doc=6933,freq=9.0), product of:
             0.09183328 = queryWeight, product of:
               1.4911579 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0113304015 = queryNorm
             0.8917446 = fieldWeight in 6933, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.14046635 = weight(abstract_txt:precision in 6933) [ClassicSimilarity], result of:
           0.14046635 = score(doc=6933,freq=6.0), product of:
             0.1897849 = queryWeight, product of:
               3.0315826 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0113304015 = queryNorm
             0.7401345 = fieldWeight in 6933, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.05295453 = weight(abstract_txt:search in 6933) [ClassicSimilarity], result of:
           0.05295453 = score(doc=6933,freq=2.0), product of:
             0.18717597 = queryWeight, product of:
               4.51601 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0113304015 = queryNorm
             0.28291306 = fieldWeight in 6933, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
         0.24962835 = weight(abstract_txt:outcome in 6933) [ClassicSimilarity], result of:
           0.24962835 = score(doc=6933,freq=1.0), product of:
             0.6630109 = queryWeight, product of:
               8.499437 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0113304015 = queryNorm
             0.37650716 = fieldWeight in 6933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6933)
       0.32 = coord(8/25)