Document (#12071)

Author

Hersh, W.
Pentecost, J.
Hickam, D.

Title

¬A task-oriented approach to information retrieval evaluation : overview and design for empirical testing

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.50-56

Year

1996

Abstract

As retrieval system become more oriented towards end-users, there is an increasing need for improved methods to evaluate their effectiveness. We performed a task-oriented assessment of 2 MEDLINE searching systems, one which promotes traditional Boolean searching on human-indexed thesaurus terms and the other natural language searching on words in the title, abstracts and indexing terms. Medical students were randomized to one of the 2 systems and given clinical questions to answer. The students were able to use each system successfully, with no significant differences in questions correctly answered, time taken, relevant articles retrieved, or user satisfaction between the systems. This approach to evaluation was successful in measuring effectiveness of system use and demonstrates that both types of systems can be used equally well with minimal training

Theme

Retrievalstudien

Similar documents (author)

1. Hersh, W.: Relevance and retrieval evaluation : perspectives from medicine (1994) 5.87

   5.871439 = sum of:
     5.871439 = weight(author_txt:hersh in 6932) [ClassicSimilarity], result of:
       5.871439 = fieldWeight in 6932, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.394302 = idf(docFreq=9, maxDocs=44218)
         0.625 = fieldNorm(doc=6932)
   

2. Hersh, R.: Reply to Martin Gardner (2001) 5.87

   5.871439 = sum of:
     5.871439 = weight(author_txt:hersh in 3571) [ClassicSimilarity], result of:
       5.871439 = fieldWeight in 3571, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.394302 = idf(docFreq=9, maxDocs=44218)
         0.625 = fieldNorm(doc=3571)
   

3. Hersh, W.R.; Hickam, D.H.: ¬A comparison of two methods for indexing and retrieval from a full-text medical database (1992) 4.70

   4.697151 = sum of:
     4.697151 = weight(author_txt:hersh in 4526) [ClassicSimilarity], result of:
       4.697151 = fieldWeight in 4526, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.394302 = idf(docFreq=9, maxDocs=44218)
         0.5 = fieldNorm(doc=4526)
   

4. Hersh, W.R.; Over, P.: Interactivity at the Text Retrieval Conference (TREC) (2001) 4.70

   4.697151 = sum of:
     4.697151 = weight(author_txt:hersh in 5486) [ClassicSimilarity], result of:
       4.697151 = fieldWeight in 5486, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.394302 = idf(docFreq=9, maxDocs=44218)
         0.5 = fieldNorm(doc=5486)
   

5. Hersh, W.R.; Hickam, D.H.: ¬An evaluation of interactive Boolean and natural language searching with an online medical textbook (1995) 4.70

   4.697151 = sum of:
     4.697151 = weight(author_txt:hersh in 2651) [ClassicSimilarity], result of:
       4.697151 = fieldWeight in 2651, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.394302 = idf(docFreq=9, maxDocs=44218)
         0.5 = fieldNorm(doc=2651)
   

Similar documents (content)

1. Hersh, W.R.; Pentecost, J.; Hickam, D.H.: ¬A task-oriented approach to retrieval system evaluation (1995) 1.96

   1.9611845 = sum of:
     1.9611845 = product of:
       2.1317222 = sum of:
         0.07985429 = weight(abstract_txt:satisfaction in 3867) [ClassicSimilarity], result of:
           0.07985429 = score(doc=3867,freq=1.0), product of:
             0.15949374 = queryWeight, product of:
               1.0246465 = boost
               6.4086204 = idf(docFreq=197, maxDocs=44218)
               0.024288742 = queryNorm
             0.5006735 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4086204 = idf(docFreq=197, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.08686543 = weight(abstract_txt:measuring in 3867) [ClassicSimilarity], result of:
           0.08686543 = score(doc=3867,freq=1.0), product of:
             0.16869783 = queryWeight, product of:
               1.0537971 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.024288742 = queryNorm
             0.5149173 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.09068862 = weight(abstract_txt:successfully in 3867) [ClassicSimilarity], result of:
           0.09068862 = score(doc=3867,freq=1.0), product of:
             0.17361212 = queryWeight, product of:
               1.0690359 = boost
               6.686252 = idf(docFreq=149, maxDocs=44218)
               0.024288742 = queryNorm
             0.5223634 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.686252 = idf(docFreq=149, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.095356174 = weight(abstract_txt:medline in 3867) [ClassicSimilarity], result of:
           0.095356174 = score(doc=3867,freq=1.0), product of:
             0.17951912 = queryWeight, product of:
               1.0870702 = boost
               6.7990475 = idf(docFreq=133, maxDocs=44218)
               0.024288742 = queryNorm
             0.5311756 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7990475 = idf(docFreq=133, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.025465444 = weight(abstract_txt:retrieval in 3867) [ClassicSimilarity], result of:
           0.025465444 = score(doc=3867,freq=1.0), product of:
             0.09379701 = queryWeight, product of:
               1.1112499 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.024288742 = queryNorm
             0.27149525 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.10642243 = weight(abstract_txt:minimal in 3867) [ClassicSimilarity], result of:
           0.10642243 = score(doc=3867,freq=1.0), product of:
             0.19315247 = queryWeight, product of:
               1.127593 = boost
               7.0524964 = idf(docFreq=103, maxDocs=44218)
               0.024288742 = queryNorm
             0.5509763 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0524964 = idf(docFreq=103, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.11206968 = weight(abstract_txt:equally in 3867) [ClassicSimilarity], result of:
           0.11206968 = score(doc=3867,freq=1.0), product of:
             0.19992645 = queryWeight, product of:
               1.1471953 = boost
               7.1750984 = idf(docFreq=91, maxDocs=44218)
               0.024288742 = queryNorm
             0.56055456 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1750984 = idf(docFreq=91, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.11638673 = weight(abstract_txt:clinical in 3867) [ClassicSimilarity], result of:
           0.11638673 = score(doc=3867,freq=1.0), product of:
             0.2050283 = queryWeight, product of:
               1.1617405 = boost
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.024288742 = queryNorm
             0.56766176 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.02999545 = weight(abstract_txt:were in 3867) [ClassicSimilarity], result of:
           0.02999545 = score(doc=3867,freq=1.0), product of:
             0.10461447 = queryWeight, product of:
               1.1735811 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.024288742 = queryNorm
             0.28672373 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.03187896 = weight(abstract_txt:approach in 3867) [ClassicSimilarity], result of:
           0.03187896 = score(doc=3867,freq=1.0), product of:
             0.10894926 = queryWeight, product of:
               1.1976485 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.024288742 = queryNorm
             0.29260373 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.13159811 = weight(abstract_txt:answered in 3867) [ClassicSimilarity], result of:
           0.13159811 = score(doc=3867,freq=1.0), product of:
             0.22252455 = queryWeight, product of:
               1.210295 = boost
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.024288742 = queryNorm
             0.5913869 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.13893554 = weight(abstract_txt:correctly in 3867) [ClassicSimilarity], result of:
           0.13893554 = score(doc=3867,freq=1.0), product of:
             0.23072097 = queryWeight, product of:
               1.2323833 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.024288742 = queryNorm
             0.60217994 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.1558038 = weight(abstract_txt:promotes in 3867) [ClassicSimilarity], result of:
           0.1558038 = score(doc=3867,freq=1.0), product of:
             0.2490368 = queryWeight, product of:
               1.2803657 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.024288742 = queryNorm
             0.6256256 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.056746624 = weight(abstract_txt:terms in 3867) [ClassicSimilarity], result of:
           0.056746624 = score(doc=3867,freq=2.0), product of:
             0.12701008 = queryWeight, product of:
               1.2931126 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.024288742 = queryNorm
             0.44678837 = fieldWeight in 3867, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.054781303 = weight(abstract_txt:evaluation in 3867) [ClassicSimilarity], result of:
           0.054781303 = score(doc=3867,freq=1.0), product of:
             0.15630627 = queryWeight, product of:
               1.4345162 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.024288742 = queryNorm
             0.35047412 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.10061729 = weight(abstract_txt:questions in 3867) [ClassicSimilarity], result of:
           0.10061729 = score(doc=3867,freq=2.0), product of:
             0.18606295 = queryWeight, product of:
               1.5651184 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.024288742 = queryNorm
             0.5407702 = fieldWeight in 3867, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.07188262 = weight(abstract_txt:task in 3867) [ClassicSimilarity], result of:
           0.07188262 = score(doc=3867,freq=1.0), product of:
             0.18734297 = queryWeight, product of:
               1.5704929 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.024288742 = queryNorm
             0.3836953 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.103520244 = weight(abstract_txt:students in 3867) [ClassicSimilarity], result of:
           0.103520244 = score(doc=3867,freq=2.0), product of:
             0.18962476 = queryWeight, product of:
               1.5800279 = boost
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.024288742 = queryNorm
             0.54592156 = fieldWeight in 3867, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.049365412 = weight(abstract_txt:system in 3867) [ClassicSimilarity], result of:
           0.049365412 = score(doc=3867,freq=2.0), product of:
             0.13249223 = queryWeight, product of:
               1.6175513 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.024288742 = queryNorm
             0.372591 = fieldWeight in 3867, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.113722324 = weight(abstract_txt:effectiveness in 3867) [ClassicSimilarity], result of:
           0.113722324 = score(doc=3867,freq=2.0), product of:
             0.20188713 = queryWeight, product of:
               1.6303152 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.024288742 = queryNorm
             0.56329656 = fieldWeight in 3867, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.12400978 = weight(abstract_txt:searching in 3867) [ClassicSimilarity], result of:
           0.12400978 = score(doc=3867,freq=3.0), product of:
             0.21388589 = queryWeight, product of:
               2.0551994 = boost
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.024288742 = queryNorm
             0.5797941 = fieldWeight in 3867, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.096399575 = weight(abstract_txt:systems in 3867) [ClassicSimilarity], result of:
           0.096399575 = score(doc=3867,freq=4.0), product of:
             0.18082629 = queryWeight, product of:
               2.1820416 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.024288742 = queryNorm
             0.53310597 = fieldWeight in 3867, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.15935649 = weight(abstract_txt:oriented in 3867) [ClassicSimilarity], result of:
           0.15935649 = score(doc=3867,freq=1.0), product of:
             0.36461267 = queryWeight, product of:
               2.683359 = boost
               5.5943284 = idf(docFreq=446, maxDocs=44218)
               0.024288742 = queryNorm
             0.4370569 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5943284 = idf(docFreq=446, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
       0.92 = coord(23/25)
   

2. Hersh, W.R.; Hickam, D.H.: ¬An evaluation of interactive Boolean and natural language searching with an online medical textbook (1995) 0.36

   0.35690495 = sum of:
     0.35690495 = product of:
       0.9914026 = sum of:
         0.052928932 = weight(abstract_txt:retrieval in 2651) [ClassicSimilarity], result of:
           0.052928932 = score(doc=2651,freq=3.0), product of:
             0.09379701 = queryWeight, product of:
               1.1112499 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.024288742 = queryNorm
             0.5642923 = fieldWeight in 2651, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=2651)
         0.13966405 = weight(abstract_txt:clinical in 2651) [ClassicSimilarity], result of:
           0.13966405 = score(doc=2651,freq=1.0), product of:
             0.2050283 = queryWeight, product of:
               1.1617405 = boost
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.024288742 = queryNorm
             0.68119407 = fieldWeight in 2651, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.09375 = fieldNorm(doc=2651)
         0.03599454 = weight(abstract_txt:were in 2651) [ClassicSimilarity], result of:
           0.03599454 = score(doc=2651,freq=1.0), product of:
             0.10461447 = queryWeight, product of:
               1.1735811 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.024288742 = queryNorm
             0.34406847 = fieldWeight in 2651, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.09375 = fieldNorm(doc=2651)
         0.06573756 = weight(abstract_txt:evaluation in 2651) [ClassicSimilarity], result of:
           0.06573756 = score(doc=2651,freq=1.0), product of:
             0.15630627 = queryWeight, product of:
               1.4345162 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.024288742 = queryNorm
             0.42056894 = fieldWeight in 2651, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=2651)
         0.3238658 = weight(abstract_txt:randomized in 2651) [ClassicSimilarity], result of:
           0.3238658 = score(doc=2651,freq=1.0), product of:
             0.35919812 = queryWeight, product of:
               1.5376917 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.024288742 = queryNorm
             0.9016355 = fieldWeight in 2651, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.09375 = fieldNorm(doc=2651)
         0.08783984 = weight(abstract_txt:students in 2651) [ClassicSimilarity], result of:
           0.08783984 = score(doc=2651,freq=1.0), product of:
             0.18962476 = queryWeight, product of:
               1.5800279 = boost
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.024288742 = queryNorm
             0.46322984 = fieldWeight in 2651, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.09375 = fieldNorm(doc=2651)
         0.08377587 = weight(abstract_txt:system in 2651) [ClassicSimilarity], result of:
           0.08377587 = score(doc=2651,freq=4.0), product of:
             0.13249223 = queryWeight, product of:
               1.6175513 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.024288742 = queryNorm
             0.6323078 = fieldWeight in 2651, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.09375 = fieldNorm(doc=2651)
         0.0859165 = weight(abstract_txt:searching in 2651) [ClassicSimilarity], result of:
           0.0859165 = score(doc=2651,freq=1.0), product of:
             0.21388589 = queryWeight, product of:
               2.0551994 = boost
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.024288742 = queryNorm
             0.40169317 = fieldWeight in 2651, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.09375 = fieldNorm(doc=2651)
         0.115679495 = weight(abstract_txt:systems in 2651) [ClassicSimilarity], result of:
           0.115679495 = score(doc=2651,freq=4.0), product of:
             0.18082629 = queryWeight, product of:
               2.1820416 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.024288742 = queryNorm
             0.6397272 = fieldWeight in 2651, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.09375 = fieldNorm(doc=2651)
       0.36 = coord(9/25)
   

3. Vegt, A. van der; Zuccon, G.; Koopman, B.: Do better search engines really equate to better clinical decisions? : If not, why not? (2021) 0.34

   0.3404793 = sum of:
     0.3404793 = product of:
       0.85119826 = sum of:
         0.020372355 = weight(abstract_txt:retrieval in 150) [ClassicSimilarity], result of:
           0.020372355 = score(doc=150,freq=1.0), product of:
             0.09379701 = queryWeight, product of:
               1.1112499 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.024288742 = queryNorm
             0.21719621 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.16127017 = weight(abstract_txt:clinical in 150) [ClassicSimilarity], result of:
           0.16127017 = score(doc=150,freq=3.0), product of:
             0.2050283 = queryWeight, product of:
               1.1617405 = boost
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.024288742 = queryNorm
             0.7865752 = fieldWeight in 150, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.033935975 = weight(abstract_txt:were in 150) [ClassicSimilarity], result of:
           0.033935975 = score(doc=150,freq=2.0), product of:
             0.10461447 = queryWeight, product of:
               1.1735811 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.024288742 = queryNorm
             0.32439086 = fieldWeight in 150, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.02550317 = weight(abstract_txt:approach in 150) [ClassicSimilarity], result of:
           0.02550317 = score(doc=150,freq=1.0), product of:
             0.10894926 = queryWeight, product of:
               1.1976485 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.024288742 = queryNorm
             0.234083 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.14888626 = weight(abstract_txt:answered in 150) [ClassicSimilarity], result of:
           0.14888626 = score(doc=150,freq=2.0), product of:
             0.22252455 = queryWeight, product of:
               1.210295 = boost
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.024288742 = queryNorm
             0.66907793 = fieldWeight in 150, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.11114843 = weight(abstract_txt:correctly in 150) [ClassicSimilarity], result of:
           0.11114843 = score(doc=150,freq=1.0), product of:
             0.23072097 = queryWeight, product of:
               1.2323833 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.024288742 = queryNorm
             0.48174396 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.08049383 = weight(abstract_txt:questions in 150) [ClassicSimilarity], result of:
           0.08049383 = score(doc=150,freq=2.0), product of:
             0.18606295 = queryWeight, product of:
               1.5651184 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.024288742 = queryNorm
             0.4326161 = fieldWeight in 150, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.099603474 = weight(abstract_txt:task in 150) [ClassicSimilarity], result of:
           0.099603474 = score(doc=150,freq=3.0), product of:
             0.18734297 = queryWeight, product of:
               1.5704929 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.024288742 = queryNorm
             0.5316638 = fieldWeight in 150, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.0585599 = weight(abstract_txt:students in 150) [ClassicSimilarity], result of:
           0.0585599 = score(doc=150,freq=1.0), product of:
             0.18962476 = queryWeight, product of:
               1.5800279 = boost
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.024288742 = queryNorm
             0.3088199 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.11142467 = weight(abstract_txt:effectiveness in 150) [ClassicSimilarity], result of:
           0.11142467 = score(doc=150,freq=3.0), product of:
             0.20188713 = queryWeight, product of:
               1.6303152 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.024288742 = queryNorm
             0.55191565 = fieldWeight in 150, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
       0.4 = coord(10/25)
   

4. Vakkari, P.; Huuskonen, S.: Search effort degrades search output but improves task outcome (2012) 0.29

   0.28821436 = sum of:
     0.28821436 = product of:
       0.7205359 = sum of:
         0.10788319 = weight(abstract_txt:medline in 46) [ClassicSimilarity], result of:
           0.10788319 = score(doc=46,freq=2.0), product of:
             0.17951912 = queryWeight, product of:
               1.0870702 = boost
               6.7990475 = idf(docFreq=133, maxDocs=44218)
               0.024288742 = queryNorm
             0.60095656 = fieldWeight in 46, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.7990475 = idf(docFreq=133, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.02881086 = weight(abstract_txt:retrieval in 46) [ClassicSimilarity], result of:
           0.02881086 = score(doc=46,freq=2.0), product of:
             0.09379701 = queryWeight, product of:
               1.1112499 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.024288742 = queryNorm
             0.3071618 = fieldWeight in 46, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.033935975 = weight(abstract_txt:were in 46) [ClassicSimilarity], result of:
           0.033935975 = score(doc=46,freq=2.0), product of:
             0.10461447 = queryWeight, product of:
               1.1735811 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.024288742 = queryNorm
             0.32439086 = fieldWeight in 46, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.032100737 = weight(abstract_txt:terms in 46) [ClassicSimilarity], result of:
           0.032100737 = score(doc=46,freq=1.0), product of:
             0.12701008 = queryWeight, product of:
               1.2931126 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.024288742 = queryNorm
             0.25274166 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.061977968 = weight(abstract_txt:evaluation in 46) [ClassicSimilarity], result of:
           0.061977968 = score(doc=46,freq=2.0), product of:
             0.15630627 = queryWeight, product of:
               1.4345162 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.024288742 = queryNorm
             0.3965162 = fieldWeight in 46, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.056917734 = weight(abstract_txt:questions in 46) [ClassicSimilarity], result of:
           0.056917734 = score(doc=46,freq=1.0), product of:
             0.18606295 = queryWeight, product of:
               1.5651184 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.024288742 = queryNorm
             0.3059058 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.15214682 = weight(abstract_txt:task in 46) [ClassicSimilarity], result of:
           0.15214682 = score(doc=46,freq=7.0), product of:
             0.18734297 = queryWeight, product of:
               1.5704929 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.024288742 = queryNorm
             0.81212986 = fieldWeight in 46, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.10142871 = weight(abstract_txt:students in 46) [ClassicSimilarity], result of:
           0.10142871 = score(doc=46,freq=3.0), product of:
             0.18962476 = queryWeight, product of:
               1.5800279 = boost
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.024288742 = queryNorm
             0.5348917 = fieldWeight in 46, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.06433106 = weight(abstract_txt:effectiveness in 46) [ClassicSimilarity], result of:
           0.06433106 = score(doc=46,freq=1.0), product of:
             0.20188713 = queryWeight, product of:
               1.6303152 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.024288742 = queryNorm
             0.31864864 = fieldWeight in 46, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
         0.081002854 = weight(abstract_txt:searching in 46) [ClassicSimilarity], result of:
           0.081002854 = score(doc=46,freq=2.0), product of:
             0.21388589 = queryWeight, product of:
               2.0551994 = boost
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.024288742 = queryNorm
             0.37871996 = fieldWeight in 46, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.0625 = fieldNorm(doc=46)
       0.4 = coord(10/25)
   

5. Dani, A.; Chatzopoulou, C.; Siatri, R.; Mystakopoulos, F.; Antonopoulou, S.; Katrinaki, E.; Garoufallou, E.: Digital libraries evaluation : measuring Europeana's usability (2015) 0.26

   0.26464897 = sum of:
     0.26464897 = product of:
       0.6616224 = sum of:
         0.11064934 = weight(abstract_txt:satisfaction in 2395) [ClassicSimilarity], result of:
           0.11064934 = score(doc=2395,freq=3.0), product of:
             0.15949374 = queryWeight, product of:
               1.0246465 = boost
               6.4086204 = idf(docFreq=197, maxDocs=44218)
               0.024288742 = queryNorm
             0.6937535 = fieldWeight in 2395, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.4086204 = idf(docFreq=197, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
         0.069492355 = weight(abstract_txt:measuring in 2395) [ClassicSimilarity], result of:
           0.069492355 = score(doc=2395,freq=1.0), product of:
             0.16869783 = queryWeight, product of:
               1.0537971 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.024288742 = queryNorm
             0.41193387 = fieldWeight in 2395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
         0.033935975 = weight(abstract_txt:were in 2395) [ClassicSimilarity], result of:
           0.033935975 = score(doc=2395,freq=2.0), product of:
             0.10461447 = queryWeight, product of:
               1.1735811 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.024288742 = queryNorm
             0.32439086 = fieldWeight in 2395, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
         0.04382504 = weight(abstract_txt:evaluation in 2395) [ClassicSimilarity], result of:
           0.04382504 = score(doc=2395,freq=1.0), product of:
             0.15630627 = queryWeight, product of:
               1.4345162 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.024288742 = queryNorm
             0.2803793 = fieldWeight in 2395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
         0.057506092 = weight(abstract_txt:task in 2395) [ClassicSimilarity], result of:
           0.057506092 = score(doc=2395,freq=1.0), product of:
             0.18734297 = queryWeight, product of:
               1.5704929 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.024288742 = queryNorm
             0.30695623 = fieldWeight in 2395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
         0.0585599 = weight(abstract_txt:students in 2395) [ClassicSimilarity], result of:
           0.0585599 = score(doc=2395,freq=1.0), product of:
             0.18962476 = queryWeight, product of:
               1.5800279 = boost
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.024288742 = queryNorm
             0.3088199 = fieldWeight in 2395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9411182 = idf(docFreq=858, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
         0.06433106 = weight(abstract_txt:effectiveness in 2395) [ClassicSimilarity], result of:
           0.06433106 = score(doc=2395,freq=1.0), product of:
             0.20188713 = queryWeight, product of:
               1.6303152 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.024288742 = queryNorm
             0.31864864 = fieldWeight in 2395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
         0.057277665 = weight(abstract_txt:searching in 2395) [ClassicSimilarity], result of:
           0.057277665 = score(doc=2395,freq=1.0), product of:
             0.21388589 = queryWeight, product of:
               2.0551994 = boost
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.024288742 = queryNorm
             0.26779544 = fieldWeight in 2395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
         0.03855983 = weight(abstract_txt:systems in 2395) [ClassicSimilarity], result of:
           0.03855983 = score(doc=2395,freq=1.0), product of:
             0.18082629 = queryWeight, product of:
               2.1820416 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.024288742 = queryNorm
             0.2132424 = fieldWeight in 2395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
         0.12748519 = weight(abstract_txt:oriented in 2395) [ClassicSimilarity], result of:
           0.12748519 = score(doc=2395,freq=1.0), product of:
             0.36461267 = queryWeight, product of:
               2.683359 = boost
               5.5943284 = idf(docFreq=446, maxDocs=44218)
               0.024288742 = queryNorm
             0.34964553 = fieldWeight in 2395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5943284 = idf(docFreq=446, maxDocs=44218)
               0.0625 = fieldNorm(doc=2395)
       0.4 = coord(10/25)