Document (#12068)

Author

Hersh, W.
Pentecost, J.
Hickam, D.

Title

¬A task-oriented approach to information retrieval evaluation : overview and design for empirical testing

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.50-56

Year

1996

Abstract

As retrieval system become more oriented towards end-users, there is an increasing need for improved methods to evaluate their effectiveness. We performed a task-oriented assessment of 2 MEDLINE searching systems, one which promotes traditional Boolean searching on human-indexed thesaurus terms and the other natural language searching on words in the title, abstracts and indexing terms. Medical students were randomized to one of the 2 systems and given clinical questions to answer. The students were able to use each system successfully, with no significant differences in questions correctly answered, time taken, relevant articles retrieved, or user satisfaction between the systems. This approach to evaluation was successful in measuring effectiveness of system use and demonstrates that both types of systems can be used equally well with minimal training

Theme

Retrievalstudien

Similar documents (author)

1. Hersh, W.: Relevance and retrieval evaluation : perspectives from medicine (1994) 5.86

   5.8620114 = sum of:
     5.8620114 = weight(author_txt:hersh in 6929) [ClassicSimilarity], result of:
       5.8620114 = fieldWeight in 6929, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.379218 = idf(docFreq=9, maxDocs=43556)
         0.625 = fieldNorm(doc=6929)
   

2. Hersh, R.: Reply to Martin Gardner (2001) 5.86

   5.8620114 = sum of:
     5.8620114 = weight(author_txt:hersh in 4569) [ClassicSimilarity], result of:
       5.8620114 = fieldWeight in 4569, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.379218 = idf(docFreq=9, maxDocs=43556)
         0.625 = fieldNorm(doc=4569)
   

3. Hersh, W.R.; Hickam, D.H.: ¬A comparison of two methods for indexing and retrieval from a full-text medical database (1992) 4.69

   4.689609 = sum of:
     4.689609 = weight(author_txt:hersh in 4523) [ClassicSimilarity], result of:
       4.689609 = fieldWeight in 4523, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.379218 = idf(docFreq=9, maxDocs=43556)
         0.5 = fieldNorm(doc=4523)
   

4. Hersh, W.R.; Over, P.: Interactivity at the Text Retrieval Conference (TREC) (2001) 4.69

   4.689609 = sum of:
     4.689609 = weight(author_txt:hersh in 5483) [ClassicSimilarity], result of:
       4.689609 = fieldWeight in 5483, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.379218 = idf(docFreq=9, maxDocs=43556)
         0.5 = fieldNorm(doc=5483)
   

5. Hersh, W.R.; Hickam, D.H.: ¬An evaluation of interactive Boolean and natural language searching with an online medical textbook (1995) 4.69

   4.689609 = sum of:
     4.689609 = weight(author_txt:hersh in 2717) [ClassicSimilarity], result of:
       4.689609 = fieldWeight in 2717, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.379218 = idf(docFreq=9, maxDocs=43556)
         0.5 = fieldNorm(doc=2717)
   

Similar documents (content)

1. Hersh, W.R.; Pentecost, J.; Hickam, D.H.: ¬A task-oriented approach to retrieval system evaluation (1995) 1.97

   1.9654299 = sum of:
     1.9654299 = product of:
       2.1363368 = sum of:
         0.07974732 = weight(abstract_txt:satisfaction in 3933) [ClassicSimilarity], result of:
           0.07974732 = score(doc=3933,freq=1.0), product of:
             0.15927556 = queryWeight, product of:
               1.0250055 = boost
               6.408803 = idf(docFreq=194, maxDocs=43556)
               0.024246333 = queryNorm
             0.5006877 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.408803 = idf(docFreq=194, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.08786248 = weight(abstract_txt:measuring in 3933) [ClassicSimilarity], result of:
           0.08786248 = score(doc=3933,freq=1.0), product of:
             0.16990548 = queryWeight, product of:
               1.058657 = boost
               6.619208 = idf(docFreq=157, maxDocs=43556)
               0.024246333 = queryNorm
             0.5171256 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.619208 = idf(docFreq=157, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.09132615 = weight(abstract_txt:successfully in 3933) [ClassicSimilarity], result of:
           0.09132615 = score(doc=3933,freq=1.0), product of:
             0.17434193 = queryWeight, product of:
               1.0723895 = boost
               6.705069 = idf(docFreq=144, maxDocs=43556)
               0.024246333 = queryNorm
             0.5238335 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.705069 = idf(docFreq=144, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.094901614 = weight(abstract_txt:medline in 3933) [ClassicSimilarity], result of:
           0.094901614 = score(doc=3933,freq=1.0), product of:
             0.17886314 = queryWeight, product of:
               1.0862056 = boost
               6.791454 = idf(docFreq=132, maxDocs=43556)
               0.024246333 = queryNorm
             0.5305823 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.791454 = idf(docFreq=132, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.025400992 = weight(abstract_txt:retrieval in 3933) [ClassicSimilarity], result of:
           0.025400992 = score(doc=3933,freq=1.0), product of:
             0.09359419 = queryWeight, product of:
               1.111197 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.024246333 = queryNorm
             0.27139497 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.10691339 = weight(abstract_txt:minimal in 3933) [ClassicSimilarity], result of:
           0.10691339 = score(doc=3933,freq=1.0), product of:
             0.193654 = queryWeight, product of:
               1.1302248 = boost
               7.0666823 = idf(docFreq=100, maxDocs=43556)
               0.024246333 = queryNorm
             0.55208457 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0666823 = idf(docFreq=100, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.11382981 = weight(abstract_txt:equally in 3933) [ClassicSimilarity], result of:
           0.11382981 = score(doc=3933,freq=1.0), product of:
             0.20191833 = queryWeight, product of:
               1.1540895 = boost
               7.2158947 = idf(docFreq=86, maxDocs=43556)
               0.024246333 = queryNorm
             0.5637418 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2158947 = idf(docFreq=86, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.11724515 = weight(abstract_txt:clinical in 3933) [ClassicSimilarity], result of:
           0.11724515 = score(doc=3933,freq=1.0), product of:
             0.20593731 = queryWeight, product of:
               1.1655184 = boost
               7.2873535 = idf(docFreq=80, maxDocs=43556)
               0.024246333 = queryNorm
             0.5693245 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2873535 = idf(docFreq=80, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.030215925 = weight(abstract_txt:were in 3933) [ClassicSimilarity], result of:
           0.030215925 = score(doc=3933,freq=1.0), product of:
             0.10507652 = queryWeight, product of:
               1.1773876 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.024246333 = queryNorm
             0.28756115 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.032122985 = weight(abstract_txt:approach in 3933) [ClassicSimilarity], result of:
           0.032122985 = score(doc=3933,freq=1.0), product of:
             0.1094525 = queryWeight, product of:
               1.2016541 = boost
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.024246333 = queryNorm
             0.2934879 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.13062659 = weight(abstract_txt:answered in 3933) [ClassicSimilarity], result of:
           0.13062659 = score(doc=3933,freq=1.0), product of:
             0.2213228 = queryWeight, product of:
               1.208272 = boost
               7.5546684 = idf(docFreq=61, maxDocs=43556)
               0.024246333 = queryNorm
             0.5902085 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5546684 = idf(docFreq=61, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.13893248 = weight(abstract_txt:correctly in 3933) [ClassicSimilarity], result of:
           0.13893248 = score(doc=3933,freq=1.0), product of:
             0.23060796 = queryWeight, product of:
               1.2333568 = boost
               7.7115107 = idf(docFreq=52, maxDocs=43556)
               0.024246333 = queryNorm
             0.60246176 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7115107 = idf(docFreq=52, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.15617901 = weight(abstract_txt:promotes in 3933) [ClassicSimilarity], result of:
           0.15617901 = score(doc=3933,freq=1.0), product of:
             0.24931794 = queryWeight, product of:
               1.2824143 = boost
               8.018241 = idf(docFreq=38, maxDocs=43556)
               0.024246333 = queryNorm
             0.6264251 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.018241 = idf(docFreq=38, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.057103746 = weight(abstract_txt:terms in 3933) [ClassicSimilarity], result of:
           0.057103746 = score(doc=3933,freq=2.0), product of:
             0.12748179 = queryWeight, product of:
               1.2968528 = boost
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.024246333 = queryNorm
             0.4479365 = fieldWeight in 3933, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.054971516 = weight(abstract_txt:evaluation in 3933) [ClassicSimilarity], result of:
           0.054971516 = score(doc=3933,freq=1.0), product of:
             0.15659344 = queryWeight, product of:
               1.4373198 = boost
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.024246333 = queryNorm
             0.3510461 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.10114071 = weight(abstract_txt:questions in 3933) [ClassicSimilarity], result of:
           0.10114071 = score(doc=3933,freq=2.0), product of:
             0.18661897 = queryWeight, product of:
               1.5690778 = boost
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.024246333 = queryNorm
             0.5419637 = fieldWeight in 3933, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.07217247 = weight(abstract_txt:task in 3933) [ClassicSimilarity], result of:
           0.07217247 = score(doc=3933,freq=1.0), product of:
             0.187757 = queryWeight, product of:
               1.5738548 = boost
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.024246333 = queryNorm
             0.38439298 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.10323497 = weight(abstract_txt:students in 3933) [ClassicSimilarity], result of:
           0.10323497 = score(doc=3933,freq=2.0), product of:
             0.18918629 = queryWeight, product of:
               1.5798339 = boost
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.024246333 = queryNorm
             0.5456789 = fieldWeight in 3933, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.049029265 = weight(abstract_txt:system in 3933) [ClassicSimilarity], result of:
           0.049029265 = score(doc=3933,freq=2.0), product of:
             0.13182743 = queryWeight, product of:
               1.6151584 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.024246333 = queryNorm
             0.37192005 = fieldWeight in 3933, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.114400424 = weight(abstract_txt:effectiveness in 3933) [ClassicSimilarity], result of:
           0.114400424 = score(doc=3933,freq=2.0), product of:
             0.20259258 = queryWeight, product of:
               1.6348517 = boost
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.024246333 = queryNorm
             0.5646822 = fieldWeight in 3933, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.12320959 = weight(abstract_txt:searching in 3933) [ClassicSimilarity], result of:
           0.12320959 = score(doc=3933,freq=3.0), product of:
             0.21286361 = queryWeight, product of:
               2.0524044 = boost
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.024246333 = queryNorm
             0.5788194 = fieldWeight in 3933, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.09658084 = weight(abstract_txt:systems in 3933) [ClassicSimilarity], result of:
           0.09658084 = score(doc=3933,freq=4.0), product of:
             0.18096687 = queryWeight, product of:
               2.1851494 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.024246333 = queryNorm
             0.5336935 = fieldWeight in 3933, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
         0.15918912 = weight(abstract_txt:oriented in 3933) [ClassicSimilarity], result of:
           0.15918912 = score(doc=3933,freq=1.0), product of:
             0.3641842 = queryWeight, product of:
               2.684558 = boost
               5.595028 = idf(docFreq=439, maxDocs=43556)
               0.024246333 = queryNorm
             0.43711156 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.595028 = idf(docFreq=439, maxDocs=43556)
               0.078125 = fieldNorm(doc=3933)
       0.92 = coord(23/25)
   

2. Hersh, W.R.; Hickam, D.H.: ¬An evaluation of interactive Boolean and natural language searching with an online medical textbook (1995) 0.36

   0.35627812 = sum of:
     0.35627812 = product of:
       0.9896614 = sum of:
         0.05279497 = weight(abstract_txt:retrieval in 2717) [ClassicSimilarity], result of:
           0.05279497 = score(doc=2717,freq=3.0), product of:
             0.09359419 = queryWeight, product of:
               1.111197 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.024246333 = queryNorm
             0.5640838 = fieldWeight in 2717, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.09375 = fieldNorm(doc=2717)
         0.14069419 = weight(abstract_txt:clinical in 2717) [ClassicSimilarity], result of:
           0.14069419 = score(doc=2717,freq=1.0), product of:
             0.20593731 = queryWeight, product of:
               1.1655184 = boost
               7.2873535 = idf(docFreq=80, maxDocs=43556)
               0.024246333 = queryNorm
             0.6831894 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2873535 = idf(docFreq=80, maxDocs=43556)
               0.09375 = fieldNorm(doc=2717)
         0.03625911 = weight(abstract_txt:were in 2717) [ClassicSimilarity], result of:
           0.03625911 = score(doc=2717,freq=1.0), product of:
             0.10507652 = queryWeight, product of:
               1.1773876 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.024246333 = queryNorm
             0.3450734 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.09375 = fieldNorm(doc=2717)
         0.065965824 = weight(abstract_txt:evaluation in 2717) [ClassicSimilarity], result of:
           0.065965824 = score(doc=2717,freq=1.0), product of:
             0.15659344 = queryWeight, product of:
               1.4373198 = boost
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.024246333 = queryNorm
             0.42125532 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.09375 = fieldNorm(doc=2717)
         0.32188505 = weight(abstract_txt:randomized in 2717) [ClassicSimilarity], result of:
           0.32188505 = score(doc=2717,freq=1.0), product of:
             0.3575621 = queryWeight, product of:
               1.5357741 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.024246333 = queryNorm
             0.9002214 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.09375 = fieldNorm(doc=2717)
         0.08759778 = weight(abstract_txt:students in 2717) [ClassicSimilarity], result of:
           0.08759778 = score(doc=2717,freq=1.0), product of:
             0.18918629 = queryWeight, product of:
               1.5798339 = boost
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.024246333 = queryNorm
             0.46302393 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.09375 = fieldNorm(doc=2717)
         0.08320543 = weight(abstract_txt:system in 2717) [ClassicSimilarity], result of:
           0.08320543 = score(doc=2717,freq=4.0), product of:
             0.13182743 = queryWeight, product of:
               1.6151584 = boost
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.024246333 = queryNorm
             0.6311693 = fieldWeight in 2717, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.3662362 = idf(docFreq=4086, maxDocs=43556)
               0.09375 = fieldNorm(doc=2717)
         0.08536211 = weight(abstract_txt:searching in 2717) [ClassicSimilarity], result of:
           0.08536211 = score(doc=2717,freq=1.0), product of:
             0.21286361 = queryWeight, product of:
               2.0524044 = boost
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.024246333 = queryNorm
             0.40101784 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.09375 = fieldNorm(doc=2717)
         0.11589701 = weight(abstract_txt:systems in 2717) [ClassicSimilarity], result of:
           0.11589701 = score(doc=2717,freq=4.0), product of:
             0.18096687 = queryWeight, product of:
               2.1851494 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.024246333 = queryNorm
             0.6404322 = fieldWeight in 2717, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.09375 = fieldNorm(doc=2717)
       0.36 = coord(9/25)
   

3. Vegt, A. van der; Zuccon, G.; Koopman, B.: Do better search engines really equate to better clinical decisions? : If not, why not? (2021) 0.34

   0.34120107 = sum of:
     0.34120107 = product of:
       0.85300267 = sum of:
         0.020320795 = weight(abstract_txt:retrieval in 2437) [ClassicSimilarity], result of:
           0.020320795 = score(doc=2437,freq=1.0), product of:
             0.09359419 = queryWeight, product of:
               1.111197 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.024246333 = queryNorm
             0.21711598 = fieldWeight in 2437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
         0.16245966 = weight(abstract_txt:clinical in 2437) [ClassicSimilarity], result of:
           0.16245966 = score(doc=2437,freq=3.0), product of:
             0.20593731 = queryWeight, product of:
               1.1655184 = boost
               7.2873535 = idf(docFreq=80, maxDocs=43556)
               0.024246333 = queryNorm
             0.78887916 = fieldWeight in 2437, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.2873535 = idf(docFreq=80, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
         0.034185417 = weight(abstract_txt:were in 2437) [ClassicSimilarity], result of:
           0.034185417 = score(doc=2437,freq=2.0), product of:
             0.10507652 = queryWeight, product of:
               1.1773876 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.024246333 = queryNorm
             0.3253383 = fieldWeight in 2437, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
         0.025698388 = weight(abstract_txt:approach in 2437) [ClassicSimilarity], result of:
           0.025698388 = score(doc=2437,freq=1.0), product of:
             0.1094525 = queryWeight, product of:
               1.2016541 = boost
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.024246333 = queryNorm
             0.23479033 = fieldWeight in 2437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7566452 = idf(docFreq=2765, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
         0.14778711 = weight(abstract_txt:answered in 2437) [ClassicSimilarity], result of:
           0.14778711 = score(doc=2437,freq=2.0), product of:
             0.2213228 = queryWeight, product of:
               1.208272 = boost
               7.5546684 = idf(docFreq=61, maxDocs=43556)
               0.024246333 = queryNorm
             0.66774464 = fieldWeight in 2437, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5546684 = idf(docFreq=61, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
         0.11114598 = weight(abstract_txt:correctly in 2437) [ClassicSimilarity], result of:
           0.11114598 = score(doc=2437,freq=1.0), product of:
             0.23060796 = queryWeight, product of:
               1.2333568 = boost
               7.7115107 = idf(docFreq=52, maxDocs=43556)
               0.024246333 = queryNorm
             0.48196942 = fieldWeight in 2437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7115107 = idf(docFreq=52, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
         0.08091257 = weight(abstract_txt:questions in 2437) [ClassicSimilarity], result of:
           0.08091257 = score(doc=2437,freq=2.0), product of:
             0.18661897 = queryWeight, product of:
               1.5690778 = boost
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.024246333 = queryNorm
             0.43357098 = fieldWeight in 2437, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
         0.100005105 = weight(abstract_txt:task in 2437) [ClassicSimilarity], result of:
           0.100005105 = score(doc=2437,freq=3.0), product of:
             0.187757 = queryWeight, product of:
               1.5738548 = boost
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.024246333 = queryNorm
             0.5326305 = fieldWeight in 2437, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
         0.05839852 = weight(abstract_txt:students in 2437) [ClassicSimilarity], result of:
           0.05839852 = score(doc=2437,freq=1.0), product of:
             0.18918629 = queryWeight, product of:
               1.5798339 = boost
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.024246333 = queryNorm
             0.30868262 = fieldWeight in 2437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
         0.11208907 = weight(abstract_txt:effectiveness in 2437) [ClassicSimilarity], result of:
           0.11208907 = score(doc=2437,freq=3.0), product of:
             0.20259258 = queryWeight, product of:
               1.6348517 = boost
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.024246333 = queryNorm
             0.5532733 = fieldWeight in 2437, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.0625 = fieldNorm(doc=2437)
       0.4 = coord(10/25)
   

4. Vakkari, P.; Huuskonen, S.: Search effort degrades search output but improves task outcome (2012) 0.29

   0.28844258 = sum of:
     0.28844258 = product of:
       0.7211064 = sum of:
         0.10736892 = weight(abstract_txt:medline in 2044) [ClassicSimilarity], result of:
           0.10736892 = score(doc=2044,freq=2.0), product of:
             0.17886314 = queryWeight, product of:
               1.0862056 = boost
               6.791454 = idf(docFreq=132, maxDocs=43556)
               0.024246333 = queryNorm
             0.60028535 = fieldWeight in 2044, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.791454 = idf(docFreq=132, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
         0.028737944 = weight(abstract_txt:retrieval in 2044) [ClassicSimilarity], result of:
           0.028737944 = score(doc=2044,freq=2.0), product of:
             0.09359419 = queryWeight, product of:
               1.111197 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.024246333 = queryNorm
             0.30704835 = fieldWeight in 2044, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
         0.034185417 = weight(abstract_txt:were in 2044) [ClassicSimilarity], result of:
           0.034185417 = score(doc=2044,freq=2.0), product of:
             0.10507652 = queryWeight, product of:
               1.1773876 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.024246333 = queryNorm
             0.3253383 = fieldWeight in 2044, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
         0.032302756 = weight(abstract_txt:terms in 2044) [ClassicSimilarity], result of:
           0.032302756 = score(doc=2044,freq=1.0), product of:
             0.12748179 = queryWeight, product of:
               1.2968528 = boost
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.024246333 = queryNorm
             0.25339115 = fieldWeight in 2044, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0542583 = idf(docFreq=2053, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
         0.062193174 = weight(abstract_txt:evaluation in 2044) [ClassicSimilarity], result of:
           0.062193174 = score(doc=2044,freq=2.0), product of:
             0.15659344 = queryWeight, product of:
               1.4373198 = boost
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.024246333 = queryNorm
             0.39716333 = fieldWeight in 2044, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
         0.057213828 = weight(abstract_txt:questions in 2044) [ClassicSimilarity], result of:
           0.057213828 = score(doc=2044,freq=1.0), product of:
             0.18661897 = queryWeight, product of:
               1.5690778 = boost
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.024246333 = queryNorm
             0.306581 = fieldWeight in 2044, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
         0.15276031 = weight(abstract_txt:task in 2044) [ClassicSimilarity], result of:
           0.15276031 = score(doc=2044,freq=7.0), product of:
             0.187757 = queryWeight, product of:
               1.5738548 = boost
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.024246333 = queryNorm
             0.8136065 = fieldWeight in 2044, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
         0.1011492 = weight(abstract_txt:students in 2044) [ClassicSimilarity], result of:
           0.1011492 = score(doc=2044,freq=3.0), product of:
             0.18918629 = queryWeight, product of:
               1.5798339 = boost
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.024246333 = queryNorm
             0.53465396 = fieldWeight in 2044, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
         0.064714655 = weight(abstract_txt:effectiveness in 2044) [ClassicSimilarity], result of:
           0.064714655 = score(doc=2044,freq=1.0), product of:
             0.20259258 = queryWeight, product of:
               1.6348517 = boost
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.024246333 = queryNorm
             0.3194325 = fieldWeight in 2044, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
         0.08048016 = weight(abstract_txt:searching in 2044) [ClassicSimilarity], result of:
           0.08048016 = score(doc=2044,freq=2.0), product of:
             0.21286361 = queryWeight, product of:
               2.0524044 = boost
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.024246333 = queryNorm
             0.37808323 = fieldWeight in 2044, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.0625 = fieldNorm(doc=2044)
       0.4 = coord(10/25)
   

5. Dani, A.; Chatzopoulou, C.; Siatri, R.; Mystakopoulos, F.; Antonopoulou, S.; Katrinaki, E.; Garoufallou, E.: Digital libraries evaluation : measuring Europeana's usability (2015) 0.27

   0.26507863 = sum of:
     0.26507863 = product of:
       0.66269654 = sum of:
         0.110501125 = weight(abstract_txt:satisfaction in 4393) [ClassicSimilarity], result of:
           0.110501125 = score(doc=4393,freq=3.0), product of:
             0.15927556 = queryWeight, product of:
               1.0250055 = boost
               6.408803 = idf(docFreq=194, maxDocs=43556)
               0.024246333 = queryNorm
             0.69377327 = fieldWeight in 4393, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.408803 = idf(docFreq=194, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
         0.070289984 = weight(abstract_txt:measuring in 4393) [ClassicSimilarity], result of:
           0.070289984 = score(doc=4393,freq=1.0), product of:
             0.16990548 = queryWeight, product of:
               1.058657 = boost
               6.619208 = idf(docFreq=157, maxDocs=43556)
               0.024246333 = queryNorm
             0.4137005 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.619208 = idf(docFreq=157, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
         0.034185417 = weight(abstract_txt:were in 4393) [ClassicSimilarity], result of:
           0.034185417 = score(doc=4393,freq=2.0), product of:
             0.10507652 = queryWeight, product of:
               1.1773876 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.024246333 = queryNorm
             0.3253383 = fieldWeight in 4393, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
         0.043977212 = weight(abstract_txt:evaluation in 4393) [ClassicSimilarity], result of:
           0.043977212 = score(doc=4393,freq=1.0), product of:
             0.15659344 = queryWeight, product of:
               1.4373198 = boost
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.024246333 = queryNorm
             0.28083688 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.49339 = idf(docFreq=1323, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
         0.057737976 = weight(abstract_txt:task in 4393) [ClassicSimilarity], result of:
           0.057737976 = score(doc=4393,freq=1.0), product of:
             0.187757 = queryWeight, product of:
               1.5738548 = boost
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.024246333 = queryNorm
             0.30751437 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.92023 = idf(docFreq=863, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
         0.05839852 = weight(abstract_txt:students in 4393) [ClassicSimilarity], result of:
           0.05839852 = score(doc=4393,freq=1.0), product of:
             0.18918629 = queryWeight, product of:
               1.5798339 = boost
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.024246333 = queryNorm
             0.30868262 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.938922 = idf(docFreq=847, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
         0.064714655 = weight(abstract_txt:effectiveness in 4393) [ClassicSimilarity], result of:
           0.064714655 = score(doc=4393,freq=1.0), product of:
             0.20259258 = queryWeight, product of:
               1.6348517 = boost
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.024246333 = queryNorm
             0.3194325 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.11092 = idf(docFreq=713, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
         0.056908067 = weight(abstract_txt:searching in 4393) [ClassicSimilarity], result of:
           0.056908067 = score(doc=4393,freq=1.0), product of:
             0.21286361 = queryWeight, product of:
               2.0524044 = boost
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.024246333 = queryNorm
             0.26734522 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
         0.038632333 = weight(abstract_txt:systems in 4393) [ClassicSimilarity], result of:
           0.038632333 = score(doc=4393,freq=1.0), product of:
             0.18096687 = queryWeight, product of:
               2.1851494 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.024246333 = queryNorm
             0.21347739 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
         0.1273513 = weight(abstract_txt:oriented in 4393) [ClassicSimilarity], result of:
           0.1273513 = score(doc=4393,freq=1.0), product of:
             0.3641842 = queryWeight, product of:
               2.684558 = boost
               5.595028 = idf(docFreq=439, maxDocs=43556)
               0.024246333 = queryNorm
             0.34968925 = fieldWeight in 4393, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.595028 = idf(docFreq=439, maxDocs=43556)
               0.0625 = fieldNorm(doc=4393)
       0.4 = coord(10/25)