Document (#43152)

Author

Vegt, A. van der
Zuccon, G.
Koopman, B.

Title

Do better search engines really equate to better clinical decisions? : If not, why not?

Source

Journal of the Association for Information Science and Technology. 72(2021) no.2, S.141-155

Year

2021

Abstract

Previous research has found that improved search engine effectiveness-evaluated using a batch-style approach-does not always translate to significant improvements in user task performance; however, these prior studies focused on simple recall and precision-based search tasks. We investigated the same relationship, but for realistic, complex search tasks required in clinical decision making. One hundred and nine clinicians and final year medical students answered 16 clinical questions. Although the search engine did improve answer accuracy by 20 percentage points, there was no significant difference when participants used a more effective, state-of-the-art search engine. We also found that the search engine effectiveness difference, identified in the lab, was diminished by around 70% when the search engines were used with real users. Despite the aid of the search engine, half of the clinical questions were answered incorrectly. We further identified the relative contribution of search engine effectiveness to the overall end task success. We found that the ability to interpret documents correctly was a much more important factor impacting task success. If these findings are representative, information retrieval research may need to reorient its emphasis towards helping users to better understand information, rather than just finding it for them.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24398.

Theme

Suchmaschinen
Retrievalstudien

Field

Medizin

Similar documents (author)

1. Koopman, B.; Zuccon, G.; Bruza, P.; Sitbon, L.; Lawley, M.: Information retrieval as semantic inference : a graph Inference model applied to medical search (2016) 4.26

   4.2646203 = sum of:
     4.2646203 = sum of:
       1.9633093 = weight(author_txt:koopman in 3260) [ClassicSimilarity], result of:
         1.9633093 = score(doc=3260,freq=1.0), product of:
           0.66876596 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.071188465 = queryNorm
           2.9357195 = fieldWeight in 3260, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.3125 = fieldNorm(doc=3260)
       2.301311 = weight(author_txt:zuccon in 3260) [ClassicSimilarity], result of:
         2.301311 = score(doc=3260,freq=1.0), product of:
           0.743473 = queryWeight, product of:
             1.054376 = boost
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.071188465 = queryNorm
           3.0953524 = fieldWeight in 3260, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.3125 = fieldNorm(doc=3260)
   

2. Koopman, B.; Zuccon, G.; Bruza, P.; Nguyen, A.: What makes an effective clinical query and querier? (2017) 4.26

   4.2646203 = sum of:
     4.2646203 = sum of:
       1.9633093 = weight(author_txt:koopman in 3922) [ClassicSimilarity], result of:
         1.9633093 = score(doc=3922,freq=1.0), product of:
           0.66876596 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.071188465 = queryNorm
           2.9357195 = fieldWeight in 3922, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.3125 = fieldNorm(doc=3922)
       2.301311 = weight(author_txt:zuccon in 3922) [ClassicSimilarity], result of:
         2.301311 = score(doc=3922,freq=1.0), product of:
           0.743473 = queryWeight, product of:
             1.054376 = boost
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.071188465 = queryNorm
           3.0953524 = fieldWeight in 3922, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.3125 = fieldNorm(doc=3922)
   

3. Symonds, M.; Bruza, P.; Zuccon, G.; Koopman, B.; Sitbon, L.; Turner, I.: Automatic query expansion : a structural linguistic perspective (2014) 3.41

   3.411696 = sum of:
     3.411696 = sum of:
       1.5706474 = weight(author_txt:koopman in 1338) [ClassicSimilarity], result of:
         1.5706474 = score(doc=1338,freq=1.0), product of:
           0.66876596 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.071188465 = queryNorm
           2.3485756 = fieldWeight in 1338, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.25 = fieldNorm(doc=1338)
       1.8410487 = weight(author_txt:zuccon in 1338) [ClassicSimilarity], result of:
         1.8410487 = score(doc=1338,freq=1.0), product of:
           0.743473 = queryWeight, product of:
             1.054376 = boost
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.071188465 = queryNorm
           2.476282 = fieldWeight in 1338, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.905128 = idf(docFreq=5, maxDocs=44218)
             0.25 = fieldNorm(doc=1338)
   

4. Koopman, R.: ¬The Pica Micro OPC (1995) 1.96

   1.9633093 = sum of:
     1.9633093 = product of:
       3.9266186 = sum of:
         3.9266186 = weight(author_txt:koopman in 4105) [ClassicSimilarity], result of:
           3.9266186 = score(doc=4105,freq=1.0), product of:
             0.66876596 = queryWeight, product of:
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.071188465 = queryNorm
             5.871439 = fieldWeight in 4105, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.625 = fieldNorm(doc=4105)
       0.5 = coord(1/2)
   

5. Koopman, R.: ¬Ein OPAC mit Gewichtungsalgorithmen : Der PICA Micro OPC (1996) 1.96

   1.9633093 = sum of:
     1.9633093 = product of:
       3.9266186 = sum of:
         3.9266186 = weight(author_txt:koopman in 4114) [ClassicSimilarity], result of:
           3.9266186 = score(doc=4114,freq=1.0), product of:
             0.66876596 = queryWeight, product of:
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.071188465 = queryNorm
             5.871439 = fieldWeight in 4114, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.625 = fieldNorm(doc=4114)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Lewandowski, D.: ¬The retrieval effectiveness of search engines on navigational queries (2011) 0.28

   0.28191218 = sum of:
     0.28191218 = product of:
       0.78308934 = sum of:
         0.06239783 = weight(abstract_txt:correctly in 4537) [ClassicSimilarity], result of:
           0.06239783 = score(doc=4537,freq=1.0), product of:
             0.12952489 = queryWeight, product of:
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.016804166 = queryNorm
             0.48174396 = fieldWeight in 4537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.0625 = fieldNorm(doc=4537)
         0.019454092 = weight(abstract_txt:when in 4537) [ClassicSimilarity], result of:
           0.019454092 = score(doc=4537,freq=1.0), product of:
             0.0750339 = queryWeight, product of:
               1.0763838 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.016804166 = queryNorm
             0.2592707 = fieldWeight in 4537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0625 = fieldNorm(doc=4537)
         0.11485845 = weight(abstract_txt:engines in 4537) [ClassicSimilarity], result of:
           0.11485845 = score(doc=4537,freq=8.0), product of:
             0.122554384 = queryWeight, product of:
               1.3756337 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.016804166 = queryNorm
             0.9372039 = fieldWeight in 4537, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0625 = fieldNorm(doc=4537)
         0.050612085 = weight(abstract_txt:success in 4537) [ClassicSimilarity], result of:
           0.050612085 = score(doc=4537,freq=1.0), product of:
             0.14193398 = queryWeight, product of:
               1.4804085 = boost
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.016804166 = queryNorm
             0.35658893 = fieldWeight in 4537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.0625 = fieldNorm(doc=4537)
         0.036687206 = weight(abstract_txt:found in 4537) [ClassicSimilarity], result of:
           0.036687206 = score(doc=4537,freq=1.0), product of:
             0.13110635 = queryWeight, product of:
               1.7425927 = boost
               4.4772453 = idf(docFreq=1365, maxDocs=44218)
               0.016804166 = queryNorm
             0.27982783 = fieldWeight in 4537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4772453 = idf(docFreq=1365, maxDocs=44218)
               0.0625 = fieldNorm(doc=4537)
         0.11820498 = weight(abstract_txt:answered in 4537) [ClassicSimilarity], result of:
           0.11820498 = score(doc=4537,freq=1.0), product of:
             0.24984697 = queryWeight, product of:
               1.9641535 = boost
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.016804166 = queryNorm
             0.47310954 = fieldWeight in 4537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.0625 = fieldNorm(doc=4537)
         0.054172404 = weight(abstract_txt:effectiveness in 4537) [ClassicSimilarity], result of:
           0.054172404 = score(doc=4537,freq=1.0), product of:
             0.1700067 = queryWeight, product of:
               1.9843444 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.016804166 = queryNorm
             0.31864864 = fieldWeight in 4537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=4537)
         0.1380529 = weight(abstract_txt:engine in 4537) [ClassicSimilarity], result of:
           0.1380529 = score(doc=4537,freq=1.0), product of:
             0.39962652 = queryWeight, product of:
               4.302552 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.016804166 = queryNorm
             0.34545478 = fieldWeight in 4537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.0625 = fieldNorm(doc=4537)
         0.18864942 = weight(abstract_txt:search in 4537) [ClassicSimilarity], result of:
           0.18864942 = score(doc=4537,freq=8.0), product of:
             0.29172963 = queryWeight, product of:
               4.7458463 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016804166 = queryNorm
             0.6466584 = fieldWeight in 4537, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=4537)
       0.36 = coord(9/25)
   

2. Radev, D.R.; Libner, K.; Fan, W.: Getting answers to natural language questions on the Web (2002) 0.25

   0.2545616 = sum of:
     0.2545616 = product of:
       0.79550505 = sum of:
         0.051143214 = weight(abstract_txt:significant in 5204) [ClassicSimilarity], result of:
           0.051143214 = score(doc=5204,freq=3.0), product of:
             0.099098824 = queryWeight, product of:
               1.2370083 = boost
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.016804166 = queryNorm
             0.51608294 = fieldWeight in 5204, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.0625 = fieldNorm(doc=5204)
         0.031953156 = weight(abstract_txt:questions in 5204) [ClassicSimilarity], result of:
           0.031953156 = score(doc=5204,freq=1.0), product of:
             0.10445424 = queryWeight, product of:
               1.2699933 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.016804166 = queryNorm
             0.3059058 = fieldWeight in 5204, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.0625 = fieldNorm(doc=5204)
         0.03241779 = weight(abstract_txt:identified in 5204) [ClassicSimilarity], result of:
           0.03241779 = score(doc=5204,freq=1.0), product of:
             0.105464384 = queryWeight, product of:
               1.2761194 = boost
               4.9181023 = idf(docFreq=878, maxDocs=44218)
               0.016804166 = queryNorm
             0.3073814 = fieldWeight in 5204, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9181023 = idf(docFreq=878, maxDocs=44218)
               0.0625 = fieldNorm(doc=5204)
         0.057429224 = weight(abstract_txt:engines in 5204) [ClassicSimilarity], result of:
           0.057429224 = score(doc=5204,freq=2.0), product of:
             0.122554384 = queryWeight, product of:
               1.3756337 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.016804166 = queryNorm
             0.46860194 = fieldWeight in 5204, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0625 = fieldNorm(doc=5204)
         0.036687206 = weight(abstract_txt:found in 5204) [ClassicSimilarity], result of:
           0.036687206 = score(doc=5204,freq=1.0), product of:
             0.13110635 = queryWeight, product of:
               1.7425927 = boost
               4.4772453 = idf(docFreq=1365, maxDocs=44218)
               0.016804166 = queryNorm
             0.27982783 = fieldWeight in 5204, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4772453 = idf(docFreq=1365, maxDocs=44218)
               0.0625 = fieldNorm(doc=5204)
         0.044155437 = weight(abstract_txt:better in 5204) [ClassicSimilarity], result of:
           0.044155437 = score(doc=5204,freq=1.0), product of:
             0.14834404 = queryWeight, product of:
               1.853613 = boost
               4.76249 = idf(docFreq=1026, maxDocs=44218)
               0.016804166 = queryNorm
             0.2976556 = fieldWeight in 5204, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.76249 = idf(docFreq=1026, maxDocs=44218)
               0.0625 = fieldNorm(doc=5204)
         0.3652536 = weight(abstract_txt:engine in 5204) [ClassicSimilarity], result of:
           0.3652536 = score(doc=5204,freq=7.0), product of:
             0.39962652 = queryWeight, product of:
               4.302552 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.016804166 = queryNorm
             0.9139874 = fieldWeight in 5204, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.0625 = fieldNorm(doc=5204)
         0.17646538 = weight(abstract_txt:search in 5204) [ClassicSimilarity], result of:
           0.17646538 = score(doc=5204,freq=7.0), product of:
             0.29172963 = queryWeight, product of:
               4.7458463 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016804166 = queryNorm
             0.60489357 = fieldWeight in 5204, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=5204)
       0.32 = coord(8/25)
   

3. Hersh, W.; Pentecost, J.; Hickam, D.: ¬A task-oriented approach to information retrieval evaluation : overview and design for empirical testing (1996) 0.21

   0.20630361 = sum of:
     0.20630361 = product of:
       0.7367986 = sum of:
         0.07799729 = weight(abstract_txt:correctly in 3001) [ClassicSimilarity], result of:
           0.07799729 = score(doc=3001,freq=1.0), product of:
             0.12952489 = queryWeight, product of:
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.016804166 = queryNorm
             0.60217994 = fieldWeight in 3001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.078125 = fieldNorm(doc=3001)
         0.036909435 = weight(abstract_txt:significant in 3001) [ClassicSimilarity], result of:
           0.036909435 = score(doc=3001,freq=1.0), product of:
             0.099098824 = queryWeight, product of:
               1.2370083 = boost
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.016804166 = queryNorm
             0.3724508 = fieldWeight in 3001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.078125 = fieldNorm(doc=3001)
         0.05648574 = weight(abstract_txt:questions in 3001) [ClassicSimilarity], result of:
           0.05648574 = score(doc=3001,freq=2.0), product of:
             0.10445424 = queryWeight, product of:
               1.2699933 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.016804166 = queryNorm
             0.5407702 = fieldWeight in 3001, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.078125 = fieldNorm(doc=3001)
         0.060531482 = weight(abstract_txt:task in 3001) [ClassicSimilarity], result of:
           0.060531482 = score(doc=3001,freq=1.0), product of:
             0.15775925 = queryWeight, product of:
               1.9115313 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.016804166 = queryNorm
             0.3836953 = fieldWeight in 3001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.078125 = fieldNorm(doc=3001)
         0.14775622 = weight(abstract_txt:answered in 3001) [ClassicSimilarity], result of:
           0.14775622 = score(doc=3001,freq=1.0), product of:
             0.24984697 = queryWeight, product of:
               1.9641535 = boost
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.016804166 = queryNorm
             0.5913869 = fieldWeight in 3001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.078125 = fieldNorm(doc=3001)
         0.09576419 = weight(abstract_txt:effectiveness in 3001) [ClassicSimilarity], result of:
           0.09576419 = score(doc=3001,freq=2.0), product of:
             0.1700067 = queryWeight, product of:
               1.9843444 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.016804166 = queryNorm
             0.56329656 = fieldWeight in 3001, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=3001)
         0.26135424 = weight(abstract_txt:clinical in 3001) [ClassicSimilarity], result of:
           0.26135424 = score(doc=3001,freq=1.0), product of:
             0.46040484 = queryWeight, product of:
               3.7707117 = boost
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.016804166 = queryNorm
             0.56766176 = fieldWeight in 3001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.078125 = fieldNorm(doc=3001)
       0.28 = coord(7/25)
   

4. Hersh, W.R.; Pentecost, J.; Hickam, D.H.: ¬A task-oriented approach to retrieval system evaluation (1995) 0.21

   0.20630361 = sum of:
     0.20630361 = product of:
       0.7367986 = sum of:
         0.07799729 = weight(abstract_txt:correctly in 3867) [ClassicSimilarity], result of:
           0.07799729 = score(doc=3867,freq=1.0), product of:
             0.12952489 = queryWeight, product of:
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.016804166 = queryNorm
             0.60217994 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.036909435 = weight(abstract_txt:significant in 3867) [ClassicSimilarity], result of:
           0.036909435 = score(doc=3867,freq=1.0), product of:
             0.099098824 = queryWeight, product of:
               1.2370083 = boost
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.016804166 = queryNorm
             0.3724508 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.05648574 = weight(abstract_txt:questions in 3867) [ClassicSimilarity], result of:
           0.05648574 = score(doc=3867,freq=2.0), product of:
             0.10445424 = queryWeight, product of:
               1.2699933 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.016804166 = queryNorm
             0.5407702 = fieldWeight in 3867, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.060531482 = weight(abstract_txt:task in 3867) [ClassicSimilarity], result of:
           0.060531482 = score(doc=3867,freq=1.0), product of:
             0.15775925 = queryWeight, product of:
               1.9115313 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.016804166 = queryNorm
             0.3836953 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.14775622 = weight(abstract_txt:answered in 3867) [ClassicSimilarity], result of:
           0.14775622 = score(doc=3867,freq=1.0), product of:
             0.24984697 = queryWeight, product of:
               1.9641535 = boost
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.016804166 = queryNorm
             0.5913869 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.09576419 = weight(abstract_txt:effectiveness in 3867) [ClassicSimilarity], result of:
           0.09576419 = score(doc=3867,freq=2.0), product of:
             0.1700067 = queryWeight, product of:
               1.9843444 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.016804166 = queryNorm
             0.56329656 = fieldWeight in 3867, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
         0.26135424 = weight(abstract_txt:clinical in 3867) [ClassicSimilarity], result of:
           0.26135424 = score(doc=3867,freq=1.0), product of:
             0.46040484 = queryWeight, product of:
               3.7707117 = boost
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.016804166 = queryNorm
             0.56766176 = fieldWeight in 3867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.078125 = fieldNorm(doc=3867)
       0.28 = coord(7/25)
   

5. Lewandowski, D.: Evaluating the retrieval effectiveness of web search engines using a representative query sample (2015) 0.18

   0.18070862 = sum of:
     0.18070862 = product of:
       0.7529526 = sum of:
         0.050760742 = weight(abstract_txt:engines in 2157) [ClassicSimilarity], result of:
           0.050760742 = score(doc=2157,freq=1.0), product of:
             0.122554384 = queryWeight, product of:
               1.3756337 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.016804166 = queryNorm
             0.41418952 = fieldWeight in 2157, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.078125 = fieldNorm(doc=2157)
         0.07712095 = weight(abstract_txt:difference in 2157) [ClassicSimilarity], result of:
           0.07712095 = score(doc=2157,freq=1.0), product of:
             0.16196647 = queryWeight, product of:
               1.5814335 = boost
               6.0947685 = idf(docFreq=270, maxDocs=44218)
               0.016804166 = queryNorm
             0.4761538 = fieldWeight in 2157, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0947685 = idf(docFreq=270, maxDocs=44218)
               0.078125 = fieldNorm(doc=2157)
         0.09171801 = weight(abstract_txt:found in 2157) [ClassicSimilarity], result of:
           0.09171801 = score(doc=2157,freq=4.0), product of:
             0.13110635 = queryWeight, product of:
               1.7425927 = boost
               4.4772453 = idf(docFreq=1365, maxDocs=44218)
               0.016804166 = queryNorm
             0.6995696 = fieldWeight in 2157, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4772453 = idf(docFreq=1365, maxDocs=44218)
               0.078125 = fieldNorm(doc=2157)
         0.0677155 = weight(abstract_txt:effectiveness in 2157) [ClassicSimilarity], result of:
           0.0677155 = score(doc=2157,freq=1.0), product of:
             0.1700067 = queryWeight, product of:
               1.9843444 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.016804166 = queryNorm
             0.39831078 = fieldWeight in 2157, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=2157)
         0.29889327 = weight(abstract_txt:engine in 2157) [ClassicSimilarity], result of:
           0.29889327 = score(doc=2157,freq=3.0), product of:
             0.39962652 = queryWeight, product of:
               4.302552 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.016804166 = queryNorm
             0.74793154 = fieldWeight in 2157, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.078125 = fieldNorm(doc=2157)
         0.16674411 = weight(abstract_txt:search in 2157) [ClassicSimilarity], result of:
           0.16674411 = score(doc=2157,freq=4.0), product of:
             0.29172963 = queryWeight, product of:
               4.7458463 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016804166 = queryNorm
             0.5715707 = fieldWeight in 2157, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=2157)
       0.24 = coord(6/25)