Document (#40702)

Author

Behnert, C.
Lewandowski, D.

Title

¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments

Source

Journal of documentation. 73(2017) no.3, S.509-527

Year

2017

Abstract

Purpose This paper demonstrates how to apply traditional information retrieval evaluation methods based on standards from the Text REtrieval Conference (TREC) and web search evaluation to all types of modern library information systems including online public access catalogs, discovery systems, and digital libraries that provide web search features to gather information from heterogeneous sources. Design/methodology/approach We apply conventional procedures from information retrieval evaluation to the library information system context considering the specific characteristics of modern library materials. Findings We introduce a framework consisting of five parts: (1) search queries, (2) search results, (3) assessors, (4) testing, and (5) data analysis. We show how to deal with comparability problems resulting from diverse document types, e.g., electronic articles vs. printed monographs and what issues need to be considered for retrieval tests in the library context. Practical implications The framework can be used as a guideline for conducting retrieval effectiveness studies in the library context. Originality/value Although a considerable amount of research has been done on information retrieval evaluation, and standards for conducting retrieval effectiveness studies do exist, to our knowledge this is the first attempt to provide a systematic framework for evaluating the retrieval effectiveness of twenty-first-century library information systems. We demonstrate which issues must be considered and what decisions must be made by researchers prior to a retrieval test.

Content

Vgl.: http://www.emeraldinsight.com/doi/pdfplus/10.1108/JD-08-2016-0099.

Theme

Retrievalstudien

Similar documents (author)

1. Lewandowski, D.: Informationsarmut : sowohl ein quantitatives als auch ein qualitatives Problem (1999) 4.80

   4.796191 = sum of:
     4.796191 = weight(author_txt:lewandowski in 4647) [ClassicSimilarity], result of:
       4.796191 = fieldWeight in 4647, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.6739063 = idf(docFreq=53, maxDocs=42740)
         0.625 = fieldNorm(doc=4647)
   

2. Lewandowski, D.: Wie können sich Bibliotheken gegenüber Wissenschaftssuchmaschinen positionieren? (2007) 4.80

   4.796191 = sum of:
     4.796191 = weight(author_txt:lewandowski in 28) [ClassicSimilarity], result of:
       4.796191 = fieldWeight in 28, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.6739063 = idf(docFreq=53, maxDocs=42740)
         0.625 = fieldNorm(doc=28)
   

3. Lewandowski, D.: "Find what I mean not what I say" : Neuere Ansätze zur Qualifizierung von Suchmaschinen-Ergebnissen (2001) 4.80

   4.796191 = sum of:
     4.796191 = weight(author_txt:lewandowski in 848) [ClassicSimilarity], result of:
       4.796191 = fieldWeight in 848, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.6739063 = idf(docFreq=53, maxDocs=42740)
         0.625 = fieldNorm(doc=848)
   

4. Lewandowski, D.: Alles nur noch Google? : Entwicklungen im Bereich der WWW-Suchmaschinen (2002) 4.80

   4.796191 = sum of:
     4.796191 = weight(author_txt:lewandowski in 1998) [ClassicSimilarity], result of:
       4.796191 = fieldWeight in 1998, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.6739063 = idf(docFreq=53, maxDocs=42740)
         0.625 = fieldNorm(doc=1998)
   

5. Lewandowski, D.: Aktualität als erfolgskritischer Faktor bei Suchmaschinen (2006) 4.80

   4.796191 = sum of:
     4.796191 = weight(author_txt:lewandowski in 2817) [ClassicSimilarity], result of:
       4.796191 = fieldWeight in 2817, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.6739063 = idf(docFreq=53, maxDocs=42740)
         0.625 = fieldNorm(doc=2817)
   

Similar documents (content)

1. Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008) 0.34

   0.34399706 = sum of:
     0.34399706 = product of:
       0.9555474 = sum of:
         0.111998945 = weight(abstract_txt:studies in 4022) [ClassicSimilarity], result of:
           0.111998945 = score(doc=4022,freq=4.0), product of:
             0.16624251 = queryWeight, product of:
               1.5967195 = boost
               4.3117323 = idf(docFreq=1557, maxDocs=42740)
               0.024146916 = queryNorm
             0.6737082 = fieldWeight in 4022, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.3117323 = idf(docFreq=1557, maxDocs=42740)
               0.078125 = fieldNorm(doc=4022)
         0.058596615 = weight(abstract_txt:context in 4022) [ClassicSimilarity], result of:
           0.058596615 = score(doc=4022,freq=1.0), product of:
             0.17134358 = queryWeight, product of:
               1.6210318 = boost
               4.377384 = idf(docFreq=1458, maxDocs=42740)
               0.024146916 = queryNorm
             0.34198314 = fieldWeight in 4022, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.377384 = idf(docFreq=1458, maxDocs=42740)
               0.078125 = fieldNorm(doc=4022)
         0.08292407 = weight(abstract_txt:systems in 4022) [ClassicSimilarity], result of:
           0.08292407 = score(doc=4022,freq=5.0), product of:
             0.13901536 = queryWeight, product of:
               1.6860031 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.024146916 = queryNorm
             0.5965101 = fieldWeight in 4022, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.078125 = fieldNorm(doc=4022)
         0.16732672 = weight(abstract_txt:conducting in 4022) [ClassicSimilarity], result of:
           0.16732672 = score(doc=4022,freq=1.0), product of:
             0.30127698 = queryWeight, product of:
               1.755072 = boost
               7.1090136 = idf(docFreq=94, maxDocs=42740)
               0.024146916 = queryNorm
             0.55539167 = fieldWeight in 4022, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1090136 = idf(docFreq=94, maxDocs=42740)
               0.078125 = fieldNorm(doc=4022)
         0.23892146 = weight(abstract_txt:evaluation in 4022) [ClassicSimilarity], result of:
           0.23892146 = score(doc=4022,freq=8.0), product of:
             0.24066108 = queryWeight, product of:
               2.218349 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.024146916 = queryNorm
             0.9927715 = fieldWeight in 4022, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.078125 = fieldNorm(doc=4022)
         0.091629095 = weight(abstract_txt:framework in 4022) [ClassicSimilarity], result of:
           0.091629095 = score(doc=4022,freq=1.0), product of:
             0.25407076 = queryWeight, product of:
               2.2793148 = boost
               4.6162434 = idf(docFreq=1148, maxDocs=42740)
               0.024146916 = queryNorm
             0.360644 = fieldWeight in 4022, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6162434 = idf(docFreq=1148, maxDocs=42740)
               0.078125 = fieldNorm(doc=4022)
         0.026734488 = weight(abstract_txt:information in 4022) [ClassicSimilarity], result of:
           0.026734488 = score(doc=4022,freq=1.0), product of:
             0.14081761 = queryWeight, product of:
               2.3997746 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.024146916 = queryNorm
             0.18985188 = fieldWeight in 4022, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.078125 = fieldNorm(doc=4022)
         0.124839276 = weight(abstract_txt:effectiveness in 4022) [ClassicSimilarity], result of:
           0.124839276 = score(doc=4022,freq=1.0), product of:
             0.31224817 = queryWeight, product of:
               2.5268352 = boost
               5.117541 = idf(docFreq=695, maxDocs=42740)
               0.024146916 = queryNorm
             0.39980787 = fieldWeight in 4022, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.117541 = idf(docFreq=695, maxDocs=42740)
               0.078125 = fieldNorm(doc=4022)
         0.05257674 = weight(abstract_txt:library in 4022) [ClassicSimilarity], result of:
           0.05257674 = score(doc=4022,freq=1.0), product of:
             0.21141747 = queryWeight, product of:
               2.7505302 = boost
               3.1831915 = idf(docFreq=4815, maxDocs=42740)
               0.024146916 = queryNorm
             0.24868684 = fieldWeight in 4022, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1831915 = idf(docFreq=4815, maxDocs=42740)
               0.078125 = fieldNorm(doc=4022)
       0.36 = coord(9/25)
   

2. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.30

   0.303655 = sum of:
     0.303655 = product of:
       0.6326146 = sum of:
         0.038780246 = weight(abstract_txt:issues in 4020) [ClassicSimilarity], result of:
           0.038780246 = score(doc=4020,freq=3.0), product of:
             0.11079535 = queryWeight, product of:
               1.0643213 = boost
               4.3110905 = idf(docFreq=1558, maxDocs=42740)
               0.024146916 = queryNorm
             0.35001692 = fieldWeight in 4020, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.3110905 = idf(docFreq=1558, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.0228284 = weight(abstract_txt:what in 4020) [ClassicSimilarity], result of:
           0.0228284 = score(doc=4020,freq=1.0), product of:
             0.11223765 = queryWeight, product of:
               1.0712264 = boost
               4.33906 = idf(docFreq=1515, maxDocs=42740)
               0.024146916 = queryNorm
             0.20339343 = fieldWeight in 4020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.33906 = idf(docFreq=1515, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.025354465 = weight(abstract_txt:types in 4020) [ClassicSimilarity], result of:
           0.025354465 = score(doc=4020,freq=1.0), product of:
             0.12037174 = queryWeight, product of:
               1.1093644 = boost
               4.4935403 = idf(docFreq=1298, maxDocs=42740)
               0.024146916 = queryNorm
             0.21063471 = fieldWeight in 4020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4935403 = idf(docFreq=1298, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.036562666 = weight(abstract_txt:must in 4020) [ClassicSimilarity], result of:
           0.036562666 = score(doc=4020,freq=1.0), product of:
             0.15364325 = queryWeight, product of:
               1.2533394 = boost
               5.076719 = idf(docFreq=724, maxDocs=42740)
               0.024146916 = queryNorm
             0.23797119 = fieldWeight in 4020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.076719 = idf(docFreq=724, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.012120888 = weight(abstract_txt:from in 4020) [ClassicSimilarity], result of:
           0.012120888 = score(doc=4020,freq=1.0), product of:
             0.09272309 = queryWeight, product of:
               1.3769586 = boost
               2.7887225 = idf(docFreq=7144, maxDocs=42740)
               0.024146916 = queryNorm
             0.13072136 = fieldWeight in 4020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7887225 = idf(docFreq=7144, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.033599682 = weight(abstract_txt:studies in 4020) [ClassicSimilarity], result of:
           0.033599682 = score(doc=4020,freq=1.0), product of:
             0.16624251 = queryWeight, product of:
               1.5967195 = boost
               4.3117323 = idf(docFreq=1557, maxDocs=42740)
               0.024146916 = queryNorm
             0.20211245 = fieldWeight in 4020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3117323 = idf(docFreq=1557, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.05887024 = weight(abstract_txt:systems in 4020) [ClassicSimilarity], result of:
           0.05887024 = score(doc=4020,freq=7.0), product of:
             0.13901536 = queryWeight, product of:
               1.6860031 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.024146916 = queryNorm
             0.42348012 = fieldWeight in 4020, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.06084574 = weight(abstract_txt:search in 4020) [ClassicSimilarity], result of:
           0.06084574 = score(doc=4020,freq=5.0), product of:
             0.15897481 = queryWeight, product of:
               1.8029809 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.024146916 = queryNorm
             0.38273823 = fieldWeight in 4020, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.15204869 = weight(abstract_txt:evaluation in 4020) [ClassicSimilarity], result of:
           0.15204869 = score(doc=4020,freq=9.0), product of:
             0.24066108 = queryWeight, product of:
               2.218349 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.024146916 = queryNorm
             0.63179594 = fieldWeight in 4020, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.016040692 = weight(abstract_txt:information in 4020) [ClassicSimilarity], result of:
           0.016040692 = score(doc=4020,freq=1.0), product of:
             0.14081761 = queryWeight, product of:
               2.3997746 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.024146916 = queryNorm
             0.11391112 = fieldWeight in 4020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.07490357 = weight(abstract_txt:effectiveness in 4020) [ClassicSimilarity], result of:
           0.07490357 = score(doc=4020,freq=1.0), product of:
             0.31224817 = queryWeight, product of:
               2.5268352 = boost
               5.117541 = idf(docFreq=695, maxDocs=42740)
               0.024146916 = queryNorm
             0.23988473 = fieldWeight in 4020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.117541 = idf(docFreq=695, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
         0.10065937 = weight(abstract_txt:retrieval in 4020) [ClassicSimilarity], result of:
           0.10065937 = score(doc=4020,freq=3.0), product of:
             0.35782772 = queryWeight, product of:
               4.276948 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.024146916 = queryNorm
             0.2813068 = fieldWeight in 4020, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.046875 = fieldNorm(doc=4020)
       0.48 = coord(12/25)
   

3. Spink, A.; Cole, C.: New directions in cognitive information retrieval : introduction (2005) 0.29

   0.29047692 = sum of:
     0.29047692 = product of:
       0.66017485 = sum of:
         0.037526596 = weight(abstract_txt:provide in 1773) [ClassicSimilarity], result of:
           0.037526596 = score(doc=1773,freq=3.0), product of:
             0.09780838 = queryWeight, product of:
               4.050554 = idf(docFreq=2022, maxDocs=42740)
               0.024146916 = queryNorm
             0.38367462 = fieldWeight in 1773, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.050554 = idf(docFreq=2022, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.04180758 = weight(abstract_txt:considered in 1773) [ClassicSimilarity], result of:
           0.04180758 = score(doc=1773,freq=1.0), product of:
             0.1515981 = queryWeight, product of:
               1.2449698 = boost
               5.042817 = idf(docFreq=749, maxDocs=42740)
               0.024146916 = queryNorm
             0.27577907 = fieldWeight in 1773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.042817 = idf(docFreq=749, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.019998444 = weight(abstract_txt:from in 1773) [ClassicSimilarity], result of:
           0.019998444 = score(doc=1773,freq=2.0), product of:
             0.09272309 = queryWeight, product of:
               1.3769586 = boost
               2.7887225 = idf(docFreq=7144, maxDocs=42740)
               0.024146916 = queryNorm
             0.21567924 = fieldWeight in 1773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.7887225 = idf(docFreq=7144, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.08992579 = weight(abstract_txt:systems in 1773) [ClassicSimilarity], result of:
           0.08992579 = score(doc=1773,freq=12.0), product of:
             0.13901536 = queryWeight, product of:
               1.6860031 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.024146916 = queryNorm
             0.64687663 = fieldWeight in 1773, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.117128715 = weight(abstract_txt:conducting in 1773) [ClassicSimilarity], result of:
           0.117128715 = score(doc=1773,freq=1.0), product of:
             0.30127698 = queryWeight, product of:
               1.755072 = boost
               7.1090136 = idf(docFreq=94, maxDocs=42740)
               0.024146916 = queryNorm
             0.3887742 = fieldWeight in 1773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1090136 = idf(docFreq=94, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.044895925 = weight(abstract_txt:search in 1773) [ClassicSimilarity], result of:
           0.044895925 = score(doc=1773,freq=2.0), product of:
             0.15897481 = queryWeight, product of:
               1.8029809 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.024146916 = queryNorm
             0.28240904 = fieldWeight in 1773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.05913005 = weight(abstract_txt:evaluation in 1773) [ClassicSimilarity], result of:
           0.05913005 = score(doc=1773,freq=1.0), product of:
             0.24066108 = queryWeight, product of:
               2.218349 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.024146916 = queryNorm
             0.24569842 = fieldWeight in 1773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.06414037 = weight(abstract_txt:framework in 1773) [ClassicSimilarity], result of:
           0.06414037 = score(doc=1773,freq=1.0), product of:
             0.25407076 = queryWeight, product of:
               2.2793148 = boost
               4.6162434 = idf(docFreq=1148, maxDocs=42740)
               0.024146916 = queryNorm
             0.25245082 = fieldWeight in 1773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6162434 = idf(docFreq=1148, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.05293159 = weight(abstract_txt:information in 1773) [ClassicSimilarity], result of:
           0.05293159 = score(doc=1773,freq=8.0), product of:
             0.14081761 = queryWeight, product of:
               2.3997746 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.024146916 = queryNorm
             0.37588754 = fieldWeight in 1773, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.03680372 = weight(abstract_txt:library in 1773) [ClassicSimilarity], result of:
           0.03680372 = score(doc=1773,freq=1.0), product of:
             0.21141747 = queryWeight, product of:
               2.7505302 = boost
               3.1831915 = idf(docFreq=4815, maxDocs=42740)
               0.024146916 = queryNorm
             0.17408079 = fieldWeight in 1773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1831915 = idf(docFreq=4815, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
         0.09588604 = weight(abstract_txt:retrieval in 1773) [ClassicSimilarity], result of:
           0.09588604 = score(doc=1773,freq=2.0), product of:
             0.35782772 = queryWeight, product of:
               4.276948 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.024146916 = queryNorm
             0.26796705 = fieldWeight in 1773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0546875 = fieldNorm(doc=1773)
       0.44 = coord(11/25)
   

4. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.27

   0.26946506 = sum of:
     0.26946506 = product of:
       0.61242056 = sum of:
         0.026633134 = weight(abstract_txt:what in 3593) [ClassicSimilarity], result of:
           0.026633134 = score(doc=3593,freq=1.0), product of:
             0.11223765 = queryWeight, product of:
               1.0712264 = boost
               4.33906 = idf(docFreq=1515, maxDocs=42740)
               0.024146916 = queryNorm
             0.23729233 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.33906 = idf(docFreq=1515, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.014141036 = weight(abstract_txt:from in 3593) [ClassicSimilarity], result of:
           0.014141036 = score(doc=3593,freq=1.0), product of:
             0.09272309 = queryWeight, product of:
               1.3769586 = boost
               2.7887225 = idf(docFreq=7144, maxDocs=42740)
               0.024146916 = queryNorm
             0.15250826 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7887225 = idf(docFreq=7144, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.11909299 = weight(abstract_txt:apply in 3593) [ClassicSimilarity], result of:
           0.11909299 = score(doc=3593,freq=3.0), product of:
             0.21122278 = queryWeight, product of:
               1.4695432 = boost
               5.9524636 = idf(docFreq=301, maxDocs=42740)
               0.024146916 = queryNorm
             0.56382644 = fieldWeight in 3593, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9524636 = idf(docFreq=301, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.039199628 = weight(abstract_txt:studies in 3593) [ClassicSimilarity], result of:
           0.039199628 = score(doc=3593,freq=1.0), product of:
             0.16624251 = queryWeight, product of:
               1.5967195 = boost
               4.3117323 = idf(docFreq=1557, maxDocs=42740)
               0.024146916 = queryNorm
             0.23579785 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3117323 = idf(docFreq=1557, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.04101763 = weight(abstract_txt:context in 3593) [ClassicSimilarity], result of:
           0.04101763 = score(doc=3593,freq=1.0), product of:
             0.17134358 = queryWeight, product of:
               1.6210318 = boost
               4.377384 = idf(docFreq=1458, maxDocs=42740)
               0.024146916 = queryNorm
             0.2393882 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.377384 = idf(docFreq=1458, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.025959339 = weight(abstract_txt:systems in 3593) [ClassicSimilarity], result of:
           0.025959339 = score(doc=3593,freq=1.0), product of:
             0.13901536 = queryWeight, product of:
               1.6860031 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.024146916 = queryNorm
             0.1867372 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.117128715 = weight(abstract_txt:conducting in 3593) [ClassicSimilarity], result of:
           0.117128715 = score(doc=3593,freq=1.0), product of:
             0.30127698 = queryWeight, product of:
               1.755072 = boost
               7.1090136 = idf(docFreq=94, maxDocs=42740)
               0.024146916 = queryNorm
             0.3887742 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1090136 = idf(docFreq=94, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.05913005 = weight(abstract_txt:evaluation in 3593) [ClassicSimilarity], result of:
           0.05913005 = score(doc=3593,freq=1.0), product of:
             0.24066108 = queryWeight, product of:
               2.218349 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.024146916 = queryNorm
             0.24569842 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.037428286 = weight(abstract_txt:information in 3593) [ClassicSimilarity], result of:
           0.037428286 = score(doc=3593,freq=4.0), product of:
             0.14081761 = queryWeight, product of:
               2.3997746 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.024146916 = queryNorm
             0.26579264 = fieldWeight in 3593, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.03680372 = weight(abstract_txt:library in 3593) [ClassicSimilarity], result of:
           0.03680372 = score(doc=3593,freq=1.0), product of:
             0.21141747 = queryWeight, product of:
               2.7505302 = boost
               3.1831915 = idf(docFreq=4815, maxDocs=42740)
               0.024146916 = queryNorm
             0.17408079 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1831915 = idf(docFreq=4815, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
         0.09588604 = weight(abstract_txt:retrieval in 3593) [ClassicSimilarity], result of:
           0.09588604 = score(doc=3593,freq=2.0), product of:
             0.35782772 = queryWeight, product of:
               4.276948 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.024146916 = queryNorm
             0.26796705 = fieldWeight in 3593, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0546875 = fieldNorm(doc=3593)
       0.44 = coord(11/25)
   

5. Progress in visual information access and retrieval (1999) 0.27

   0.26640916 = sum of:
     0.26640916 = product of:
       0.51232535 = sum of:
         0.02166599 = weight(abstract_txt:provide in 1965) [ClassicSimilarity], result of:
           0.02166599 = score(doc=1965,freq=4.0), product of:
             0.09780838 = queryWeight, product of:
               4.050554 = idf(docFreq=2022, maxDocs=42740)
               0.024146916 = queryNorm
             0.22151466 = fieldWeight in 1965, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.050554 = idf(docFreq=2022, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.0120876245 = weight(abstract_txt:first in 1965) [ClassicSimilarity], result of:
           0.0120876245 = score(doc=1965,freq=1.0), product of:
             0.105221465 = queryWeight, product of:
               1.0372039 = boost
               4.20125 = idf(docFreq=1739, maxDocs=42740)
               0.024146916 = queryNorm
             0.11487793 = fieldWeight in 1965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.20125 = idf(docFreq=1739, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.018470632 = weight(abstract_txt:issues in 1965) [ClassicSimilarity], result of:
           0.018470632 = score(doc=1965,freq=2.0), product of:
             0.11079535 = queryWeight, product of:
               1.0643213 = boost
               4.3110905 = idf(docFreq=1558, maxDocs=42740)
               0.024146916 = queryNorm
             0.16670945 = fieldWeight in 1965, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3110905 = idf(docFreq=1558, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.013316567 = weight(abstract_txt:what in 1965) [ClassicSimilarity], result of:
           0.013316567 = score(doc=1965,freq=1.0), product of:
             0.11223765 = queryWeight, product of:
               1.0712264 = boost
               4.33906 = idf(docFreq=1515, maxDocs=42740)
               0.024146916 = queryNorm
             0.11864617 = fieldWeight in 1965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.33906 = idf(docFreq=1515, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.018064164 = weight(abstract_txt:standards in 1965) [ClassicSimilarity], result of:
           0.018064164 = score(doc=1965,freq=1.0), product of:
             0.13753787 = queryWeight, product of:
               1.1858318 = boost
               4.8032756 = idf(docFreq=952, maxDocs=42740)
               0.024146916 = queryNorm
             0.13133956 = fieldWeight in 1965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8032756 = idf(docFreq=952, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.012246497 = weight(abstract_txt:from in 1965) [ClassicSimilarity], result of:
           0.012246497 = score(doc=1965,freq=3.0), product of:
             0.09272309 = queryWeight, product of:
               1.3769586 = boost
               2.7887225 = idf(docFreq=7144, maxDocs=42740)
               0.024146916 = queryNorm
             0.13207603 = fieldWeight in 1965, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.7887225 = idf(docFreq=7144, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.03671205 = weight(abstract_txt:systems in 1965) [ClassicSimilarity], result of:
           0.03671205 = score(doc=1965,freq=8.0), product of:
             0.13901536 = queryWeight, product of:
               1.6860031 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.024146916 = queryNorm
             0.26408628 = fieldWeight in 1965, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.015873106 = weight(abstract_txt:search in 1965) [ClassicSimilarity], result of:
           0.015873106 = score(doc=1965,freq=1.0), product of:
             0.15897481 = queryWeight, product of:
               1.8029809 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.024146916 = queryNorm
             0.099846676 = fieldWeight in 1965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.05913005 = weight(abstract_txt:evaluation in 1965) [ClassicSimilarity], result of:
           0.05913005 = score(doc=1965,freq=4.0), product of:
             0.24066108 = queryWeight, product of:
               2.218349 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.024146916 = queryNorm
             0.24569842 = fieldWeight in 1965, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.032070186 = weight(abstract_txt:framework in 1965) [ClassicSimilarity], result of:
           0.032070186 = score(doc=1965,freq=1.0), product of:
             0.25407076 = queryWeight, product of:
               2.2793148 = boost
               4.6162434 = idf(docFreq=1148, maxDocs=42740)
               0.024146916 = queryNorm
             0.12622541 = fieldWeight in 1965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6162434 = idf(docFreq=1148, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.054560628 = weight(abstract_txt:information in 1965) [ClassicSimilarity], result of:
           0.054560628 = score(doc=1965,freq=34.0), product of:
             0.14081761 = queryWeight, product of:
               2.3997746 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.024146916 = queryNorm
             0.387456 = fieldWeight in 1965, product of:
               5.8309517 = tf(freq=34.0), with freq of:
                 34.0 = termFreq=34.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.05204832 = weight(abstract_txt:library in 1965) [ClassicSimilarity], result of:
           0.05204832 = score(doc=1965,freq=8.0), product of:
             0.21141747 = queryWeight, product of:
               2.7505302 = boost
               3.1831915 = idf(docFreq=4815, maxDocs=42740)
               0.024146916 = queryNorm
             0.24618742 = fieldWeight in 1965, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.1831915 = idf(docFreq=4815, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
         0.1660795 = weight(abstract_txt:retrieval in 1965) [ClassicSimilarity], result of:
           0.1660795 = score(doc=1965,freq=24.0), product of:
             0.35782772 = queryWeight, product of:
               4.276948 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.024146916 = queryNorm
             0.46413258 = fieldWeight in 1965, product of:
               4.8989797 = tf(freq=24.0), with freq of:
                 24.0 = termFreq=24.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.02734375 = fieldNorm(doc=1965)
       0.52 = coord(13/25)