Document (#40701)

Author

Behnert, C.
Lewandowski, D.

Title

¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments

Source

Journal of documentation. 73(2017) no.3, S.509-527

Year

2017

Abstract

Purpose This paper demonstrates how to apply traditional information retrieval evaluation methods based on standards from the Text REtrieval Conference (TREC) and web search evaluation to all types of modern library information systems including online public access catalogs, discovery systems, and digital libraries that provide web search features to gather information from heterogeneous sources. Design/methodology/approach We apply conventional procedures from information retrieval evaluation to the library information system context considering the specific characteristics of modern library materials. Findings We introduce a framework consisting of five parts: (1) search queries, (2) search results, (3) assessors, (4) testing, and (5) data analysis. We show how to deal with comparability problems resulting from diverse document types, e.g., electronic articles vs. printed monographs and what issues need to be considered for retrieval tests in the library context. Practical implications The framework can be used as a guideline for conducting retrieval effectiveness studies in the library context. Originality/value Although a considerable amount of research has been done on information retrieval evaluation, and standards for conducting retrieval effectiveness studies do exist, to our knowledge this is the first attempt to provide a systematic framework for evaluating the retrieval effectiveness of twenty-first-century library information systems. We demonstrate which issues must be considered and what decisions must be made by researchers prior to a retrieval test.

Content

Vgl.: http://www.emeraldinsight.com/doi/pdfplus/10.1108/JD-08-2016-0099.

Theme

Retrievalstudien

Similar documents (author)

1. Lewandowski, D.: Informationsarmut : sowohl ein quantitatives als auch ein qualitatives Problem (1999) 4.75

   4.7515893 = sum of:
     4.7515893 = weight(author_txt:lewandowski in 3646) [ClassicSimilarity], result of:
       4.7515893 = fieldWeight in 3646, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.602543 = idf(docFreq=59, maxDocs=44218)
         0.625 = fieldNorm(doc=3646)
   

2. Lewandowski, D.: Wie können sich Bibliotheken gegenüber Wissenschaftssuchmaschinen positionieren? (2007) 4.75

   4.7515893 = sum of:
     4.7515893 = weight(author_txt:lewandowski in 5112) [ClassicSimilarity], result of:
       4.7515893 = fieldWeight in 5112, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.602543 = idf(docFreq=59, maxDocs=44218)
         0.625 = fieldNorm(doc=5112)
   

3. Lewandowski, D.: "Find what I mean not what I say" : Neuere Ansätze zur Qualifizierung von Suchmaschinen-Ergebnissen (2001) 4.75

   4.7515893 = sum of:
     4.7515893 = weight(author_txt:lewandowski in 5932) [ClassicSimilarity], result of:
       4.7515893 = fieldWeight in 5932, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.602543 = idf(docFreq=59, maxDocs=44218)
         0.625 = fieldNorm(doc=5932)
   

4. Lewandowski, D.: Alles nur noch Google? : Entwicklungen im Bereich der WWW-Suchmaschinen (2002) 4.75

   4.7515893 = sum of:
     4.7515893 = weight(author_txt:lewandowski in 997) [ClassicSimilarity], result of:
       4.7515893 = fieldWeight in 997, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.602543 = idf(docFreq=59, maxDocs=44218)
         0.625 = fieldNorm(doc=997)
   

5. Lewandowski, D.: Aktualität als erfolgskritischer Faktor bei Suchmaschinen (2006) 4.75

   4.7515893 = sum of:
     4.7515893 = weight(author_txt:lewandowski in 1816) [ClassicSimilarity], result of:
       4.7515893 = fieldWeight in 1816, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.602543 = idf(docFreq=59, maxDocs=44218)
         0.625 = fieldNorm(doc=1816)
   

Similar documents (content)

1. Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008) 0.34

   0.3399658 = sum of:
     0.3399658 = product of:
       0.94434935 = sum of:
         0.109342925 = weight(abstract_txt:studies in 2021) [ClassicSimilarity], result of:
           0.109342925 = score(doc=2021,freq=4.0), product of:
             0.16396469 = queryWeight, product of:
               1.5932761 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.024112316 = queryNorm
             0.66686875 = fieldWeight in 2021, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.057485666 = weight(abstract_txt:context in 2021) [ClassicSimilarity], result of:
           0.057485666 = score(doc=2021,freq=1.0), product of:
             0.16954418 = queryWeight, product of:
               1.6201578 = boost
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.024112316 = queryNorm
             0.3390601 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.08327296 = weight(abstract_txt:systems in 2021) [ClassicSimilarity], result of:
           0.08327296 = score(doc=2021,freq=5.0), product of:
             0.13971256 = queryWeight, product of:
               1.6982553 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.024112316 = queryNorm
             0.5960306 = fieldWeight in 2021, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.16246983 = weight(abstract_txt:conducting in 2021) [ClassicSimilarity], result of:
           0.16246983 = score(doc=2021,freq=1.0), product of:
             0.29607013 = queryWeight, product of:
               1.7481052 = boost
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.024112316 = queryNorm
             0.5487546 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.23943143 = weight(abstract_txt:evaluation in 2021) [ClassicSimilarity], result of:
           0.23943143 = score(doc=2021,freq=8.0), product of:
             0.24153507 = queryWeight, product of:
               2.2329314 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.024112316 = queryNorm
             0.9912905 = fieldWeight in 2021, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.08837534 = weight(abstract_txt:framework in 2021) [ClassicSimilarity], result of:
           0.08837534 = score(doc=2021,freq=1.0), product of:
             0.24856701 = queryWeight, product of:
               2.2652023 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.024112316 = queryNorm
             0.3555393 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.026608711 = weight(abstract_txt:information in 2021) [ClassicSimilarity], result of:
           0.026608711 = score(doc=2021,freq=1.0), product of:
             0.14068528 = queryWeight, product of:
               2.4100418 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.024112316 = queryNorm
             0.18913643 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.1242609 = weight(abstract_txt:effectiveness in 2021) [ClassicSimilarity], result of:
           0.1242609 = score(doc=2021,freq=1.0), product of:
             0.31196973 = queryWeight, product of:
               2.537707 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.024112316 = queryNorm
             0.39831078 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.0531016 = weight(abstract_txt:library in 2021) [ClassicSimilarity], result of:
           0.0531016 = score(doc=2021,freq=1.0), product of:
             0.21329165 = queryWeight, product of:
               2.7758195 = boost
               3.1867187 = idf(docFreq=4964, maxDocs=44218)
               0.024112316 = queryNorm
             0.2489624 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1867187 = idf(docFreq=4964, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
       0.36 = coord(9/25)
   

2. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.30

   0.30424955 = sum of:
     0.30424955 = product of:
       0.63385326 = sum of:
         0.03878509 = weight(abstract_txt:issues in 2019) [ClassicSimilarity], result of:
           0.03878509 = score(doc=2019,freq=3.0), product of:
             0.11104901 = queryWeight, product of:
               1.0706009 = boost
               4.3017797 = idf(docFreq=1627, maxDocs=44218)
               0.024112316 = queryNorm
             0.349261 = fieldWeight in 2019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.3017797 = idf(docFreq=1627, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.022595944 = weight(abstract_txt:what in 2019) [ClassicSimilarity], result of:
           0.022595944 = score(doc=2019,freq=1.0), product of:
             0.111720346 = queryWeight, product of:
               1.0738322 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.024112316 = queryNorm
             0.20225452 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.025098316 = weight(abstract_txt:types in 2019) [ClassicSimilarity], result of:
           0.025098316 = score(doc=2019,freq=1.0), product of:
             0.1198234 = queryWeight, product of:
               1.112093 = boost
               4.4684987 = idf(docFreq=1377, maxDocs=44218)
               0.024112316 = queryNorm
             0.20946088 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4684987 = idf(docFreq=1377, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.03686536 = weight(abstract_txt:must in 2019) [ClassicSimilarity], result of:
           0.03686536 = score(doc=2019,freq=1.0), product of:
             0.15483089 = queryWeight, product of:
               1.2641513 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.024112316 = queryNorm
             0.23810083 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.011878139 = weight(abstract_txt:from in 2019) [ClassicSimilarity], result of:
           0.011878139 = score(doc=2019,freq=1.0), product of:
             0.09168273 = queryWeight, product of:
               1.3757168 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.024112316 = queryNorm
             0.129557 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.03280288 = weight(abstract_txt:studies in 2019) [ClassicSimilarity], result of:
           0.03280288 = score(doc=2019,freq=1.0), product of:
             0.16396469 = queryWeight, product of:
               1.5932761 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.024112316 = queryNorm
             0.20006064 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.059117936 = weight(abstract_txt:systems in 2019) [ClassicSimilarity], result of:
           0.059117936 = score(doc=2019,freq=7.0), product of:
             0.13971256 = queryWeight, product of:
               1.6982553 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.024112316 = queryNorm
             0.42313975 = fieldWeight in 2019, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.06157784 = weight(abstract_txt:search in 2019) [ClassicSimilarity], result of:
           0.06157784 = score(doc=2019,freq=5.0), product of:
             0.16060099 = queryWeight, product of:
               1.8207879 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.024112316 = queryNorm
             0.3834213 = fieldWeight in 2019, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.15237322 = weight(abstract_txt:evaluation in 2019) [ClassicSimilarity], result of:
           0.15237322 = score(doc=2019,freq=9.0), product of:
             0.24153507 = queryWeight, product of:
               2.2329314 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.024112316 = queryNorm
             0.6308534 = fieldWeight in 2019, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.015965227 = weight(abstract_txt:information in 2019) [ClassicSimilarity], result of:
           0.015965227 = score(doc=2019,freq=1.0), product of:
             0.14068528 = queryWeight, product of:
               2.4100418 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.024112316 = queryNorm
             0.113481864 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.074556544 = weight(abstract_txt:effectiveness in 2019) [ClassicSimilarity], result of:
           0.074556544 = score(doc=2019,freq=1.0), product of:
             0.31196973 = queryWeight, product of:
               2.537707 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.024112316 = queryNorm
             0.23898648 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.102236725 = weight(abstract_txt:retrieval in 2019) [ClassicSimilarity], result of:
           0.102236725 = score(doc=2019,freq=3.0), product of:
             0.36235377 = queryWeight, product of:
               4.324358 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.024112316 = queryNorm
             0.28214616 = fieldWeight in 2019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
       0.48 = coord(12/25)
   

3. Spink, A.; Cole, C.: New directions in cognitive information retrieval : introduction (2005) 0.29

   0.28857207 = sum of:
     0.28857207 = product of:
       0.65584564 = sum of:
         0.036874723 = weight(abstract_txt:provide in 647) [ClassicSimilarity], result of:
           0.036874723 = score(doc=647,freq=3.0), product of:
             0.09688566 = queryWeight, product of:
               4.0180984 = idf(docFreq=2161, maxDocs=44218)
               0.024112316 = queryNorm
             0.38060042 = fieldWeight in 647, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.0180984 = idf(docFreq=2161, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.041542597 = weight(abstract_txt:considered in 647) [ClassicSimilarity], result of:
           0.041542597 = score(doc=647,freq=1.0), product of:
             0.15128987 = queryWeight, product of:
               1.249612 = boost
               5.021064 = idf(docFreq=792, maxDocs=44218)
               0.024112316 = queryNorm
             0.27458942 = fieldWeight in 647, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.021064 = idf(docFreq=792, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.01959793 = weight(abstract_txt:from in 647) [ClassicSimilarity], result of:
           0.01959793 = score(doc=647,freq=2.0), product of:
             0.09168273 = queryWeight, product of:
               1.3757168 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.024112316 = queryNorm
             0.21375814 = fieldWeight in 647, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.09030414 = weight(abstract_txt:systems in 647) [ClassicSimilarity], result of:
           0.09030414 = score(doc=647,freq=12.0), product of:
             0.13971256 = queryWeight, product of:
               1.6982553 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.024112316 = queryNorm
             0.64635664 = fieldWeight in 647, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.11372888 = weight(abstract_txt:conducting in 647) [ClassicSimilarity], result of:
           0.11372888 = score(doc=647,freq=1.0), product of:
             0.29607013 = queryWeight, product of:
               1.7481052 = boost
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.024112316 = queryNorm
             0.38412818 = fieldWeight in 647, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.045436118 = weight(abstract_txt:search in 647) [ClassicSimilarity], result of:
           0.045436118 = score(doc=647,freq=2.0), product of:
             0.16060099 = queryWeight, product of:
               1.8207879 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.024112316 = queryNorm
             0.28291306 = fieldWeight in 647, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.059256252 = weight(abstract_txt:evaluation in 647) [ClassicSimilarity], result of:
           0.059256252 = score(doc=647,freq=1.0), product of:
             0.24153507 = queryWeight, product of:
               2.2329314 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.024112316 = queryNorm
             0.24533188 = fieldWeight in 647, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.061862737 = weight(abstract_txt:framework in 647) [ClassicSimilarity], result of:
           0.061862737 = score(doc=647,freq=1.0), product of:
             0.24856701 = queryWeight, product of:
               2.2652023 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.024112316 = queryNorm
             0.2488775 = fieldWeight in 647, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.05268256 = weight(abstract_txt:information in 647) [ClassicSimilarity], result of:
           0.05268256 = score(doc=647,freq=8.0), product of:
             0.14068528 = queryWeight, product of:
               2.4100418 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.024112316 = queryNorm
             0.37447104 = fieldWeight in 647, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.03717112 = weight(abstract_txt:library in 647) [ClassicSimilarity], result of:
           0.03717112 = score(doc=647,freq=1.0), product of:
             0.21329165 = queryWeight, product of:
               2.7758195 = boost
               3.1867187 = idf(docFreq=4964, maxDocs=44218)
               0.024112316 = queryNorm
             0.17427368 = fieldWeight in 647, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1867187 = idf(docFreq=4964, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
         0.09738859 = weight(abstract_txt:retrieval in 647) [ClassicSimilarity], result of:
           0.09738859 = score(doc=647,freq=2.0), product of:
             0.36235377 = queryWeight, product of:
               4.324358 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.024112316 = queryNorm
             0.26876658 = fieldWeight in 647, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0546875 = fieldNorm(doc=647)
       0.44 = coord(11/25)
   

4. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.27

   0.26721075 = sum of:
     0.26721075 = product of:
       0.6072972 = sum of:
         0.026361937 = weight(abstract_txt:what in 2592) [ClassicSimilarity], result of:
           0.026361937 = score(doc=2592,freq=1.0), product of:
             0.111720346 = queryWeight, product of:
               1.0738322 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.024112316 = queryNorm
             0.23596361 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.01385783 = weight(abstract_txt:from in 2592) [ClassicSimilarity], result of:
           0.01385783 = score(doc=2592,freq=1.0), product of:
             0.09168273 = queryWeight, product of:
               1.3757168 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.024112316 = queryNorm
             0.15114984 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.117701836 = weight(abstract_txt:apply in 2592) [ClassicSimilarity], result of:
           0.117701836 = score(doc=2592,freq=3.0), product of:
             0.21003701 = queryWeight, product of:
               1.4723741 = boost
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.024112316 = queryNorm
             0.5603862 = fieldWeight in 2592, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.038270026 = weight(abstract_txt:studies in 2592) [ClassicSimilarity], result of:
           0.038270026 = score(doc=2592,freq=1.0), product of:
             0.16396469 = queryWeight, product of:
               1.5932761 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.024112316 = queryNorm
             0.23340407 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.040239964 = weight(abstract_txt:context in 2592) [ClassicSimilarity], result of:
           0.040239964 = score(doc=2592,freq=1.0), product of:
             0.16954418 = queryWeight, product of:
               1.6201578 = boost
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.024112316 = queryNorm
             0.23734206 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.02606856 = weight(abstract_txt:systems in 2592) [ClassicSimilarity], result of:
           0.02606856 = score(doc=2592,freq=1.0), product of:
             0.13971256 = queryWeight, product of:
               1.6982553 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.024112316 = queryNorm
             0.1865871 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.11372888 = weight(abstract_txt:conducting in 2592) [ClassicSimilarity], result of:
           0.11372888 = score(doc=2592,freq=1.0), product of:
             0.29607013 = queryWeight, product of:
               1.7481052 = boost
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.024112316 = queryNorm
             0.38412818 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.059256252 = weight(abstract_txt:evaluation in 2592) [ClassicSimilarity], result of:
           0.059256252 = score(doc=2592,freq=1.0), product of:
             0.24153507 = queryWeight, product of:
               2.2329314 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.024112316 = queryNorm
             0.24533188 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.037252195 = weight(abstract_txt:information in 2592) [ClassicSimilarity], result of:
           0.037252195 = score(doc=2592,freq=4.0), product of:
             0.14068528 = queryWeight, product of:
               2.4100418 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.024112316 = queryNorm
             0.264791 = fieldWeight in 2592, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.03717112 = weight(abstract_txt:library in 2592) [ClassicSimilarity], result of:
           0.03717112 = score(doc=2592,freq=1.0), product of:
             0.21329165 = queryWeight, product of:
               2.7758195 = boost
               3.1867187 = idf(docFreq=4964, maxDocs=44218)
               0.024112316 = queryNorm
             0.17427368 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1867187 = idf(docFreq=4964, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.09738859 = weight(abstract_txt:retrieval in 2592) [ClassicSimilarity], result of:
           0.09738859 = score(doc=2592,freq=2.0), product of:
             0.36235377 = queryWeight, product of:
               4.324358 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.024112316 = queryNorm
             0.26876658 = fieldWeight in 2592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
       0.44 = coord(11/25)
   

5. Progress in visual information access and retrieval (1999) 0.27

   0.2670965 = sum of:
     0.2670965 = product of:
       0.51364714 = sum of:
         0.02128963 = weight(abstract_txt:provide in 839) [ClassicSimilarity], result of:
           0.02128963 = score(doc=839,freq=4.0), product of:
             0.09688566 = queryWeight, product of:
               4.0180984 = idf(docFreq=2161, maxDocs=44218)
               0.024112316 = queryNorm
             0.21973975 = fieldWeight in 839, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.0180984 = idf(docFreq=2161, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.011881333 = weight(abstract_txt:first in 839) [ClassicSimilarity], result of:
           0.011881333 = score(doc=839,freq=1.0), product of:
             0.10425035 = queryWeight, product of:
               1.0373111 = boost
               4.168018 = idf(docFreq=1860, maxDocs=44218)
               0.024112316 = queryNorm
             0.11396924 = fieldWeight in 839, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.168018 = idf(docFreq=1860, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.018472938 = weight(abstract_txt:issues in 839) [ClassicSimilarity], result of:
           0.018472938 = score(doc=839,freq=2.0), product of:
             0.11104901 = queryWeight, product of:
               1.0706009 = boost
               4.3017797 = idf(docFreq=1627, maxDocs=44218)
               0.024112316 = queryNorm
             0.16634941 = fieldWeight in 839, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3017797 = idf(docFreq=1627, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.013180968 = weight(abstract_txt:what in 839) [ClassicSimilarity], result of:
           0.013180968 = score(doc=839,freq=1.0), product of:
             0.111720346 = queryWeight, product of:
               1.0738322 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.024112316 = queryNorm
             0.11798181 = fieldWeight in 839, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.01814899 = weight(abstract_txt:standards in 839) [ClassicSimilarity], result of:
           0.01814899 = score(doc=839,freq=1.0), product of:
             0.13827246 = queryWeight, product of:
               1.1946429 = boost
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.024112316 = queryNorm
             0.13125527 = fieldWeight in 839, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.012001232 = weight(abstract_txt:from in 839) [ClassicSimilarity], result of:
           0.012001232 = score(doc=839,freq=3.0), product of:
             0.09168273 = queryWeight, product of:
               1.3757168 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.024112316 = queryNorm
             0.1308996 = fieldWeight in 839, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.036866512 = weight(abstract_txt:systems in 839) [ClassicSimilarity], result of:
           0.036866512 = score(doc=839,freq=8.0), product of:
             0.13971256 = queryWeight, product of:
               1.6982553 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.024112316 = queryNorm
             0.263874 = fieldWeight in 839, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.016064093 = weight(abstract_txt:search in 839) [ClassicSimilarity], result of:
           0.016064093 = score(doc=839,freq=1.0), product of:
             0.16060099 = queryWeight, product of:
               1.8207879 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.024112316 = queryNorm
             0.10002487 = fieldWeight in 839, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.059256252 = weight(abstract_txt:evaluation in 839) [ClassicSimilarity], result of:
           0.059256252 = score(doc=839,freq=4.0), product of:
             0.24153507 = queryWeight, product of:
               2.2329314 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.024112316 = queryNorm
             0.24533188 = fieldWeight in 839, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.030931368 = weight(abstract_txt:framework in 839) [ClassicSimilarity], result of:
           0.030931368 = score(doc=839,freq=1.0), product of:
             0.24856701 = queryWeight, product of:
               2.2652023 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.024112316 = queryNorm
             0.12443875 = fieldWeight in 839, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.05430394 = weight(abstract_txt:information in 839) [ClassicSimilarity], result of:
           0.05430394 = score(doc=839,freq=34.0), product of:
             0.14068528 = queryWeight, product of:
               2.4100418 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.024112316 = queryNorm
             0.3859959 = fieldWeight in 839, product of:
               5.8309517 = tf(freq=34.0), with freq of:
                 34.0 = termFreq=34.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.0525679 = weight(abstract_txt:library in 839) [ClassicSimilarity], result of:
           0.0525679 = score(doc=839,freq=8.0), product of:
             0.21329165 = queryWeight, product of:
               2.7758195 = boost
               3.1867187 = idf(docFreq=4964, maxDocs=44218)
               0.024112316 = queryNorm
             0.24646018 = fieldWeight in 839, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.1867187 = idf(docFreq=4964, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
         0.168682 = weight(abstract_txt:retrieval in 839) [ClassicSimilarity], result of:
           0.168682 = score(doc=839,freq=24.0), product of:
             0.36235377 = queryWeight, product of:
               4.324358 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.024112316 = queryNorm
             0.46551743 = fieldWeight in 839, product of:
               4.8989797 = tf(freq=24.0), with freq of:
                 24.0 = termFreq=24.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.02734375 = fieldNorm(doc=839)
       0.52 = coord(13/25)