Document (#40701)

Author

Behnert, C.
Lewandowski, D.

Title

¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments

Source

Journal of documentation. 73(2017) no.3, S.509-527

Year

2017

Abstract

Purpose This paper demonstrates how to apply traditional information retrieval evaluation methods based on standards from the Text REtrieval Conference (TREC) and web search evaluation to all types of modern library information systems including online public access catalogs, discovery systems, and digital libraries that provide web search features to gather information from heterogeneous sources. Design/methodology/approach We apply conventional procedures from information retrieval evaluation to the library information system context considering the specific characteristics of modern library materials. Findings We introduce a framework consisting of five parts: (1) search queries, (2) search results, (3) assessors, (4) testing, and (5) data analysis. We show how to deal with comparability problems resulting from diverse document types, e.g., electronic articles vs. printed monographs and what issues need to be considered for retrieval tests in the library context. Practical implications The framework can be used as a guideline for conducting retrieval effectiveness studies in the library context. Originality/value Although a considerable amount of research has been done on information retrieval evaluation, and standards for conducting retrieval effectiveness studies do exist, to our knowledge this is the first attempt to provide a systematic framework for evaluating the retrieval effectiveness of twenty-first-century library information systems. We demonstrate which issues must be considered and what decisions must be made by researchers prior to a retrieval test.

Content

Vgl.: http://www.emeraldinsight.com/doi/pdfplus/10.1108/JD-08-2016-0099.

Theme

Retrievalstudien

Similar documents (author)

1. Lewandowski, D.: Informationsarmut : sowohl ein quantitatives als auch ein qualitatives Problem (1999) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:lewandowski in 4646) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 4646, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=4646)
   

2. Lewandowski, D.: Wie können sich Bibliotheken gegenüber Wissenschaftssuchmaschinen positionieren? (2007) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:lewandowski in 6112) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 6112, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=6112)
   

3. Lewandowski, D.: "Find what I mean not what I say" : Neuere Ansätze zur Qualifizierung von Suchmaschinen-Ergebnissen (2001) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:lewandowski in 6932) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 6932, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=6932)
   

4. Lewandowski, D.: Alles nur noch Google? : Entwicklungen im Bereich der WWW-Suchmaschinen (2002) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:lewandowski in 1997) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 1997, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=1997)
   

5. Lewandowski, D.: Aktualität als erfolgskritischer Faktor bei Suchmaschinen (2006) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:lewandowski in 2816) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 2816, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=2816)
   

Similar documents (content)

1. Keller, K.; Breuer, T.; Schaer, P.: Evaluation of temporal change in IR test collections (2024) 0.37

   0.3715285 = sum of:
     0.3715285 = product of:
       0.844383 = sum of:
         0.052056845 = weight(abstract_txt:what in 2344) [ClassicSimilarity], result of:
           0.052056845 = score(doc=2344,freq=3.0), product of:
             0.11163565 = queryWeight, product of:
               1.0731604 = boost
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.024149267 = queryNorm
             0.46631023 = fieldWeight in 2344, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.033474658 = weight(abstract_txt:types in 2344) [ClassicSimilarity], result of:
           0.033474658 = score(doc=2344,freq=1.0), product of:
             0.119950525 = queryWeight, product of:
               1.1124084 = boost
               4.4651284 = idf(docFreq=1388, maxDocs=44421)
               0.024149267 = queryNorm
             0.27907053 = fieldWeight in 2344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4651284 = idf(docFreq=1388, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.047515344 = weight(abstract_txt:considered in 2344) [ClassicSimilarity], result of:
           0.047515344 = score(doc=2344,freq=1.0), product of:
             0.15150048 = queryWeight, product of:
               1.2501732 = boost
               5.0181065 = idf(docFreq=798, maxDocs=44421)
               0.024149267 = queryNorm
             0.31363165 = fieldWeight in 2344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0181065 = idf(docFreq=798, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.04918112 = weight(abstract_txt:must in 2344) [ClassicSimilarity], result of:
           0.04918112 = score(doc=2344,freq=1.0), product of:
             0.15502094 = queryWeight, product of:
               1.264615 = boost
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.024149267 = queryNorm
             0.3172547 = fieldWeight in 2344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.022346152 = weight(abstract_txt:from in 2344) [ClassicSimilarity], result of:
           0.022346152 = score(doc=2344,freq=2.0), product of:
             0.091620624 = queryWeight, product of:
               1.3749117 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.024149267 = queryNorm
             0.2438987 = fieldWeight in 2344, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.045889158 = weight(abstract_txt:context in 2344) [ClassicSimilarity], result of:
           0.045889158 = score(doc=2344,freq=1.0), product of:
             0.16944492 = queryWeight, product of:
               1.6192843 = boost
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.024149267 = queryNorm
             0.2708205 = fieldWeight in 2344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.05970165 = weight(abstract_txt:systems in 2344) [ClassicSimilarity], result of:
           0.05970165 = score(doc=2344,freq=4.0), product of:
             0.14001428 = queryWeight, product of:
               1.6996689 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024149267 = queryNorm
             0.42639688 = fieldWeight in 2344, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.11709326 = weight(abstract_txt:evaluation in 2344) [ClassicSimilarity], result of:
           0.11709326 = score(doc=2344,freq=3.0), product of:
             0.24146208 = queryWeight, product of:
               2.2320435 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024149267 = queryNorm
             0.48493436 = fieldWeight in 2344, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.021287652 = weight(abstract_txt:information in 2344) [ClassicSimilarity], result of:
           0.021287652 = score(doc=2344,freq=1.0), product of:
             0.14080884 = queryWeight, product of:
               2.4105055 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.024149267 = queryNorm
             0.15118122 = fieldWeight in 2344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.1723997 = weight(abstract_txt:effectiveness in 2344) [ClassicSimilarity], result of:
           0.1723997 = score(doc=2344,freq=3.0), product of:
             0.31250143 = queryWeight, product of:
               2.5392425 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.024149267 = queryNorm
             0.5516765 = fieldWeight in 2344, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.22343744 = weight(abstract_txt:retrieval in 2344) [ClassicSimilarity], result of:
           0.22343744 = score(doc=2344,freq=8.0), product of:
             0.36357057 = queryWeight, product of:
               4.330545 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.024149267 = queryNorm
             0.6145642 = fieldWeight in 2344, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
       0.44 = coord(11/25)
   

2. Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008) 0.34

   0.33949685 = sum of:
     0.33949685 = product of:
       0.9430468 = sum of:
         0.10870907 = weight(abstract_txt:studies in 3021) [ClassicSimilarity], result of:
           0.10870907 = score(doc=3021,freq=4.0), product of:
             0.16347036 = queryWeight, product of:
               1.5904803 = boost
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.024149267 = queryNorm
             0.6650078 = fieldWeight in 3021, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.057361446 = weight(abstract_txt:context in 3021) [ClassicSimilarity], result of:
           0.057361446 = score(doc=3021,freq=1.0), product of:
             0.16944492 = queryWeight, product of:
               1.6192843 = boost
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.024149267 = queryNorm
             0.33852562 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.083435595 = weight(abstract_txt:systems in 3021) [ClassicSimilarity], result of:
           0.083435595 = score(doc=3021,freq=5.0), product of:
             0.14001428 = queryWeight, product of:
               1.6996689 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024149267 = queryNorm
             0.59590775 = fieldWeight in 3021, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.16192004 = weight(abstract_txt:conducting in 3021) [ClassicSimilarity], result of:
           0.16192004 = score(doc=3021,freq=1.0), product of:
             0.29565495 = queryWeight, product of:
               1.7464484 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.024149267 = queryNorm
             0.5476656 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.23901561 = weight(abstract_txt:evaluation in 3021) [ClassicSimilarity], result of:
           0.23901561 = score(doc=3021,freq=8.0), product of:
             0.24146208 = queryWeight, product of:
               2.2320435 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024149267 = queryNorm
             0.9898681 = fieldWeight in 3021, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.08822992 = weight(abstract_txt:framework in 3021) [ClassicSimilarity], result of:
           0.08822992 = score(doc=3021,freq=1.0), product of:
             0.24850701 = queryWeight, product of:
               2.2643707 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.024149267 = queryNorm
             0.35503995 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.026609564 = weight(abstract_txt:information in 3021) [ClassicSimilarity], result of:
           0.026609564 = score(doc=3021,freq=1.0), product of:
             0.14080884 = queryWeight, product of:
               2.4105055 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.024149267 = queryNorm
             0.18897653 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.124418765 = weight(abstract_txt:effectiveness in 3021) [ClassicSimilarity], result of:
           0.124418765 = score(doc=3021,freq=1.0), product of:
             0.31250143 = queryWeight, product of:
               2.5392425 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.024149267 = queryNorm
             0.39813823 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.053346865 = weight(abstract_txt:library in 3021) [ClassicSimilarity], result of:
           0.053346865 = score(doc=3021,freq=1.0), product of:
             0.21413124 = queryWeight, product of:
               2.7805917 = boost
               3.188885 = idf(docFreq=4976, maxDocs=44421)
               0.024149267 = queryNorm
             0.24913163 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.188885 = idf(docFreq=4976, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
       0.36 = coord(9/25)
   

3. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.30

   0.30430266 = sum of:
     0.30430266 = product of:
       0.6339639 = sum of:
         0.038826495 = weight(abstract_txt:issues in 3019) [ClassicSimilarity], result of:
           0.038826495 = score(doc=3019,freq=3.0), product of:
             0.11122326 = queryWeight, product of:
               1.0711764 = boost
               4.299626 = idf(docFreq=1638, maxDocs=44421)
               0.024149267 = queryNorm
             0.3490861 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.299626 = idf(docFreq=1638, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.022541275 = weight(abstract_txt:what in 3019) [ClassicSimilarity], result of:
           0.022541275 = score(doc=3019,freq=1.0), product of:
             0.11163565 = queryWeight, product of:
               1.0731604 = boost
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.024149267 = queryNorm
             0.20191826 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.025105992 = weight(abstract_txt:types in 3019) [ClassicSimilarity], result of:
           0.025105992 = score(doc=3019,freq=1.0), product of:
             0.119950525 = queryWeight, product of:
               1.1124084 = boost
               4.4651284 = idf(docFreq=1388, maxDocs=44421)
               0.024149267 = queryNorm
             0.2093029 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4651284 = idf(docFreq=1388, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.036885843 = weight(abstract_txt:must in 3019) [ClassicSimilarity], result of:
           0.036885843 = score(doc=3019,freq=1.0), product of:
             0.15502094 = queryWeight, product of:
               1.264615 = boost
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.024149267 = queryNorm
             0.23794103 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.011850836 = weight(abstract_txt:from in 3019) [ClassicSimilarity], result of:
           0.011850836 = score(doc=3019,freq=1.0), product of:
             0.091620624 = queryWeight, product of:
               1.3749117 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.024149267 = queryNorm
             0.12934682 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.03261272 = weight(abstract_txt:studies in 3019) [ClassicSimilarity], result of:
           0.03261272 = score(doc=3019,freq=1.0), product of:
             0.16347036 = queryWeight, product of:
               1.5904803 = boost
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.024149267 = queryNorm
             0.19950235 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.059233397 = weight(abstract_txt:systems in 3019) [ClassicSimilarity], result of:
           0.059233397 = score(doc=3019,freq=7.0), product of:
             0.14001428 = queryWeight, product of:
               1.6996689 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024149267 = queryNorm
             0.42305255 = fieldWeight in 3019, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.06156153 = weight(abstract_txt:search in 3019) [ClassicSimilarity], result of:
           0.06156153 = score(doc=3019,freq=5.0), product of:
             0.16071022 = queryWeight, product of:
               1.820958 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.024149267 = queryNorm
             0.3830592 = fieldWeight in 3019, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.15210862 = weight(abstract_txt:evaluation in 3019) [ClassicSimilarity], result of:
           0.15210862 = score(doc=3019,freq=9.0), product of:
             0.24146208 = queryWeight, product of:
               2.2320435 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024149267 = queryNorm
             0.62994826 = fieldWeight in 3019, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.01596574 = weight(abstract_txt:information in 3019) [ClassicSimilarity], result of:
           0.01596574 = score(doc=3019,freq=1.0), product of:
             0.14080884 = queryWeight, product of:
               2.4105055 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.024149267 = queryNorm
             0.113385916 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.07465126 = weight(abstract_txt:effectiveness in 3019) [ClassicSimilarity], result of:
           0.07465126 = score(doc=3019,freq=1.0), product of:
             0.31250143 = queryWeight, product of:
               2.5392425 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.024149267 = queryNorm
             0.23888294 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.10262019 = weight(abstract_txt:retrieval in 3019) [ClassicSimilarity], result of:
           0.10262019 = score(doc=3019,freq=3.0), product of:
             0.36357057 = queryWeight, product of:
               4.330545 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.024149267 = queryNorm
             0.2822566 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
       0.48 = coord(12/25)
   

4. Spink, A.; Cole, C.: New directions in cognitive information retrieval : introduction (2005) 0.29

   0.28860798 = sum of:
     0.28860798 = product of:
       0.65592724 = sum of:
         0.036854625 = weight(abstract_txt:provide in 772) [ClassicSimilarity], result of:
           0.036854625 = score(doc=772,freq=3.0), product of:
             0.09693344 = queryWeight, product of:
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.024149267 = queryNorm
             0.38020548 = fieldWeight in 772, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.04157593 = weight(abstract_txt:considered in 772) [ClassicSimilarity], result of:
           0.04157593 = score(doc=772,freq=1.0), product of:
             0.15150048 = queryWeight, product of:
               1.2501732 = boost
               5.0181065 = idf(docFreq=798, maxDocs=44421)
               0.024149267 = queryNorm
             0.2744277 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0181065 = idf(docFreq=798, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.019552883 = weight(abstract_txt:from in 772) [ClassicSimilarity], result of:
           0.019552883 = score(doc=772,freq=2.0), product of:
             0.091620624 = queryWeight, product of:
               1.3749117 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.024149267 = queryNorm
             0.21341136 = fieldWeight in 772, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.09048051 = weight(abstract_txt:systems in 772) [ClassicSimilarity], result of:
           0.09048051 = score(doc=772,freq=12.0), product of:
             0.14001428 = queryWeight, product of:
               1.6996689 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024149267 = queryNorm
             0.6462234 = fieldWeight in 772, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.113344036 = weight(abstract_txt:conducting in 772) [ClassicSimilarity], result of:
           0.113344036 = score(doc=772,freq=1.0), product of:
             0.29565495 = queryWeight, product of:
               1.7464484 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.024149267 = queryNorm
             0.38336593 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.045424085 = weight(abstract_txt:search in 772) [ClassicSimilarity], result of:
           0.045424085 = score(doc=772,freq=2.0), product of:
             0.16071022 = queryWeight, product of:
               1.820958 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.024149267 = queryNorm
             0.2826459 = fieldWeight in 772, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.059153352 = weight(abstract_txt:evaluation in 772) [ClassicSimilarity], result of:
           0.059153352 = score(doc=772,freq=1.0), product of:
             0.24146208 = queryWeight, product of:
               2.2320435 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024149267 = queryNorm
             0.24497987 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.06176094 = weight(abstract_txt:framework in 772) [ClassicSimilarity], result of:
           0.06176094 = score(doc=772,freq=1.0), product of:
             0.24850701 = queryWeight, product of:
               2.2643707 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.024149267 = queryNorm
             0.24852796 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.052684247 = weight(abstract_txt:information in 772) [ClassicSimilarity], result of:
           0.052684247 = score(doc=772,freq=8.0), product of:
             0.14080884 = queryWeight, product of:
               2.4105055 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.024149267 = queryNorm
             0.37415442 = fieldWeight in 772, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.037342805 = weight(abstract_txt:library in 772) [ClassicSimilarity], result of:
           0.037342805 = score(doc=772,freq=1.0), product of:
             0.21413124 = queryWeight, product of:
               2.7805917 = boost
               3.188885 = idf(docFreq=4976, maxDocs=44421)
               0.024149267 = queryNorm
             0.17439215 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.188885 = idf(docFreq=4976, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.09775389 = weight(abstract_txt:retrieval in 772) [ClassicSimilarity], result of:
           0.09775389 = score(doc=772,freq=2.0), product of:
             0.36357057 = queryWeight, product of:
               4.330545 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.024149267 = queryNorm
             0.26887184 = fieldWeight in 772, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
       0.44 = coord(11/25)
   

5. Progress in visual information access and retrieval (1999) 0.27

   0.2675034 = sum of:
     0.2675034 = product of:
       0.5144296 = sum of:
         0.021278027 = weight(abstract_txt:provide in 964) [ClassicSimilarity], result of:
           0.021278027 = score(doc=964,freq=4.0), product of:
             0.09693344 = queryWeight, product of:
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.024149267 = queryNorm
             0.21951173 = fieldWeight in 964, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.011859598 = weight(abstract_txt:first in 964) [ClassicSimilarity], result of:
           0.011859598 = score(doc=964,freq=1.0), product of:
             0.10421239 = queryWeight, product of:
               1.0368665 = boost
               4.1619086 = idf(docFreq=1880, maxDocs=44421)
               0.024149267 = queryNorm
             0.11380219 = fieldWeight in 964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1619086 = idf(docFreq=1880, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.01849266 = weight(abstract_txt:issues in 964) [ClassicSimilarity], result of:
           0.01849266 = score(doc=964,freq=2.0), product of:
             0.11122326 = queryWeight, product of:
               1.0711764 = boost
               4.299626 = idf(docFreq=1638, maxDocs=44421)
               0.024149267 = queryNorm
             0.16626611 = fieldWeight in 964, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.299626 = idf(docFreq=1638, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.013149077 = weight(abstract_txt:what in 964) [ClassicSimilarity], result of:
           0.013149077 = score(doc=964,freq=1.0), product of:
             0.11163565 = queryWeight, product of:
               1.0731604 = boost
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.024149267 = queryNorm
             0.11778565 = fieldWeight in 964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.018213337 = weight(abstract_txt:standards in 964) [ClassicSimilarity], result of:
           0.018213337 = score(doc=964,freq=1.0), product of:
             0.13871786 = queryWeight, product of:
               1.1962705 = boost
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.024149267 = queryNorm
             0.13129771 = fieldWeight in 964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.0119736465 = weight(abstract_txt:from in 964) [ClassicSimilarity], result of:
           0.0119736465 = score(doc=964,freq=3.0), product of:
             0.091620624 = queryWeight, product of:
               1.3749117 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.024149267 = queryNorm
             0.13068724 = fieldWeight in 964, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.03693851 = weight(abstract_txt:systems in 964) [ClassicSimilarity], result of:
           0.03693851 = score(doc=964,freq=8.0), product of:
             0.14001428 = queryWeight, product of:
               1.6996689 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024149267 = queryNorm
             0.2638196 = fieldWeight in 964, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.016059838 = weight(abstract_txt:search in 964) [ClassicSimilarity], result of:
           0.016059838 = score(doc=964,freq=1.0), product of:
             0.16071022 = queryWeight, product of:
               1.820958 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.024149267 = queryNorm
             0.09993041 = fieldWeight in 964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.059153352 = weight(abstract_txt:evaluation in 964) [ClassicSimilarity], result of:
           0.059153352 = score(doc=964,freq=4.0), product of:
             0.24146208 = queryWeight, product of:
               2.2320435 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024149267 = queryNorm
             0.24497987 = fieldWeight in 964, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.03088047 = weight(abstract_txt:framework in 964) [ClassicSimilarity], result of:
           0.03088047 = score(doc=964,freq=1.0), product of:
             0.24850701 = queryWeight, product of:
               2.2643707 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.024149267 = queryNorm
             0.12426398 = fieldWeight in 964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.05430568 = weight(abstract_txt:information in 964) [ClassicSimilarity], result of:
           0.05430568 = score(doc=964,freq=34.0), product of:
             0.14080884 = queryWeight, product of:
               2.4105055 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.024149267 = queryNorm
             0.38566956 = fieldWeight in 964, product of:
               5.8309517 = tf(freq=34.0), with freq of:
                 34.0 = termFreq=34.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.052810702 = weight(abstract_txt:library in 964) [ClassicSimilarity], result of:
           0.052810702 = score(doc=964,freq=8.0), product of:
             0.21413124 = queryWeight, product of:
               2.7805917 = boost
               3.188885 = idf(docFreq=4976, maxDocs=44421)
               0.024149267 = queryNorm
             0.24662773 = fieldWeight in 964, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.188885 = idf(docFreq=4976, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
         0.16931471 = weight(abstract_txt:retrieval in 964) [ClassicSimilarity], result of:
           0.16931471 = score(doc=964,freq=24.0), product of:
             0.36357057 = queryWeight, product of:
               4.330545 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.024149267 = queryNorm
             0.4656997 = fieldWeight in 964, product of:
               4.8989797 = tf(freq=24.0), with freq of:
                 24.0 = termFreq=24.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.02734375 = fieldNorm(doc=964)
       0.52 = coord(13/25)