Document (#31842)

Author

Landoni, M.
Bell, S.

Title

Information retrieval techniques for evaluating search engines : a critical overview

Source

Aslib proceedings. 52(2000) no.3, S.124-129

Year

2000

Abstract

The objective of this paper is to highlight the importance of a scientifically sounded approach to search engine evaluation. Nowadays there is a flourishing literature which describes various attempts at conducting such evaluation by following all sort of approaches, but very often only the final results are published with little, if any, information about the methodology and the procedures adopted. These various experiments have been critically investigated and catalogued according to their scientific foundation by Bell [1] in the attempt to provide a valuable framework for future studies in this area. This paper reconsiders some of Bell's ideas in the light of the crisis of classic evaluation techniques for information retrieval and tries to envisage some form of collaboration between the IR and web communities in order to design a better and more consistent platform for the evaluation of tools for interactive information retrieval.

Theme

Suchmaschinen
Retrievalstudien

Similar documents (author)

1. Bell, H.K.: Compiling an anthology of indexes (2002) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:bell in 2860) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 2860, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=2860)
   

2. Bell, S.J.: Providing remote access to CD-ROMs : some practical advice (1993) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:bell in 3748) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 3748, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=3748)
   

3. Bell, H.: On the indexability of butterflies (1992) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:bell in 3847) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 3847, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=3847)
   

4. Bell, S.S: Serials directory: EBSCO CD-ROM (1993) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:bell in 4427) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 4427, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=4427)
   

5. Bell, H.K.: Vive la différence : the survival of the softest (1993) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:bell in 6349) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 6349, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=6349)
   

Similar documents (content)

1. Nicholson, S.: Raising reliability of Web search tool research through replication and chaos theory (2000) 0.15

   0.15083 = sum of:
     0.15083 = product of:
       0.5386786 = sum of:
         0.14577132 = weight(abstract_txt:classic in 4806) [ClassicSimilarity], result of:
           0.14577132 = score(doc=4806,freq=1.0), product of:
             0.18602917 = queryWeight, product of:
               1.1668109 = boost
               7.1642876 = idf(docFreq=92, maxDocs=44218)
               0.022253973 = queryNorm
             0.78359395 = fieldWeight in 4806, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1642876 = idf(docFreq=92, maxDocs=44218)
               0.109375 = fieldNorm(doc=4806)
         0.016709205 = weight(abstract_txt:this in 4806) [ClassicSimilarity], result of:
           0.016709205 = score(doc=4806,freq=1.0), product of:
             0.06331072 = queryWeight, product of:
               1.1789875 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.022253973 = queryNorm
             0.2639238 = fieldWeight in 4806, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.109375 = fieldNorm(doc=4806)
         0.07761807 = weight(abstract_txt:search in 4806) [ClassicSimilarity], result of:
           0.07761807 = score(doc=4806,freq=4.0), product of:
             0.09699846 = queryWeight, product of:
               1.1915365 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.022253973 = queryNorm
             0.800199 = fieldWeight in 4806, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.109375 = fieldNorm(doc=4806)
         0.073694386 = weight(abstract_txt:techniques in 4806) [ClassicSimilarity], result of:
           0.073694386 = score(doc=4806,freq=1.0), product of:
             0.14874165 = queryWeight, product of:
               1.4755069 = boost
               4.5298495 = idf(docFreq=1295, maxDocs=44218)
               0.022253973 = queryNorm
             0.49545228 = fieldWeight in 4806, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5298495 = idf(docFreq=1295, maxDocs=44218)
               0.109375 = fieldNorm(doc=4806)
         0.031818785 = weight(abstract_txt:information in 4806) [ClassicSimilarity], result of:
           0.031818785 = score(doc=4806,freq=2.0), product of:
             0.084969945 = queryWeight, product of:
               1.5771486 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022253973 = queryNorm
             0.37447104 = fieldWeight in 4806, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.109375 = fieldNorm(doc=4806)
         0.049910393 = weight(abstract_txt:retrieval in 4806) [ClassicSimilarity], result of:
           0.049910393 = score(doc=4806,freq=1.0), product of:
             0.13131088 = queryWeight, product of:
               1.6979345 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.022253973 = queryNorm
             0.38009337 = fieldWeight in 4806, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.109375 = fieldNorm(doc=4806)
         0.14315642 = weight(abstract_txt:evaluation in 4806) [ClassicSimilarity], result of:
           0.14315642 = score(doc=4806,freq=1.0), product of:
             0.29176074 = queryWeight, product of:
               2.9224923 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022253973 = queryNorm
             0.49066377 = fieldWeight in 4806, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.109375 = fieldNorm(doc=4806)
       0.28 = coord(7/25)
   

2. García Cumbreras, M.A.; Perea-Ortega, J.M.; García Vega, M.; Ureña López, L.A.: Information retrieval with geographical references : relevant documents filtering vs. query expansion (2009) 0.15

   0.14524068 = sum of:
     0.14524068 = product of:
       0.45387715 = sum of:
         0.08383231 = weight(abstract_txt:final in 4222) [ClassicSimilarity], result of:
           0.08383231 = score(doc=4222,freq=1.0), product of:
             0.14257339 = queryWeight, product of:
               1.0214784 = boost
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.022253973 = queryNorm
             0.5879941 = fieldWeight in 4222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
         0.028329514 = weight(abstract_txt:paper in 4222) [ClassicSimilarity], result of:
           0.028329514 = score(doc=4222,freq=1.0), product of:
             0.0871499 = queryWeight, product of:
               1.1294276 = boost
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.022253973 = queryNorm
             0.3250665 = fieldWeight in 4222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
         0.020254616 = weight(abstract_txt:this in 4222) [ClassicSimilarity], result of:
           0.020254616 = score(doc=4222,freq=2.0), product of:
             0.06331072 = queryWeight, product of:
               1.1789875 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.022253973 = queryNorm
             0.31992394 = fieldWeight in 4222, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
         0.047814824 = weight(abstract_txt:some in 4222) [ClassicSimilarity], result of:
           0.047814824 = score(doc=4222,freq=2.0), product of:
             0.09805562 = queryWeight, product of:
               1.1980121 = boost
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.022253973 = queryNorm
             0.4876296 = fieldWeight in 4222, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
         0.06316662 = weight(abstract_txt:techniques in 4222) [ClassicSimilarity], result of:
           0.06316662 = score(doc=4222,freq=1.0), product of:
             0.14874165 = queryWeight, product of:
               1.4755069 = boost
               4.5298495 = idf(docFreq=1295, maxDocs=44218)
               0.022253973 = queryNorm
             0.42467338 = fieldWeight in 4222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5298495 = idf(docFreq=1295, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
         0.027273243 = weight(abstract_txt:information in 4222) [ClassicSimilarity], result of:
           0.027273243 = score(doc=4222,freq=2.0), product of:
             0.084969945 = queryWeight, product of:
               1.5771486 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022253973 = queryNorm
             0.32097518 = fieldWeight in 4222, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
         0.060500532 = weight(abstract_txt:retrieval in 4222) [ClassicSimilarity], result of:
           0.060500532 = score(doc=4222,freq=2.0), product of:
             0.13131088 = queryWeight, product of:
               1.6979345 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.022253973 = queryNorm
             0.4607427 = fieldWeight in 4222, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
         0.122705504 = weight(abstract_txt:evaluation in 4222) [ClassicSimilarity], result of:
           0.122705504 = score(doc=4222,freq=1.0), product of:
             0.29176074 = queryWeight, product of:
               2.9224923 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022253973 = queryNorm
             0.42056894 = fieldWeight in 4222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
       0.32 = coord(8/25)
   

3. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.13

   0.13186449 = sum of:
     0.13186449 = product of:
       0.47094458 = sum of:
         0.018886343 = weight(abstract_txt:paper in 3700) [ClassicSimilarity], result of:
           0.018886343 = score(doc=3700,freq=1.0), product of:
             0.0871499 = queryWeight, product of:
               1.1294276 = boost
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.022253973 = queryNorm
             0.216711 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.11101825 = weight(abstract_txt:conducting in 3700) [ClassicSimilarity], result of:
           0.11101825 = score(doc=3700,freq=2.0), product of:
             0.178818 = queryWeight, product of:
               1.1439724 = boost
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.022253973 = queryNorm
             0.6208449 = fieldWeight in 3700, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.0135030765 = weight(abstract_txt:this in 3700) [ClassicSimilarity], result of:
           0.0135030765 = score(doc=3700,freq=2.0), product of:
             0.06331072 = queryWeight, product of:
               1.1789875 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.022253973 = queryNorm
             0.21328263 = fieldWeight in 3700, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.044353183 = weight(abstract_txt:search in 3700) [ClassicSimilarity], result of:
           0.044353183 = score(doc=3700,freq=4.0), product of:
             0.09699846 = queryWeight, product of:
               1.1915365 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.022253973 = queryNorm
             0.45725656 = fieldWeight in 3700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.03401571 = weight(abstract_txt:information in 3700) [ClassicSimilarity], result of:
           0.03401571 = score(doc=3700,freq=7.0), product of:
             0.084969945 = queryWeight, product of:
               1.5771486 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022253973 = queryNorm
             0.40032637 = fieldWeight in 3700, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.08556067 = weight(abstract_txt:retrieval in 3700) [ClassicSimilarity], result of:
           0.08556067 = score(doc=3700,freq=9.0), product of:
             0.13131088 = queryWeight, product of:
               1.6979345 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.022253973 = queryNorm
             0.6515886 = fieldWeight in 3700, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.16360734 = weight(abstract_txt:evaluation in 3700) [ClassicSimilarity], result of:
           0.16360734 = score(doc=3700,freq=4.0), product of:
             0.29176074 = queryWeight, product of:
               2.9224923 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022253973 = queryNorm
             0.5607586 = fieldWeight in 3700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
       0.28 = coord(7/25)
   

4. Fafalios, P.; Tzitzikas, Y.: Stochastic reranking of biomedical search results based on extracted entities (2017) 0.12

   0.11703752 = sum of:
     0.11703752 = product of:
       0.41799113 = sum of:
         0.11780102 = weight(abstract_txt:classic in 3919) [ClassicSimilarity], result of:
           0.11780102 = score(doc=3919,freq=2.0), product of:
             0.18602917 = queryWeight, product of:
               1.1668109 = boost
               7.1642876 = idf(docFreq=92, maxDocs=44218)
               0.022253973 = queryNorm
             0.6332395 = fieldWeight in 3919, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1642876 = idf(docFreq=92, maxDocs=44218)
               0.0625 = fieldNorm(doc=3919)
         0.009548117 = weight(abstract_txt:this in 3919) [ClassicSimilarity], result of:
           0.009548117 = score(doc=3919,freq=1.0), product of:
             0.06331072 = queryWeight, product of:
               1.1789875 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.022253973 = queryNorm
             0.1508136 = fieldWeight in 3919, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3919)
         0.049588367 = weight(abstract_txt:search in 3919) [ClassicSimilarity], result of:
           0.049588367 = score(doc=3919,freq=5.0), product of:
             0.09699846 = queryWeight, product of:
               1.1915365 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.022253973 = queryNorm
             0.5112284 = fieldWeight in 3919, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=3919)
         0.10605954 = weight(abstract_txt:nowadays in 3919) [ClassicSimilarity], result of:
           0.10605954 = score(doc=3919,freq=1.0), product of:
             0.21853691 = queryWeight, product of:
               1.2646558 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.022253973 = queryNorm
             0.48531634 = fieldWeight in 3919, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0625 = fieldNorm(doc=3919)
         0.01285673 = weight(abstract_txt:information in 3919) [ClassicSimilarity], result of:
           0.01285673 = score(doc=3919,freq=1.0), product of:
             0.084969945 = queryWeight, product of:
               1.5771486 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022253973 = queryNorm
             0.15130915 = fieldWeight in 3919, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3919)
         0.04033369 = weight(abstract_txt:retrieval in 3919) [ClassicSimilarity], result of:
           0.04033369 = score(doc=3919,freq=2.0), product of:
             0.13131088 = queryWeight, product of:
               1.6979345 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.022253973 = queryNorm
             0.3071618 = fieldWeight in 3919, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3919)
         0.08180367 = weight(abstract_txt:evaluation in 3919) [ClassicSimilarity], result of:
           0.08180367 = score(doc=3919,freq=1.0), product of:
             0.29176074 = queryWeight, product of:
               2.9224923 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022253973 = queryNorm
             0.2803793 = fieldWeight in 3919, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3919)
       0.28 = coord(7/25)
   

5. Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008) 0.11

   0.113299124 = sum of:
     0.113299124 = product of:
       0.4720797 = sum of:
         0.023607928 = weight(abstract_txt:paper in 2021) [ClassicSimilarity], result of:
           0.023607928 = score(doc=2021,freq=1.0), product of:
             0.0871499 = queryWeight, product of:
               1.1294276 = boost
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.022253973 = queryNorm
             0.27088875 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.098127194 = weight(abstract_txt:conducting in 2021) [ClassicSimilarity], result of:
           0.098127194 = score(doc=2021,freq=1.0), product of:
             0.178818 = queryWeight, product of:
               1.1439724 = boost
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.022253973 = queryNorm
             0.5487546 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.016878847 = weight(abstract_txt:this in 2021) [ClassicSimilarity], result of:
           0.016878847 = score(doc=2021,freq=2.0), product of:
             0.06331072 = queryWeight, product of:
               1.1789875 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.022253973 = queryNorm
             0.2666033 = fieldWeight in 2021, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.028175153 = weight(abstract_txt:some in 2021) [ClassicSimilarity], result of:
           0.028175153 = score(doc=2021,freq=1.0), product of:
             0.09805562 = queryWeight, product of:
               1.1980121 = boost
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.022253973 = queryNorm
             0.28733847 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.016070912 = weight(abstract_txt:information in 2021) [ClassicSimilarity], result of:
           0.016070912 = score(doc=2021,freq=1.0), product of:
             0.084969945 = queryWeight, product of:
               1.5771486 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022253973 = queryNorm
             0.18913643 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.28921965 = weight(abstract_txt:evaluation in 2021) [ClassicSimilarity], result of:
           0.28921965 = score(doc=2021,freq=8.0), product of:
             0.29176074 = queryWeight, product of:
               2.9224923 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022253973 = queryNorm
             0.9912905 = fieldWeight in 2021, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
       0.24 = coord(6/25)