Document (#16540)

Author

Borlund, P.
Ingwersen, P.

Title

¬The development of a method for the evaluation of interactive information retrieval systems

Source

Journal of documentation. 53(1997) no.3, S.225-250

Year

1997

Abstract

Describes the development of a methods for the evaluation and comparison of interactive information retrieval systems. The method is based on the introduction of the concept of a 'simulated work task situation' or scenario and the involvement of real end users as test persons. The relevance assessments are made with reference to the concepts of situational as well as topic relevance, assessed in a non binary way and calculated as precision. The method is further based on a mixture of simulated and real information needs, and involves also assessments made by individual panel memebers

Content

Vgl. auch unter: http://www.emeraldinsight.com/10.1108/EUM0000000007198.

Similar documents (author)

1. Jepsen, E.T.; Seiden, P.; Ingwersen, P.; Björneborn, L.; Borlund, P.: Characteristics of scientific Web publications : preliminary data gathering and analysis (2004) 3.79

   3.7901485 = sum of:
     3.7901485 = sum of:
       1.64523 = weight(author_txt:ingwersen in 4092) [ClassicSimilarity], result of:
         1.64523 = score(doc=4092,freq=1.0), product of:
           0.6422638 = queryWeight, product of:
             8.197155 = idf(docFreq=31, maxDocs=42740)
             0.07835204 = queryNorm
           2.561611 = fieldWeight in 4092, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.197155 = idf(docFreq=31, maxDocs=42740)
             0.3125 = fieldNorm(doc=4092)
       2.1449184 = weight(author_txt:borlund in 4092) [ClassicSimilarity], result of:
         2.1449184 = score(doc=4092,freq=1.0), product of:
           0.76648366 = queryWeight, product of:
             1.0924327 = boost
             8.954841 = idf(docFreq=14, maxDocs=42740)
             0.07835204 = queryNorm
           2.7983878 = fieldWeight in 4092, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.954841 = idf(docFreq=14, maxDocs=42740)
             0.3125 = fieldNorm(doc=4092)
   

2. Borlund, P.: ¬The IIR evaluation model : a framework for evaluation of interactive information retrieval systems (2003) 2.14

   2.1449184 = sum of:
     2.1449184 = product of:
       4.289837 = sum of:
         4.289837 = weight(author_txt:borlund in 1923) [ClassicSimilarity], result of:
           4.289837 = score(doc=1923,freq=1.0), product of:
             0.76648366 = queryWeight, product of:
               1.0924327 = boost
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.07835204 = queryNorm
             5.5967755 = fieldWeight in 1923, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.625 = fieldNorm(doc=1923)
       0.5 = coord(1/2)
   

3. Borlund, P.: ¬The concept of relevance in IR (2003) 2.14

   2.1449184 = sum of:
     2.1449184 = product of:
       4.289837 = sum of:
         4.289837 = weight(author_txt:borlund in 2799) [ClassicSimilarity], result of:
           4.289837 = score(doc=2799,freq=1.0), product of:
             0.76648366 = queryWeight, product of:
               1.0924327 = boost
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.07835204 = queryNorm
             5.5967755 = fieldWeight in 2799, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.625 = fieldNorm(doc=2799)
       0.5 = coord(1/2)
   

4. Borlund, P.: Evaluation of interactive information retrieval systems (2000) 2.14

   2.1449184 = sum of:
     2.1449184 = product of:
       4.289837 = sum of:
         4.289837 = weight(author_txt:borlund in 3557) [ClassicSimilarity], result of:
           4.289837 = score(doc=3557,freq=1.0), product of:
             0.76648366 = queryWeight, product of:
               1.0924327 = boost
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.07835204 = queryNorm
             5.5967755 = fieldWeight in 3557, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.625 = fieldNorm(doc=3557)
       0.5 = coord(1/2)
   

5. Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems (2000) 2.14

   2.1449184 = sum of:
     2.1449184 = product of:
       4.289837 = sum of:
         4.289837 = weight(author_txt:borlund in 550) [ClassicSimilarity], result of:
           4.289837 = score(doc=550,freq=1.0), product of:
             0.76648366 = queryWeight, product of:
               1.0924327 = boost
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.07835204 = queryNorm
             5.5967755 = fieldWeight in 550, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.954841 = idf(docFreq=14, maxDocs=42740)
               0.625 = fieldNorm(doc=550)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems (2000) 0.51

   0.5143546 = sum of:
     0.5143546 = product of:
       1.1689878 = sum of:
         0.036319572 = weight(abstract_txt:situation in 550) [ClassicSimilarity], result of:
           0.036319572 = score(doc=550,freq=1.0), product of:
             0.116945714 = queryWeight, product of:
               1.0065736 = boost
               5.678954 = idf(docFreq=396, maxDocs=42740)
               0.02045834 = queryNorm
             0.3105678 = fieldWeight in 550, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.678954 = idf(docFreq=396, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.031580854 = weight(abstract_txt:systems in 550) [ClassicSimilarity], result of:
           0.031580854 = score(doc=550,freq=4.0), product of:
             0.08455963 = queryWeight, product of:
               1.2104585 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.02045834 = queryNorm
             0.3734744 = fieldWeight in 550, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.016496835 = weight(abstract_txt:retrieval in 550) [ClassicSimilarity], result of:
           0.016496835 = score(doc=550,freq=1.0), product of:
             0.08706312 = queryWeight, product of:
               1.2282463 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.02045834 = queryNorm
             0.18948132 = fieldWeight in 550, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.13282144 = weight(abstract_txt:persons in 550) [ClassicSimilarity], result of:
           0.13282144 = score(doc=550,freq=4.0), product of:
             0.17487025 = queryWeight, product of:
               1.2308676 = boost
               6.9443917 = idf(docFreq=111, maxDocs=42740)
               0.02045834 = queryNorm
             0.7595428 = fieldWeight in 550, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.9443917 = idf(docFreq=111, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.06827958 = weight(abstract_txt:involvement in 550) [ClassicSimilarity], result of:
           0.06827958 = score(doc=550,freq=1.0), product of:
             0.17813572 = queryWeight, product of:
               1.2423068 = boost
               7.00893 = idf(docFreq=104, maxDocs=42740)
               0.02045834 = queryNorm
             0.38330087 = fieldWeight in 550, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.00893 = idf(docFreq=104, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.024147736 = weight(abstract_txt:information in 550) [ClassicSimilarity], result of:
           0.024147736 = score(doc=550,freq=8.0), product of:
             0.064241916 = queryWeight, product of:
               1.2921807 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.02045834 = queryNorm
             0.37588754 = fieldWeight in 550, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.09516067 = weight(abstract_txt:evaluation in 550) [ClassicSimilarity], result of:
           0.09516067 = score(doc=550,freq=7.0), product of:
             0.14638822 = queryWeight, product of:
               1.592654 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.02045834 = queryNorm
             0.6500569 = fieldWeight in 550, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.047646627 = weight(abstract_txt:relevance in 550) [ClassicSimilarity], result of:
           0.047646627 = score(doc=550,freq=1.0), product of:
             0.17657202 = queryWeight, product of:
               1.7491591 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.02045834 = queryNorm
             0.26984245 = fieldWeight in 550, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.08525286 = weight(abstract_txt:real in 550) [ClassicSimilarity], result of:
           0.08525286 = score(doc=550,freq=2.0), product of:
             0.20655218 = queryWeight, product of:
               1.891835 = boost
               5.336741 = idf(docFreq=558, maxDocs=42740)
               0.02045834 = queryNorm
             0.4127425 = fieldWeight in 550, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.336741 = idf(docFreq=558, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.067773305 = weight(abstract_txt:interactive in 550) [ClassicSimilarity], result of:
           0.067773305 = score(doc=550,freq=1.0), product of:
             0.22332615 = queryWeight, product of:
               1.9671531 = boost
               5.549208 = idf(docFreq=451, maxDocs=42740)
               0.02045834 = queryNorm
             0.3034723 = fieldWeight in 550, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.549208 = idf(docFreq=451, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
         0.5635082 = weight(abstract_txt:simulated in 550) [ClassicSimilarity], result of:
           0.5635082 = score(doc=550,freq=8.0), product of:
             0.45828676 = queryWeight, product of:
               2.8179743 = boost
               7.9493184 = idf(docFreq=40, maxDocs=42740)
               0.02045834 = queryNorm
             1.2295974 = fieldWeight in 550, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               7.9493184 = idf(docFreq=40, maxDocs=42740)
               0.0546875 = fieldNorm(doc=550)
       0.44 = coord(11/25)
   

2. Hansen, P.; Karlgren, J.: Effects of foreign language and task scenario on relevance assessment (2005) 0.42

   0.4182708 = sum of:
     0.4182708 = product of:
       0.95061547 = sum of:
         0.03561264 = weight(abstract_txt:comparison in 394) [ClassicSimilarity], result of:
           0.03561264 = score(doc=394,freq=1.0), product of:
             0.11542324 = queryWeight, product of:
               5.641867 = idf(docFreq=411, maxDocs=42740)
               0.02045834 = queryNorm
             0.3085396 = fieldWeight in 394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.641867 = idf(docFreq=411, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.015790427 = weight(abstract_txt:systems in 394) [ClassicSimilarity], result of:
           0.015790427 = score(doc=394,freq=1.0), product of:
             0.08455963 = queryWeight, product of:
               1.2104585 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.02045834 = queryNorm
             0.1867372 = fieldWeight in 394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.08984952 = weight(abstract_txt:assessed in 394) [ClassicSimilarity], result of:
           0.08984952 = score(doc=394,freq=2.0), product of:
             0.16978173 = queryWeight, product of:
               1.212827 = boost
               6.842609 = idf(docFreq=123, maxDocs=42740)
               0.02045834 = queryNorm
             0.52920604 = fieldWeight in 394, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.842609 = idf(docFreq=123, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.016496835 = weight(abstract_txt:retrieval in 394) [ClassicSimilarity], result of:
           0.016496835 = score(doc=394,freq=1.0), product of:
             0.08706312 = queryWeight, product of:
               1.2282463 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.02045834 = queryNorm
             0.18948132 = fieldWeight in 394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.14645217 = weight(abstract_txt:scenario in 394) [ClassicSimilarity], result of:
           0.14645217 = score(doc=394,freq=4.0), product of:
             0.18663841 = queryWeight, product of:
               1.2716099 = boost
               7.174254 = idf(docFreq=88, maxDocs=42740)
               0.02045834 = queryNorm
             0.784684 = fieldWeight in 394, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.174254 = idf(docFreq=88, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.012073868 = weight(abstract_txt:information in 394) [ClassicSimilarity], result of:
           0.012073868 = score(doc=394,freq=2.0), product of:
             0.064241916 = queryWeight, product of:
               1.2921807 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.02045834 = queryNorm
             0.18794377 = fieldWeight in 394, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.037944924 = weight(abstract_txt:made in 394) [ClassicSimilarity], result of:
           0.037944924 = score(doc=394,freq=1.0), product of:
             0.15170605 = queryWeight, product of:
               1.6213241 = boost
               4.5736475 = idf(docFreq=1198, maxDocs=42740)
               0.02045834 = queryNorm
             0.25012136 = fieldWeight in 394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5736475 = idf(docFreq=1198, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.12606113 = weight(abstract_txt:relevance in 394) [ClassicSimilarity], result of:
           0.12606113 = score(doc=394,freq=7.0), product of:
             0.17657202 = queryWeight, product of:
               1.7491591 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.02045834 = queryNorm
             0.713936 = fieldWeight in 394, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.067773305 = weight(abstract_txt:interactive in 394) [ClassicSimilarity], result of:
           0.067773305 = score(doc=394,freq=1.0), product of:
             0.22332615 = queryWeight, product of:
               1.9671531 = boost
               5.549208 = idf(docFreq=451, maxDocs=42740)
               0.02045834 = queryNorm
             0.3034723 = fieldWeight in 394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.549208 = idf(docFreq=451, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.2033304 = weight(abstract_txt:assessments in 394) [ClassicSimilarity], result of:
           0.2033304 = score(doc=394,freq=2.0), product of:
             0.36871603 = queryWeight, product of:
               2.527635 = boost
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.02045834 = queryNorm
             0.55145526 = fieldWeight in 394, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
         0.19923025 = weight(abstract_txt:simulated in 394) [ClassicSimilarity], result of:
           0.19923025 = score(doc=394,freq=1.0), product of:
             0.45828676 = queryWeight, product of:
               2.8179743 = boost
               7.9493184 = idf(docFreq=40, maxDocs=42740)
               0.02045834 = queryNorm
             0.43472835 = fieldWeight in 394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9493184 = idf(docFreq=40, maxDocs=42740)
               0.0546875 = fieldNorm(doc=394)
       0.44 = coord(11/25)
   

3. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.29

   0.2909769 = sum of:
     0.2909769 = product of:
       0.8082692 = sum of:
         0.014976346 = weight(abstract_txt:based in 3073) [ClassicSimilarity], result of:
           0.014976346 = score(doc=3073,freq=1.0), product of:
             0.0746752 = queryWeight, product of:
               1.1375135 = boost
               3.2088501 = idf(docFreq=4693, maxDocs=42740)
               0.02045834 = queryNorm
             0.20055313 = fieldWeight in 3073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2088501 = idf(docFreq=4693, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.018046202 = weight(abstract_txt:systems in 3073) [ClassicSimilarity], result of:
           0.018046202 = score(doc=3073,freq=1.0), product of:
             0.08455963 = queryWeight, product of:
               1.2104585 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.02045834 = queryNorm
             0.21341394 = fieldWeight in 3073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.042157765 = weight(abstract_txt:retrieval in 3073) [ClassicSimilarity], result of:
           0.042157765 = score(doc=3073,freq=5.0), product of:
             0.08706312 = queryWeight, product of:
               1.2282463 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.02045834 = queryNorm
             0.4842207 = fieldWeight in 3073, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.013798706 = weight(abstract_txt:information in 3073) [ClassicSimilarity], result of:
           0.013798706 = score(doc=3073,freq=2.0), product of:
             0.064241916 = queryWeight, product of:
               1.2921807 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.02045834 = queryNorm
             0.21479288 = fieldWeight in 3073, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.10026861 = weight(abstract_txt:situational in 3073) [ClassicSimilarity], result of:
           0.10026861 = score(doc=3073,freq=1.0), product of:
             0.2105422 = queryWeight, product of:
               1.3505882 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.02045834 = queryNorm
             0.47623995 = fieldWeight in 3073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.0711969 = weight(abstract_txt:evaluation in 3073) [ClassicSimilarity], result of:
           0.0711969 = score(doc=3073,freq=3.0), product of:
             0.14638822 = queryWeight, product of:
               1.592654 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.02045834 = queryNorm
             0.48635674 = fieldWeight in 3073, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.121761255 = weight(abstract_txt:relevance in 3073) [ClassicSimilarity], result of:
           0.121761255 = score(doc=3073,freq=5.0), product of:
             0.17657202 = queryWeight, product of:
               1.7491591 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.02045834 = queryNorm
             0.6895841 = fieldWeight in 3073, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.09743184 = weight(abstract_txt:real in 3073) [ClassicSimilarity], result of:
           0.09743184 = score(doc=3073,freq=2.0), product of:
             0.20655218 = queryWeight, product of:
               1.891835 = boost
               5.336741 = idf(docFreq=558, maxDocs=42740)
               0.02045834 = queryNorm
             0.4717057 = fieldWeight in 3073, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.336741 = idf(docFreq=558, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.32863158 = weight(abstract_txt:assessments in 3073) [ClassicSimilarity], result of:
           0.32863158 = score(doc=3073,freq=4.0), product of:
             0.36871603 = queryWeight, product of:
               2.527635 = boost
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.02045834 = queryNorm
             0.8912864 = fieldWeight in 3073, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
       0.36 = coord(9/25)
   

4. Ruthven, T.; Lalmas, M.; Rijsbergen, K.van: Incorporating user research behavior into relevance feedback (2003) 0.21

   0.21363954 = sum of:
     0.21363954 = product of:
       0.59344316 = sum of:
         0.014976346 = weight(abstract_txt:based in 170) [ClassicSimilarity], result of:
           0.014976346 = score(doc=170,freq=1.0), product of:
             0.0746752 = queryWeight, product of:
               1.1375135 = boost
               3.2088501 = idf(docFreq=4693, maxDocs=42740)
               0.02045834 = queryNorm
             0.20055313 = fieldWeight in 170, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2088501 = idf(docFreq=4693, maxDocs=42740)
               0.0625 = fieldNorm(doc=170)
         0.018046202 = weight(abstract_txt:systems in 170) [ClassicSimilarity], result of:
           0.018046202 = score(doc=170,freq=1.0), product of:
             0.08455963 = queryWeight, product of:
               1.2104585 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.02045834 = queryNorm
             0.21341394 = fieldWeight in 170, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.0625 = fieldNorm(doc=170)
         0.07260937 = weight(abstract_txt:assessed in 170) [ClassicSimilarity], result of:
           0.07260937 = score(doc=170,freq=1.0), product of:
             0.16978173 = queryWeight, product of:
               1.212827 = boost
               6.842609 = idf(docFreq=123, maxDocs=42740)
               0.02045834 = queryNorm
             0.42766306 = fieldWeight in 170, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.842609 = idf(docFreq=123, maxDocs=42740)
               0.0625 = fieldNorm(doc=170)
         0.018853525 = weight(abstract_txt:retrieval in 170) [ClassicSimilarity], result of:
           0.018853525 = score(doc=170,freq=1.0), product of:
             0.08706312 = queryWeight, product of:
               1.2282463 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.02045834 = queryNorm
             0.21655008 = fieldWeight in 170, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0625 = fieldNorm(doc=170)
         0.013798706 = weight(abstract_txt:information in 170) [ClassicSimilarity], result of:
           0.013798706 = score(doc=170,freq=2.0), product of:
             0.064241916 = queryWeight, product of:
               1.2921807 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.02045834 = queryNorm
             0.21479288 = fieldWeight in 170, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0625 = fieldNorm(doc=170)
         0.041105546 = weight(abstract_txt:evaluation in 170) [ClassicSimilarity], result of:
           0.041105546 = score(doc=170,freq=1.0), product of:
             0.14638822 = queryWeight, product of:
               1.592654 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.02045834 = queryNorm
             0.2807982 = fieldWeight in 170, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0625 = fieldNorm(doc=170)
         0.108906575 = weight(abstract_txt:relevance in 170) [ClassicSimilarity], result of:
           0.108906575 = score(doc=170,freq=4.0), product of:
             0.17657202 = queryWeight, product of:
               1.7491591 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.02045834 = queryNorm
             0.6167827 = fieldWeight in 170, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.0625 = fieldNorm(doc=170)
         0.07745521 = weight(abstract_txt:interactive in 170) [ClassicSimilarity], result of:
           0.07745521 = score(doc=170,freq=1.0), product of:
             0.22332615 = queryWeight, product of:
               1.9671531 = boost
               5.549208 = idf(docFreq=451, maxDocs=42740)
               0.02045834 = queryNorm
             0.3468255 = fieldWeight in 170, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.549208 = idf(docFreq=451, maxDocs=42740)
               0.0625 = fieldNorm(doc=170)
         0.22769171 = weight(abstract_txt:simulated in 170) [ClassicSimilarity], result of:
           0.22769171 = score(doc=170,freq=1.0), product of:
             0.45828676 = queryWeight, product of:
               2.8179743 = boost
               7.9493184 = idf(docFreq=40, maxDocs=42740)
               0.02045834 = queryNorm
             0.4968324 = fieldWeight in 170, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9493184 = idf(docFreq=40, maxDocs=42740)
               0.0625 = fieldNorm(doc=170)
       0.36 = coord(9/25)
   

5. Golub, K.; Soergel, D.; Buchanan, G.; Tudhope, D.; Lykke, M.; Hiom, D.: ¬A framework for evaluating automatic indexing or classification in the context of retrieval (2016) 0.19

   0.1860775 = sum of:
     0.1860775 = product of:
       0.51688194 = sum of:
         0.04070016 = weight(abstract_txt:comparison in 5312) [ClassicSimilarity], result of:
           0.04070016 = score(doc=5312,freq=1.0), product of:
             0.11542324 = queryWeight, product of:
               5.641867 = idf(docFreq=411, maxDocs=42740)
               0.02045834 = queryNorm
             0.3526167 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.641867 = idf(docFreq=411, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.018046202 = weight(abstract_txt:systems in 5312) [ClassicSimilarity], result of:
           0.018046202 = score(doc=5312,freq=1.0), product of:
             0.08455963 = queryWeight, product of:
               1.2104585 = boost
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.02045834 = queryNorm
             0.21341394 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.414623 = idf(docFreq=3820, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.026662912 = weight(abstract_txt:retrieval in 5312) [ClassicSimilarity], result of:
           0.026662912 = score(doc=5312,freq=2.0), product of:
             0.08706312 = queryWeight, product of:
               1.2282463 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.02045834 = queryNorm
             0.30624807 = fieldWeight in 5312, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.009757158 = weight(abstract_txt:information in 5312) [ClassicSimilarity], result of:
           0.009757158 = score(doc=5312,freq=1.0), product of:
             0.064241916 = queryWeight, product of:
               1.2921807 = boost
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.02045834 = queryNorm
             0.1518815 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.430104 = idf(docFreq=10226, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.0711969 = weight(abstract_txt:evaluation in 5312) [ClassicSimilarity], result of:
           0.0711969 = score(doc=5312,freq=3.0), product of:
             0.14638822 = queryWeight, product of:
               1.592654 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.02045834 = queryNorm
             0.48635674 = fieldWeight in 5312, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.054453287 = weight(abstract_txt:relevance in 5312) [ClassicSimilarity], result of:
           0.054453287 = score(doc=5312,freq=1.0), product of:
             0.17657202 = queryWeight, product of:
               1.7491591 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.02045834 = queryNorm
             0.30839136 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.068894714 = weight(abstract_txt:real in 5312) [ClassicSimilarity], result of:
           0.068894714 = score(doc=5312,freq=1.0), product of:
             0.20655218 = queryWeight, product of:
               1.891835 = boost
               5.336741 = idf(docFreq=558, maxDocs=42740)
               0.02045834 = queryNorm
             0.3335463 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.336741 = idf(docFreq=558, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.06285479 = weight(abstract_txt:method in 5312) [ClassicSimilarity], result of:
           0.06285479 = score(doc=5312,freq=1.0), product of:
             0.22241385 = queryWeight, product of:
               2.4043345 = boost
               4.5216455 = idf(docFreq=1262, maxDocs=42740)
               0.02045834 = queryNorm
             0.28260285 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5216455 = idf(docFreq=1262, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
         0.16431579 = weight(abstract_txt:assessments in 5312) [ClassicSimilarity], result of:
           0.16431579 = score(doc=5312,freq=1.0), product of:
             0.36871603 = queryWeight, product of:
               2.527635 = boost
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.02045834 = queryNorm
             0.4456432 = fieldWeight in 5312, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.130291 = idf(docFreq=92, maxDocs=42740)
               0.0625 = fieldNorm(doc=5312)
       0.36 = coord(9/25)