Document (#40312)

Author

Golub, K.
Soergel, D.
Buchanan, G.
Tudhope, D.
Lykke, M.
Hiom, D.

Title

¬A framework for evaluating automatic indexing or classification in the context of retrieval

Source

Journal of the Association for Information Science and Technology. 67(2016) no.1, S.3-16

Year

2016

Series

Advances in information science

Abstract

Tools for automatic subject assignment help deal with scale and sustainability in creating and enriching metadata, establishing more connections across and between resources and enhancing consistency. Although some software vendors and experimental researchers claim the tools can replace manual subject indexing, hard scientific evidence of their performance in operating information environments is scarce. A major reason for this is that research is usually conducted in laboratory conditions, excluding the complexities of real-life systems and situations. The article reviews and discusses issues with existing evaluation approaches such as problems of aboutness and relevance assessments, implying the need to use more than a single "gold standard" method when evaluating indexing and retrieval, and proposes a comprehensive evaluation framework. The framework is informed by a systematic review of the literature on evaluation approaches: evaluating indexing quality directly through assessment by an evaluator or through comparison with a gold standard, evaluating the quality of computer-assisted indexing directly in the context of an indexing workflow, and evaluating indexing quality indirectly through analyzing retrieval performance.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23600/abstract.

Theme

Automatisches Indexieren
Automatisches Klassifizieren

Similar documents (author)

1. Golub, K.; Lykke, M.; Tudhope, D.: Enhancing social tagging with automated keywords from the Dewey Decimal Classification (2014) 1.91

   1.9078054 = sum of:
     1.9078054 = product of:
       3.815611 = sum of:
         1.0507677 = weight(author_txt:tudhope in 2918) [ClassicSimilarity], result of:
           1.0507677 = score(doc=2918,freq=1.0), product of:
             0.34653202 = queryWeight, product of:
               1.0065532 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.04257695 = queryNorm
             3.0322385 = fieldWeight in 2918, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.375 = fieldNorm(doc=2918)
         1.2111347 = weight(author_txt:golub in 2918) [ClassicSimilarity], result of:
           1.2111347 = score(doc=2918,freq=1.0), product of:
             0.38094932 = queryWeight, product of:
               1.0553552 = boost
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.04257695 = queryNorm
             3.179254 = fieldWeight in 2918, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.375 = fieldNorm(doc=2918)
         1.5537086 = weight(author_txt:lykke in 2918) [ClassicSimilarity], result of:
           1.5537086 = score(doc=2918,freq=1.0), product of:
             0.44976458 = queryWeight, product of:
               1.1467208 = boost
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.04257695 = queryNorm
             3.4544928 = fieldWeight in 2918, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.375 = fieldNorm(doc=2918)
       0.5 = coord(3/6)
   

2. Golub, K.; Hansson, J.; Soergel, D.; Tudhope, D.: Managing classification in libraries : a methodological outline for evaluating automatic subject indexing and classification in Swedish library catalogues (2015) 1.37

   1.3717835 = sum of:
     1.3717835 = product of:
       2.743567 = sum of:
         0.85864824 = weight(author_txt:soergel in 2300) [ClassicSimilarity], result of:
           0.85864824 = score(doc=2300,freq=1.0), product of:
             0.3420345 = queryWeight, product of:
               8.033325 = idf(docFreq=38, maxDocs=44218)
               0.04257695 = queryNorm
             2.5104141 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.033325 = idf(docFreq=38, maxDocs=44218)
               0.3125 = fieldNorm(doc=2300)
         0.87563974 = weight(author_txt:tudhope in 2300) [ClassicSimilarity], result of:
           0.87563974 = score(doc=2300,freq=1.0), product of:
             0.34653202 = queryWeight, product of:
               1.0065532 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.04257695 = queryNorm
             2.5268652 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.3125 = fieldNorm(doc=2300)
         1.0092789 = weight(author_txt:golub in 2300) [ClassicSimilarity], result of:
           1.0092789 = score(doc=2300,freq=1.0), product of:
             0.38094932 = queryWeight, product of:
               1.0553552 = boost
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.04257695 = queryNorm
             2.6493785 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.3125 = fieldNorm(doc=2300)
       0.5 = coord(3/6)
   

3. Golub, K.; Lykke, M.: Automated classification of web pages in hierarchical browsing (2009) 1.23

   1.2288193 = sum of:
     1.2288193 = product of:
       3.6864576 = sum of:
         1.6148462 = weight(author_txt:golub in 3614) [ClassicSimilarity], result of:
           1.6148462 = score(doc=3614,freq=1.0), product of:
             0.38094932 = queryWeight, product of:
               1.0553552 = boost
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.04257695 = queryNorm
             4.2390056 = fieldWeight in 3614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.5 = fieldNorm(doc=3614)
         2.0716114 = weight(author_txt:lykke in 3614) [ClassicSimilarity], result of:
           2.0716114 = score(doc=3614,freq=1.0), product of:
             0.44976458 = queryWeight, product of:
               1.1467208 = boost
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.04257695 = queryNorm
             4.6059904 = fieldWeight in 3614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.5 = fieldNorm(doc=3614)
       0.33333334 = coord(2/6)
   

4. Golub, K.; Moon, J.; Nielsen, M.L.; Tudhope, D.: EnTag: Enhanced Tagging for Discovery (2008) 0.63

   0.62830627 = sum of:
     0.62830627 = product of:
       1.8849187 = sum of:
         0.87563974 = weight(author_txt:tudhope in 2294) [ClassicSimilarity], result of:
           0.87563974 = score(doc=2294,freq=1.0), product of:
             0.34653202 = queryWeight, product of:
               1.0065532 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.04257695 = queryNorm
             2.5268652 = fieldWeight in 2294, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.3125 = fieldNorm(doc=2294)
         1.0092789 = weight(author_txt:golub in 2294) [ClassicSimilarity], result of:
           1.0092789 = score(doc=2294,freq=1.0), product of:
             0.38094932 = queryWeight, product of:
               1.0553552 = boost
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.04257695 = queryNorm
             2.6493785 = fieldWeight in 2294, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.3125 = fieldNorm(doc=2294)
       0.33333334 = coord(2/6)
   

5. Golub, K.; Tudhope, D.; Zeng, M.L.; Zumer, M.: Terminology registries for knowledge organization systems : functionality, use, and attributes (2014) 0.63

   0.62830627 = sum of:
     0.62830627 = product of:
       1.8849187 = sum of:
         0.87563974 = weight(author_txt:tudhope in 1347) [ClassicSimilarity], result of:
           0.87563974 = score(doc=1347,freq=1.0), product of:
             0.34653202 = queryWeight, product of:
               1.0065532 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.04257695 = queryNorm
             2.5268652 = fieldWeight in 1347, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.3125 = fieldNorm(doc=1347)
         1.0092789 = weight(author_txt:golub in 1347) [ClassicSimilarity], result of:
           1.0092789 = score(doc=1347,freq=1.0), product of:
             0.38094932 = queryWeight, product of:
               1.0553552 = boost
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.04257695 = queryNorm
             2.6493785 = fieldWeight in 1347, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.3125 = fieldNorm(doc=1347)
       0.33333334 = coord(2/6)
   

Similar documents (content)

1. Golub, K.; Hansson, J.; Soergel, D.; Tudhope, D.: Managing classification in libraries : a methodological outline for evaluating automatic subject indexing and classification in Swedish library catalogues (2015) 0.41

   0.40694398 = sum of:
     0.40694398 = product of:
       0.84779996 = sum of:
         0.045826685 = weight(abstract_txt:subject in 2300) [ClassicSimilarity], result of:
           0.045826685 = score(doc=2300,freq=5.0), product of:
             0.083928205 = queryWeight, product of:
               1.0419828 = boost
               3.9070187 = idf(docFreq=2415, maxDocs=44218)
               0.020615881 = queryNorm
             0.5460225 = fieldWeight in 2300, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.9070187 = idf(docFreq=2415, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.08586587 = weight(abstract_txt:sustainability in 2300) [ClassicSimilarity], result of:
           0.08586587 = score(doc=2300,freq=1.0), product of:
             0.1731235 = queryWeight, product of:
               1.0582044 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.020615881 = queryNorm
             0.49598044 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.042860046 = weight(abstract_txt:tools in 2300) [ClassicSimilarity], result of:
           0.042860046 = score(doc=2300,freq=2.0), product of:
             0.1089375 = queryWeight, product of:
               1.1871217 = boost
               4.451232 = idf(docFreq=1401, maxDocs=44218)
               0.020615881 = queryNorm
             0.39343703 = fieldWeight in 2300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.451232 = idf(docFreq=1401, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.033633314 = weight(abstract_txt:approaches in 2300) [ClassicSimilarity], result of:
           0.033633314 = score(doc=2300,freq=1.0), product of:
             0.11677021 = queryWeight, product of:
               1.2290586 = boost
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.020615881 = queryNorm
             0.2880299 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.051271703 = weight(abstract_txt:standard in 2300) [ClassicSimilarity], result of:
           0.051271703 = score(doc=2300,freq=2.0), product of:
             0.122761115 = queryWeight, product of:
               1.2601928 = boost
               4.725219 = idf(docFreq=1065, maxDocs=44218)
               0.020615881 = queryNorm
             0.41765428 = fieldWeight in 2300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.725219 = idf(docFreq=1065, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.06815826 = weight(abstract_txt:automatic in 2300) [ClassicSimilarity], result of:
           0.06815826 = score(doc=2300,freq=2.0), product of:
             0.14841849 = queryWeight, product of:
               1.3856405 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.020615881 = queryNorm
             0.45923027 = fieldWeight in 2300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.030592846 = weight(abstract_txt:retrieval in 2300) [ClassicSimilarity], result of:
           0.030592846 = score(doc=2300,freq=2.0), product of:
             0.09959847 = queryWeight, product of:
               1.390204 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020615881 = queryNorm
             0.3071618 = fieldWeight in 2300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.033266418 = weight(abstract_txt:through in 2300) [ClassicSimilarity], result of:
           0.033266418 = score(doc=2300,freq=1.0), product of:
             0.13269465 = queryWeight, product of:
               1.6046447 = boost
               4.011184 = idf(docFreq=2176, maxDocs=44218)
               0.020615881 = queryNorm
             0.250699 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.011184 = idf(docFreq=2176, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.06870619 = weight(abstract_txt:framework in 2300) [ClassicSimilarity], result of:
           0.06870619 = score(doc=2300,freq=2.0), product of:
             0.17080608 = queryWeight, product of:
               1.8205552 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.020615881 = queryNorm
             0.40224677 = fieldWeight in 2300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.051921424 = weight(abstract_txt:quality in 2300) [ClassicSimilarity], result of:
           0.051921424 = score(doc=2300,freq=1.0), product of:
             0.17854476 = queryWeight, product of:
               1.8613402 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.020615881 = queryNorm
             0.2908034 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.23672584 = weight(abstract_txt:gold in 2300) [ClassicSimilarity], result of:
           0.23672584 = score(doc=2300,freq=2.0), product of:
             0.34038684 = queryWeight, product of:
               2.0984225 = boost
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.020615881 = queryNorm
             0.6954612 = fieldWeight in 2300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
         0.09897129 = weight(abstract_txt:indexing in 2300) [ClassicSimilarity], result of:
           0.09897129 = score(doc=2300,freq=1.0), product of:
             0.36406687 = queryWeight, product of:
               4.060048 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.020615881 = queryNorm
             0.27184922 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.0625 = fieldNorm(doc=2300)
       0.48 = coord(12/25)
   

2. Bodoff, D.; Kambil, A.: Partial coordination : II. A preliminary evaluation and failure analysis (1998) 0.26

   0.2553441 = sum of:
     0.2553441 = product of:
       0.70928913 = sum of:
         0.014232932 = weight(abstract_txt:with in 2323) [ClassicSimilarity], result of:
           0.014232932 = score(doc=2323,freq=2.0), product of:
             0.05153421 = queryWeight, product of:
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.020615881 = queryNorm
             0.27618414 = fieldWeight in 2323, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.025617896 = weight(abstract_txt:subject in 2323) [ClassicSimilarity], result of:
           0.025617896 = score(doc=2323,freq=1.0), product of:
             0.083928205 = queryWeight, product of:
               1.0419828 = boost
               3.9070187 = idf(docFreq=2415, maxDocs=44218)
               0.020615881 = queryNorm
             0.30523583 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9070187 = idf(docFreq=2415, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.060243968 = weight(abstract_txt:automatic in 2323) [ClassicSimilarity], result of:
           0.060243968 = score(doc=2323,freq=1.0), product of:
             0.14841849 = queryWeight, product of:
               1.3856405 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.020615881 = queryNorm
             0.40590608 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.060464427 = weight(abstract_txt:retrieval in 2323) [ClassicSimilarity], result of:
           0.060464427 = score(doc=2323,freq=5.0), product of:
             0.09959847 = queryWeight, product of:
               1.390204 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020615881 = queryNorm
             0.6070819 = fieldWeight in 2323, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.09139839 = weight(abstract_txt:directly in 2323) [ClassicSimilarity], result of:
           0.09139839 = score(doc=2323,freq=1.0), product of:
             0.19596176 = queryWeight, product of:
               1.5921803 = boost
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.020615881 = queryNorm
             0.46640933 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.05816959 = weight(abstract_txt:evaluation in 2323) [ClassicSimilarity], result of:
           0.05816959 = score(doc=2323,freq=1.0), product of:
             0.16597399 = queryWeight, product of:
               1.7946188 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020615881 = queryNorm
             0.35047412 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.060728274 = weight(abstract_txt:framework in 2323) [ClassicSimilarity], result of:
           0.060728274 = score(doc=2323,freq=1.0), product of:
             0.17080608 = queryWeight, product of:
               1.8205552 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.020615881 = queryNorm
             0.3555393 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.21471955 = weight(abstract_txt:evaluating in 2323) [ClassicSimilarity], result of:
           0.21471955 = score(doc=2323,freq=1.0), product of:
             0.47000957 = queryWeight, product of:
               3.8987906 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.020615881 = queryNorm
             0.4568408 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.12371411 = weight(abstract_txt:indexing in 2323) [ClassicSimilarity], result of:
           0.12371411 = score(doc=2323,freq=1.0), product of:
             0.36406687 = queryWeight, product of:
               4.060048 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.020615881 = queryNorm
             0.3398115 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
       0.36 = coord(9/25)
   

3. Rada, R.: Connecting and evaluating thesauri : issues and cases (1987) 0.20

   0.20445922 = sum of:
     0.20445922 = product of:
       0.7302115 = sum of:
         0.012077043 = weight(abstract_txt:with in 823) [ClassicSimilarity], result of:
           0.012077043 = score(doc=823,freq=1.0), product of:
             0.05153421 = queryWeight, product of:
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.020615881 = queryNorm
             0.23435001 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.030741476 = weight(abstract_txt:subject in 823) [ClassicSimilarity], result of:
           0.030741476 = score(doc=823,freq=1.0), product of:
             0.083928205 = queryWeight, product of:
               1.0419828 = boost
               3.9070187 = idf(docFreq=2415, maxDocs=44218)
               0.020615881 = queryNorm
             0.366283 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9070187 = idf(docFreq=2415, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.07229276 = weight(abstract_txt:automatic in 823) [ClassicSimilarity], result of:
           0.07229276 = score(doc=823,freq=1.0), product of:
             0.14841849 = queryWeight, product of:
               1.3856405 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.020615881 = queryNorm
             0.48708728 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.032448612 = weight(abstract_txt:retrieval in 823) [ClassicSimilarity], result of:
           0.032448612 = score(doc=823,freq=1.0), product of:
             0.09959847 = queryWeight, product of:
               1.390204 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020615881 = queryNorm
             0.3257943 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.069803506 = weight(abstract_txt:evaluation in 823) [ClassicSimilarity], result of:
           0.069803506 = score(doc=823,freq=1.0), product of:
             0.16597399 = queryWeight, product of:
               1.7946188 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020615881 = queryNorm
             0.42056894 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.36439115 = weight(abstract_txt:evaluating in 823) [ClassicSimilarity], result of:
           0.36439115 = score(doc=823,freq=2.0), product of:
             0.47000957 = queryWeight, product of:
               3.8987906 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.020615881 = queryNorm
             0.7752845 = fieldWeight in 823, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
         0.14845695 = weight(abstract_txt:indexing in 823) [ClassicSimilarity], result of:
           0.14845695 = score(doc=823,freq=1.0), product of:
             0.36406687 = queryWeight, product of:
               4.060048 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.020615881 = queryNorm
             0.40777382 = fieldWeight in 823, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.09375 = fieldNorm(doc=823)
       0.28 = coord(7/25)
   

4. Chung, E.-K.; Miksa, S.; Hastings, S.K.: ¬A framework of automatic subject term assignment for text categorization : an indexing conception-based approach (2010) 0.19

   0.19380385 = sum of:
     0.19380385 = product of:
       0.605637 = sum of:
         0.012202196 = weight(abstract_txt:with in 3434) [ClassicSimilarity], result of:
           0.012202196 = score(doc=3434,freq=3.0), product of:
             0.05153421 = queryWeight, product of:
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.020615881 = queryNorm
             0.23677856 = fieldWeight in 3434, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3434)
         0.047445007 = weight(abstract_txt:subject in 3434) [ClassicSimilarity], result of:
           0.047445007 = score(doc=3434,freq=7.0), product of:
             0.083928205 = queryWeight, product of:
               1.0419828 = boost
               3.9070187 = idf(docFreq=2415, maxDocs=44218)
               0.020615881 = queryNorm
             0.5653047 = fieldWeight in 3434, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.9070187 = idf(docFreq=2415, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3434)
         0.034760017 = weight(abstract_txt:context in 3434) [ClassicSimilarity], result of:
           0.034760017 = score(doc=3434,freq=2.0), product of:
             0.103559576 = queryWeight, product of:
               1.1574485 = boost
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.020615881 = queryNorm
             0.33565238 = fieldWeight in 3434, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3434)
         0.06580558 = weight(abstract_txt:approaches in 3434) [ClassicSimilarity], result of:
           0.06580558 = score(doc=3434,freq=5.0), product of:
             0.11677021 = queryWeight, product of:
               1.2290586 = boost
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.020615881 = queryNorm
             0.5635477 = fieldWeight in 3434, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3434)
         0.08434155 = weight(abstract_txt:automatic in 3434) [ClassicSimilarity], result of:
           0.08434155 = score(doc=3434,freq=4.0), product of:
             0.14841849 = queryWeight, product of:
               1.3856405 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.020615881 = queryNorm
             0.5682685 = fieldWeight in 3434, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3434)
         0.041165087 = weight(abstract_txt:through in 3434) [ClassicSimilarity], result of:
           0.041165087 = score(doc=3434,freq=2.0), product of:
             0.13269465 = queryWeight, product of:
               1.6046447 = boost
               4.011184 = idf(docFreq=2176, maxDocs=44218)
               0.020615881 = queryNorm
             0.31022418 = fieldWeight in 3434, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.011184 = idf(docFreq=2176, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3434)
         0.060117923 = weight(abstract_txt:framework in 3434) [ClassicSimilarity], result of:
           0.060117923 = score(doc=3434,freq=2.0), product of:
             0.17080608 = queryWeight, product of:
               1.8205552 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.020615881 = queryNorm
             0.35196593 = fieldWeight in 3434, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3434)
         0.25979966 = weight(abstract_txt:indexing in 3434) [ClassicSimilarity], result of:
           0.25979966 = score(doc=3434,freq=9.0), product of:
             0.36406687 = queryWeight, product of:
               4.060048 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.020615881 = queryNorm
             0.7136042 = fieldWeight in 3434, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3434)
       0.32 = coord(8/25)
   

5. Ménard, E.: Image retrieval : a comparative study on the influence of indexing vocabularies (2009) 0.19

   0.19021857 = sum of:
     0.19021857 = product of:
       0.67935205 = sum of:
         0.019721728 = weight(abstract_txt:with in 3250) [ClassicSimilarity], result of:
           0.019721728 = score(doc=3250,freq=6.0), product of:
             0.05153421 = queryWeight, product of:
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.020615881 = queryNorm
             0.38269198 = fieldWeight in 3250, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=3250)
         0.06880699 = weight(abstract_txt:context in 3250) [ClassicSimilarity], result of:
           0.06880699 = score(doc=3250,freq=6.0), product of:
             0.103559576 = queryWeight, product of:
               1.1574485 = boost
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.020615881 = queryNorm
             0.6644194 = fieldWeight in 3250, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.0625 = fieldNorm(doc=3250)
         0.033633314 = weight(abstract_txt:approaches in 3250) [ClassicSimilarity], result of:
           0.033633314 = score(doc=3250,freq=1.0), product of:
             0.11677021 = queryWeight, product of:
               1.2290586 = boost
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.020615881 = queryNorm
             0.2880299 = fieldWeight in 3250, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.0625 = fieldNorm(doc=3250)
         0.048247315 = weight(abstract_txt:performance in 3250) [ClassicSimilarity], result of:
           0.048247315 = score(doc=3250,freq=2.0), product of:
             0.117884785 = queryWeight, product of:
               1.2349104 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.020615881 = queryNorm
             0.40927517 = fieldWeight in 3250, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=3250)
         0.057233974 = weight(abstract_txt:retrieval in 3250) [ClassicSimilarity], result of:
           0.057233974 = score(doc=3250,freq=7.0), product of:
             0.09959847 = queryWeight, product of:
               1.390204 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020615881 = queryNorm
             0.5746471 = fieldWeight in 3250, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3250)
         0.17177564 = weight(abstract_txt:evaluating in 3250) [ClassicSimilarity], result of:
           0.17177564 = score(doc=3250,freq=1.0), product of:
             0.47000957 = queryWeight, product of:
               3.8987906 = boost
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.020615881 = queryNorm
             0.36547264 = fieldWeight in 3250, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8475623 = idf(docFreq=346, maxDocs=44218)
               0.0625 = fieldNorm(doc=3250)
         0.2799331 = weight(abstract_txt:indexing in 3250) [ClassicSimilarity], result of:
           0.2799331 = score(doc=3250,freq=8.0), product of:
             0.36406687 = queryWeight, product of:
               4.060048 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.020615881 = queryNorm
             0.7689057 = fieldWeight in 3250, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.0625 = fieldNorm(doc=3250)
       0.28 = coord(7/25)