Document (#32965)

Author
Tsai, C.-F.
McGarry, K.
Tait, J.
Title
Qualitative evaluation of automatic assignment of keywords to images
Source
Information processing and management. 42(2006) no.1, S.136-154
Year
2006
Abstract
In image retrieval, most systems lack user-centred evaluation since they are assessed by some chosen ground truth dataset. The results reported through precision and recall assessed against the ground truth are thought of as being an acceptable surrogate for the judgment of real users. Much current research focuses on automatically assigning keywords to images for enhancing retrieval effectiveness. However, evaluation methods are usually based on system-level assessment, e.g. classification accuracy based on some chosen ground truth dataset. In this paper, we present a qualitative evaluation methodology for automatic image indexing systems. The automatic indexing task is formulated as one of image annotation, or automatic metadata generation for images. The evaluation is composed of two individual methods. First, the automatic indexing annotation results are assessed by human subjects. Second, the subjects are asked to annotate some chosen images as the test set whose annotations are used as ground truth. Then, the system is tested by the test set whose annotation results are judged against the ground truth. Only one of these methods is reported for most systems on which user-centred evaluation are conducted. We believe that both methods need to be considered for full evaluation. We also provide an example evaluation of our system based on this methodology. According to this study, our proposed evaluation methodology is able to provide deeper understanding of the system's performance.
Theme
Automatisches Indexieren
Form
Bilder

Similar documents (author)

  1. Tait, J.: CALS and its implications for the library and information retrieval communities (1994) 1.20
    1.1967996 = sum of:
      1.1967996 = product of:
        3.5903988 = sum of:
          3.5903988 = weight(author_txt:tait in 1730) [ClassicSimilarity], result of:
            3.5903988 = score(doc=1730,freq=1.0), product of:
              0.6149303 = queryWeight, product of:
                1.0737755 = boost
                9.341934 = idf(docFreq=9, maxDocs=41962)
                0.06130213 = queryNorm
              5.838709 = fieldWeight in 1730, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.341934 = idf(docFreq=9, maxDocs=41962)
                0.625 = fieldNorm(doc=1730)
        0.33333334 = coord(1/3)
    
  2. Tait, J.A.: Authors and titles : an analytical study of the author concept in codes of cataloguing rules in the English language, from that of the British Museum in 1841 to the Anglo-American Cataloguing Rules 1967 (1969) 1.20
    1.1967996 = sum of:
      1.1967996 = product of:
        3.5903988 = sum of:
          3.5903988 = weight(author_txt:tait in 4162) [ClassicSimilarity], result of:
            3.5903988 = score(doc=4162,freq=1.0), product of:
              0.6149303 = queryWeight, product of:
                1.0737755 = boost
                9.341934 = idf(docFreq=9, maxDocs=41962)
                0.06130213 = queryNorm
              5.838709 = fieldWeight in 4162, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.341934 = idf(docFreq=9, maxDocs=41962)
                0.625 = fieldNorm(doc=4162)
        0.33333334 = coord(1/3)
    
  3. McGarry, D.: Report from the section on classification and indexing : 1989-90 (1990) 0.97
    0.96667594 = sum of:
      0.96667594 = product of:
        2.9000278 = sum of:
          2.9000278 = weight(author_txt:mcgarry in 475) [ClassicSimilarity], result of:
            2.9000278 = score(doc=475,freq=1.0), product of:
              0.5333335 = queryWeight, product of:
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.06130213 = queryNorm
              5.4375505 = fieldWeight in 475, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.625 = fieldNorm(doc=475)
        0.33333334 = coord(1/3)
    
  4. McGarry, D.: Displays of bibliographic records in call number order : functions of the displays and data elements needed (1992) 0.97
    0.96667594 = sum of:
      0.96667594 = product of:
        2.9000278 = sum of:
          2.9000278 = weight(author_txt:mcgarry in 2384) [ClassicSimilarity], result of:
            2.9000278 = score(doc=2384,freq=1.0), product of:
              0.5333335 = queryWeight, product of:
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.06130213 = queryNorm
              5.4375505 = fieldWeight in 2384, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.625 = fieldNorm(doc=2384)
        0.33333334 = coord(1/3)
    
  5. McGarry, D.: Report from the section on classification and indexing : 1991-1992 (1992) 0.97
    0.96667594 = sum of:
      0.96667594 = product of:
        2.9000278 = sum of:
          2.9000278 = weight(author_txt:mcgarry in 2608) [ClassicSimilarity], result of:
            2.9000278 = score(doc=2608,freq=1.0), product of:
              0.5333335 = queryWeight, product of:
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.06130213 = queryNorm
              5.4375505 = fieldWeight in 2608, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.625 = fieldNorm(doc=2608)
        0.33333334 = coord(1/3)
    

Similar documents (content)

  1. Ostermann, F.O.; Tomko, M.; Purves, R.: User evaluation of automatically generated keywords and toponyms for geo-referenced images (2013) 0.33
    0.33219343 = sum of:
      0.33219343 = product of:
        0.83048356 = sum of:
          0.019631958 = weight(abstract_txt:results in 2664) [ClassicSimilarity], result of:
            0.019631958 = score(doc=2664,freq=2.0), product of:
              0.06303975 = queryWeight, product of:
                1.0476614 = boost
                3.5233364 = idf(docFreq=3364, maxDocs=41962)
                0.017078094 = queryNorm
              0.31142187 = fieldWeight in 2664, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.5233364 = idf(docFreq=3364, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
          0.015907539 = weight(abstract_txt:some in 2664) [ClassicSimilarity], result of:
            0.015907539 = score(doc=2664,freq=1.0), product of:
              0.06903204 = queryWeight, product of:
                1.0963243 = boost
                3.6869924 = idf(docFreq=2856, maxDocs=41962)
                0.017078094 = queryNorm
              0.23043703 = fieldWeight in 2664, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6869924 = idf(docFreq=2856, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
          0.05486187 = weight(abstract_txt:qualitative in 2664) [ClassicSimilarity], result of:
            0.05486187 = score(doc=2664,freq=2.0), product of:
              0.10925854 = queryWeight, product of:
                1.1261488 = boost
                5.68094 = idf(docFreq=388, maxDocs=41962)
                0.017078094 = queryNorm
              0.5021289 = fieldWeight in 2664, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.68094 = idf(docFreq=388, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
          0.09404939 = weight(abstract_txt:keywords in 2664) [ClassicSimilarity], result of:
            0.09404939 = score(doc=2664,freq=4.0), product of:
              0.12421355 = queryWeight, product of:
                1.2007499 = boost
                6.057271 = idf(docFreq=266, maxDocs=41962)
                0.017078094 = queryNorm
              0.7571589 = fieldWeight in 2664, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.057271 = idf(docFreq=266, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
          0.08484831 = weight(abstract_txt:image in 2664) [ClassicSimilarity], result of:
            0.08484831 = score(doc=2664,freq=3.0), product of:
              0.14611802 = queryWeight, product of:
                1.595018 = boost
                5.364124 = idf(docFreq=533, maxDocs=41962)
                0.017078094 = queryNorm
              0.5806834 = fieldWeight in 2664, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.364124 = idf(docFreq=533, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
          0.044200115 = weight(abstract_txt:methods in 2664) [ClassicSimilarity], result of:
            0.044200115 = score(doc=2664,freq=2.0), product of:
              0.119188376 = queryWeight, product of:
                1.6634128 = boost
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.017078094 = queryNorm
              0.3708425 = fieldWeight in 2664, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
          0.11521884 = weight(abstract_txt:annotation in 2664) [ClassicSimilarity], result of:
            0.11521884 = score(doc=2664,freq=1.0), product of:
              0.25842294 = queryWeight, product of:
                2.1211884 = boost
                7.1336603 = idf(docFreq=90, maxDocs=41962)
                0.017078094 = queryNorm
              0.44585377 = fieldWeight in 2664, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.1336603 = idf(docFreq=90, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
          0.17729318 = weight(abstract_txt:images in 2664) [ClassicSimilarity], result of:
            0.17729318 = score(doc=2664,freq=7.0), product of:
              0.19817871 = queryWeight, product of:
                2.1449223 = boost
                5.410109 = idf(docFreq=509, maxDocs=41962)
                0.017078094 = queryNorm
              0.89461267 = fieldWeight in 2664, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                5.410109 = idf(docFreq=509, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
          0.07425859 = weight(abstract_txt:automatic in 2664) [ClassicSimilarity], result of:
            0.07425859 = score(doc=2664,freq=1.0), product of:
              0.22861047 = queryWeight, product of:
                2.575646 = boost
                5.1972136 = idf(docFreq=630, maxDocs=41962)
                0.017078094 = queryNorm
              0.32482585 = fieldWeight in 2664, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1972136 = idf(docFreq=630, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
          0.15021378 = weight(abstract_txt:evaluation in 2664) [ClassicSimilarity], result of:
            0.15021378 = score(doc=2664,freq=3.0), product of:
              0.30840537 = queryWeight, product of:
                4.0136113 = boost
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.017078094 = queryNorm
              0.48706603 = fieldWeight in 2664, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.0625 = fieldNorm(doc=2664)
        0.4 = coord(10/25)
    
  2. Hu, X.; Lee, J.H.; Bainbridge, D.; Choi, K.; Organisciak, P.; Downie, J.S.: ¬The MIREX grand challenge : a framework of holistic user-experience evaluation in music information retrieval (2017) 0.26
    0.26256225 = sum of:
      0.26256225 = product of:
        0.9377223 = sum of:
          0.021340804 = weight(abstract_txt:system in 322) [ClassicSimilarity], result of:
            0.021340804 = score(doc=322,freq=2.0), product of:
              0.057434466 = queryWeight, product of:
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.017078094 = queryNorm
              0.3715679 = fieldWeight in 322, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.078125 = fieldNorm(doc=322)
          0.035497297 = weight(abstract_txt:systems in 322) [ClassicSimilarity], result of:
            0.035497297 = score(doc=322,freq=5.0), product of:
              0.05940854 = queryWeight, product of:
                1.0170403 = boost
                3.4203563 = idf(docFreq=3729, maxDocs=41962)
                0.017078094 = queryNorm
              0.59751165 = fieldWeight in 322, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.4203563 = idf(docFreq=3729, maxDocs=41962)
                0.078125 = fieldNorm(doc=322)
          0.017352363 = weight(abstract_txt:results in 322) [ClassicSimilarity], result of:
            0.017352363 = score(doc=322,freq=1.0), product of:
              0.06303975 = queryWeight, product of:
                1.0476614 = boost
                3.5233364 = idf(docFreq=3364, maxDocs=41962)
                0.017078094 = queryNorm
              0.27526066 = fieldWeight in 322, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.5233364 = idf(docFreq=3364, maxDocs=41962)
                0.078125 = fieldNorm(doc=322)
          0.054273665 = weight(abstract_txt:against in 322) [ClassicSimilarity], result of:
            0.054273665 = score(doc=322,freq=1.0), product of:
              0.11777987 = queryWeight, product of:
                1.1692399 = boost
                5.8983164 = idf(docFreq=312, maxDocs=41962)
                0.017078094 = queryNorm
              0.46080595 = fieldWeight in 322, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.8983164 = idf(docFreq=312, maxDocs=41962)
                0.078125 = fieldNorm(doc=322)
          0.23785137 = weight(abstract_txt:ground in 322) [ClassicSimilarity], result of:
            0.23785137 = score(doc=322,freq=1.0), product of:
              0.42808375 = queryWeight, product of:
                3.52454 = boost
                7.1119204 = idf(docFreq=92, maxDocs=41962)
                0.017078094 = queryNorm
              0.55561876 = fieldWeight in 322, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.1119204 = idf(docFreq=92, maxDocs=41962)
                0.078125 = fieldNorm(doc=322)
          0.28458768 = weight(abstract_txt:truth in 322) [ClassicSimilarity], result of:
            0.28458768 = score(doc=322,freq=1.0), product of:
              0.48246858 = queryWeight, product of:
                3.7417314 = boost
                7.550175 = idf(docFreq=59, maxDocs=41962)
                0.017078094 = queryNorm
              0.58985746 = fieldWeight in 322, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.550175 = idf(docFreq=59, maxDocs=41962)
                0.078125 = fieldNorm(doc=322)
          0.28681916 = weight(abstract_txt:evaluation in 322) [ClassicSimilarity], result of:
            0.28681916 = score(doc=322,freq=7.0), product of:
              0.30840537 = queryWeight, product of:
                4.0136113 = boost
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.017078094 = queryNorm
              0.93000704 = fieldWeight in 322, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.078125 = fieldNorm(doc=322)
        0.28 = coord(7/25)
    
  3. Névéol, A.; Deserno, T.M.; Darmoni, S.J.; Güld, M.O.; Aronson, A.R.: Natural language processing versus content-based image analysis for medical document retrieval (2009) 0.19
    0.19118051 = sum of:
      0.19118051 = product of:
        0.53105694 = sum of:
          0.012072182 = weight(abstract_txt:system in 4703) [ClassicSimilarity], result of:
            0.012072182 = score(doc=4703,freq=1.0), product of:
              0.057434466 = queryWeight, product of:
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.017078094 = queryNorm
              0.21019055 = fieldWeight in 4703, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.0625 = fieldNorm(doc=4703)
          0.027566135 = weight(abstract_txt:test in 4703) [ClassicSimilarity], result of:
            0.027566135 = score(doc=4703,freq=1.0), product of:
              0.08700327 = queryWeight, product of:
                1.0049301 = boost
                5.0694437 = idf(docFreq=716, maxDocs=41962)
                0.017078094 = queryNorm
              0.31684023 = fieldWeight in 4703, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0694437 = idf(docFreq=716, maxDocs=41962)
                0.0625 = fieldNorm(doc=4703)
          0.012699898 = weight(abstract_txt:systems in 4703) [ClassicSimilarity], result of:
            0.012699898 = score(doc=4703,freq=1.0), product of:
              0.05940854 = queryWeight, product of:
                1.0170403 = boost
                3.4203563 = idf(docFreq=3729, maxDocs=41962)
                0.017078094 = queryNorm
              0.21377227 = fieldWeight in 4703, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4203563 = idf(docFreq=3729, maxDocs=41962)
                0.0625 = fieldNorm(doc=4703)
          0.04475118 = weight(abstract_txt:indexing in 4703) [ClassicSimilarity], result of:
            0.04475118 = score(doc=4703,freq=3.0), product of:
              0.09538454 = queryWeight, product of:
                1.2887026 = boost
                4.3339696 = idf(docFreq=1495, maxDocs=41962)
                0.017078094 = queryNorm
              0.46916595 = fieldWeight in 4703, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.3339696 = idf(docFreq=1495, maxDocs=41962)
                0.0625 = fieldNorm(doc=4703)
          0.14696158 = weight(abstract_txt:image in 4703) [ClassicSimilarity], result of:
            0.14696158 = score(doc=4703,freq=9.0), product of:
              0.14611802 = queryWeight, product of:
                1.595018 = boost
                5.364124 = idf(docFreq=533, maxDocs=41962)
                0.017078094 = queryNorm
              1.0057732 = fieldWeight in 4703, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                5.364124 = idf(docFreq=533, maxDocs=41962)
                0.0625 = fieldNorm(doc=4703)
          0.031254202 = weight(abstract_txt:methods in 4703) [ClassicSimilarity], result of:
            0.031254202 = score(doc=4703,freq=1.0), product of:
              0.119188376 = queryWeight, product of:
                1.6634128 = boost
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.017078094 = queryNorm
              0.26222524 = fieldWeight in 4703, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.0625 = fieldNorm(doc=4703)
          0.0947672 = weight(abstract_txt:images in 4703) [ClassicSimilarity], result of:
            0.0947672 = score(doc=4703,freq=2.0), product of:
              0.19817871 = queryWeight, product of:
                2.1449223 = boost
                5.410109 = idf(docFreq=509, maxDocs=41962)
                0.017078094 = queryNorm
              0.4781906 = fieldWeight in 4703, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.410109 = idf(docFreq=509, maxDocs=41962)
                0.0625 = fieldNorm(doc=4703)
          0.07425859 = weight(abstract_txt:automatic in 4703) [ClassicSimilarity], result of:
            0.07425859 = score(doc=4703,freq=1.0), product of:
              0.22861047 = queryWeight, product of:
                2.575646 = boost
                5.1972136 = idf(docFreq=630, maxDocs=41962)
                0.017078094 = queryNorm
              0.32482585 = fieldWeight in 4703, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1972136 = idf(docFreq=630, maxDocs=41962)
                0.0625 = fieldNorm(doc=4703)
          0.086725965 = weight(abstract_txt:evaluation in 4703) [ClassicSimilarity], result of:
            0.086725965 = score(doc=4703,freq=1.0), product of:
              0.30840537 = queryWeight, product of:
                4.0136113 = boost
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.017078094 = queryNorm
              0.2812077 = fieldWeight in 4703, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.0625 = fieldNorm(doc=4703)
        0.36 = coord(9/25)
    
  4. Rasmussen, E.M.: Indexing images (1997) 0.18
    0.1835701 = sum of:
      0.1835701 = product of:
        0.6556075 = sum of:
          0.031749748 = weight(abstract_txt:systems in 3629) [ClassicSimilarity], result of:
            0.031749748 = score(doc=3629,freq=4.0), product of:
              0.05940854 = queryWeight, product of:
                1.0170403 = boost
                3.4203563 = idf(docFreq=3729, maxDocs=41962)
                0.017078094 = queryNorm
              0.5344307 = fieldWeight in 3629, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.4203563 = idf(docFreq=3729, maxDocs=41962)
                0.078125 = fieldNorm(doc=3629)
          0.079109654 = weight(abstract_txt:indexing in 3629) [ClassicSimilarity], result of:
            0.079109654 = score(doc=3629,freq=6.0), product of:
              0.09538454 = queryWeight, product of:
                1.2887026 = boost
                4.3339696 = idf(docFreq=1495, maxDocs=41962)
                0.017078094 = queryNorm
              0.8293761 = fieldWeight in 3629, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.3339696 = idf(docFreq=1495, maxDocs=41962)
                0.078125 = fieldNorm(doc=3629)
          0.13692337 = weight(abstract_txt:image in 3629) [ClassicSimilarity], result of:
            0.13692337 = score(doc=3629,freq=5.0), product of:
              0.14611802 = queryWeight, product of:
                1.595018 = boost
                5.364124 = idf(docFreq=533, maxDocs=41962)
                0.017078094 = queryNorm
              0.9370739 = fieldWeight in 3629, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.364124 = idf(docFreq=533, maxDocs=41962)
                0.078125 = fieldNorm(doc=3629)
          0.039067753 = weight(abstract_txt:methods in 3629) [ClassicSimilarity], result of:
            0.039067753 = score(doc=3629,freq=1.0), product of:
              0.119188376 = queryWeight, product of:
                1.6634128 = boost
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.017078094 = queryNorm
              0.32778156 = fieldWeight in 3629, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.195604 = idf(docFreq=1717, maxDocs=41962)
                0.078125 = fieldNorm(doc=3629)
          0.16752632 = weight(abstract_txt:images in 3629) [ClassicSimilarity], result of:
            0.16752632 = score(doc=3629,freq=4.0), product of:
              0.19817871 = queryWeight, product of:
                2.1449223 = boost
                5.410109 = idf(docFreq=509, maxDocs=41962)
                0.017078094 = queryNorm
              0.8453295 = fieldWeight in 3629, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.410109 = idf(docFreq=509, maxDocs=41962)
                0.078125 = fieldNorm(doc=3629)
          0.09282324 = weight(abstract_txt:automatic in 3629) [ClassicSimilarity], result of:
            0.09282324 = score(doc=3629,freq=1.0), product of:
              0.22861047 = queryWeight, product of:
                2.575646 = boost
                5.1972136 = idf(docFreq=630, maxDocs=41962)
                0.017078094 = queryNorm
              0.40603232 = fieldWeight in 3629, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1972136 = idf(docFreq=630, maxDocs=41962)
                0.078125 = fieldNorm(doc=3629)
          0.10840746 = weight(abstract_txt:evaluation in 3629) [ClassicSimilarity], result of:
            0.10840746 = score(doc=3629,freq=1.0), product of:
              0.30840537 = queryWeight, product of:
                4.0136113 = boost
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.017078094 = queryNorm
              0.35150963 = fieldWeight in 3629, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.078125 = fieldNorm(doc=3629)
        0.28 = coord(7/25)
    
  5. Gil-Leiva, I.: SISA-automatic indexing system for scientific articles : experiments with location heuristics rules versus TF-IDF rules (2017) 0.17
    0.1709751 = sum of:
      0.1709751 = product of:
        0.5342972 = sum of:
          0.015090228 = weight(abstract_txt:system in 187) [ClassicSimilarity], result of:
            0.015090228 = score(doc=187,freq=1.0), product of:
              0.057434466 = queryWeight, product of:
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.017078094 = queryNorm
              0.2627382 = fieldWeight in 187, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.078125 = fieldNorm(doc=187)
          0.015874874 = weight(abstract_txt:systems in 187) [ClassicSimilarity], result of:
            0.015874874 = score(doc=187,freq=1.0), product of:
              0.05940854 = queryWeight, product of:
                1.0170403 = boost
                3.4203563 = idf(docFreq=3729, maxDocs=41962)
                0.017078094 = queryNorm
              0.26721534 = fieldWeight in 187, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4203563 = idf(docFreq=3729, maxDocs=41962)
                0.078125 = fieldNorm(doc=187)
          0.017352363 = weight(abstract_txt:results in 187) [ClassicSimilarity], result of:
            0.017352363 = score(doc=187,freq=1.0), product of:
              0.06303975 = queryWeight, product of:
                1.0476614 = boost
                3.5233364 = idf(docFreq=3364, maxDocs=41962)
                0.017078094 = queryNorm
              0.27526066 = fieldWeight in 187, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.5233364 = idf(docFreq=3364, maxDocs=41962)
                0.078125 = fieldNorm(doc=187)
          0.019884422 = weight(abstract_txt:some in 187) [ClassicSimilarity], result of:
            0.019884422 = score(doc=187,freq=1.0), product of:
              0.06903204 = queryWeight, product of:
                1.0963243 = boost
                3.6869924 = idf(docFreq=2856, maxDocs=41962)
                0.017078094 = queryNorm
              0.28804627 = fieldWeight in 187, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6869924 = idf(docFreq=2856, maxDocs=41962)
                0.078125 = fieldNorm(doc=187)
          0.058780868 = weight(abstract_txt:keywords in 187) [ClassicSimilarity], result of:
            0.058780868 = score(doc=187,freq=1.0), product of:
              0.12421355 = queryWeight, product of:
                1.2007499 = boost
                6.057271 = idf(docFreq=266, maxDocs=41962)
                0.017078094 = queryNorm
              0.47322428 = fieldWeight in 187, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.057271 = idf(docFreq=266, maxDocs=41962)
                0.078125 = fieldNorm(doc=187)
          0.09134796 = weight(abstract_txt:indexing in 187) [ClassicSimilarity], result of:
            0.09134796 = score(doc=187,freq=8.0), product of:
              0.09538454 = queryWeight, product of:
                1.2887026 = boost
                4.3339696 = idf(docFreq=1495, maxDocs=41962)
                0.017078094 = queryNorm
              0.957681 = fieldWeight in 187, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.3339696 = idf(docFreq=1495, maxDocs=41962)
                0.078125 = fieldNorm(doc=187)
          0.20755908 = weight(abstract_txt:automatic in 187) [ClassicSimilarity], result of:
            0.20755908 = score(doc=187,freq=5.0), product of:
              0.22861047 = queryWeight, product of:
                2.575646 = boost
                5.1972136 = idf(docFreq=630, maxDocs=41962)
                0.017078094 = queryNorm
              0.9079159 = fieldWeight in 187, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.1972136 = idf(docFreq=630, maxDocs=41962)
                0.078125 = fieldNorm(doc=187)
          0.10840746 = weight(abstract_txt:evaluation in 187) [ClassicSimilarity], result of:
            0.10840746 = score(doc=187,freq=1.0), product of:
              0.30840537 = queryWeight, product of:
                4.0136113 = boost
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.017078094 = queryNorm
              0.35150963 = fieldWeight in 187, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.078125 = fieldNorm(doc=187)
        0.32 = coord(8/25)