Document (#14069)

Author
Malone, L.C.
Wildman-Pepe, J.
Driscoll, J.R.
Title
Evaluation of an automated keywording system
Source
Microcomputers for information management. 7(1990) no. 2, S.127-148
Year
1990
Abstract
An automated keywording system has been designed ro artifically behave as a human "expert" indexer. The system was designed to keyword 100 to 800 word documents representing lessons learned from military exercises and operations. A set of 74 documents can be keyworded on an IBM PS/2 model 80 in about five minutes. This paper presents a variety of ways for statistical documenting improvements in the development of an automated keywording system over time. It is not only beneficial to have some measure of system performance for a given time, but it is also useful as attemps are made to improve a system to assess if actual statistically significant improvements have been made. Furthermore, it is useful to identify the source of any existing problems so that they can be rectified. The specifics of the automated system that was evaluated are described, and the performance measures used are discussed.
Theme
Automatisches Indexieren

Similar documents (author)

  1. Malone, L.C.; Driscoll, J.R.; Pepe, J.W.: Modeling the performance of an automated keywording system (1991) 5.15
    5.1532626 = sum of:
      5.1532626 = sum of:
        2.4622731 = weight(author_txt:malone in 6682) [ClassicSimilarity], result of:
          2.4622731 = score(doc=6682,freq=1.0), product of:
            0.6858765 = queryWeight, product of:
              9.573242 = idf(docFreq=7, maxDocs=42306)
              0.07164516 = queryNorm
            3.5899658 = fieldWeight in 6682, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              9.573242 = idf(docFreq=7, maxDocs=42306)
              0.375 = fieldNorm(doc=6682)
        2.6909895 = weight(author_txt:pepe in 6682) [ClassicSimilarity], result of:
          2.6909895 = score(doc=6682,freq=1.0), product of:
            0.72771794 = queryWeight, product of:
              1.0300506 = boost
              9.860925 = idf(docFreq=5, maxDocs=42306)
              0.07164516 = queryNorm
            3.697847 = fieldWeight in 6682, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              9.860925 = idf(docFreq=5, maxDocs=42306)
              0.375 = fieldNorm(doc=6682)
    
  2. Pepe, A.: ¬The relationship between acquaintanceship and coauthorship in scientific collaboration networks (2011) 2.24
    2.2424912 = sum of:
      2.2424912 = product of:
        4.4849825 = sum of:
          4.4849825 = weight(author_txt:pepe in 1918) [ClassicSimilarity], result of:
            4.4849825 = score(doc=1918,freq=1.0), product of:
              0.72771794 = queryWeight, product of:
                1.0300506 = boost
                9.860925 = idf(docFreq=5, maxDocs=42306)
                0.07164516 = queryNorm
              6.163078 = fieldWeight in 1918, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.860925 = idf(docFreq=5, maxDocs=42306)
                0.625 = fieldNorm(doc=1918)
        0.5 = coord(1/2)
    
  3. Malone, C. Knott -> Knott Malone, C.: 1.74
    1.7410899 = sum of:
      1.7410899 = product of:
        3.4821799 = sum of:
          3.4821799 = weight(author_txt:malone in 3736) [ClassicSimilarity], result of:
            3.4821799 = score(doc=3736,freq=2.0), product of:
              0.6858765 = queryWeight, product of:
                9.573242 = idf(docFreq=7, maxDocs=42306)
                0.07164516 = queryNorm
              5.076978 = fieldWeight in 3736, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                9.573242 = idf(docFreq=7, maxDocs=42306)
                0.375 = fieldNorm(doc=3736)
        0.5 = coord(1/2)
    
  4. Malone, T.W.; Rockart, J.F.: Vernetzung und Management (1995) 1.64
    1.6415155 = sum of:
      1.6415155 = product of:
        3.283031 = sum of:
          3.283031 = weight(author_txt:malone in 950) [ClassicSimilarity], result of:
            3.283031 = score(doc=950,freq=1.0), product of:
              0.6858765 = queryWeight, product of:
                9.573242 = idf(docFreq=7, maxDocs=42306)
                0.07164516 = queryNorm
              4.786621 = fieldWeight in 950, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.573242 = idf(docFreq=7, maxDocs=42306)
                0.5 = fieldNorm(doc=950)
        0.5 = coord(1/2)
    
  5. Elichirigoity, F.; Malone, C.K.: Measuring the new economy : industrial classification and open source software production (2005) 1.64
    1.6415155 = sum of:
      1.6415155 = product of:
        3.283031 = sum of:
          3.283031 = weight(author_txt:malone in 40) [ClassicSimilarity], result of:
            3.283031 = score(doc=40,freq=1.0), product of:
              0.6858765 = queryWeight, product of:
                9.573242 = idf(docFreq=7, maxDocs=42306)
                0.07164516 = queryNorm
              4.786621 = fieldWeight in 40, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.573242 = idf(docFreq=7, maxDocs=42306)
                0.5 = fieldNorm(doc=40)
        0.5 = coord(1/2)
    

Similar documents (content)

  1. Malone, L.C.; Driscoll, J.R.; Pepe, J.W.: Modeling the performance of an automated keywording system (1991) 0.38
    0.3766276 = sum of:
      0.3766276 = product of:
        1.1769613 = sum of:
          0.115970165 = weight(abstract_txt:operations in 6682) [ClassicSimilarity], result of:
            0.115970165 = score(doc=6682,freq=1.0), product of:
              0.14197479 = queryWeight, product of:
                1.0573225 = boost
                6.5346904 = idf(docFreq=166, maxDocs=42306)
                0.020548435 = queryNorm
              0.8168363 = fieldWeight in 6682, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.5346904 = idf(docFreq=166, maxDocs=42306)
                0.125 = fieldNorm(doc=6682)
          0.121053316 = weight(abstract_txt:learned in 6682) [ClassicSimilarity], result of:
            0.121053316 = score(doc=6682,freq=1.0), product of:
              0.14609371 = queryWeight, product of:
                1.0725502 = boost
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.020548435 = queryNorm
              0.82860047 = fieldWeight in 6682, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.125 = fieldNorm(doc=6682)
          0.14364913 = weight(abstract_txt:lessons in 6682) [ClassicSimilarity], result of:
            0.14364913 = score(doc=6682,freq=1.0), product of:
              0.16375041 = queryWeight, product of:
                1.1355155 = boost
                7.0179553 = idf(docFreq=102, maxDocs=42306)
                0.020548435 = queryNorm
              0.8772444 = fieldWeight in 6682, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.0179553 = idf(docFreq=102, maxDocs=42306)
                0.125 = fieldNorm(doc=6682)
          0.16677737 = weight(abstract_txt:exercises in 6682) [ClassicSimilarity], result of:
            0.16677737 = score(doc=6682,freq=1.0), product of:
              0.18088607 = queryWeight, product of:
                1.1934506 = boost
                7.376018 = idf(docFreq=71, maxDocs=42306)
                0.020548435 = queryNorm
              0.92200226 = fieldWeight in 6682, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.376018 = idf(docFreq=71, maxDocs=42306)
                0.125 = fieldNorm(doc=6682)
          0.25294933 = weight(abstract_txt:military in 6682) [ClassicSimilarity], result of:
            0.25294933 = score(doc=6682,freq=1.0), product of:
              0.23878263 = queryWeight, product of:
                1.3712076 = boost
                8.47463 = idf(docFreq=23, maxDocs=42306)
                0.020548435 = queryNorm
              1.0593288 = fieldWeight in 6682, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.47463 = idf(docFreq=23, maxDocs=42306)
                0.125 = fieldNorm(doc=6682)
          0.08350234 = weight(abstract_txt:performance in 6682) [ClassicSimilarity], result of:
            0.08350234 = score(doc=6682,freq=1.0), product of:
              0.1436998 = queryWeight, product of:
                1.5043362 = boost
                4.6487103 = idf(docFreq=1100, maxDocs=42306)
                0.020548435 = queryNorm
              0.5810888 = fieldWeight in 6682, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6487103 = idf(docFreq=1100, maxDocs=42306)
                0.125 = fieldNorm(doc=6682)
          0.10108314 = weight(abstract_txt:designed in 6682) [ClassicSimilarity], result of:
            0.10108314 = score(doc=6682,freq=1.0), product of:
              0.16322106 = queryWeight, product of:
                1.6032636 = boost
                4.9544163 = idf(docFreq=810, maxDocs=42306)
                0.020548435 = queryNorm
              0.61930203 = fieldWeight in 6682, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.9544163 = idf(docFreq=810, maxDocs=42306)
                0.125 = fieldNorm(doc=6682)
          0.19197647 = weight(abstract_txt:system in 6682) [ClassicSimilarity], result of:
            0.19197647 = score(doc=6682,freq=3.0), product of:
              0.26351458 = queryWeight, product of:
                3.811125 = boost
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.020548435 = queryNorm
              0.72852314 = fieldWeight in 6682, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.125 = fieldNorm(doc=6682)
        0.32 = coord(8/25)
    
  2. Oard, D.W.: Alternative approaches for cross-language text retrieval (1997) 0.14
    0.14305052 = sum of:
      0.14305052 = product of:
        0.39736256 = sum of:
          0.015336103 = weight(abstract_txt:have in 3165) [ClassicSimilarity], result of:
            0.015336103 = score(doc=3165,freq=3.0), product of:
              0.06990796 = queryWeight, product of:
                1.0492529 = boost
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.020548435 = queryNorm
              0.21937563 = fieldWeight in 3165, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.0390625 = fieldNorm(doc=3165)
          0.021775136 = weight(abstract_txt:been in 3165) [ClassicSimilarity], result of:
            0.021775136 = score(doc=3165,freq=3.0), product of:
              0.08831285 = queryWeight, product of:
                1.1793122 = boost
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.020548435 = queryNorm
              0.24656816 = fieldWeight in 3165, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.0390625 = fieldNorm(doc=3165)
          0.05465472 = weight(abstract_txt:beneficial in 3165) [ClassicSimilarity], result of:
            0.05465472 = score(doc=3165,freq=1.0), product of:
              0.1867091 = queryWeight, product of:
                1.212508 = boost
                7.493801 = idf(docFreq=63, maxDocs=42306)
                0.020548435 = queryNorm
              0.2927266 = fieldWeight in 3165, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.493801 = idf(docFreq=63, maxDocs=42306)
                0.0390625 = fieldNorm(doc=3165)
          0.040494394 = weight(abstract_txt:documents in 3165) [ClassicSimilarity], result of:
            0.040494394 = score(doc=3165,freq=5.0), product of:
              0.112641126 = queryWeight, product of:
                1.3318808 = boost
                4.115787 = idf(docFreq=1875, maxDocs=42306)
                0.020548435 = queryNorm
              0.3594992 = fieldWeight in 3165, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.115787 = idf(docFreq=1875, maxDocs=42306)
                0.0390625 = fieldNorm(doc=3165)
          0.026722929 = weight(abstract_txt:time in 3165) [ClassicSimilarity], result of:
            0.026722929 = score(doc=3165,freq=2.0), product of:
              0.11587856 = queryWeight, product of:
                1.350885 = boost
                4.1745143 = idf(docFreq=1768, maxDocs=42306)
                0.020548435 = queryNorm
              0.2306115 = fieldWeight in 3165, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.1745143 = idf(docFreq=1768, maxDocs=42306)
                0.0390625 = fieldNorm(doc=3165)
          0.024862071 = weight(abstract_txt:made in 3165) [ClassicSimilarity], result of:
            0.024862071 = score(doc=3165,freq=1.0), product of:
              0.1391389 = queryWeight, product of:
                1.4802707 = boost
                4.5743427 = idf(docFreq=1185, maxDocs=42306)
                0.020548435 = queryNorm
              0.17868526 = fieldWeight in 3165, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5743427 = idf(docFreq=1185, maxDocs=42306)
                0.0390625 = fieldNorm(doc=3165)
          0.07210381 = weight(abstract_txt:useful in 3165) [ClassicSimilarity], result of:
            0.07210381 = score(doc=3165,freq=6.0), product of:
              0.15572037 = queryWeight, product of:
                1.5659921 = boost
                4.8392396 = idf(docFreq=909, maxDocs=42306)
                0.020548435 = queryNorm
              0.4630339 = fieldWeight in 3165, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.8392396 = idf(docFreq=909, maxDocs=42306)
                0.0390625 = fieldNorm(doc=3165)
          0.09242962 = weight(abstract_txt:automated in 3165) [ClassicSimilarity], result of:
            0.09242962 = score(doc=3165,freq=1.0), product of:
              0.42070192 = queryWeight, product of:
                3.6401484 = boost
                5.624406 = idf(docFreq=414, maxDocs=42306)
                0.020548435 = queryNorm
              0.21970335 = fieldWeight in 3165, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.624406 = idf(docFreq=414, maxDocs=42306)
                0.0390625 = fieldNorm(doc=3165)
          0.04898379 = weight(abstract_txt:system in 3165) [ClassicSimilarity], result of:
            0.04898379 = score(doc=3165,freq=2.0), product of:
              0.26351458 = queryWeight, product of:
                3.811125 = boost
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.020548435 = queryNorm
              0.18588646 = fieldWeight in 3165, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.0390625 = fieldNorm(doc=3165)
        0.36 = coord(9/25)
    
  3. Peckham, J.; MacKellar, B.; Vorback, J.: ¬A unified approach to the design and generation of complex database schemata (1997) 0.13
    0.12806185 = sum of:
      0.12806185 = product of:
        0.6403092 = sum of:
          0.105921656 = weight(abstract_txt:learned in 2260) [ClassicSimilarity], result of:
            0.105921656 = score(doc=2260,freq=1.0), product of:
              0.14609371 = queryWeight, product of:
                1.0725502 = boost
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.020548435 = queryNorm
              0.7250254 = fieldWeight in 2260, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.109375 = fieldNorm(doc=2260)
          0.125693 = weight(abstract_txt:lessons in 2260) [ClassicSimilarity], result of:
            0.125693 = score(doc=2260,freq=1.0), product of:
              0.16375041 = queryWeight, product of:
                1.1355155 = boost
                7.0179553 = idf(docFreq=102, maxDocs=42306)
                0.020548435 = queryNorm
              0.76758885 = fieldWeight in 2260, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.0179553 = idf(docFreq=102, maxDocs=42306)
                0.109375 = fieldNorm(doc=2260)
          0.0529087 = weight(abstract_txt:time in 2260) [ClassicSimilarity], result of:
            0.0529087 = score(doc=2260,freq=1.0), product of:
              0.11587856 = queryWeight, product of:
                1.350885 = boost
                4.1745143 = idf(docFreq=1768, maxDocs=42306)
                0.020548435 = queryNorm
              0.4565875 = fieldWeight in 2260, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1745143 = idf(docFreq=1768, maxDocs=42306)
                0.109375 = fieldNorm(doc=2260)
          0.25880295 = weight(abstract_txt:automated in 2260) [ClassicSimilarity], result of:
            0.25880295 = score(doc=2260,freq=1.0), product of:
              0.42070192 = queryWeight, product of:
                3.6401484 = boost
                5.624406 = idf(docFreq=414, maxDocs=42306)
                0.020548435 = queryNorm
              0.6151694 = fieldWeight in 2260, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.624406 = idf(docFreq=414, maxDocs=42306)
                0.109375 = fieldNorm(doc=2260)
          0.096982956 = weight(abstract_txt:system in 2260) [ClassicSimilarity], result of:
            0.096982956 = score(doc=2260,freq=1.0), product of:
              0.26351458 = queryWeight, product of:
                3.811125 = boost
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.020548435 = queryNorm
              0.3680364 = fieldWeight in 2260, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.109375 = fieldNorm(doc=2260)
        0.2 = coord(5/25)
    
  4. Kgosiemang, R.T.: Role changes : Cataloguing, technical services and subject librarianship at the University of Botswana Library (UBL) (2000) 0.11
    0.11213603 = sum of:
      0.11213603 = product of:
        0.56068015 = sum of:
          0.03506125 = weight(abstract_txt:have in 373) [ClassicSimilarity], result of:
            0.03506125 = score(doc=373,freq=2.0), product of:
              0.06990796 = queryWeight, product of:
                1.0492529 = boost
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.020548435 = queryNorm
              0.50153446 = fieldWeight in 373, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.109375 = fieldNorm(doc=373)
          0.105921656 = weight(abstract_txt:learned in 373) [ClassicSimilarity], result of:
            0.105921656 = score(doc=373,freq=1.0), product of:
              0.14609371 = queryWeight, product of:
                1.0725502 = boost
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.020548435 = queryNorm
              0.7250254 = fieldWeight in 373, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6288037 = idf(docFreq=151, maxDocs=42306)
                0.109375 = fieldNorm(doc=373)
          0.125693 = weight(abstract_txt:lessons in 373) [ClassicSimilarity], result of:
            0.125693 = score(doc=373,freq=1.0), product of:
              0.16375041 = queryWeight, product of:
                1.1355155 = boost
                7.0179553 = idf(docFreq=102, maxDocs=42306)
                0.020548435 = queryNorm
              0.76758885 = fieldWeight in 373, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.0179553 = idf(docFreq=102, maxDocs=42306)
                0.109375 = fieldNorm(doc=373)
          0.03520127 = weight(abstract_txt:been in 373) [ClassicSimilarity], result of:
            0.03520127 = score(doc=373,freq=1.0), product of:
              0.08831285 = queryWeight, product of:
                1.1793122 = boost
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.020548435 = queryNorm
              0.39859736 = fieldWeight in 373, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.109375 = fieldNorm(doc=373)
          0.25880295 = weight(abstract_txt:automated in 373) [ClassicSimilarity], result of:
            0.25880295 = score(doc=373,freq=1.0), product of:
              0.42070192 = queryWeight, product of:
                3.6401484 = boost
                5.624406 = idf(docFreq=414, maxDocs=42306)
                0.020548435 = queryNorm
              0.6151694 = fieldWeight in 373, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.624406 = idf(docFreq=414, maxDocs=42306)
                0.109375 = fieldNorm(doc=373)
        0.2 = coord(5/25)
    
  5. Beitzel, S.M.; Jensen, E.C.; Chowdhury, A.; Grossman, D.; Frieder, O; Goharian, N.: Fusion of effective retrieval strategies in the same information retrieval system (2004) 0.11
    0.1082538 = sum of:
      0.1082538 = product of:
        0.4510575 = sum of:
          0.061320245 = weight(abstract_txt:furthermore in 3503) [ClassicSimilarity], result of:
            0.061320245 = score(doc=3503,freq=1.0), product of:
              0.12699783 = queryWeight, product of:
                6.1804137 = idf(docFreq=237, maxDocs=42306)
                0.020548435 = queryNorm
              0.48284483 = fieldWeight in 3503, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1804137 = idf(docFreq=237, maxDocs=42306)
                0.078125 = fieldNorm(doc=3503)
          0.02504375 = weight(abstract_txt:have in 3503) [ClassicSimilarity], result of:
            0.02504375 = score(doc=3503,freq=2.0), product of:
              0.06990796 = queryWeight, product of:
                1.0492529 = boost
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.020548435 = queryNorm
              0.35823888 = fieldWeight in 3503, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.2424083 = idf(docFreq=4492, maxDocs=42306)
                0.078125 = fieldNorm(doc=3503)
          0.03555865 = weight(abstract_txt:been in 3503) [ClassicSimilarity], result of:
            0.03555865 = score(doc=3503,freq=2.0), product of:
              0.08831285 = queryWeight, product of:
                1.1793122 = boost
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.020548435 = queryNorm
              0.40264413 = fieldWeight in 3503, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6443186 = idf(docFreq=3005, maxDocs=42306)
                0.078125 = fieldNorm(doc=3503)
          0.052188963 = weight(abstract_txt:performance in 3503) [ClassicSimilarity], result of:
            0.052188963 = score(doc=3503,freq=1.0), product of:
              0.1436998 = queryWeight, product of:
                1.5043362 = boost
                4.6487103 = idf(docFreq=1100, maxDocs=42306)
                0.020548435 = queryNorm
              0.3631805 = fieldWeight in 3503, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6487103 = idf(docFreq=1100, maxDocs=42306)
                0.078125 = fieldNorm(doc=3503)
          0.17897834 = weight(abstract_txt:improvements in 3503) [ClassicSimilarity], result of:
            0.17897834 = score(doc=3503,freq=2.0), product of:
              0.25937456 = queryWeight, product of:
                2.0210662 = boost
                6.2455125 = idf(docFreq=222, maxDocs=42306)
                0.020548435 = queryNorm
              0.69003814 = fieldWeight in 3503, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.2455125 = idf(docFreq=222, maxDocs=42306)
                0.078125 = fieldNorm(doc=3503)
          0.09796758 = weight(abstract_txt:system in 3503) [ClassicSimilarity], result of:
            0.09796758 = score(doc=3503,freq=2.0), product of:
              0.26351458 = queryWeight, product of:
                3.811125 = boost
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.020548435 = queryNorm
              0.37177292 = fieldWeight in 3503, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3649042 = idf(docFreq=3974, maxDocs=42306)
                0.078125 = fieldNorm(doc=3503)
        0.24 = coord(6/25)