Document (#39879)

Author
Olmos, R.
Jorge-Botana, G.
Luzón, J.M.
Martín-Cordero, J.I.
León, J.A.
Title
Transforming LSA space dimensions into a rubric for an automatic assessment and feedback system
Source
Information processing and management. 52(2016) no.3, S.359-373
Year
2016
Abstract
The purpose of this article is to validate, through two empirical studies, a new method for automatic evaluation of written texts, called Inbuilt Rubric, based on the Latent Semantic Analysis (LSA) technique, which constitutes an innovative and distinct turn with respect to LSA application so far. In the first empirical study, evidence of the validity of the method to identify and evaluate the conceptual axes of a text in a sample of 78 summaries by secondary school students is sought. Results show that the proposed method has a significantly higher degree of reliability than classic LSA methods of text evaluation, and displays very high sensitivity to identify which conceptual axes are included or not in each summary. A second study evaluates the method's capacity to interact and provide feedback about quality in a real online system on a sample of 924 discursive texts written by university students. Results show that students improved the quality of their written texts using this system, and also rated the experience very highly. The final conclusion is that this new method opens a very interesting way regarding the role of automatic assessors in the identification of presence/absence and quality of elaboration of relevant conceptual information in texts written by students with lower time costs than the usual LSA-based methods.
Content
Vgl.: 10.1016/j.ipm.2015.12.002.
Theme
Semantisches Umfeld in Indexierung u. Retrieval
Object
Latent semantic analysis

Similar documents (author)

  1. Martín, A. Martín- => Martín-Martín, A.: 6.65
    6.6477556 = sum of:
      6.6477556 = weight(author_txt:martín in 1137) [ClassicSimilarity], result of:
        6.6477556 = fieldWeight in 1137, product of:
          2.0 = tf(freq=4.0), with freq of:
            4.0 = termFreq=4.0
          8.863674 = idf(docFreq=16, maxDocs=44218)
          0.375 = fieldNorm(doc=1137)
    
  2. Martín, A.C.; Gómez Prada, R.: RDA and rare materials at the National Library of Spain (2016) 3.88
    3.8778574 = sum of:
      3.8778574 = weight(author_txt:martín in 5129) [ClassicSimilarity], result of:
        3.8778574 = fieldWeight in 5129, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.863674 = idf(docFreq=16, maxDocs=44218)
          0.4375 = fieldNorm(doc=5129)
    
  3. Bautista, M.J. Mártin- -> Martín-Bautista, M.J.: 3.32
    3.3238778 = sum of:
      3.3238778 = weight(author_txt:martín in 2775) [ClassicSimilarity], result of:
        3.3238778 = fieldWeight in 2775, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.863674 = idf(docFreq=16, maxDocs=44218)
          0.375 = fieldNorm(doc=2775)
    
  4. Martín-Martín, A.; Ayllón, J.M.; López-Cózar, E.D.; Orduna-Malea, E.: Nature's top 100 Re-revisited (2015) 3.13
    3.133782 = sum of:
      3.133782 = weight(author_txt:martín in 2352) [ClassicSimilarity], result of:
        3.133782 = fieldWeight in 2352, product of:
          1.4142135 = tf(freq=2.0), with freq of:
            2.0 = termFreq=2.0
          8.863674 = idf(docFreq=16, maxDocs=44218)
          0.25 = fieldNorm(doc=2352)
    
  5. Delgado-Quirós, L.; Aguillo, I.F.; Martín-Martín, A.; López-Cózar, E.D.; Orduña-Malea, E.; Ortega, J.L.: Why are these publications missing? : uncovering the reasons behind the exclusion of documents in free-access scholarly databases (2024) 3.13
    3.133782 = sum of:
      3.133782 = weight(author_txt:martín in 1201) [ClassicSimilarity], result of:
        3.133782 = fieldWeight in 1201, product of:
          1.4142135 = tf(freq=2.0), with freq of:
            2.0 = termFreq=2.0
          8.863674 = idf(docFreq=16, maxDocs=44218)
          0.25 = fieldNorm(doc=1201)
    

Similar documents (content)

  1. Abdi, A.; Idris, N.; Alguliev, R.M.; Aliguliyev, R.M.: Automatic summarization assessment through a combination of semantic and syntactic information for intelligent educational systems (2015) 0.16
    0.1636581 = sum of:
      0.1636581 = product of:
        0.5114316 = sum of:
          0.019801155 = weight(abstract_txt:text in 2681) [ClassicSimilarity], result of:
            0.019801155 = score(doc=2681,freq=1.0), product of:
              0.07834543 = queryWeight, product of:
                1.025032 = boost
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.018900767 = queryNorm
              0.25274166 = fieldWeight in 2681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.0625 = fieldNorm(doc=2681)
          0.03823075 = weight(abstract_txt:evaluation in 2681) [ClassicSimilarity], result of:
            0.03823075 = score(doc=2681,freq=2.0), product of:
              0.096416615 = queryWeight, product of:
                1.1371206 = boost
                4.4860687 = idf(docFreq=1353, maxDocs=44218)
                0.018900767 = queryNorm
              0.3965162 = fieldWeight in 2681, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4860687 = idf(docFreq=1353, maxDocs=44218)
                0.0625 = fieldNorm(doc=2681)
          0.017225552 = weight(abstract_txt:system in 2681) [ClassicSimilarity], result of:
            0.017225552 = score(doc=2681,freq=1.0), product of:
              0.08172706 = queryWeight, product of:
                1.28221 = boost
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.018900767 = queryNorm
              0.21076928 = fieldWeight in 2681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.0625 = fieldNorm(doc=2681)
          0.053541362 = weight(abstract_txt:very in 2681) [ClassicSimilarity], result of:
            0.053541362 = score(doc=2681,freq=1.0), product of:
              0.17406443 = queryWeight, product of:
                1.8712475 = boost
                4.921521 = idf(docFreq=875, maxDocs=44218)
                0.018900767 = queryNorm
              0.30759507 = fieldWeight in 2681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.921521 = idf(docFreq=875, maxDocs=44218)
                0.0625 = fieldNorm(doc=2681)
          0.0629938 = weight(abstract_txt:automatic in 2681) [ClassicSimilarity], result of:
            0.0629938 = score(doc=2681,freq=1.0), product of:
              0.19399132 = queryWeight, product of:
                1.9754561 = boost
                5.1955976 = idf(docFreq=665, maxDocs=44218)
                0.018900767 = queryNorm
              0.32472485 = fieldWeight in 2681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1955976 = idf(docFreq=665, maxDocs=44218)
                0.0625 = fieldNorm(doc=2681)
          0.10921255 = weight(abstract_txt:method in 2681) [ClassicSimilarity], result of:
            0.10921255 = score(doc=2681,freq=4.0), product of:
              0.19411467 = queryWeight, product of:
                2.2817852 = boost
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.018900767 = queryNorm
              0.56261873 = fieldWeight in 2681, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.0625 = fieldNorm(doc=2681)
          0.10216939 = weight(abstract_txt:students in 2681) [ClassicSimilarity], result of:
            0.10216939 = score(doc=2681,freq=2.0), product of:
              0.23393787 = queryWeight, product of:
                2.5049314 = boost
                4.9411182 = idf(docFreq=858, maxDocs=44218)
                0.018900767 = queryNorm
              0.43673727 = fieldWeight in 2681, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.9411182 = idf(docFreq=858, maxDocs=44218)
                0.0625 = fieldNorm(doc=2681)
          0.108257025 = weight(abstract_txt:texts in 2681) [ClassicSimilarity], result of:
            0.108257025 = score(doc=2681,freq=1.0), product of:
              0.3063379 = queryWeight, product of:
                2.8664606 = boost
                5.6542544 = idf(docFreq=420, maxDocs=44218)
                0.018900767 = queryNorm
              0.3533909 = fieldWeight in 2681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6542544 = idf(docFreq=420, maxDocs=44218)
                0.0625 = fieldNorm(doc=2681)
        0.32 = coord(8/25)
    
  2. Hirao, T.; Okumura, M.; Yasuda, N.; Isozaki, H.: Supervised automatic evaluation for summarization with voted regression model (2007) 0.16
    0.16276279 = sum of:
      0.16276279 = product of:
        0.58129567 = sum of:
          0.04622691 = weight(abstract_txt:methods in 942) [ClassicSimilarity], result of:
            0.04622691 = score(doc=942,freq=3.0), product of:
              0.08238272 = queryWeight, product of:
                1.0511112 = boost
                4.146752 = idf(docFreq=1900, maxDocs=44218)
                0.018900767 = queryNorm
              0.56112385 = fieldWeight in 942, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.146752 = idf(docFreq=1900, maxDocs=44218)
                0.078125 = fieldNorm(doc=942)
          0.032012355 = weight(abstract_txt:show in 942) [ClassicSimilarity], result of:
            0.032012355 = score(doc=942,freq=1.0), product of:
              0.09300188 = queryWeight, product of:
                1.1168027 = boost
                4.4059124 = idf(docFreq=1466, maxDocs=44218)
                0.018900767 = queryNorm
              0.3442119 = fieldWeight in 942, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4059124 = idf(docFreq=1466, maxDocs=44218)
                0.078125 = fieldNorm(doc=942)
          0.095576875 = weight(abstract_txt:evaluation in 942) [ClassicSimilarity], result of:
            0.095576875 = score(doc=942,freq=8.0), product of:
              0.096416615 = queryWeight, product of:
                1.1371206 = boost
                4.4860687 = idf(docFreq=1353, maxDocs=44218)
                0.018900767 = queryNorm
              0.9912905 = fieldWeight in 942, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.4860687 = idf(docFreq=1353, maxDocs=44218)
                0.078125 = fieldNorm(doc=942)
          0.021531941 = weight(abstract_txt:system in 942) [ClassicSimilarity], result of:
            0.021531941 = score(doc=942,freq=1.0), product of:
              0.08172706 = queryWeight, product of:
                1.28221 = boost
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.018900767 = queryNorm
              0.2634616 = fieldWeight in 942, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.078125 = fieldNorm(doc=942)
          0.056553528 = weight(abstract_txt:quality in 942) [ClassicSimilarity], result of:
            0.056553528 = score(doc=942,freq=1.0), product of:
              0.15557872 = queryWeight, product of:
                1.7690957 = boost
                4.6528544 = idf(docFreq=1145, maxDocs=44218)
                0.018900767 = queryNorm
              0.36350426 = fieldWeight in 942, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6528544 = idf(docFreq=1145, maxDocs=44218)
                0.078125 = fieldNorm(doc=942)
          0.19287834 = weight(abstract_txt:automatic in 942) [ClassicSimilarity], result of:
            0.19287834 = score(doc=942,freq=6.0), product of:
              0.19399132 = queryWeight, product of:
                1.9754561 = boost
                5.1955976 = idf(docFreq=665, maxDocs=44218)
                0.018900767 = queryNorm
              0.99426275 = fieldWeight in 942, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.1955976 = idf(docFreq=665, maxDocs=44218)
                0.078125 = fieldNorm(doc=942)
          0.13651569 = weight(abstract_txt:method in 942) [ClassicSimilarity], result of:
            0.13651569 = score(doc=942,freq=4.0), product of:
              0.19411467 = queryWeight, product of:
                2.2817852 = boost
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.018900767 = queryNorm
              0.7032734 = fieldWeight in 942, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.078125 = fieldNorm(doc=942)
        0.28 = coord(7/25)
    
  3. Wang, W.M.; Cheung, C.F.; Lee, W.B.; Kwok, S.K.: Mining knowledge from natural language texts using fuzzy associated concept mapping (2008) 0.15
    0.1543255 = sum of:
      0.1543255 = product of:
        0.4822672 = sum of:
          0.03874214 = weight(abstract_txt:text in 2121) [ClassicSimilarity], result of:
            0.03874214 = score(doc=2121,freq=5.0), product of:
              0.07834543 = queryWeight, product of:
                1.025032 = boost
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.018900767 = queryNorm
              0.49450412 = fieldWeight in 2121, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2121)
          0.022408647 = weight(abstract_txt:show in 2121) [ClassicSimilarity], result of:
            0.022408647 = score(doc=2121,freq=1.0), product of:
              0.09300188 = queryWeight, product of:
                1.1168027 = boost
                4.4059124 = idf(docFreq=1466, maxDocs=44218)
                0.018900767 = queryNorm
              0.24094833 = fieldWeight in 2121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4059124 = idf(docFreq=1466, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2121)
          0.02365407 = weight(abstract_txt:evaluation in 2121) [ClassicSimilarity], result of:
            0.02365407 = score(doc=2121,freq=1.0), product of:
              0.096416615 = queryWeight, product of:
                1.1371206 = boost
                4.4860687 = idf(docFreq=1353, maxDocs=44218)
                0.018900767 = queryNorm
              0.24533188 = fieldWeight in 2121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4860687 = idf(docFreq=1353, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2121)
          0.039587468 = weight(abstract_txt:quality in 2121) [ClassicSimilarity], result of:
            0.039587468 = score(doc=2121,freq=1.0), product of:
              0.15557872 = queryWeight, product of:
                1.7690957 = boost
                4.6528544 = idf(docFreq=1145, maxDocs=44218)
                0.018900767 = queryNorm
              0.25445297 = fieldWeight in 2121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6528544 = idf(docFreq=1145, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2121)
          0.055119574 = weight(abstract_txt:automatic in 2121) [ClassicSimilarity], result of:
            0.055119574 = score(doc=2121,freq=1.0), product of:
              0.19399132 = queryWeight, product of:
                1.9754561 = boost
                5.1955976 = idf(docFreq=665, maxDocs=44218)
                0.018900767 = queryNorm
              0.28413424 = fieldWeight in 2121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1955976 = idf(docFreq=665, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2121)
          0.06757182 = weight(abstract_txt:method in 2121) [ClassicSimilarity], result of:
            0.06757182 = score(doc=2121,freq=2.0), product of:
              0.19411467 = queryWeight, product of:
                2.2817852 = boost
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.018900767 = queryNorm
              0.34810257 = fieldWeight in 2121, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2121)
          0.13396123 = weight(abstract_txt:texts in 2121) [ClassicSimilarity], result of:
            0.13396123 = score(doc=2121,freq=2.0), product of:
              0.3063379 = queryWeight, product of:
                2.8664606 = boost
                5.6542544 = idf(docFreq=420, maxDocs=44218)
                0.018900767 = queryNorm
              0.43729892 = fieldWeight in 2121, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.6542544 = idf(docFreq=420, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2121)
          0.101222254 = weight(abstract_txt:written in 2121) [ClassicSimilarity], result of:
            0.101222254 = score(doc=2121,freq=1.0), product of:
              0.32019064 = queryWeight, product of:
                2.930555 = boost
                5.780685 = idf(docFreq=370, maxDocs=44218)
                0.018900767 = queryNorm
              0.3161312 = fieldWeight in 2121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.780685 = idf(docFreq=370, maxDocs=44218)
                0.0546875 = fieldNorm(doc=2121)
        0.32 = coord(8/25)
    
  4. Hjoerland, B.; Hartel, J.: Introduction to a Special Issue of Knowledge Organization (2003) 0.13
    0.126343 = sum of:
      0.126343 = product of:
        0.35095274 = sum of:
          0.01321044 = weight(abstract_txt:methods in 3013) [ClassicSimilarity], result of:
            0.01321044 = score(doc=3013,freq=2.0), product of:
              0.08238272 = queryWeight, product of:
                1.0511112 = boost
                4.146752 = idf(docFreq=1900, maxDocs=44218)
                0.018900767 = queryNorm
              0.1603545 = fieldWeight in 3013, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.146752 = idf(docFreq=1900, maxDocs=44218)
                0.02734375 = fieldNorm(doc=3013)
          0.0075361794 = weight(abstract_txt:system in 3013) [ClassicSimilarity], result of:
            0.0075361794 = score(doc=3013,freq=1.0), product of:
              0.08172706 = queryWeight, product of:
                1.28221 = boost
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.018900767 = queryNorm
              0.09221156 = fieldWeight in 3013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.02734375 = fieldNorm(doc=3013)
          0.041443646 = weight(abstract_txt:empirical in 3013) [ClassicSimilarity], result of:
            0.041443646 = score(doc=3013,freq=5.0), product of:
              0.13008182 = queryWeight, product of:
                1.3208055 = boost
                5.2107263 = idf(docFreq=655, maxDocs=44218)
                0.018900767 = queryNorm
              0.31859675 = fieldWeight in 3013, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.2107263 = idf(docFreq=655, maxDocs=44218)
                0.02734375 = fieldNorm(doc=3013)
          0.02299356 = weight(abstract_txt:conceptual in 3013) [ClassicSimilarity], result of:
            0.02299356 = score(doc=3013,freq=1.0), product of:
              0.17192376 = queryWeight, product of:
                1.8597054 = boost
                4.891165 = idf(docFreq=902, maxDocs=44218)
                0.018900767 = queryNorm
              0.13374278 = fieldWeight in 3013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.891165 = idf(docFreq=902, maxDocs=44218)
                0.02734375 = fieldNorm(doc=3013)
          0.033127025 = weight(abstract_txt:very in 3013) [ClassicSimilarity], result of:
            0.033127025 = score(doc=3013,freq=2.0), product of:
              0.17406443 = queryWeight, product of:
                1.8712475 = boost
                4.921521 = idf(docFreq=875, maxDocs=44218)
                0.018900767 = queryNorm
              0.19031474 = fieldWeight in 3013, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.921521 = idf(docFreq=875, maxDocs=44218)
                0.02734375 = fieldNorm(doc=3013)
          0.12653348 = weight(abstract_txt:axes in 3013) [ClassicSimilarity], result of:
            0.12653348 = score(doc=3013,freq=2.0), product of:
              0.3715594 = queryWeight, product of:
                2.2322598 = boost
                8.806516 = idf(docFreq=17, maxDocs=44218)
                0.018900767 = queryNorm
              0.34054708 = fieldWeight in 3013, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                8.806516 = idf(docFreq=17, maxDocs=44218)
                0.02734375 = fieldNorm(doc=3013)
          0.023890246 = weight(abstract_txt:method in 3013) [ClassicSimilarity], result of:
            0.023890246 = score(doc=3013,freq=1.0), product of:
              0.19411467 = queryWeight, product of:
                2.2817852 = boost
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.018900767 = queryNorm
              0.12307285 = fieldWeight in 3013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.02734375 = fieldNorm(doc=3013)
          0.031607043 = weight(abstract_txt:students in 3013) [ClassicSimilarity], result of:
            0.031607043 = score(doc=3013,freq=1.0), product of:
              0.23393787 = queryWeight, product of:
                2.5049314 = boost
                4.9411182 = idf(docFreq=858, maxDocs=44218)
                0.018900767 = queryNorm
              0.13510871 = fieldWeight in 3013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.9411182 = idf(docFreq=858, maxDocs=44218)
                0.02734375 = fieldNorm(doc=3013)
          0.050611127 = weight(abstract_txt:written in 3013) [ClassicSimilarity], result of:
            0.050611127 = score(doc=3013,freq=1.0), product of:
              0.32019064 = queryWeight, product of:
                2.930555 = boost
                5.780685 = idf(docFreq=370, maxDocs=44218)
                0.018900767 = queryNorm
              0.1580656 = fieldWeight in 3013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.780685 = idf(docFreq=370, maxDocs=44218)
                0.02734375 = fieldNorm(doc=3013)
        0.36 = coord(9/25)
    
  5. Reeve, L.H.; Han, H.; Brooks, A.D.: ¬The use of domain-specific concepts in biomedical text summarization (2007) 0.12
    0.119220436 = sum of:
      0.119220436 = product of:
        0.42578727 = sum of:
          0.044276733 = weight(abstract_txt:text in 955) [ClassicSimilarity], result of:
            0.044276733 = score(doc=955,freq=5.0), product of:
              0.07834543 = queryWeight, product of:
                1.025032 = boost
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.018900767 = queryNorm
              0.5651476 = fieldWeight in 955, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.0625 = fieldNorm(doc=955)
          0.04270259 = weight(abstract_txt:methods in 955) [ClassicSimilarity], result of:
            0.04270259 = score(doc=955,freq=4.0), product of:
              0.08238272 = queryWeight, product of:
                1.0511112 = boost
                4.146752 = idf(docFreq=1900, maxDocs=44218)
                0.018900767 = queryNorm
              0.518344 = fieldWeight in 955, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.146752 = idf(docFreq=1900, maxDocs=44218)
                0.0625 = fieldNorm(doc=955)
          0.025609883 = weight(abstract_txt:show in 955) [ClassicSimilarity], result of:
            0.025609883 = score(doc=955,freq=1.0), product of:
              0.09300188 = queryWeight, product of:
                1.1168027 = boost
                4.4059124 = idf(docFreq=1466, maxDocs=44218)
                0.018900767 = queryNorm
              0.27536952 = fieldWeight in 955, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4059124 = idf(docFreq=1466, maxDocs=44218)
                0.0625 = fieldNorm(doc=955)
          0.046822913 = weight(abstract_txt:evaluation in 955) [ClassicSimilarity], result of:
            0.046822913 = score(doc=955,freq=3.0), product of:
              0.096416615 = queryWeight, product of:
                1.1371206 = boost
                4.4860687 = idf(docFreq=1353, maxDocs=44218)
                0.018900767 = queryNorm
              0.48563117 = fieldWeight in 955, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.4860687 = idf(docFreq=1353, maxDocs=44218)
                0.0625 = fieldNorm(doc=955)
          0.024360612 = weight(abstract_txt:system in 955) [ClassicSimilarity], result of:
            0.024360612 = score(doc=955,freq=2.0), product of:
              0.08172706 = queryWeight, product of:
                1.28221 = boost
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.018900767 = queryNorm
              0.2980728 = fieldWeight in 955, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3723085 = idf(docFreq=4123, maxDocs=44218)
                0.0625 = fieldNorm(doc=955)
          0.13375752 = weight(abstract_txt:method in 955) [ClassicSimilarity], result of:
            0.13375752 = score(doc=955,freq=6.0), product of:
              0.19411467 = queryWeight, product of:
                2.2817852 = boost
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.018900767 = queryNorm
              0.68906444 = fieldWeight in 955, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.50095 = idf(docFreq=1333, maxDocs=44218)
                0.0625 = fieldNorm(doc=955)
          0.108257025 = weight(abstract_txt:texts in 955) [ClassicSimilarity], result of:
            0.108257025 = score(doc=955,freq=1.0), product of:
              0.3063379 = queryWeight, product of:
                2.8664606 = boost
                5.6542544 = idf(docFreq=420, maxDocs=44218)
                0.018900767 = queryNorm
              0.3533909 = fieldWeight in 955, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6542544 = idf(docFreq=420, maxDocs=44218)
                0.0625 = fieldNorm(doc=955)
        0.28 = coord(7/25)