Document (#35957)

Author

Olvera-Lobo, M.-D.
García-Santiago, L.

Title

Analysis of errors in the automatic translation of questions for translingual QA systems

Source

Journal of documentation. 66(2010) no.3, S.434-455

Year

2010

Abstract

Purpose - This study aims to focus on the evaluation of systems for the automatic translation of questions destined to translingual question-answer (QA) systems. The efficacy of online translators when performing as tools in QA systems is analysed using a collection of documents in the Spanish language. Design/methodology/approach - Automatic translation is evaluated in terms of the functionality of actual translations produced by three online translators (Google Translator, Promt Translator, and Worldlingo) by means of objective and subjective evaluation measures, and the typology of errors produced was identified. For this purpose, a comparative study of the quality of the translation of factual questions of the CLEF collection of queries was carried out, from German and French to Spanish. Findings - It was observed that the rates of error for the three systems evaluated here are greater in the translations pertaining to the language pair German-Spanish . Promt was identified as the most reliable translator of the three (on average) for the two linguistic combinations evaluated. However, for the Spanish-German pair, a good assessment of the Google online translator was obtained as well. Most errors (46.38 percent) tended to be of a lexical nature, followed by those due to a poor translation of the interrogative particle of the query (31.16 percent). Originality/value - The evaluation methodology applied focuses above all on the finality of the translation. That is, does the resulting question serve as effective input into a translingual QA system? Thus, instead of searching for "perfection", the functionality of the question and its capacity to lead one to an adequate response are appraised. The results obtained contribute to the development of improved translingual QA systems.

Theme

Multilinguale Probleme

Similar documents (author)

1. Lobo, D.O.: Metodos y technicas para la indizacion y recuperacion de los recursos de la World Wide Web (1999) 1.34

   1.3366876 = sum of:
     1.3366876 = product of:
       4.0100627 = sum of:
         4.0100627 = weight(author_txt:lobo in 2241) [ClassicSimilarity], result of:
           4.0100627 = score(doc=2241,freq=1.0), product of:
             0.64775544 = queryWeight, product of:
               1.2249771 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.053385466 = queryNorm
             6.190705 = fieldWeight in 2241, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.625 = fieldNorm(doc=2241)
       0.33333334 = coord(1/3)
   

2. Lobo, R.: ¬Der Umgang mit der Verunsicherungssynthese der Zeiterfahrung : zu einer lebensnahen Theorie der Samädhi-Erfahrung in Yoga und Zen (1989) 1.34

   1.3366876 = sum of:
     1.3366876 = product of:
       4.0100627 = sum of:
         4.0100627 = weight(author_txt:lobo in 282) [ClassicSimilarity], result of:
           4.0100627 = score(doc=282,freq=1.0), product of:
             0.64775544 = queryWeight, product of:
               1.2249771 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.053385466 = queryNorm
             6.190705 = fieldWeight in 282, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.625 = fieldNorm(doc=282)
       0.33333334 = coord(1/3)
   

3. Lobo, S.: ¬Das Ende von Google, wie wir es kannten : Bessere Treffer durch ChatGPT (2022) 1.34

   1.3366876 = sum of:
     1.3366876 = product of:
       4.0100627 = sum of:
         4.0100627 = weight(author_txt:lobo in 852) [ClassicSimilarity], result of:
           4.0100627 = score(doc=852,freq=1.0), product of:
             0.64775544 = queryWeight, product of:
               1.2249771 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.053385466 = queryNorm
             6.190705 = fieldWeight in 852, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.625 = fieldNorm(doc=852)
       0.33333334 = coord(1/3)
   

4. Santiago, S.: International serials data system (1993) 1.28

   1.2752466 = sum of:
     1.2752466 = product of:
       3.8257399 = sum of:
         3.8257399 = weight(author_txt:santiago in 4562) [ClassicSimilarity], result of:
           3.8257399 = score(doc=4562,freq=1.0), product of:
             0.6277508 = queryWeight, product of:
               1.2059133 = boost
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.053385466 = queryNorm
             6.094361 = fieldWeight in 4562, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.625 = fieldNorm(doc=4562)
       0.33333334 = coord(1/3)
   

5. Santiago, S.: ISDS and union catalogues (1991) 1.28

   1.2752466 = sum of:
     1.2752466 = product of:
       3.8257399 = sum of:
         3.8257399 = weight(author_txt:santiago in 5060) [ClassicSimilarity], result of:
           3.8257399 = score(doc=5060,freq=1.0), product of:
             0.6277508 = queryWeight, product of:
               1.2059133 = boost
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.053385466 = queryNorm
             6.094361 = fieldWeight in 5060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.625 = fieldNorm(doc=5060)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Jahns, Y.; Karg, H.: Translingual retrieval : Moving between vocabularies - MACS 2010 (2011) 0.35

   0.3464784 = sum of:
     0.3464784 = product of:
       2.1654902 = sum of:
         0.029594913 = weight(abstract_txt:produced in 648) [ClassicSimilarity], result of:
           0.029594913 = score(doc=648,freq=1.0), product of:
             0.08537582 = queryWeight, product of:
               1.1533799 = boost
               5.5462847 = idf(docFreq=468, maxDocs=44218)
               0.013346285 = queryNorm
             0.3466428 = fieldWeight in 648, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5462847 = idf(docFreq=468, maxDocs=44218)
               0.0625 = fieldNorm(doc=648)
         0.022410171 = weight(abstract_txt:three in 648) [ClassicSimilarity], result of:
           0.022410171 = score(doc=648,freq=1.0), product of:
             0.08119278 = queryWeight, product of:
               1.377556 = boost
               4.41619 = idf(docFreq=1451, maxDocs=44218)
               0.013346285 = queryNorm
             0.27601188 = fieldWeight in 648, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.41619 = idf(docFreq=1451, maxDocs=44218)
               0.0625 = fieldNorm(doc=648)
         0.0905959 = weight(abstract_txt:german in 648) [ClassicSimilarity], result of:
           0.0905959 = score(doc=648,freq=2.0), product of:
             0.16353711 = queryWeight, product of:
               1.9550538 = boost
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.013346285 = queryNorm
             0.5539776 = fieldWeight in 648, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.0625 = fieldNorm(doc=648)
         2.0228891 = weight(title_txt:translingual in 648) [ClassicSimilarity], result of:
           2.0228891 = score(doc=648,freq=1.0), product of:
             0.5446039 = queryWeight, product of:
               4.11965 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.013346285 = queryNorm
             3.7144227 = fieldWeight in 648, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.375 = fieldNorm(doc=648)
       0.16 = coord(4/25)
   

2. Bernard, U.: Machine translation : success of failure using MT in an IT research and development environment (1996) 0.29

   0.29019406 = sum of:
     0.29019406 = product of:
       1.209142 = sum of:
         0.0517911 = weight(abstract_txt:produced in 8600) [ClassicSimilarity], result of:
           0.0517911 = score(doc=8600,freq=1.0), product of:
             0.08537582 = queryWeight, product of:
               1.1533799 = boost
               5.5462847 = idf(docFreq=468, maxDocs=44218)
               0.013346285 = queryNorm
             0.6066249 = fieldWeight in 8600, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5462847 = idf(docFreq=468, maxDocs=44218)
               0.109375 = fieldNorm(doc=8600)
         0.18274699 = weight(abstract_txt:translations in 8600) [ClassicSimilarity], result of:
           0.18274699 = score(doc=8600,freq=2.0), product of:
             0.15705617 = queryWeight, product of:
               1.5643446 = boost
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.013346285 = queryNorm
             1.1635773 = fieldWeight in 8600, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.109375 = fieldNorm(doc=8600)
         0.19417451 = weight(abstract_txt:german in 8600) [ClassicSimilarity], result of:
           0.19417451 = score(doc=8600,freq=3.0), product of:
             0.16353711 = queryWeight, product of:
               1.9550538 = boost
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.013346285 = queryNorm
             1.1873422 = fieldWeight in 8600, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.109375 = fieldNorm(doc=8600)
         0.036170173 = weight(abstract_txt:systems in 8600) [ClassicSimilarity], result of:
           0.036170173 = score(doc=8600,freq=1.0), product of:
             0.096925706 = queryWeight, product of:
               2.1285558 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.013346285 = queryNorm
             0.3731742 = fieldWeight in 8600, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.109375 = fieldNorm(doc=8600)
         0.44094986 = weight(abstract_txt:translator in 8600) [ClassicSimilarity], result of:
           0.44094986 = score(doc=8600,freq=1.0), product of:
             0.44850534 = queryWeight, product of:
               3.7385547 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.013346285 = queryNorm
             0.98315406 = fieldWeight in 8600, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.109375 = fieldNorm(doc=8600)
         0.30330935 = weight(abstract_txt:translation in 8600) [ClassicSimilarity], result of:
           0.30330935 = score(doc=8600,freq=2.0), product of:
             0.31753075 = queryWeight, product of:
               3.8526402 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.013346285 = queryNorm
             0.95521253 = fieldWeight in 8600, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.109375 = fieldNorm(doc=8600)
       0.24 = coord(6/25)
   

3. Reyes Ayala, B.; Knudson, R.; Chen, J.; Cao, G.; Wang, X.: Metadata records machine translation combining multi-engine outputs with limited parallel data (2018) 0.28

   0.2809985 = sum of:
     0.2809985 = product of:
       0.63863295 = sum of:
         0.02684595 = weight(abstract_txt:google in 4010) [ClassicSimilarity], result of:
           0.02684595 = score(doc=4010,freq=1.0), product of:
             0.080003574 = queryWeight, product of:
               1.1165023 = boost
               5.3689504 = idf(docFreq=559, maxDocs=44218)
               0.013346285 = queryNorm
             0.3355594 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3689504 = idf(docFreq=559, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.022207212 = weight(abstract_txt:online in 4010) [ClassicSimilarity], result of:
           0.022207212 = score(doc=4010,freq=3.0), product of:
             0.055955514 = queryWeight, product of:
               1.1435944 = boost
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.013346285 = queryNorm
             0.3968726 = fieldWeight in 4010, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.029594913 = weight(abstract_txt:produced in 4010) [ClassicSimilarity], result of:
           0.029594913 = score(doc=4010,freq=1.0), product of:
             0.08537582 = queryWeight, product of:
               1.1533799 = boost
               5.5462847 = idf(docFreq=468, maxDocs=44218)
               0.013346285 = queryNorm
             0.3466428 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5462847 = idf(docFreq=468, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.033092912 = weight(abstract_txt:obtained in 4010) [ClassicSimilarity], result of:
           0.033092912 = score(doc=4010,freq=1.0), product of:
             0.0919772 = queryWeight, product of:
               1.1971402 = boost
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.013346285 = queryNorm
             0.35979474 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.022410171 = weight(abstract_txt:three in 4010) [ClassicSimilarity], result of:
           0.022410171 = score(doc=4010,freq=1.0), product of:
             0.08119278 = queryWeight, product of:
               1.377556 = boost
               4.41619 = idf(docFreq=1451, maxDocs=44218)
               0.013346285 = queryNorm
             0.27601188 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.41619 = idf(docFreq=1451, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.023490902 = weight(abstract_txt:evaluation in 4010) [ClassicSimilarity], result of:
           0.023490902 = score(doc=4010,freq=1.0), product of:
             0.08378258 = queryWeight, product of:
               1.3993535 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.013346285 = queryNorm
             0.2803793 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.07384094 = weight(abstract_txt:translations in 4010) [ClassicSimilarity], result of:
           0.07384094 = score(doc=4010,freq=1.0), product of:
             0.15705617 = queryWeight, product of:
               1.5643446 = boost
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.013346285 = queryNorm
             0.47015625 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.0486446 = weight(abstract_txt:evaluated in 4010) [ClassicSimilarity], result of:
           0.0486446 = score(doc=4010,freq=1.0), product of:
             0.13611637 = queryWeight, product of:
               1.783634 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.013346285 = queryNorm
             0.3573751 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.029229913 = weight(abstract_txt:systems in 4010) [ClassicSimilarity], result of:
           0.029229913 = score(doc=4010,freq=2.0), product of:
             0.096925706 = queryWeight, product of:
               2.1285558 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.013346285 = queryNorm
             0.3015703 = fieldWeight in 4010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.11700307 = weight(abstract_txt:spanish in 4010) [ClassicSimilarity], result of:
           0.11700307 = score(doc=4010,freq=1.0), product of:
             0.26894596 = queryWeight, product of:
               2.8950257 = boost
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.013346285 = queryNorm
             0.43504304 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
         0.21227233 = weight(abstract_txt:translation in 4010) [ClassicSimilarity], result of:
           0.21227233 = score(doc=4010,freq=3.0), product of:
             0.31753075 = queryWeight, product of:
               3.8526402 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.013346285 = queryNorm
             0.66850954 = fieldWeight in 4010, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0625 = fieldNorm(doc=4010)
       0.44 = coord(11/25)
   

4. Greiner-Petter, A.; Schubotz, M.; Cohl, H.S.; Gipp, B.: Semantic preserving bijective mappings for expressions involving special functions between computer algebra systems and document preparation systems (2019) 0.28

   0.27997556 = sum of:
     0.27997556 = product of:
       0.7777099 = sum of:
         0.018132111 = weight(abstract_txt:online in 5499) [ClassicSimilarity], result of:
           0.018132111 = score(doc=5499,freq=2.0), product of:
             0.055955514 = queryWeight, product of:
               1.1435944 = boost
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.013346285 = queryNorm
             0.32404512 = fieldWeight in 5499, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.0625 = fieldNorm(doc=5499)
         0.023490902 = weight(abstract_txt:evaluation in 5499) [ClassicSimilarity], result of:
           0.023490902 = score(doc=5499,freq=1.0), product of:
             0.08378258 = queryWeight, product of:
               1.3993535 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.013346285 = queryNorm
             0.2803793 = fieldWeight in 5499, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=5499)
         0.06754829 = weight(abstract_txt:percent in 5499) [ClassicSimilarity], result of:
           0.06754829 = score(doc=5499,freq=1.0), product of:
             0.14800161 = queryWeight, product of:
               1.5185816 = boost
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.013346285 = queryNorm
             0.4564024 = fieldWeight in 5499, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.0625 = fieldNorm(doc=5499)
         0.10442685 = weight(abstract_txt:translations in 5499) [ClassicSimilarity], result of:
           0.10442685 = score(doc=5499,freq=2.0), product of:
             0.15705617 = queryWeight, product of:
               1.5643446 = boost
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.013346285 = queryNorm
             0.6649013 = fieldWeight in 5499, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.0625 = fieldNorm(doc=5499)
         0.036492903 = weight(abstract_txt:automatic in 5499) [ClassicSimilarity], result of:
           0.036492903 = score(doc=5499,freq=1.0), product of:
             0.112381 = queryWeight, product of:
               1.620679 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.013346285 = queryNorm
             0.32472485 = fieldWeight in 5499, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0625 = fieldNorm(doc=5499)
         0.073097914 = weight(abstract_txt:errors in 5499) [ClassicSimilarity], result of:
           0.073097914 = score(doc=5499,freq=1.0), product of:
             0.17857635 = queryWeight, product of:
               2.0429726 = boost
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.013346285 = queryNorm
             0.40933704 = fieldWeight in 5499, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.0625 = fieldNorm(doc=5499)
         0.029229913 = weight(abstract_txt:systems in 5499) [ClassicSimilarity], result of:
           0.029229913 = score(doc=5499,freq=2.0), product of:
             0.096925706 = queryWeight, product of:
               2.1285558 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.013346285 = queryNorm
             0.3015703 = fieldWeight in 5499, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=5499)
         0.25197133 = weight(abstract_txt:translator in 5499) [ClassicSimilarity], result of:
           0.25197133 = score(doc=5499,freq=1.0), product of:
             0.44850534 = queryWeight, product of:
               3.7385547 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.013346285 = queryNorm
             0.5618023 = fieldWeight in 5499, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.0625 = fieldNorm(doc=5499)
         0.17331964 = weight(abstract_txt:translation in 5499) [ClassicSimilarity], result of:
           0.17331964 = score(doc=5499,freq=2.0), product of:
             0.31753075 = queryWeight, product of:
               3.8526402 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.013346285 = queryNorm
             0.54583573 = fieldWeight in 5499, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0625 = fieldNorm(doc=5499)
       0.36 = coord(9/25)
   

5. Farreús, M.; Costa-jussà, M.R.; Popovic' Morse, M.: Study and correlation analysis of linguistic, perceptual, and automatic machine translation evaluations (2012) 0.24

   0.23800997 = sum of:
     0.23800997 = product of:
       0.7437812 = sum of:
         0.062151078 = weight(abstract_txt:evaluation in 4975) [ClassicSimilarity], result of:
           0.062151078 = score(doc=4975,freq=7.0), product of:
             0.08378258 = queryWeight, product of:
               1.3993535 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.013346285 = queryNorm
             0.74181384 = fieldWeight in 4975, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=4975)
         0.07384094 = weight(abstract_txt:translations in 4975) [ClassicSimilarity], result of:
           0.07384094 = score(doc=4975,freq=1.0), product of:
             0.15705617 = queryWeight, product of:
               1.5643446 = boost
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.013346285 = queryNorm
             0.47015625 = fieldWeight in 4975, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.0625 = fieldNorm(doc=4975)
         0.072985806 = weight(abstract_txt:automatic in 4975) [ClassicSimilarity], result of:
           0.072985806 = score(doc=4975,freq=4.0), product of:
             0.112381 = queryWeight, product of:
               1.620679 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.013346285 = queryNorm
             0.6494497 = fieldWeight in 4975, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0625 = fieldNorm(doc=4975)
         0.0486446 = weight(abstract_txt:evaluated in 4975) [ClassicSimilarity], result of:
           0.0486446 = score(doc=4975,freq=1.0), product of:
             0.13611637 = queryWeight, product of:
               1.783634 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.013346285 = queryNorm
             0.3573751 = fieldWeight in 4975, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.0625 = fieldNorm(doc=4975)
         0.10337606 = weight(abstract_txt:errors in 4975) [ClassicSimilarity], result of:
           0.10337606 = score(doc=4975,freq=2.0), product of:
             0.17857635 = queryWeight, product of:
               2.0429726 = boost
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.013346285 = queryNorm
             0.57888997 = fieldWeight in 4975, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.0625 = fieldNorm(doc=4975)
         0.02066867 = weight(abstract_txt:systems in 4975) [ClassicSimilarity], result of:
           0.02066867 = score(doc=4975,freq=1.0), product of:
             0.096925706 = queryWeight, product of:
               2.1285558 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.013346285 = queryNorm
             0.2132424 = fieldWeight in 4975, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=4975)
         0.11700307 = weight(abstract_txt:spanish in 4975) [ClassicSimilarity], result of:
           0.11700307 = score(doc=4975,freq=1.0), product of:
             0.26894596 = queryWeight, product of:
               2.8950257 = boost
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.013346285 = queryNorm
             0.43504304 = fieldWeight in 4975, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.0625 = fieldNorm(doc=4975)
         0.24511097 = weight(abstract_txt:translation in 4975) [ClassicSimilarity], result of:
           0.24511097 = score(doc=4975,freq=4.0), product of:
             0.31753075 = queryWeight, product of:
               3.8526402 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.013346285 = queryNorm
             0.7719283 = fieldWeight in 4975, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0625 = fieldNorm(doc=4975)
       0.32 = coord(8/25)