Document (#21251)

Author

Rey, J.

Title

Discourse markers : a challenge for natural language processing

Source

AI communications. 10(1997) nos.3/4, S.177-184

Year

1997

Abstract

Analyses the role-played by discourse markers in any communication process and the complex process involved in translating them. The analysis is conducted from a pragmatic standpoint and stresses the importance of context in determining the preference for 1 marker over another. Illustrates this process, presenting examples in both French and English. Makes suggestions on parameters, which should be taken into consideration for natural language processing applications

Theme

Computerlinguistik

Similar documents (content)

1. Hawes, T.; Lin, J.; Resnik, P.: Elements of a computational model for multi-party discourse : the turn-taking behavior of Supreme Court justices (2009) 0.18

   0.18265839 = sum of:
     0.18265839 = product of:
       0.91329193 = sum of:
         0.049720146 = weight(abstract_txt:language in 3087) [ClassicSimilarity], result of:
           0.049720146 = score(doc=3087,freq=1.0), product of:
             0.12681423 = queryWeight, product of:
               1.5278955 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.019846378 = queryNorm
             0.3920707 = fieldWeight in 3087, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.09375 = fieldNorm(doc=3087)
         0.08154214 = weight(abstract_txt:processing in 3087) [ClassicSimilarity], result of:
           0.08154214 = score(doc=3087,freq=1.0), product of:
             0.17636043 = queryWeight, product of:
               1.8018152 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019846378 = queryNorm
             0.46236074 = fieldWeight in 3087, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=3087)
         0.08908651 = weight(abstract_txt:natural in 3087) [ClassicSimilarity], result of:
           0.08908651 = score(doc=3087,freq=1.0), product of:
             0.18707728 = queryWeight, product of:
               1.8557531 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.019846378 = queryNorm
             0.47620165 = fieldWeight in 3087, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.09375 = fieldNorm(doc=3087)
         0.23717736 = weight(abstract_txt:discourse in 3087) [ClassicSimilarity], result of:
           0.23717736 = score(doc=3087,freq=2.0), product of:
             0.28522345 = queryWeight, product of:
               2.291407 = boost
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.019846378 = queryNorm
             0.8315493 = fieldWeight in 3087, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.09375 = fieldNorm(doc=3087)
         0.45576575 = weight(abstract_txt:markers in 3087) [ClassicSimilarity], result of:
           0.45576575 = score(doc=3087,freq=1.0), product of:
             0.5554448 = queryWeight, product of:
               3.1976438 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.019846378 = queryNorm
             0.820542 = fieldWeight in 3087, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.09375 = fieldNorm(doc=3087)
       0.2 = coord(5/25)
   

2. Park, J.-r.: Evolution of concept networks and implications for knowledge representation (2007) 0.15

   0.14784299 = sum of:
     0.14784299 = product of:
       0.61601245 = sum of:
         0.07368076 = weight(abstract_txt:parameters in 847) [ClassicSimilarity], result of:
           0.07368076 = score(doc=847,freq=1.0), product of:
             0.17143519 = queryWeight, product of:
               1.2561591 = boost
               6.8766055 = idf(docFreq=123, maxDocs=44218)
               0.019846378 = queryNorm
             0.42978784 = fieldWeight in 847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8766055 = idf(docFreq=123, maxDocs=44218)
               0.0625 = fieldNorm(doc=847)
         0.15459687 = weight(abstract_txt:pragmatic in 847) [ClassicSimilarity], result of:
           0.15459687 = score(doc=847,freq=4.0), product of:
             0.17700182 = queryWeight, product of:
               1.2763903 = boost
               6.987357 = idf(docFreq=110, maxDocs=44218)
               0.019846378 = queryNorm
             0.87341964 = fieldWeight in 847, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.987357 = idf(docFreq=110, maxDocs=44218)
               0.0625 = fieldNorm(doc=847)
         0.03314676 = weight(abstract_txt:language in 847) [ClassicSimilarity], result of:
           0.03314676 = score(doc=847,freq=1.0), product of:
             0.12681423 = queryWeight, product of:
               1.5278955 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.019846378 = queryNorm
             0.26138046 = fieldWeight in 847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=847)
         0.05939101 = weight(abstract_txt:natural in 847) [ClassicSimilarity], result of:
           0.05939101 = score(doc=847,freq=1.0), product of:
             0.18707728 = queryWeight, product of:
               1.8557531 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.019846378 = queryNorm
             0.31746778 = fieldWeight in 847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.0625 = fieldNorm(doc=847)
         0.045190122 = weight(abstract_txt:process in 847) [ClassicSimilarity], result of:
           0.045190122 = score(doc=847,freq=1.0), product of:
             0.17848429 = queryWeight, product of:
               2.2200117 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.019846378 = queryNorm
             0.25318822 = fieldWeight in 847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0625 = fieldNorm(doc=847)
         0.25000688 = weight(abstract_txt:discourse in 847) [ClassicSimilarity], result of:
           0.25000688 = score(doc=847,freq=5.0), product of:
             0.28522345 = queryWeight, product of:
               2.291407 = boost
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.019846378 = queryNorm
             0.87652993 = fieldWeight in 847, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.0625 = fieldNorm(doc=847)
       0.24 = coord(6/25)
   

3. Teixera Lopes, C.; Ribeiro, C.: Measuring the value of health query translation : An analysis by user language proficiency (2013) 0.11

   0.10741422 = sum of:
     0.10741422 = product of:
       0.44755927 = sum of:
         0.03852473 = weight(abstract_txt:makes in 739) [ClassicSimilarity], result of:
           0.03852473 = score(doc=739,freq=1.0), product of:
             0.111264594 = queryWeight, product of:
               1.0119828 = boost
               5.5399084 = idf(docFreq=471, maxDocs=44218)
               0.019846378 = queryNorm
             0.34624428 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5399084 = idf(docFreq=471, maxDocs=44218)
               0.0625 = fieldNorm(doc=739)
         0.11101199 = weight(abstract_txt:english in 739) [ClassicSimilarity], result of:
           0.11101199 = score(doc=739,freq=8.0), product of:
             0.11265415 = queryWeight, product of:
               1.0182824 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.019846378 = queryNorm
             0.98542297 = fieldWeight in 739, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0625 = fieldNorm(doc=739)
         0.048773896 = weight(abstract_txt:suggestions in 739) [ClassicSimilarity], result of:
           0.048773896 = score(doc=739,freq=1.0), product of:
             0.13021336 = queryWeight, product of:
               1.0947689 = boost
               5.993105 = idf(docFreq=299, maxDocs=44218)
               0.019846378 = queryNorm
             0.37456906 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.993105 = idf(docFreq=299, maxDocs=44218)
               0.0625 = fieldNorm(doc=739)
         0.116360426 = weight(abstract_txt:translating in 739) [ClassicSimilarity], result of:
           0.116360426 = score(doc=739,freq=1.0), product of:
             0.23248813 = queryWeight, product of:
               1.462834 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.019846378 = queryNorm
             0.5005005 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.0625 = fieldNorm(doc=739)
         0.08769809 = weight(abstract_txt:language in 739) [ClassicSimilarity], result of:
           0.08769809 = score(doc=739,freq=7.0), product of:
             0.12681423 = queryWeight, product of:
               1.5278955 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.019846378 = queryNorm
             0.6915477 = fieldWeight in 739, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=739)
         0.045190122 = weight(abstract_txt:process in 739) [ClassicSimilarity], result of:
           0.045190122 = score(doc=739,freq=1.0), product of:
             0.17848429 = queryWeight, product of:
               2.2200117 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.019846378 = queryNorm
             0.25318822 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0625 = fieldNorm(doc=739)
       0.24 = coord(6/25)
   

4. Sabah, G.: Knowledge representation and natural language understanding (1993) 0.10

   0.10441424 = sum of:
     0.10441424 = product of:
       0.5220712 = sum of:
         0.11594764 = weight(abstract_txt:pragmatic in 7025) [ClassicSimilarity], result of:
           0.11594764 = score(doc=7025,freq=1.0), product of:
             0.17700182 = queryWeight, product of:
               1.2763903 = boost
               6.987357 = idf(docFreq=110, maxDocs=44218)
               0.019846378 = queryNorm
             0.6550647 = fieldWeight in 7025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.987357 = idf(docFreq=110, maxDocs=44218)
               0.09375 = fieldNorm(doc=7025)
         0.08154214 = weight(abstract_txt:processing in 7025) [ClassicSimilarity], result of:
           0.08154214 = score(doc=7025,freq=1.0), product of:
             0.17636043 = queryWeight, product of:
               1.8018152 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019846378 = queryNorm
             0.46236074 = fieldWeight in 7025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=7025)
         0.08908651 = weight(abstract_txt:natural in 7025) [ClassicSimilarity], result of:
           0.08908651 = score(doc=7025,freq=1.0), product of:
             0.18707728 = queryWeight, product of:
               1.8557531 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.019846378 = queryNorm
             0.47620165 = fieldWeight in 7025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.09375 = fieldNorm(doc=7025)
         0.06778518 = weight(abstract_txt:process in 7025) [ClassicSimilarity], result of:
           0.06778518 = score(doc=7025,freq=1.0), product of:
             0.17848429 = queryWeight, product of:
               2.2200117 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.019846378 = queryNorm
             0.37978232 = fieldWeight in 7025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.09375 = fieldNorm(doc=7025)
         0.16770971 = weight(abstract_txt:discourse in 7025) [ClassicSimilarity], result of:
           0.16770971 = score(doc=7025,freq=1.0), product of:
             0.28522345 = queryWeight, product of:
               2.291407 = boost
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.019846378 = queryNorm
             0.5879941 = fieldWeight in 7025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2719374 = idf(docFreq=226, maxDocs=44218)
               0.09375 = fieldNorm(doc=7025)
       0.2 = coord(5/25)
   

5. Schubert, K.: Parameters for the design of an intermediate language for multilingual thesauri (1995) 0.10

   0.10292412 = sum of:
     0.10292412 = product of:
       0.42885053 = sum of:
         0.046822503 = weight(abstract_txt:taken in 2092) [ClassicSimilarity], result of:
           0.046822503 = score(doc=2092,freq=1.0), product of:
             0.109201096 = queryWeight, product of:
               1.0025549 = boost
               5.488297 = idf(docFreq=496, maxDocs=44218)
               0.019846378 = queryNorm
             0.4287732 = fieldWeight in 2092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.488297 = idf(docFreq=496, maxDocs=44218)
               0.078125 = fieldNorm(doc=2092)
         0.06973222 = weight(abstract_txt:consideration in 2092) [ClassicSimilarity], result of:
           0.06973222 = score(doc=2092,freq=1.0), product of:
             0.14241189 = queryWeight, product of:
               1.1449006 = boost
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.019846378 = queryNorm
             0.48965168 = fieldWeight in 2092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2675414 = idf(docFreq=227, maxDocs=44218)
               0.078125 = fieldNorm(doc=2092)
         0.08286691 = weight(abstract_txt:language in 2092) [ClassicSimilarity], result of:
           0.08286691 = score(doc=2092,freq=4.0), product of:
             0.12681423 = queryWeight, product of:
               1.5278955 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.019846378 = queryNorm
             0.65345114 = fieldWeight in 2092, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=2092)
         0.06795178 = weight(abstract_txt:processing in 2092) [ClassicSimilarity], result of:
           0.06795178 = score(doc=2092,freq=1.0), product of:
             0.17636043 = queryWeight, product of:
               1.8018152 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019846378 = queryNorm
             0.38530064 = fieldWeight in 2092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=2092)
         0.10498946 = weight(abstract_txt:natural in 2092) [ClassicSimilarity], result of:
           0.10498946 = score(doc=2092,freq=2.0), product of:
             0.18707728 = queryWeight, product of:
               1.8557531 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.019846378 = queryNorm
             0.561209 = fieldWeight in 2092, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.078125 = fieldNorm(doc=2092)
         0.056487653 = weight(abstract_txt:process in 2092) [ClassicSimilarity], result of:
           0.056487653 = score(doc=2092,freq=1.0), product of:
             0.17848429 = queryWeight, product of:
               2.2200117 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.019846378 = queryNorm
             0.3164853 = fieldWeight in 2092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.078125 = fieldNorm(doc=2092)
       0.24 = coord(6/25)