Toutanova, K.; Manning, C.D.: Enriching the knowledge sources used in a maximum entropy Part-of-Speech Tagger (2000)
0.00
0.0020999676 = product of:
0.00839987 = sum of:
0.00839987 = weight(_text_:information in 1060) [ClassicSimilarity], result of:
0.00839987 = score(doc=1060,freq=2.0), product of:
0.06186915 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.035243478 = queryNorm
0.13576832 = fieldWeight in 1060, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0546875 = fieldNorm(doc=1060)
0.25 = coord(1/4)
- Abstract
- This paper presents results for a maximumentropy-based part of speech tagger, which achieves superior performance principally by enriching the information sources used for tagging. In particular, we get improved results by incorporating these features: (i) more extensive treatment of capitalization for unknown words; (ii) features for the disambiguation of the tense forms of verbs; (iii) features for disambiguating particles from prepositions and adverbs. The best resulting accuracy for the tagger on the Penn Treebank is 96.86% overall, and 86.91% on previously unseen words.
