Melucci, M.; Orio, N.: Design, implementation, and evaluation of a methodology for automatic stemmer generation (2007)
0.02
0.015078641 = product of:
0.060314562 = sum of:
0.060314562 = weight(_text_:digital in 268) [ClassicSimilarity], result of:
0.060314562 = score(doc=268,freq=2.0), product of:
0.19770671 = queryWeight, product of:
3.944552 = idf(docFreq=2326, maxDocs=44218)
0.050121464 = queryNorm
0.30507088 = fieldWeight in 268, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.944552 = idf(docFreq=2326, maxDocs=44218)
0.0546875 = fieldNorm(doc=268)
0.25 = coord(1/4)
- Abstract
- The authors describe a statistical approach based on hidden Markov models (HMMs), for generating stemmers automatically. The proposed approach requires little effort to insert new languages in the system even if minimal linguistic knowledge is available. This is a key advantage especially for digital libraries, which are often developed for a specific institution or government because the program can manage a great amount of documents written in local languages. The evaluation described in the article shows that the stemmers implemented by means of HMMs are as effective as those based on linguistic rules.
