Airio, E.; Kettunen, K.: Does dictionary based bilingual retrieval work in a non-normalized index? (2009)
0.00
0.0023241614 = product of:
0.0046483227 = sum of:
0.0046483227 = product of:
0.009296645 = sum of:
0.009296645 = weight(_text_:s in 4224) [ClassicSimilarity], result of:
0.009296645 = score(doc=4224,freq=10.0), product of:
0.057684682 = queryWeight, product of:
1.0872376 = idf(docFreq=40523, maxDocs=44218)
0.053056188 = queryNorm
0.16116315 = fieldWeight in 4224, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
1.0872376 = idf(docFreq=40523, maxDocs=44218)
0.046875 = fieldNorm(doc=4224)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Many operational IR indexes are non-normalized, i.e. no lemmatization or stemming techniques, etc. have been employed in indexing. This poses a challenge for dictionary-based cross-language retrieval (CLIR), because translations are mostly lemmas. In this study, we face the challenge of dictionary-based CLIR in a non-normalized index. We test two optional approaches: FCG (Frequent Case Generation) and s-gramming. The idea of FCG is to automatically generate the most frequent inflected forms for a given lemma. FCG has been tested in monolingual retrieval and has been shown to be a good method for inflected retrieval, especially for highly inflected languages. S-gramming is an approximate string matching technique (an extension of n-gramming). The language pairs in our tests were English-Finnish, English-Swedish, Swedish-Finnish and Finnish-Swedish. Both our approaches performed quite well, but the results varied depending on the language pair. S-gramming and FCG performed quite equally in all the other language pairs except Finnish-Swedish, where s-gramming outperformed FCG.
- Source
- Information processing and management. 45(2009) no.6, S.703-713