He, J.; Meij, E.; Rijke, M. de: Result diversification based on query-specific cluster ranking (2011)
0.00
4.9814244E-4 = product of:
0.007472136 = sum of:
0.007472136 = weight(_text_:in in 4355) [ClassicSimilarity], result of:
0.007472136 = score(doc=4355,freq=10.0), product of:
0.044469737 = queryWeight, product of:
1.3602545 = idf(docFreq=30841, maxDocs=44218)
0.032692216 = queryNorm
0.16802745 = fieldWeight in 4355, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
1.3602545 = idf(docFreq=30841, maxDocs=44218)
0.0390625 = fieldNorm(doc=4355)
0.06666667 = coord(1/15)
- Abstract
- Result diversification is a retrieval strategy for dealing with ambiguous or multi-faceted queries by providing documents that cover as many facets of the query as possible. We propose a result diversification framework based on query-specific clustering and cluster ranking, in which diversification is restricted to documents belonging to clusters that potentially contain a high percentage of relevant documents. Empirical results show that the proposed framework improves the performance of several existing diversification methods. The framework also gives rise to a simple yet effective cluster-based approach to result diversification that selects documents from different clusters to be included in a ranked list in a round robin fashion. We describe a set of experiments aimed at thoroughly analyzing the behavior of the two main components of the proposed diversification framework, ranking and selecting clusters for diversification. Both components have a crucial impact on the overall performance of our framework, but ranking clusters plays a more important role than selecting clusters. We also examine properties that clusters should have in order for our diversification framework to be effective. Most relevant documents should be contained in a small number of high-quality clusters, while there should be no dominantly large clusters. Also, documents from these high-quality clusters should have a diverse content. These properties are strongly correlated with the overall performance of the proposed diversification framework.