Menczer, F.: Lexical and semantic clustering by Web links (2004)
0.01
0.011045 = product of:
0.02209 = sum of:
0.02209 = product of:
0.04418 = sum of:
0.04418 = weight(_text_:i in 3090) [ClassicSimilarity], result of:
0.04418 = score(doc=3090,freq=2.0), product of:
0.17669687 = queryWeight, product of:
3.7717297 = idf(docFreq=2765, maxDocs=44218)
0.0468477 = queryNorm
0.25003272 = fieldWeight in 3090, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.7717297 = idf(docFreq=2765, maxDocs=44218)
0.046875 = fieldNorm(doc=3090)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Recent Web-searching and -mining tools are combining text and link analysis to improve ranking and crawling algorithms. The central assumption behind such approaches is that there is a correiation between the graph structure of the Web and the text and meaning of pages. Here I formalize and empirically evaluate two general conjectures drawing connections from link information to lexical and semantic Web content. The link-content conjecture states that a page is similar to the pages that link to it, and the link-cluster conjecture that pages about the same topic are clustered together. These conjectures are offen simply assumed to hold, and Web search tools are built an such assumptions. The present quantitative confirmation sheds light an the connection between the success of the latest Web-mining techniques and the small world topology of the Web, with encouraging implications for the design of better crawling algorithms.
