Allen, R.B.; Wu, Y.: Metrics for the scope of a collection (2005)
0.00
0.0011815331 = product of:
0.010633797 = sum of:
0.010633797 = product of:
0.021267595 = sum of:
0.021267595 = weight(_text_:web in 4570) [ClassicSimilarity], result of:
0.021267595 = score(doc=4570,freq=2.0), product of:
0.098305345 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.030122576 = queryNorm
0.21634221 = fieldWeight in 4570, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=4570)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- Some collections cover many topics, while others are narrowly focused an a limited number of topics. We introduce the concept of the "scope" of a collection of documents and we compare two ways of measuring lt. These measures are based an the distances between documents. The first uses the overlap of words between pairs of documents. The second measure uses a novel method that calculates the semantic relatedness to pairs of words from the documents. Those values are combined to obtain an overall distance between the documents. The main validation for the measures compared Web pages categorized by Yahoo. Sets of pages sampied from broad categories were determined to have a higher scope than sets derived from subcategories. The measure was significant and confirmed the expected difference in scope. Finally, we discuss other measures related to scope.
