Efron, M.: Linear time series models for term weighting in information retrieval (2010)
0.01
0.011671098 = product of:
0.023342196 = sum of:
0.023342196 = product of:
0.04668439 = sum of:
0.04668439 = weight(_text_:t in 3688) [ClassicSimilarity], result of:
0.04668439 = score(doc=3688,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.26114836 = fieldWeight in 3688, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.046875 = fieldNorm(doc=3688)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Common measures of term importance in information retrieval (IR) rely on counts of term frequency; rare terms receive higher weight in document ranking than common terms receive. However, realistic scenarios yield additional information about terms in a collection. Of interest in this article is the temporal behavior of terms as a collection changes over time. We propose capturing each term's collection frequency at discrete time intervals over the lifespan of a corpus and analyzing the resulting time series. We hypothesize the collection frequency of a weakly discriminative term x at time t is predictable by a linear model of the term's prior observations. On the other hand, a linear time series model for a strong discriminators' collection frequency will yield a poor fit to the data. Operationalizing this hypothesis, we induce three time-based measures of term importance and test these against state-of-the-art term weighting models.
