-
Rajagopal, P.; Ravana, S.D.; Koh, Y.S.; Balakrishnan, V.: Evaluating the effectiveness of information retrieval systems using effort-based relevance judgment (2019)
0.04
0.044738617 = product of:
0.08947723 = sum of:
0.08947723 = sum of:
0.05899287 = weight(_text_:v in 5287) [ClassicSimilarity], result of:
0.05899287 = score(doc=5287,freq=2.0), product of:
0.219214 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044999957 = queryNorm
0.26911086 = fieldWeight in 5287, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0390625 = fieldNorm(doc=5287)
0.030484365 = weight(_text_:22 in 5287) [ClassicSimilarity], result of:
0.030484365 = score(doc=5287,freq=2.0), product of:
0.15758218 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044999957 = queryNorm
0.19345059 = fieldWeight in 5287, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=5287)
0.5 = coord(1/2)
- Date
- 20. 1.2015 18:30:22
-
Angelini, M.; Fazzini, V.; Ferro, N.; Santucci, G.; Silvello, G.: CLAIRE: A combinatorial visual analytics system for information retrieval evaluation (2018)
0.01
0.014748218 = product of:
0.029496435 = sum of:
0.029496435 = product of:
0.05899287 = sum of:
0.05899287 = weight(_text_:v in 5049) [ClassicSimilarity], result of:
0.05899287 = score(doc=5049,freq=2.0), product of:
0.219214 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044999957 = queryNorm
0.26911086 = fieldWeight in 5049, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0390625 = fieldNorm(doc=5049)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
White, H.D.: Relevance theory and distributions of judgments in document retrieval (2017)
0.01
0.014748218 = product of:
0.029496435 = sum of:
0.029496435 = product of:
0.05899287 = sum of:
0.05899287 = weight(_text_:v in 5099) [ClassicSimilarity], result of:
0.05899287 = score(doc=5099,freq=2.0), product of:
0.219214 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044999957 = queryNorm
0.26911086 = fieldWeight in 5099, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0390625 = fieldNorm(doc=5099)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- This article extends relevance theory (RT) from linguistic pragmatics into information retrieval. Using more than 50 retrieval experiments from the literature as examples, it applies RT to explain the frequency distributions of documents on relevance scales with three or more points. The scale points, which judges in experiments must consider in addition to queries and documents, are communications from researchers. In RT, the relevance of a communication varies directly with its cognitive effects and inversely with the effort of processing it. Researchers define and/or label the scale points to measure the cognitive effects of documents on judges. However, they apparently assume that all scale points as presented are equally easy for judges to process. Yet the notion that points cost variable effort explains fairly well the frequency distributions of judgments across them. By hypothesis, points that cost more effort are chosen by judges less frequently. Effort varies with the vagueness or strictness of scale-point labels and definitions. It is shown that vague scales tend to produce U- or V-shaped distributions, while strict scales tend to produce right-skewed distributions. These results reinforce the paper's more general argument that RT clarifies the concept of relevance in the dialogues of retrieval evaluation.
-
Reichert, S.; Mayr, P.: Untersuchung von Relevanzeigenschaften in einem kontrollierten Eyetracking-Experiment (2012)
0.01
0.009145309 = product of:
0.018290618 = sum of:
0.018290618 = product of:
0.036581237 = sum of:
0.036581237 = weight(_text_:22 in 328) [ClassicSimilarity], result of:
0.036581237 = score(doc=328,freq=2.0), product of:
0.15758218 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044999957 = queryNorm
0.23214069 = fieldWeight in 328, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046875 = fieldNorm(doc=328)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 22. 7.2012 19:25:54
-
Pal, S.; Mitra, M.; Kamps, J.: Evaluation effort, reliability and reusability in XML retrieval (2011)
0.01
0.0076210913 = product of:
0.015242183 = sum of:
0.015242183 = product of:
0.030484365 = sum of:
0.030484365 = weight(_text_:22 in 4197) [ClassicSimilarity], result of:
0.030484365 = score(doc=4197,freq=2.0), product of:
0.15758218 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044999957 = queryNorm
0.19345059 = fieldWeight in 4197, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=4197)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 22. 1.2011 14:20:56
-
Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track (2011)
0.01
0.0076210913 = product of:
0.015242183 = sum of:
0.015242183 = product of:
0.030484365 = sum of:
0.030484365 = weight(_text_:22 in 4540) [ClassicSimilarity], result of:
0.030484365 = score(doc=4540,freq=2.0), product of:
0.15758218 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044999957 = queryNorm
0.19345059 = fieldWeight in 4540, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=4540)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 12. 7.2011 18:29:22
-
Wildemuth, B.; Freund, L.; Toms, E.G.: Untangling search task complexity and difficulty in the context of interactive information retrieval studies (2014)
0.01
0.0076210913 = product of:
0.015242183 = sum of:
0.015242183 = product of:
0.030484365 = sum of:
0.030484365 = weight(_text_:22 in 1786) [ClassicSimilarity], result of:
0.030484365 = score(doc=1786,freq=2.0), product of:
0.15758218 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044999957 = queryNorm
0.19345059 = fieldWeight in 1786, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=1786)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 6. 4.2015 19:31:22
-
Ravana, S.D.; Taheri, M.S.; Rajagopal, P.: Document-based approach to improve the accuracy of pairwise comparison in evaluating information retrieval systems (2015)
0.01
0.0076210913 = product of:
0.015242183 = sum of:
0.015242183 = product of:
0.030484365 = sum of:
0.030484365 = weight(_text_:22 in 2587) [ClassicSimilarity], result of:
0.030484365 = score(doc=2587,freq=2.0), product of:
0.15758218 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044999957 = queryNorm
0.19345059 = fieldWeight in 2587, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=2587)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 20. 1.2015 18:30:22
