-
Buckley, C.; Voorhees, E.M.: Retrieval system evaluation (2005)
0.04
0.042086527 = product of:
0.11223073 = sum of:
0.017167233 = weight(_text_:information in 648) [ClassicSimilarity], result of:
0.017167233 = score(doc=648,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.27153665 = fieldWeight in 648, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=648)
0.072086 = weight(_text_:retrieval in 648) [ClassicSimilarity], result of:
0.072086 = score(doc=648,freq=4.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.6617001 = fieldWeight in 648, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.109375 = fieldNorm(doc=648)
0.022977501 = product of:
0.0689325 = sum of:
0.0689325 = weight(_text_:29 in 648) [ClassicSimilarity], result of:
0.0689325 = score(doc=648,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.5441145 = fieldWeight in 648, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.109375 = fieldNorm(doc=648)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Beaulieu, M.: Approaches to user-based studies in information seeking and retrieval : a Sheffield perspective (2003)
0.04
0.03683555 = product of:
0.098228134 = sum of:
0.024278132 = weight(_text_:information in 4692) [ClassicSimilarity], result of:
0.024278132 = score(doc=4692,freq=4.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.3840108 = fieldWeight in 4692, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=4692)
0.0509725 = weight(_text_:retrieval in 4692) [ClassicSimilarity], result of:
0.0509725 = score(doc=4692,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.46789268 = fieldWeight in 4692, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.109375 = fieldNorm(doc=4692)
0.022977501 = product of:
0.0689325 = sum of:
0.0689325 = weight(_text_:29 in 4692) [ClassicSimilarity], result of:
0.0689325 = score(doc=4692,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.5441145 = fieldWeight in 4692, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.109375 = fieldNorm(doc=4692)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Source
- Journal of information science. 29(2003) no.4, S.239-248
-
Kwok, K.-L.: Ten years of ad hoc retrieval at TREC using PIRCS (2005)
0.04
0.03607416 = product of:
0.09619777 = sum of:
0.014714771 = weight(_text_:information in 5090) [ClassicSimilarity], result of:
0.014714771 = score(doc=5090,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 5090, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=5090)
0.061788 = weight(_text_:retrieval in 5090) [ClassicSimilarity], result of:
0.061788 = score(doc=5090,freq=4.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.5671716 = fieldWeight in 5090, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=5090)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 5090) [ClassicSimilarity], result of:
0.059085 = score(doc=5090,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 5090, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=5090)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Harman, D.K.: ¬The TREC test collections (2005)
0.03
0.034168962 = product of:
0.09111723 = sum of:
0.017167233 = weight(_text_:information in 4637) [ClassicSimilarity], result of:
0.017167233 = score(doc=4637,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.27153665 = fieldWeight in 4637, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=4637)
0.0509725 = weight(_text_:retrieval in 4637) [ClassicSimilarity], result of:
0.0509725 = score(doc=4637,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.46789268 = fieldWeight in 4637, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.109375 = fieldNorm(doc=4637)
0.022977501 = product of:
0.0689325 = sum of:
0.0689325 = weight(_text_:29 in 4637) [ClassicSimilarity], result of:
0.0689325 = score(doc=4637,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.5441145 = fieldWeight in 4637, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.109375 = fieldNorm(doc=4637)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Harman, D.K.: ¬The TREC ad hoc experiments (2005)
0.03
0.034168962 = product of:
0.09111723 = sum of:
0.017167233 = weight(_text_:information in 5711) [ClassicSimilarity], result of:
0.017167233 = score(doc=5711,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.27153665 = fieldWeight in 5711, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=5711)
0.0509725 = weight(_text_:retrieval in 5711) [ClassicSimilarity], result of:
0.0509725 = score(doc=5711,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.46789268 = fieldWeight in 5711, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.109375 = fieldNorm(doc=5711)
0.022977501 = product of:
0.0689325 = sum of:
0.0689325 = weight(_text_:29 in 5711) [ClassicSimilarity], result of:
0.0689325 = score(doc=5711,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.5441145 = fieldWeight in 5711, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.109375 = fieldNorm(doc=5711)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Robertson, S.; Callan, J.: Routing and filtering (2005)
0.03
0.034168962 = product of:
0.09111723 = sum of:
0.017167233 = weight(_text_:information in 4688) [ClassicSimilarity], result of:
0.017167233 = score(doc=4688,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.27153665 = fieldWeight in 4688, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=4688)
0.0509725 = weight(_text_:retrieval in 4688) [ClassicSimilarity], result of:
0.0509725 = score(doc=4688,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.46789268 = fieldWeight in 4688, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.109375 = fieldNorm(doc=4688)
0.022977501 = product of:
0.0689325 = sum of:
0.0689325 = weight(_text_:29 in 4688) [ClassicSimilarity], result of:
0.0689325 = score(doc=4688,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.5441145 = fieldWeight in 4688, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.109375 = fieldNorm(doc=4688)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Harman, D.K.: Beyond English (2005)
0.03
0.034168962 = product of:
0.09111723 = sum of:
0.017167233 = weight(_text_:information in 4850) [ClassicSimilarity], result of:
0.017167233 = score(doc=4850,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.27153665 = fieldWeight in 4850, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=4850)
0.0509725 = weight(_text_:retrieval in 4850) [ClassicSimilarity], result of:
0.0509725 = score(doc=4850,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.46789268 = fieldWeight in 4850, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.109375 = fieldNorm(doc=4850)
0.022977501 = product of:
0.0689325 = sum of:
0.0689325 = weight(_text_:29 in 4850) [ClassicSimilarity], result of:
0.0689325 = score(doc=4850,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.5441145 = fieldWeight in 4850, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.109375 = fieldNorm(doc=4850)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Voorhees, E.M.; Garofolo, J.S.: Retrieving noisy text (2005)
0.03
0.034168962 = product of:
0.09111723 = sum of:
0.017167233 = weight(_text_:information in 5084) [ClassicSimilarity], result of:
0.017167233 = score(doc=5084,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.27153665 = fieldWeight in 5084, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=5084)
0.0509725 = weight(_text_:retrieval in 5084) [ClassicSimilarity], result of:
0.0509725 = score(doc=5084,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.46789268 = fieldWeight in 5084, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.109375 = fieldNorm(doc=5084)
0.022977501 = product of:
0.0689325 = sum of:
0.0689325 = weight(_text_:29 in 5084) [ClassicSimilarity], result of:
0.0689325 = score(doc=5084,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.5441145 = fieldWeight in 5084, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.109375 = fieldNorm(doc=5084)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000)
0.03
0.03409145 = product of:
0.09091053 = sum of:
0.017167233 = weight(_text_:information in 6438) [ClassicSimilarity], result of:
0.017167233 = score(doc=6438,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.27153665 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.0509725 = weight(_text_:retrieval in 6438) [ClassicSimilarity], result of:
0.0509725 = score(doc=6438,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.46789268 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.0227708 = product of:
0.0683124 = sum of:
0.0683124 = weight(_text_:22 in 6438) [ClassicSimilarity], result of:
0.0683124 = score(doc=6438,freq=2.0), product of:
0.12611638 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.036014426 = queryNorm
0.5416616 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 11. 8.2001 16:22:19
- Source
- Information processing and management. 36(2000) no.1, S.3-36
-
Voorhees, E.M.: On test collections for adaptive information retrieval (2008)
0.03
0.030145593 = product of:
0.08038825 = sum of:
0.012743366 = weight(_text_:information in 2444) [ClassicSimilarity], result of:
0.012743366 = score(doc=2444,freq=6.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.20156369 = fieldWeight in 2444, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046875 = fieldNorm(doc=2444)
0.05779738 = weight(_text_:retrieval in 2444) [ClassicSimilarity], result of:
0.05779738 = score(doc=2444,freq=14.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.5305404 = fieldWeight in 2444, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.046875 = fieldNorm(doc=2444)
0.0098475 = product of:
0.0295425 = sum of:
0.0295425 = weight(_text_:29 in 2444) [ClassicSimilarity], result of:
0.0295425 = score(doc=2444,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.23319192 = fieldWeight in 2444, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.046875 = fieldNorm(doc=2444)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Abstract
- Traditional Cranfield test collections represent an abstraction of a retrieval task that Sparck Jones calls the "core competency" of retrieval: a task that is necessary, but not sufficient, for user retrieval tasks. The abstraction facilitates research by controlling for (some) sources of variability, thus increasing the power of experiments that compare system effectiveness while reducing their cost. However, even within the highly-abstracted case of the Cranfield paradigm, meta-analysis demonstrates that the user/topic effect is greater than the system effect, so experiments must include a relatively large number of topics to distinguish systems' effectiveness. The evidence further suggests that changing the abstraction slightly to include just a bit more characterization of the user will result in a dramatic loss of power or increase in cost of retrieval experiments. Defining a new, feasible abstraction for supporting adaptive IR research will require winnowing the list of all possible factors that can affect retrieval behavior to a minimum number of essential factors.
- Date
- 22.11.2008 16:29:00
- Footnote
- Beitrag in einem Themenheft "Adaptive information retrieval"
- Source
- Information processing and management. 44(2008) no.6, S.1879-1885
-
Voorhees, E.M.: Question answering in TREC (2005)
0.03
0.029287683 = product of:
0.07810049 = sum of:
0.014714771 = weight(_text_:information in 6487) [ClassicSimilarity], result of:
0.014714771 = score(doc=6487,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 6487, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=6487)
0.043690715 = weight(_text_:retrieval in 6487) [ClassicSimilarity], result of:
0.043690715 = score(doc=6487,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.40105087 = fieldWeight in 6487, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=6487)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 6487) [ClassicSimilarity], result of:
0.059085 = score(doc=6487,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 6487, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=6487)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Cormack, G.V.; Clarke, C.L.A.; Palmer, C.R.; Lynam, T.R.: MultiText experiments for TREC (2005)
0.03
0.029287683 = product of:
0.07810049 = sum of:
0.014714771 = weight(_text_:information in 4298) [ClassicSimilarity], result of:
0.014714771 = score(doc=4298,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 4298, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=4298)
0.043690715 = weight(_text_:retrieval in 4298) [ClassicSimilarity], result of:
0.043690715 = score(doc=4298,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.40105087 = fieldWeight in 4298, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=4298)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 4298) [ClassicSimilarity], result of:
0.059085 = score(doc=4298,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 4298, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=4298)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Dumais, S.T.; Belkin, N.J.: ¬The TREC interactive tracks : putting the user into search (2005)
0.03
0.029287683 = product of:
0.07810049 = sum of:
0.014714771 = weight(_text_:information in 5081) [ClassicSimilarity], result of:
0.014714771 = score(doc=5081,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 5081, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=5081)
0.043690715 = weight(_text_:retrieval in 5081) [ClassicSimilarity], result of:
0.043690715 = score(doc=5081,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.40105087 = fieldWeight in 5081, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=5081)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 5081) [ClassicSimilarity], result of:
0.059085 = score(doc=5081,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 5081, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=5081)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Hawking, D.; Craswell, N.: ¬The very large collection and Web tracks (2005)
0.03
0.029287683 = product of:
0.07810049 = sum of:
0.014714771 = weight(_text_:information in 5085) [ClassicSimilarity], result of:
0.014714771 = score(doc=5085,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 5085, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=5085)
0.043690715 = weight(_text_:retrieval in 5085) [ClassicSimilarity], result of:
0.043690715 = score(doc=5085,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.40105087 = fieldWeight in 5085, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=5085)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 5085) [ClassicSimilarity], result of:
0.059085 = score(doc=5085,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 5085, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=5085)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Allan, J.; Croft, W.B.; Callan, J.: ¬The University of Massachusetts and a dozen TRECs (2005)
0.03
0.029287683 = product of:
0.07810049 = sum of:
0.014714771 = weight(_text_:information in 5086) [ClassicSimilarity], result of:
0.014714771 = score(doc=5086,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 5086, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=5086)
0.043690715 = weight(_text_:retrieval in 5086) [ClassicSimilarity], result of:
0.043690715 = score(doc=5086,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.40105087 = fieldWeight in 5086, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=5086)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 5086) [ClassicSimilarity], result of:
0.059085 = score(doc=5086,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 5086, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=5086)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Robertson, S.: How Okapi came to TREC (2005)
0.03
0.029287683 = product of:
0.07810049 = sum of:
0.014714771 = weight(_text_:information in 5087) [ClassicSimilarity], result of:
0.014714771 = score(doc=5087,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 5087, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=5087)
0.043690715 = weight(_text_:retrieval in 5087) [ClassicSimilarity], result of:
0.043690715 = score(doc=5087,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.40105087 = fieldWeight in 5087, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=5087)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 5087) [ClassicSimilarity], result of:
0.059085 = score(doc=5087,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 5087, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=5087)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Buckley, C.: ¬The SMART Project at TREC (2005)
0.03
0.029287683 = product of:
0.07810049 = sum of:
0.014714771 = weight(_text_:information in 5088) [ClassicSimilarity], result of:
0.014714771 = score(doc=5088,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 5088, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=5088)
0.043690715 = weight(_text_:retrieval in 5088) [ClassicSimilarity], result of:
0.043690715 = score(doc=5088,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.40105087 = fieldWeight in 5088, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=5088)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 5088) [ClassicSimilarity], result of:
0.059085 = score(doc=5088,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 5088, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=5088)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Hiemstra, D.; Kraaij, W.: ¬A language-modeling approach to TREC (2005)
0.03
0.029287683 = product of:
0.07810049 = sum of:
0.014714771 = weight(_text_:information in 5091) [ClassicSimilarity], result of:
0.014714771 = score(doc=5091,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 5091, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=5091)
0.043690715 = weight(_text_:retrieval in 5091) [ClassicSimilarity], result of:
0.043690715 = score(doc=5091,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.40105087 = fieldWeight in 5091, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=5091)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 5091) [ClassicSimilarity], result of:
0.059085 = score(doc=5091,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 5091, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=5091)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Sparck Jones, K.: Metareflections on TREC (2005)
0.03
0.029287683 = product of:
0.07810049 = sum of:
0.014714771 = weight(_text_:information in 5092) [ClassicSimilarity], result of:
0.014714771 = score(doc=5092,freq=2.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.23274569 = fieldWeight in 5092, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=5092)
0.043690715 = weight(_text_:retrieval in 5092) [ClassicSimilarity], result of:
0.043690715 = score(doc=5092,freq=2.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.40105087 = fieldWeight in 5092, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.09375 = fieldNorm(doc=5092)
0.019695 = product of:
0.059085 = sum of:
0.059085 = weight(_text_:29 in 5092) [ClassicSimilarity], result of:
0.059085 = score(doc=5092,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.46638384 = fieldWeight in 5092, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=5092)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Date
- 29. 3.1996 18:16:49
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
-
Alemayehu, N.: Analysis of performance variation using quey expansion (2003)
0.03
0.028537815 = product of:
0.07610084 = sum of:
0.012743366 = weight(_text_:information in 1454) [ClassicSimilarity], result of:
0.012743366 = score(doc=1454,freq=6.0), product of:
0.06322253 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.036014426 = queryNorm
0.20156369 = fieldWeight in 1454, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046875 = fieldNorm(doc=1454)
0.053509977 = weight(_text_:retrieval in 1454) [ClassicSimilarity], result of:
0.053509977 = score(doc=1454,freq=12.0), product of:
0.10894058 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.036014426 = queryNorm
0.49118498 = fieldWeight in 1454, product of:
3.4641016 = tf(freq=12.0), with freq of:
12.0 = termFreq=12.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.046875 = fieldNorm(doc=1454)
0.0098475 = product of:
0.0295425 = sum of:
0.0295425 = weight(_text_:29 in 1454) [ClassicSimilarity], result of:
0.0295425 = score(doc=1454,freq=2.0), product of:
0.1266875 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.036014426 = queryNorm
0.23319192 = fieldWeight in 1454, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.046875 = fieldNorm(doc=1454)
0.33333334 = coord(1/3)
0.375 = coord(3/8)
- Abstract
- Information retrieval performance evaluation is commonly made based an the classical recall and precision based figures or graphs. However, important information indicating causes for variation may remain hidden under the average recall and precision figures. Identifying significant causes for variation can help researchers and developers to focus an opportunities for improvement that underlay the averages. This article presents a case study showing the potential of a statistical repeated measures analysis of variance for testing the significance of factors in retrieval performance variation. The TREC-9 Query Track performance data is used as a case study and the factors studied are retrieval method, topic, and their interaction. The results show that retrieval method, topic, and their interaction are all significant. A topic level analysis is also made to see the nature of variation in the performance of retrieval methods across topics. The observed retrieval performances of expansion runs are truly significant improvements for most of the topics. Analyses of the effect of query expansion an document ranking confirm that expansion affects ranking positively.
- Date
- 29. 3.2003 19:28:33
- Source
- Journal of the American Society for Information Science and technology. 54(2003) no.5, S.379-391