-
Saracevic, T.: On a method for studying the structure and nature of requests in information retrieval (1983)
0.07
0.0696447 = product of:
0.1392894 = sum of:
0.1392894 = sum of:
0.07780732 = weight(_text_:t in 2417) [ClassicSimilarity], result of:
0.07780732 = score(doc=2417,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.43524727 = fieldWeight in 2417, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.078125 = fieldNorm(doc=2417)
0.06148207 = weight(_text_:22 in 2417) [ClassicSimilarity], result of:
0.06148207 = score(doc=2417,freq=2.0), product of:
0.15890898 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04537884 = queryNorm
0.38690117 = fieldWeight in 2417, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=2417)
0.5 = coord(1/2)
- Pages
- S.22-25
-
Ravana, S.D.; Taheri, M.S.; Rajagopal, P.: Document-based approach to improve the accuracy of pairwise comparison in evaluating information retrieval systems (2015)
0.03
0.03482235 = product of:
0.0696447 = sum of:
0.0696447 = sum of:
0.03890366 = weight(_text_:t in 2587) [ClassicSimilarity], result of:
0.03890366 = score(doc=2587,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.21762364 = fieldWeight in 2587, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.0390625 = fieldNorm(doc=2587)
0.030741034 = weight(_text_:22 in 2587) [ClassicSimilarity], result of:
0.030741034 = score(doc=2587,freq=2.0), product of:
0.15890898 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04537884 = queryNorm
0.19345059 = fieldWeight in 2587, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=2587)
0.5 = coord(1/2)
- Abstract
- Purpose The purpose of this paper is to propose a method to have more accurate results in comparing performance of the paired information retrieval (IR) systems with reference to the current method, which is based on the mean effectiveness scores of the systems across a set of identified topics/queries. Design/methodology/approach Based on the proposed approach, instead of the classic method of using a set of topic scores, the documents level scores are considered as the evaluation unit. These document scores are the defined document's weight, which play the role of the mean average precision (MAP) score of the systems as a significance test's statics. The experiments were conducted using the TREC 9 Web track collection. Findings The p-values generated through the two types of significance tests, namely the Student's t-test and Mann-Whitney show that by using the document level scores as an evaluation unit, the difference between IR systems is more significant compared with utilizing topic scores. Originality/value Utilizing a suitable test collection is a primary prerequisite for IR systems comparative evaluation. However, in addition to reusable test collections, having an accurate statistical testing is a necessity for these evaluations. The findings of this study will assist IR researchers to evaluate their retrieval systems and algorithms more accurately.
- Date
- 20. 1.2015 18:30:22
-
Strzalkowski, T.; Guthrie, L.; Karlgren, J.; Leistensnider, J.; Lin, F.; Perez-Carballo, J.; Straszheim, T.; Wang, J.; Wilding, J.: Natural language information retrieval : TREC-5 report (1997)
0.03
0.027509041 = product of:
0.055018082 = sum of:
0.055018082 = product of:
0.110036165 = sum of:
0.110036165 = weight(_text_:t in 3100) [ClassicSimilarity], result of:
0.110036165 = score(doc=3100,freq=4.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.6155326 = fieldWeight in 3100, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.078125 = fieldNorm(doc=3100)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
Davis, M.; Dunning, T.: ¬A TREC evaluation of query translation methods for multi-lingual text retrieval (1996)
0.02
0.023342196 = product of:
0.04668439 = sum of:
0.04668439 = product of:
0.09336878 = sum of:
0.09336878 = weight(_text_:t in 1917) [ClassicSimilarity], result of:
0.09336878 = score(doc=1917,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.5222967 = fieldWeight in 1917, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.09375 = fieldNorm(doc=1917)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
Strzalkowski, T.; Perez-Carballo, J.: Natural language information retrieval : TREC-4 report (1996)
0.02
0.023342196 = product of:
0.04668439 = sum of:
0.04668439 = product of:
0.09336878 = sum of:
0.09336878 = weight(_text_:t in 3211) [ClassicSimilarity], result of:
0.09336878 = score(doc=3211,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.5222967 = fieldWeight in 3211, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.09375 = fieldNorm(doc=3211)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
Strzalkowski, T.; Sparck Jones, K.: NLP track at TREC-5 (1997)
0.02
0.023342196 = product of:
0.04668439 = sum of:
0.04668439 = product of:
0.09336878 = sum of:
0.09336878 = weight(_text_:t in 3098) [ClassicSimilarity], result of:
0.09336878 = score(doc=3098,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.5222967 = fieldWeight in 3098, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.09375 = fieldNorm(doc=3098)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
Kuriyama, K.; Kando, N.; Nozue, T.; Eguchi, K.: Pooling for a large-scale test collection : an analysis of the search results from the First NTCIR Workshop (2002)
0.02
0.023342196 = product of:
0.04668439 = sum of:
0.04668439 = product of:
0.09336878 = sum of:
0.09336878 = weight(_text_:t in 3830) [ClassicSimilarity], result of:
0.09336878 = score(doc=3830,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.5222967 = fieldWeight in 3830, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.09375 = fieldNorm(doc=3830)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
Tomaiuolo, N.G.; Parker, J.: Maximizing relevant retrieval : keyword and natural language searching (1998)
0.02
0.021518724 = product of:
0.043037448 = sum of:
0.043037448 = product of:
0.086074896 = sum of:
0.086074896 = weight(_text_:22 in 6418) [ClassicSimilarity], result of:
0.086074896 = score(doc=6418,freq=2.0), product of:
0.15890898 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04537884 = queryNorm
0.5416616 = fieldWeight in 6418, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6418)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Online. 22(1998) no.6, S.57-58
-
Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000)
0.02
0.021518724 = product of:
0.043037448 = sum of:
0.043037448 = product of:
0.086074896 = sum of:
0.086074896 = weight(_text_:22 in 6438) [ClassicSimilarity], result of:
0.086074896 = score(doc=6438,freq=2.0), product of:
0.15890898 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04537884 = queryNorm
0.5416616 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 11. 8.2001 16:22:19
-
Dalrymple, P.W.: Retrieval by reformulation in two library catalogs : toward a cognitive model of searching behavior (1990)
0.02
0.021518724 = product of:
0.043037448 = sum of:
0.043037448 = product of:
0.086074896 = sum of:
0.086074896 = weight(_text_:22 in 5089) [ClassicSimilarity], result of:
0.086074896 = score(doc=5089,freq=2.0), product of:
0.15890898 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04537884 = queryNorm
0.5416616 = fieldWeight in 5089, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=5089)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 22. 7.2006 18:43:54
-
Brown, E.W.; Carmel, D.; Franz, M.; Ittycheriah, A.; Kanungo, T.; Maarek, Y.; McCarley, J.S.; Mack, R.L.; Prager, J.M.; Smith, J.R.; Soffer, A.; Zien, J.Y.; Marwick, A.D.: IBM research activities at TREC (2005)
0.02
0.01945183 = product of:
0.03890366 = sum of:
0.03890366 = product of:
0.07780732 = sum of:
0.07780732 = weight(_text_:t in 5093) [ClassicSimilarity], result of:
0.07780732 = score(doc=5093,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.43524727 = fieldWeight in 5093, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.078125 = fieldNorm(doc=5093)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
Bellardo, T.; Saracevic, T.: Online searching and search output : relationships between overlap, relevance, recall and precision (1987)
0.02
0.016505426 = product of:
0.03301085 = sum of:
0.03301085 = product of:
0.0660217 = sum of:
0.0660217 = weight(_text_:t in 4150) [ClassicSimilarity], result of:
0.0660217 = score(doc=4150,freq=4.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.36931956 = fieldWeight in 4150, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.046875 = fieldNorm(doc=4150)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
Saracevic, T.: Individual differences in organizing, searching and retrieving information (1991)
0.02
0.015561464 = product of:
0.031122928 = sum of:
0.031122928 = product of:
0.062245857 = sum of:
0.062245857 = weight(_text_:t in 3692) [ClassicSimilarity], result of:
0.062245857 = score(doc=3692,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.34819782 = fieldWeight in 3692, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.0625 = fieldNorm(doc=3692)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
Barry, C.I.; Schamber, L.: User-defined relevance criteria : a comparison of 2 studies (1995)
0.02
0.015561464 = product of:
0.031122928 = sum of:
0.031122928 = product of:
0.062245857 = sum of:
0.062245857 = weight(_text_:t in 3850) [ClassicSimilarity], result of:
0.062245857 = score(doc=3850,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.34819782 = fieldWeight in 3850, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.0625 = fieldNorm(doc=3850)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Forging new partnerships in information: converging technologies. Proceedings of the 58th Annual Meeting of the American Society for Information Science, ASIS'95, Chicago, IL, 9-12 October 1995. Ed.: T. Kinney
-
Pfeifer, U.; Poersch, T.; Fuhr, N.: Retrieval effectiveness of proper name search methods (1996)
0.02
0.015561464 = product of:
0.031122928 = sum of:
0.031122928 = product of:
0.062245857 = sum of:
0.062245857 = weight(_text_:t in 6982) [ClassicSimilarity], result of:
0.062245857 = score(doc=6982,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.34819782 = fieldWeight in 6982, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.0625 = fieldNorm(doc=6982)
0.5 = coord(1/2)
0.5 = coord(1/2)
-
Allan, J.; Callan, J.P.; Croft, W.B.; Ballesteros, L.; Broglio, J.; Xu, J.; Shu, H.: INQUERY at TREC-5 (1997)
0.02
0.015370517 = product of:
0.030741034 = sum of:
0.030741034 = product of:
0.06148207 = sum of:
0.06148207 = weight(_text_:22 in 3103) [ClassicSimilarity], result of:
0.06148207 = score(doc=3103,freq=2.0), product of:
0.15890898 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04537884 = queryNorm
0.38690117 = fieldWeight in 3103, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3103)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 27. 2.1999 20:55:22
-
Ng, K.B.; Loewenstern, D.; Basu, C.; Hirsh, H.; Kantor, P.B.: Data fusion of machine-learning methods for the TREC5 routing tak (and other work) (1997)
0.02
0.015370517 = product of:
0.030741034 = sum of:
0.030741034 = product of:
0.06148207 = sum of:
0.06148207 = weight(_text_:22 in 3107) [ClassicSimilarity], result of:
0.06148207 = score(doc=3107,freq=2.0), product of:
0.15890898 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04537884 = queryNorm
0.38690117 = fieldWeight in 3107, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3107)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 27. 2.1999 20:59:22
-
Buckland, M.K.: Partnerships in navigation : an information retrieval research agenda (1995)
0.01
0.013616281 = product of:
0.027232561 = sum of:
0.027232561 = product of:
0.054465123 = sum of:
0.054465123 = weight(_text_:t in 3849) [ClassicSimilarity], result of:
0.054465123 = score(doc=3849,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.30467308 = fieldWeight in 3849, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.0546875 = fieldNorm(doc=3849)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Forging new partnerships in information: converging technologies. Proceedings of the 58th Annual Meeting of the American Society for Information Science, ASIS'95, Chicago, IL, 9-12 October 1995. Ed.: T. Kinney
-
Spink, A.; Goodrum, A.; Robins, D.: Search intermediary elicitations during mediated online searching (1995)
0.01
0.013616281 = product of:
0.027232561 = sum of:
0.027232561 = product of:
0.054465123 = sum of:
0.054465123 = weight(_text_:t in 3872) [ClassicSimilarity], result of:
0.054465123 = score(doc=3872,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.30467308 = fieldWeight in 3872, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.0546875 = fieldNorm(doc=3872)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Forging new partnerships in information: converging technologies. Proceedings of the 58th Annual Meeting of the American Society for Information Science, ASIS'95, Chicago, IL, 9-12 October 1995. Ed.: T. Kinney
-
Wan, T.-L.; Evens, M.; Wan, Y.-W.; Pao, Y.-Y.: Experiments with automatic indexing and a relational thesaurus in a Chinese information retrieval system (1997)
0.01
0.013616281 = product of:
0.027232561 = sum of:
0.027232561 = product of:
0.054465123 = sum of:
0.054465123 = weight(_text_:t in 956) [ClassicSimilarity], result of:
0.054465123 = score(doc=956,freq=2.0), product of:
0.17876579 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04537884 = queryNorm
0.30467308 = fieldWeight in 956, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.0546875 = fieldNorm(doc=956)
0.5 = coord(1/2)
0.5 = coord(1/2)
