-
Saracevic, T.: On a method for studying the structure and nature of requests in information retrieval (1983)
0.05
0.045335304 = product of:
0.09067061 = sum of:
0.09067061 = product of:
0.13600591 = sum of:
0.07597316 = weight(_text_:t in 2417) [ClassicSimilarity], result of:
0.07597316 = score(doc=2417,freq=2.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.43524727 = fieldWeight in 2417, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.078125 = fieldNorm(doc=2417)
0.060032744 = weight(_text_:22 in 2417) [ClassicSimilarity], result of:
0.060032744 = score(doc=2417,freq=2.0), product of:
0.15516299 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04430912 = queryNorm
0.38690117 = fieldWeight in 2417, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=2417)
0.6666667 = coord(2/3)
0.5 = coord(1/2)
- Pages
- S.22-25
-
Rajagopal, P.; Ravana, S.D.; Koh, Y.S.; Balakrishnan, V.: Evaluating the effectiveness of information retrieval systems using effort-based relevance judgment (2019)
0.03
0.029367864 = product of:
0.05873573 = sum of:
0.05873573 = product of:
0.08810359 = sum of:
0.05808722 = weight(_text_:v in 5287) [ClassicSimilarity], result of:
0.05808722 = score(doc=5287,freq=2.0), product of:
0.21584865 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.04430912 = queryNorm
0.26911086 = fieldWeight in 5287, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0390625 = fieldNorm(doc=5287)
0.030016372 = weight(_text_:22 in 5287) [ClassicSimilarity], result of:
0.030016372 = score(doc=5287,freq=2.0), product of:
0.15516299 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04430912 = queryNorm
0.19345059 = fieldWeight in 5287, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=5287)
0.6666667 = coord(2/3)
0.5 = coord(1/2)
- Date
- 20. 1.2015 18:30:22
-
Lohmann, H.: Verbesserung der Literatursuche durch Dokumentanreicherung und automatische Inhaltserschließung : Das Projekt 'KASCADE' an der Universitäts- und Landesbibliothek Düsseldorf (1999)
0.02
0.023234887 = product of:
0.046469774 = sum of:
0.046469774 = product of:
0.13940932 = sum of:
0.13940932 = weight(_text_:v in 1221) [ClassicSimilarity], result of:
0.13940932 = score(doc=1221,freq=2.0), product of:
0.21584865 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.04430912 = queryNorm
0.64586604 = fieldWeight in 1221, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.09375 = fieldNorm(doc=1221)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Pages
- V,117,14 S
-
Ravana, S.D.; Taheri, M.S.; Rajagopal, P.: Document-based approach to improve the accuracy of pairwise comparison in evaluating information retrieval systems (2015)
0.02
0.022667652 = product of:
0.045335304 = sum of:
0.045335304 = product of:
0.068002954 = sum of:
0.03798658 = weight(_text_:t in 2587) [ClassicSimilarity], result of:
0.03798658 = score(doc=2587,freq=2.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.21762364 = fieldWeight in 2587, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.0390625 = fieldNorm(doc=2587)
0.030016372 = weight(_text_:22 in 2587) [ClassicSimilarity], result of:
0.030016372 = score(doc=2587,freq=2.0), product of:
0.15516299 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04430912 = queryNorm
0.19345059 = fieldWeight in 2587, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=2587)
0.6666667 = coord(2/3)
0.5 = coord(1/2)
- Abstract
- Purpose The purpose of this paper is to propose a method to have more accurate results in comparing performance of the paired information retrieval (IR) systems with reference to the current method, which is based on the mean effectiveness scores of the systems across a set of identified topics/queries. Design/methodology/approach Based on the proposed approach, instead of the classic method of using a set of topic scores, the documents level scores are considered as the evaluation unit. These document scores are the defined document's weight, which play the role of the mean average precision (MAP) score of the systems as a significance test's statics. The experiments were conducted using the TREC 9 Web track collection. Findings The p-values generated through the two types of significance tests, namely the Student's t-test and Mann-Whitney show that by using the document level scores as an evaluation unit, the difference between IR systems is more significant compared with utilizing topic scores. Originality/value Utilizing a suitable test collection is a primary prerequisite for IR systems comparative evaluation. However, in addition to reusable test collections, having an accurate statistical testing is a necessity for these evaluations. The findings of this study will assist IR researchers to evaluate their retrieval systems and algorithms more accurately.
- Date
- 20. 1.2015 18:30:22
-
Strzalkowski, T.; Guthrie, L.; Karlgren, J.; Leistensnider, J.; Lin, F.; Perez-Carballo, J.; Straszheim, T.; Wang, J.; Wilding, J.: Natural language information retrieval : TREC-5 report (1997)
0.02
0.017907046 = product of:
0.03581409 = sum of:
0.03581409 = product of:
0.107442275 = sum of:
0.107442275 = weight(_text_:t in 3100) [ClassicSimilarity], result of:
0.107442275 = score(doc=3100,freq=4.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.6155326 = fieldWeight in 3100, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.078125 = fieldNorm(doc=3100)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
TREC: experiment and evaluation in information retrieval (2005)
0.02
0.0160123 = product of:
0.0320246 = sum of:
0.0320246 = product of:
0.0480369 = sum of:
0.02904361 = weight(_text_:v in 636) [ClassicSimilarity], result of:
0.02904361 = score(doc=636,freq=2.0), product of:
0.21584865 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.04430912 = queryNorm
0.13455543 = fieldWeight in 636, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.01953125 = fieldNorm(doc=636)
0.01899329 = weight(_text_:t in 636) [ClassicSimilarity], result of:
0.01899329 = score(doc=636,freq=2.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.10881182 = fieldWeight in 636, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.01953125 = fieldNorm(doc=636)
0.6666667 = coord(2/3)
0.5 = coord(1/2)
- Content
- Enthält die Beiträge: 1. The Text REtrieval Conference - Ellen M. Voorhees and Donna K. Harman 2. The TREC Test Collections - Donna K. Harman 3. Retrieval System Evaluation - Chris Buckley and Ellen M. Voorhees 4. The TREC Ad Hoc Experiments - Donna K. Harman 5. Routing and Filtering - Stephen Robertson and Jamie Callan 6. The TREC Interactive Tracks: Putting the User into Search - Susan T. Dumais and Nicholas J. Belkin 7. Beyond English - Donna K. Harman 8. Retrieving Noisy Text - Ellen M. Voorhees and John S. Garofolo 9.The Very Large Collection and Web Tracks - David Hawking and Nick Craswell 10. Question Answering in TREC - Ellen M. Voorhees 11. The University of Massachusetts and a Dozen TRECs - James Allan, W. Bruce Croft and Jamie Callan 12. How Okapi Came to TREC - Stephen Robertson 13. The SMART Project at TREC - Chris Buckley 14. Ten Years of Ad Hoc Retrieval at TREC Using PIRCS - Kui-Lam Kwok 15. MultiText Experiments for TREC - Gordon V. Cormack, Charles L. A. Clarke, Christopher R. Palmer and Thomas R. Lynam 16. A Language-Modeling Approach to TREC - Djoerd Hiemstra and Wessel Kraaij 17. BM Research Activities at TREC - Eric W. Brown, David Carmel, Martin Franz, Abraham Ittycheriah, Tapas Kanungo, Yoelle Maarek, J. Scott McCarley, Robert L. Mack, John M. Prager, John R. Smith, Aya Soffer, Jason Y. Zien and Alan D. Marwick Epilogue: Metareflections on TREC - Karen Sparck Jones
-
Chen, H.; Dhar, V.: Cognitive process as a basis for intelligent retrieval system design (1991)
0.02
0.015489925 = product of:
0.03097985 = sum of:
0.03097985 = product of:
0.09293955 = sum of:
0.09293955 = weight(_text_:v in 3845) [ClassicSimilarity], result of:
0.09293955 = score(doc=3845,freq=2.0), product of:
0.21584865 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.04430912 = queryNorm
0.43057737 = fieldWeight in 3845, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0625 = fieldNorm(doc=3845)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Jochum, F.; Weissmann, V.: Struktur und Elemente des Information Retrieval Experiments (1985)
0.02
0.015489925 = product of:
0.03097985 = sum of:
0.03097985 = product of:
0.09293955 = sum of:
0.09293955 = weight(_text_:v in 114) [ClassicSimilarity], result of:
0.09293955 = score(doc=114,freq=2.0), product of:
0.21584865 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.04430912 = queryNorm
0.43057737 = fieldWeight in 114, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0625 = fieldNorm(doc=114)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Kaltenborn, K.-F.: Endnutzerrecherchen in der CD-ROM-Datenbank Medline : T.1: Evaluations- und Benutzerforschung über Nutzungscharakteristika, Bewertung der Rechercheergebnisse und künftige Informationsgewinnung; T.2: Evaluations- und Benutzerforschung über Recherchequalität und Nutzer-Computer/Datenbank-Interaktion (1991)
0.02
0.015194632 = product of:
0.030389264 = sum of:
0.030389264 = product of:
0.09116779 = sum of:
0.09116779 = weight(_text_:t in 5105) [ClassicSimilarity], result of:
0.09116779 = score(doc=5105,freq=8.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.5222967 = fieldWeight in 5105, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.046875 = fieldNorm(doc=5105)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Source
- Nachrichten für Dokumentation. 42(1991) H.2, S.107-114. (T.1); 42(1991) H.3, S.177-190 (T.2)
-
Davis, M.; Dunning, T.: ¬A TREC evaluation of query translation methods for multi-lingual text retrieval (1996)
0.02
0.015194632 = product of:
0.030389264 = sum of:
0.030389264 = product of:
0.09116779 = sum of:
0.09116779 = weight(_text_:t in 1917) [ClassicSimilarity], result of:
0.09116779 = score(doc=1917,freq=2.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.5222967 = fieldWeight in 1917, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.09375 = fieldNorm(doc=1917)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Strzalkowski, T.; Perez-Carballo, J.: Natural language information retrieval : TREC-4 report (1996)
0.02
0.015194632 = product of:
0.030389264 = sum of:
0.030389264 = product of:
0.09116779 = sum of:
0.09116779 = weight(_text_:t in 3211) [ClassicSimilarity], result of:
0.09116779 = score(doc=3211,freq=2.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.5222967 = fieldWeight in 3211, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.09375 = fieldNorm(doc=3211)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Strzalkowski, T.; Sparck Jones, K.: NLP track at TREC-5 (1997)
0.02
0.015194632 = product of:
0.030389264 = sum of:
0.030389264 = product of:
0.09116779 = sum of:
0.09116779 = weight(_text_:t in 3098) [ClassicSimilarity], result of:
0.09116779 = score(doc=3098,freq=2.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.5222967 = fieldWeight in 3098, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.09375 = fieldNorm(doc=3098)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Kuriyama, K.; Kando, N.; Nozue, T.; Eguchi, K.: Pooling for a large-scale test collection : an analysis of the search results from the First NTCIR Workshop (2002)
0.02
0.015194632 = product of:
0.030389264 = sum of:
0.030389264 = product of:
0.09116779 = sum of:
0.09116779 = weight(_text_:t in 3830) [ClassicSimilarity], result of:
0.09116779 = score(doc=3830,freq=2.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.5222967 = fieldWeight in 3830, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.09375 = fieldNorm(doc=3830)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Agata, T.: ¬A measure for evaluating search engines on the World Wide Web : retrieval test with ESL (Expected Search Length) (1997)
0.02
0.015194632 = product of:
0.030389264 = sum of:
0.030389264 = product of:
0.09116779 = sum of:
0.09116779 = weight(_text_:t in 3892) [ClassicSimilarity], result of:
0.09116779 = score(doc=3892,freq=2.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.5222967 = fieldWeight in 3892, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.09375 = fieldNorm(doc=3892)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Mandl, T.: Neue Entwicklungen bei den Evaluierungsinitiativen im Information Retrieval (2006)
0.01
0.014325636 = product of:
0.028651273 = sum of:
0.028651273 = product of:
0.08595382 = sum of:
0.08595382 = weight(_text_:t in 5975) [ClassicSimilarity], result of:
0.08595382 = score(doc=5975,freq=4.0), product of:
0.17455173 = queryWeight, product of:
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.04430912 = queryNorm
0.49242607 = fieldWeight in 5975, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.9394085 = idf(docFreq=2338, maxDocs=44218)
0.0625 = fieldNorm(doc=5975)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Source
- Effektive Information Retrieval Verfahren in Theorie und Praxis: ausgewählte und erweiterte Beiträge des Vierten Hildesheimer Evaluierungs- und Retrievalworkshop (HIER 2005), Hildesheim, 20.7.2005. Hrsg.: T. Mandl u. C. Womser-Hacker
-
Fuhr, N.; Niewelt, B.: ¬Ein Retrievaltest mit automatisch indexierten Dokumenten (1984)
0.01
0.014007639 = product of:
0.028015278 = sum of:
0.028015278 = product of:
0.084045835 = sum of:
0.084045835 = weight(_text_:22 in 262) [ClassicSimilarity], result of:
0.084045835 = score(doc=262,freq=2.0), product of:
0.15516299 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04430912 = queryNorm
0.5416616 = fieldWeight in 262, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=262)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Date
- 20.10.2000 12:22:23
-
Tomaiuolo, N.G.; Parker, J.: Maximizing relevant retrieval : keyword and natural language searching (1998)
0.01
0.014007639 = product of:
0.028015278 = sum of:
0.028015278 = product of:
0.084045835 = sum of:
0.084045835 = weight(_text_:22 in 6418) [ClassicSimilarity], result of:
0.084045835 = score(doc=6418,freq=2.0), product of:
0.15516299 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04430912 = queryNorm
0.5416616 = fieldWeight in 6418, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6418)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Source
- Online. 22(1998) no.6, S.57-58
-
Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000)
0.01
0.014007639 = product of:
0.028015278 = sum of:
0.028015278 = product of:
0.084045835 = sum of:
0.084045835 = weight(_text_:22 in 6438) [ClassicSimilarity], result of:
0.084045835 = score(doc=6438,freq=2.0), product of:
0.15516299 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04430912 = queryNorm
0.5416616 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Date
- 11. 8.2001 16:22:19
-
Dalrymple, P.W.: Retrieval by reformulation in two library catalogs : toward a cognitive model of searching behavior (1990)
0.01
0.014007639 = product of:
0.028015278 = sum of:
0.028015278 = product of:
0.084045835 = sum of:
0.084045835 = weight(_text_:22 in 5089) [ClassicSimilarity], result of:
0.084045835 = score(doc=5089,freq=2.0), product of:
0.15516299 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04430912 = queryNorm
0.5416616 = fieldWeight in 5089, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=5089)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Date
- 22. 7.2006 18:43:54
-
Della Mea, V.; Mizzaro, S.: Measuring retrieval effectiveness : a new proposal and a first experimental validation (2004)
0.01
0.013553685 = product of:
0.02710737 = sum of:
0.02710737 = product of:
0.081322104 = sum of:
0.081322104 = weight(_text_:v in 2263) [ClassicSimilarity], result of:
0.081322104 = score(doc=2263,freq=2.0), product of:
0.21584865 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.04430912 = queryNorm
0.3767552 = fieldWeight in 2263, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0546875 = fieldNorm(doc=2263)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
