-
Rajagopal, P.; Ravana, S.D.; Koh, Y.S.; Balakrishnan, V.: Evaluating the effectiveness of information retrieval systems using effort-based relevance judgment (2019)
0.03
0.029396638 = product of:
0.058793277 = sum of:
0.058793277 = product of:
0.088189915 = sum of:
0.05814413 = weight(_text_:v in 5287) [ClassicSimilarity], result of:
0.05814413 = score(doc=5287,freq=2.0), product of:
0.21606015 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044352535 = queryNorm
0.26911086 = fieldWeight in 5287, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0390625 = fieldNorm(doc=5287)
0.030045783 = weight(_text_:22 in 5287) [ClassicSimilarity], result of:
0.030045783 = score(doc=5287,freq=2.0), product of:
0.15531503 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044352535 = queryNorm
0.19345059 = fieldWeight in 5287, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=5287)
0.6666667 = coord(2/3)
0.5 = coord(1/2)
- Date
- 20. 1.2015 18:30:22
-
TREC: experiment and evaluation in information retrieval (2005)
0.02
0.018077385 = product of:
0.03615477 = sum of:
0.03615477 = product of:
0.05423215 = sum of:
0.025160085 = weight(_text_:w in 636) [ClassicSimilarity], result of:
0.025160085 = score(doc=636,freq=4.0), product of:
0.1690189 = queryWeight, product of:
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.044352535 = queryNorm
0.1488596 = fieldWeight in 636, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.01953125 = fieldNorm(doc=636)
0.029072065 = weight(_text_:v in 636) [ClassicSimilarity], result of:
0.029072065 = score(doc=636,freq=2.0), product of:
0.21606015 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044352535 = queryNorm
0.13455543 = fieldWeight in 636, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.01953125 = fieldNorm(doc=636)
0.6666667 = coord(2/3)
0.5 = coord(1/2)
- Content
- Enthält die Beiträge: 1. The Text REtrieval Conference - Ellen M. Voorhees and Donna K. Harman 2. The TREC Test Collections - Donna K. Harman 3. Retrieval System Evaluation - Chris Buckley and Ellen M. Voorhees 4. The TREC Ad Hoc Experiments - Donna K. Harman 5. Routing and Filtering - Stephen Robertson and Jamie Callan 6. The TREC Interactive Tracks: Putting the User into Search - Susan T. Dumais and Nicholas J. Belkin 7. Beyond English - Donna K. Harman 8. Retrieving Noisy Text - Ellen M. Voorhees and John S. Garofolo 9.The Very Large Collection and Web Tracks - David Hawking and Nick Craswell 10. Question Answering in TREC - Ellen M. Voorhees 11. The University of Massachusetts and a Dozen TRECs - James Allan, W. Bruce Croft and Jamie Callan 12. How Okapi Came to TREC - Stephen Robertson 13. The SMART Project at TREC - Chris Buckley 14. Ten Years of Ad Hoc Retrieval at TREC Using PIRCS - Kui-Lam Kwok 15. MultiText Experiments for TREC - Gordon V. Cormack, Charles L. A. Clarke, Christopher R. Palmer and Thomas R. Lynam 16. A Language-Modeling Approach to TREC - Djoerd Hiemstra and Wessel Kraaij 17. BM Research Activities at TREC - Eric W. Brown, David Carmel, Martin Franz, Abraham Ittycheriah, Tapas Kanungo, Yoelle Maarek, J. Scott McCarley, Robert L. Mack, John M. Prager, John R. Smith, Aya Soffer, Jason Y. Zien and Alan D. Marwick Epilogue: Metareflections on TREC - Karen Sparck Jones
-
Fan, W.; Luo, M.; Wang, L.; Xi, W.; Fox, E.A.: Tuning before feedback : combining ranking discovery and blind feedback for robust retrieval (2004)
0.02
0.016773392 = product of:
0.033546783 = sum of:
0.033546783 = product of:
0.10064034 = sum of:
0.10064034 = weight(_text_:w in 4052) [ClassicSimilarity], result of:
0.10064034 = score(doc=4052,freq=4.0), product of:
0.1690189 = queryWeight, product of:
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.044352535 = queryNorm
0.5954384 = fieldWeight in 4052, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.078125 = fieldNorm(doc=4052)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Chen, H.; Dhar, V.: Cognitive process as a basis for intelligent retrieval system design (1991)
0.02
0.0155051015 = product of:
0.031010203 = sum of:
0.031010203 = product of:
0.09303061 = sum of:
0.09303061 = weight(_text_:v in 3845) [ClassicSimilarity], result of:
0.09303061 = score(doc=3845,freq=2.0), product of:
0.21606015 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044352535 = queryNorm
0.43057737 = fieldWeight in 3845, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0625 = fieldNorm(doc=3845)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Lai, K.F.; Ngo, C.-W.: Experiments on routing, filtering and Chinese text retrieval in TREC-5 (1997)
0.01
0.014232693 = product of:
0.028465386 = sum of:
0.028465386 = product of:
0.085396156 = sum of:
0.085396156 = weight(_text_:w in 3092) [ClassicSimilarity], result of:
0.085396156 = score(doc=3092,freq=2.0), product of:
0.1690189 = queryWeight, product of:
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.044352535 = queryNorm
0.5052462 = fieldWeight in 3092, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.09375 = fieldNorm(doc=3092)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Hiemstra, D.; Kraaij, W.: ¬A language-modeling approach to TREC (2005)
0.01
0.014232693 = product of:
0.028465386 = sum of:
0.028465386 = product of:
0.085396156 = sum of:
0.085396156 = weight(_text_:w in 5091) [ClassicSimilarity], result of:
0.085396156 = score(doc=5091,freq=2.0), product of:
0.1690189 = queryWeight, product of:
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.044352535 = queryNorm
0.5052462 = fieldWeight in 5091, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.09375 = fieldNorm(doc=5091)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Tomaiuolo, N.G.; Parker, J.: Maximizing relevant retrieval : keyword and natural language searching (1998)
0.01
0.014021365 = product of:
0.02804273 = sum of:
0.02804273 = product of:
0.084128186 = sum of:
0.084128186 = weight(_text_:22 in 6418) [ClassicSimilarity], result of:
0.084128186 = score(doc=6418,freq=2.0), product of:
0.15531503 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044352535 = queryNorm
0.5416616 = fieldWeight in 6418, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6418)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Source
- Online. 22(1998) no.6, S.57-58
-
Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000)
0.01
0.014021365 = product of:
0.02804273 = sum of:
0.02804273 = product of:
0.084128186 = sum of:
0.084128186 = weight(_text_:22 in 6438) [ClassicSimilarity], result of:
0.084128186 = score(doc=6438,freq=2.0), product of:
0.15531503 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044352535 = queryNorm
0.5416616 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Date
- 11. 8.2001 16:22:19
-
Dalrymple, P.W.: Retrieval by reformulation in two library catalogs : toward a cognitive model of searching behavior (1990)
0.01
0.014021365 = product of:
0.02804273 = sum of:
0.02804273 = product of:
0.084128186 = sum of:
0.084128186 = weight(_text_:22 in 5089) [ClassicSimilarity], result of:
0.084128186 = score(doc=5089,freq=2.0), product of:
0.15531503 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044352535 = queryNorm
0.5416616 = fieldWeight in 5089, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=5089)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Date
- 22. 7.2006 18:43:54
-
Della Mea, V.; Mizzaro, S.: Measuring retrieval effectiveness : a new proposal and a first experimental validation (2004)
0.01
0.013566965 = product of:
0.02713393 = sum of:
0.02713393 = product of:
0.08140179 = sum of:
0.08140179 = weight(_text_:v in 2263) [ClassicSimilarity], result of:
0.08140179 = score(doc=2263,freq=2.0), product of:
0.21606015 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044352535 = queryNorm
0.3767552 = fieldWeight in 2263, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0546875 = fieldNorm(doc=2263)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
López-Ostenero, F.; Peinado, V.; Gonzalo, J.; Verdejo, F.: Interactive question answering : Is Cross-Language harder than monolingual searching? (2008)
0.01
0.011628827 = product of:
0.023257654 = sum of:
0.023257654 = product of:
0.06977296 = sum of:
0.06977296 = weight(_text_:v in 2023) [ClassicSimilarity], result of:
0.06977296 = score(doc=2023,freq=2.0), product of:
0.21606015 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044352535 = queryNorm
0.32293302 = fieldWeight in 2023, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.046875 = fieldNorm(doc=2023)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Allan, J.; Callan, J.P.; Croft, W.B.; Ballesteros, L.; Broglio, J.; Xu, J.; Shu, H.: INQUERY at TREC-5 (1997)
0.01
0.010015261 = product of:
0.020030523 = sum of:
0.020030523 = product of:
0.060091566 = sum of:
0.060091566 = weight(_text_:22 in 3103) [ClassicSimilarity], result of:
0.060091566 = score(doc=3103,freq=2.0), product of:
0.15531503 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044352535 = queryNorm
0.38690117 = fieldWeight in 3103, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3103)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Date
- 27. 2.1999 20:55:22
-
Ng, K.B.; Loewenstern, D.; Basu, C.; Hirsh, H.; Kantor, P.B.: Data fusion of machine-learning methods for the TREC5 routing tak (and other work) (1997)
0.01
0.010015261 = product of:
0.020030523 = sum of:
0.020030523 = product of:
0.060091566 = sum of:
0.060091566 = weight(_text_:22 in 3107) [ClassicSimilarity], result of:
0.060091566 = score(doc=3107,freq=2.0), product of:
0.15531503 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044352535 = queryNorm
0.38690117 = fieldWeight in 3107, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3107)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Date
- 27. 2.1999 20:59:22
-
Saracevic, T.: On a method for studying the structure and nature of requests in information retrieval (1983)
0.01
0.010015261 = product of:
0.020030523 = sum of:
0.020030523 = product of:
0.060091566 = sum of:
0.060091566 = weight(_text_:22 in 2417) [ClassicSimilarity], result of:
0.060091566 = score(doc=2417,freq=2.0), product of:
0.15531503 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044352535 = queryNorm
0.38690117 = fieldWeight in 2417, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=2417)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Pages
- S.22-25
-
Angelini, M.; Fazzini, V.; Ferro, N.; Santucci, G.; Silvello, G.: CLAIRE: A combinatorial visual analytics system for information retrieval evaluation (2018)
0.01
0.009690689 = product of:
0.019381378 = sum of:
0.019381378 = product of:
0.05814413 = sum of:
0.05814413 = weight(_text_:v in 5049) [ClassicSimilarity], result of:
0.05814413 = score(doc=5049,freq=2.0), product of:
0.21606015 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044352535 = queryNorm
0.26911086 = fieldWeight in 5049, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0390625 = fieldNorm(doc=5049)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
White, H.D.: Relevance theory and distributions of judgments in document retrieval (2017)
0.01
0.009690689 = product of:
0.019381378 = sum of:
0.019381378 = product of:
0.05814413 = sum of:
0.05814413 = weight(_text_:v in 5099) [ClassicSimilarity], result of:
0.05814413 = score(doc=5099,freq=2.0), product of:
0.21606015 = queryWeight, product of:
4.871427 = idf(docFreq=920, maxDocs=44218)
0.044352535 = queryNorm
0.26911086 = fieldWeight in 5099, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.871427 = idf(docFreq=920, maxDocs=44218)
0.0390625 = fieldNorm(doc=5099)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Abstract
- This article extends relevance theory (RT) from linguistic pragmatics into information retrieval. Using more than 50 retrieval experiments from the literature as examples, it applies RT to explain the frequency distributions of documents on relevance scales with three or more points. The scale points, which judges in experiments must consider in addition to queries and documents, are communications from researchers. In RT, the relevance of a communication varies directly with its cognitive effects and inversely with the effort of processing it. Researchers define and/or label the scale points to measure the cognitive effects of documents on judges. However, they apparently assume that all scale points as presented are equally easy for judges to process. Yet the notion that points cost variable effort explains fairly well the frequency distributions of judgments across them. By hypothesis, points that cost more effort are chosen by judges less frequently. Effort varies with the vagueness or strictness of scale-point labels and definitions. It is shown that vague scales tend to produce U- or V-shaped distributions, while strict scales tend to produce right-skewed distributions. These results reinforce the paper's more general argument that RT clarifies the concept of relevance in the dialogues of retrieval evaluation.
-
Shenouda, W.: Online bibliographic searching : how end-users modify their search strategies (1990)
0.01
0.008302405 = product of:
0.01660481 = sum of:
0.01660481 = product of:
0.049814425 = sum of:
0.049814425 = weight(_text_:w in 4895) [ClassicSimilarity], result of:
0.049814425 = score(doc=4895,freq=2.0), product of:
0.1690189 = queryWeight, product of:
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.044352535 = queryNorm
0.29472697 = fieldWeight in 4895, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.0546875 = fieldNorm(doc=4895)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Drabenstott, K.M.; Weller, M.S.: ¬A comparative approach to system evaluation : delegating control of retrieval tests to an experimental online system (1996)
0.01
0.008302405 = product of:
0.01660481 = sum of:
0.01660481 = product of:
0.049814425 = sum of:
0.049814425 = weight(_text_:w in 7435) [ClassicSimilarity], result of:
0.049814425 = score(doc=7435,freq=2.0), product of:
0.1690189 = queryWeight, product of:
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.044352535 = queryNorm
0.29472697 = fieldWeight in 7435, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.0546875 = fieldNorm(doc=7435)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Abstract
- Describes the comparative approach to system evaluation used in this research project which delegated the administartion of an online retrieval test to an experimental online catalogue to produce data for evaluating the effectiveness of a new subject access design. Describes the methods enlisted to sort out problem test administration, e.g. to identify out-of-scope queries, incomplete system administration, and suspect post-search questionnaire responses. Covers how w the researchers handled problem search administrations and what actions they would use to reduce or eliminate the occurrence of such administrations in future online retrieval tests that delegate control of retrieval tests to online systems
-
Wan, T.-L.; Evens, M.; Wan, Y.-W.; Pao, Y.-Y.: Experiments with automatic indexing and a relational thesaurus in a Chinese information retrieval system (1997)
0.01
0.008302405 = product of:
0.01660481 = sum of:
0.01660481 = product of:
0.049814425 = sum of:
0.049814425 = weight(_text_:w in 956) [ClassicSimilarity], result of:
0.049814425 = score(doc=956,freq=2.0), product of:
0.1690189 = queryWeight, product of:
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.044352535 = queryNorm
0.29472697 = fieldWeight in 956, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8108058 = idf(docFreq=2659, maxDocs=44218)
0.0546875 = fieldNorm(doc=956)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Rijsbergen, C.J. van: ¬A test for the separation of relevant and non-relevant documents in experimental retrieval collections (1973)
0.01
0.008012209 = product of:
0.016024418 = sum of:
0.016024418 = product of:
0.04807325 = sum of:
0.04807325 = weight(_text_:22 in 5002) [ClassicSimilarity], result of:
0.04807325 = score(doc=5002,freq=2.0), product of:
0.15531503 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.044352535 = queryNorm
0.30952093 = fieldWeight in 5002, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=5002)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
- Date
- 19. 3.1996 11:22:12
