-
Sparck Jones, K.: Reflections on TREC : TREC-2 (1995)
0.04
0.03726713 = product of:
0.07453426 = sum of:
0.07453426 = product of:
0.14906852 = sum of:
0.14906852 = weight(_text_:light in 1916) [ClassicSimilarity], result of:
0.14906852 = score(doc=1916,freq=2.0), product of:
0.2920221 = queryWeight, product of:
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.050563898 = queryNorm
0.51047 = fieldWeight in 1916, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.0625 = fieldNorm(doc=1916)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Discusses the TREC programme as a major enterprise in information retrieval research. It reviews its structure as an evaluation exercise, characterises the methods of indexing and retrieval being tested within it in terms of the approaches to system performance factors these represent; analyses the test results for solid, overall conclusions that can be drawn from them; and, in the light of the particular features of the test data, assesses TREC both for generally applicable findings that emerge from it and for directions it offers for future research
-
Shenouda, W.: Online bibliographic searching : how end-users modify their search strategies (1990)
0.03
0.03260874 = product of:
0.06521748 = sum of:
0.06521748 = product of:
0.13043496 = sum of:
0.13043496 = weight(_text_:light in 4895) [ClassicSimilarity], result of:
0.13043496 = score(doc=4895,freq=2.0), product of:
0.2920221 = queryWeight, product of:
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.050563898 = queryNorm
0.44666123 = fieldWeight in 4895, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.0546875 = fieldNorm(doc=4895)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- The study attempted to idendify how end-users modify their initial search strategies in the light of new information presented during their interaction with an online bibliographic information retrieval system in a real environment. This exploratory study was also conducted to determine the effectiveness of the changes, made by users during the online process, in retrieving relevant documents. Analysis of this data shows that all end-users modify their searches during the online process. Results indicate that certain changes were made more frequently than others. Changes affecting relevance and characteristics of end-users' online search behaviour were also identified
-
Qiu, L.: Analytical searching vs. browsing in hypertext information retrieval systems (1993)
0.03
0.03260874 = product of:
0.06521748 = sum of:
0.06521748 = product of:
0.13043496 = sum of:
0.13043496 = weight(_text_:light in 7416) [ClassicSimilarity], result of:
0.13043496 = score(doc=7416,freq=2.0), product of:
0.2920221 = queryWeight, product of:
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.050563898 = queryNorm
0.44666123 = fieldWeight in 7416, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.0546875 = fieldNorm(doc=7416)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Reports an experiment conducted to study search behaviour of different user groups in a hypertext information retrieval system. A three-way analysis of variance test was conducted to study the effects of gender, search task, and search experience on search option (analytical searching versus browsing), as measured by the proportion of nodes reached through analytical searching. The search task factor influenced search option in that a general task caused more browsing and specific task more analytical searching. Gender or search experience alone did not affect the search option. These findings are discussed in light of evaluation of existing systems and implications for future design
-
Sparck Jones, K.; Rijsbergen, C.J. van: Progress in documentation : Information retrieval test collection (1976)
0.03
0.03260874 = product of:
0.06521748 = sum of:
0.06521748 = product of:
0.13043496 = sum of:
0.13043496 = weight(_text_:light in 4161) [ClassicSimilarity], result of:
0.13043496 = score(doc=4161,freq=2.0), product of:
0.2920221 = queryWeight, product of:
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.050563898 = queryNorm
0.44666123 = fieldWeight in 4161, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.0546875 = fieldNorm(doc=4161)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Many retrieval experiments have been based on inadequate test collections, and current research is hampered by the lack of proper collections. This short review does not attempt a fully docuemted survey of all the collections used in the past decade: hopefully representative examples have been studied to throw light on the requriements test collections should meet, to show how past collections have been defective, and to suggest guidelines for a future "ideal" test collection. This specifications for this collection can be taken as an indirect comment on our present state of knowledge of major retrieval system variables, and experience in conducting experiments.
-
Harter, S.P.; Hert, C.A.: Evaluation of information retrieval systems : approaches, issues, and methods (1997)
0.03
0.03260874 = product of:
0.06521748 = sum of:
0.06521748 = product of:
0.13043496 = sum of:
0.13043496 = weight(_text_:light in 2264) [ClassicSimilarity], result of:
0.13043496 = score(doc=2264,freq=2.0), product of:
0.2920221 = queryWeight, product of:
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.050563898 = queryNorm
0.44666123 = fieldWeight in 2264, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.0546875 = fieldNorm(doc=2264)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- State of the art review of information retrieval systems, defined as systems retrieving documents a sopposed to numerical data. Explains the classic Cranfield studies that have served as a standard for retrieval testing since the 1960s and discusses the Cranfield model and its relevance based measures of retrieval effectiveness. Details sosme of the problems with the Cranfield instruments and issues of validity and reliability, generalizability, usefulness and basic concepts. Discusses the evaluation of the Internet search engines in light of the Cranfield model, noting the very real differences between batch systems (Cranfield) and interactive systems (Internet). Because the Internet collection is not fixed, it is impossible to determine recall as a measure of retrieval effectiveness. considers future directions in evaluating information retrieval systems
-
Sparck Jones, K.: Reflections on TREC (1997)
0.03
0.027950348 = product of:
0.055900697 = sum of:
0.055900697 = product of:
0.11180139 = sum of:
0.11180139 = weight(_text_:light in 580) [ClassicSimilarity], result of:
0.11180139 = score(doc=580,freq=2.0), product of:
0.2920221 = queryWeight, product of:
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.050563898 = queryNorm
0.3828525 = fieldWeight in 580, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.046875 = fieldNorm(doc=580)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- This paper discusses the Text REtrieval Conferences (TREC) programme as a major enterprise in information retrieval research. It reviews its structure as an evaluation exercise, characterises the methods of indexing and retrieval being tested within its terms of the approaches to system performance factors these represent; analyses the test results for solid, overall conclusions that can be drawn from them; and, in the light of the particular features of the test data, assesses TREC both for generally applicable findings that emerge from it and for directions it offers for future research
-
Landoni, M.; Bell, S.: Information retrieval techniques for evaluating search engines : a critical overview (2000)
0.03
0.027950348 = product of:
0.055900697 = sum of:
0.055900697 = product of:
0.11180139 = sum of:
0.11180139 = weight(_text_:light in 716) [ClassicSimilarity], result of:
0.11180139 = score(doc=716,freq=2.0), product of:
0.2920221 = queryWeight, product of:
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.050563898 = queryNorm
0.3828525 = fieldWeight in 716, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.046875 = fieldNorm(doc=716)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- The objective of this paper is to highlight the importance of a scientifically sounded approach to search engine evaluation. Nowadays there is a flourishing literature which describes various attempts at conducting such evaluation by following all sort of approaches, but very often only the final results are published with little, if any, information about the methodology and the procedures adopted. These various experiments have been critically investigated and catalogued according to their scientific foundation by Bell [1] in the attempt to provide a valuable framework for future studies in this area. This paper reconsiders some of Bell's ideas in the light of the crisis of classic evaluation techniques for information retrieval and tries to envisage some form of collaboration between the IR and web communities in order to design a better and more consistent platform for the evaluation of tools for interactive information retrieval.
-
Fuhr, N.; Niewelt, B.: ¬Ein Retrievaltest mit automatisch indexierten Dokumenten (1984)
0.02
0.023977486 = product of:
0.047954973 = sum of:
0.047954973 = product of:
0.095909946 = sum of:
0.095909946 = weight(_text_:22 in 262) [ClassicSimilarity], result of:
0.095909946 = score(doc=262,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.5416616 = fieldWeight in 262, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=262)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 20.10.2000 12:22:23
-
Tomaiuolo, N.G.; Parker, J.: Maximizing relevant retrieval : keyword and natural language searching (1998)
0.02
0.023977486 = product of:
0.047954973 = sum of:
0.047954973 = product of:
0.095909946 = sum of:
0.095909946 = weight(_text_:22 in 6418) [ClassicSimilarity], result of:
0.095909946 = score(doc=6418,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.5416616 = fieldWeight in 6418, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6418)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Online. 22(1998) no.6, S.57-58
-
Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000)
0.02
0.023977486 = product of:
0.047954973 = sum of:
0.047954973 = product of:
0.095909946 = sum of:
0.095909946 = weight(_text_:22 in 6438) [ClassicSimilarity], result of:
0.095909946 = score(doc=6438,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.5416616 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 11. 8.2001 16:22:19
-
Dalrymple, P.W.: Retrieval by reformulation in two library catalogs : toward a cognitive model of searching behavior (1990)
0.02
0.023977486 = product of:
0.047954973 = sum of:
0.047954973 = product of:
0.095909946 = sum of:
0.095909946 = weight(_text_:22 in 5089) [ClassicSimilarity], result of:
0.095909946 = score(doc=5089,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.5416616 = fieldWeight in 5089, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=5089)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 22. 7.2006 18:43:54
-
Radev, D.R.; Libner, K.; Fan, W.: Getting answers to natural language questions on the Web (2002)
0.02
0.023291955 = product of:
0.04658391 = sum of:
0.04658391 = product of:
0.09316782 = sum of:
0.09316782 = weight(_text_:light in 5204) [ClassicSimilarity], result of:
0.09316782 = score(doc=5204,freq=2.0), product of:
0.2920221 = queryWeight, product of:
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.050563898 = queryNorm
0.31904373 = fieldWeight in 5204, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.7753086 = idf(docFreq=372, maxDocs=44218)
0.0390625 = fieldNorm(doc=5204)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Seven hundred natural language questions from TREC-8 and TREC-9 were sent by Radev, Libner, and Fan to each of nine web search engines. The top 40 sites returned by each system were stored for evaluation of their productivity of correct answers. Each question per engine was scored as the sum of the reciprocal ranks of identified correct answers. The large number of zero scores gave a positive skew violating the normality assumption for ANOVA, so values were transformed to zero for no hit and one for one or more hits. The non-zero values were then square-root transformed to remove the remaining positive skew. Interactions were observed between search engine and answer type (name, place, date, et cetera), search engine and number of proper nouns in the query, search engine and the need for time limitation, and search engine and total query words. All effects were significant. Shortest queries had the highest mean scores. One or more proper nouns present provides a significant advantage. Non-time dependent queries have an advantage. Place, name, person, and text description had mean scores between .85 and .9 with date at .81 and number at .59. There were significant differences in score by search engine. Search engines found at least one correct answer in between 87.7 and 75.45 of the cases. Google and Northern Light were just short of a 90% hit rate. No evidence indicated that a particular engine was better at answering any particular sort of question.
-
Allan, J.; Callan, J.P.; Croft, W.B.; Ballesteros, L.; Broglio, J.; Xu, J.; Shu, H.: INQUERY at TREC-5 (1997)
0.02
0.017126776 = product of:
0.034253553 = sum of:
0.034253553 = product of:
0.068507105 = sum of:
0.068507105 = weight(_text_:22 in 3103) [ClassicSimilarity], result of:
0.068507105 = score(doc=3103,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.38690117 = fieldWeight in 3103, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3103)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 27. 2.1999 20:55:22
-
Ng, K.B.; Loewenstern, D.; Basu, C.; Hirsh, H.; Kantor, P.B.: Data fusion of machine-learning methods for the TREC5 routing tak (and other work) (1997)
0.02
0.017126776 = product of:
0.034253553 = sum of:
0.034253553 = product of:
0.068507105 = sum of:
0.068507105 = weight(_text_:22 in 3107) [ClassicSimilarity], result of:
0.068507105 = score(doc=3107,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.38690117 = fieldWeight in 3107, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3107)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 27. 2.1999 20:59:22
-
Saracevic, T.: On a method for studying the structure and nature of requests in information retrieval (1983)
0.02
0.017126776 = product of:
0.034253553 = sum of:
0.034253553 = product of:
0.068507105 = sum of:
0.068507105 = weight(_text_:22 in 2417) [ClassicSimilarity], result of:
0.068507105 = score(doc=2417,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.38690117 = fieldWeight in 2417, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=2417)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Pages
- S.22-25
-
Rijsbergen, C.J. van: ¬A test for the separation of relevant and non-relevant documents in experimental retrieval collections (1973)
0.01
0.013701421 = product of:
0.027402842 = sum of:
0.027402842 = product of:
0.054805685 = sum of:
0.054805685 = weight(_text_:22 in 5002) [ClassicSimilarity], result of:
0.054805685 = score(doc=5002,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.30952093 = fieldWeight in 5002, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=5002)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 19. 3.1996 11:22:12
-
Sanderson, M.: ¬The Reuters test collection (1996)
0.01
0.013701421 = product of:
0.027402842 = sum of:
0.027402842 = product of:
0.054805685 = sum of:
0.054805685 = weight(_text_:22 in 6971) [ClassicSimilarity], result of:
0.054805685 = score(doc=6971,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.30952093 = fieldWeight in 6971, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=6971)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Information retrieval: new systems and current research. Proceedings of the 16th Research Colloquium of the British Computer Society Information Retrieval Specialist Group, Drymen, Scotland, 22-23 Mar 94. Ed.: R. Leon
-
Lespinasse, K.: TREC: une conference pour l'evaluation des systemes de recherche d'information (1997)
0.01
0.013701421 = product of:
0.027402842 = sum of:
0.027402842 = product of:
0.054805685 = sum of:
0.054805685 = weight(_text_:22 in 744) [ClassicSimilarity], result of:
0.054805685 = score(doc=744,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.30952093 = fieldWeight in 744, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=744)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 1. 8.1996 22:01:00
-
¬The Fifth Text Retrieval Conference (TREC-5) (1997)
0.01
0.013701421 = product of:
0.027402842 = sum of:
0.027402842 = product of:
0.054805685 = sum of:
0.054805685 = weight(_text_:22 in 3087) [ClassicSimilarity], result of:
0.054805685 = score(doc=3087,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.30952093 = fieldWeight in 3087, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=3087)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Proceedings of the 5th TREC-confrerence held in Gaithersburgh, Maryland, Nov 20-22, 1996. Aim of the conference was discussion on retrieval techniques for large test collections. Different research groups used different techniques, such as automated thesauri, term weighting, natural language techniques, relevance feedback and advanced pattern matching, for information retrieval from the same large database. This procedure makes it possible to compare the results. The proceedings include papers, tables of the system results, and brief system descriptions including timing and storage information
-
Pemberton, J.K.; Ojala, M.; Garman, N.: Head to head : searching the Web versus traditional services (1998)
0.01
0.013701421 = product of:
0.027402842 = sum of:
0.027402842 = product of:
0.054805685 = sum of:
0.054805685 = weight(_text_:22 in 3572) [ClassicSimilarity], result of:
0.054805685 = score(doc=3572,freq=2.0), product of:
0.17706616 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050563898 = queryNorm
0.30952093 = fieldWeight in 3572, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=3572)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Online. 22(1998) no.3, S.24-26,28
