-
Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track (2011)
0.07
0.07203211 = product of:
0.14406422 = sum of:
0.14406422 = sum of:
0.11008652 = weight(_text_:memory in 4540) [ClassicSimilarity], result of:
0.11008652 = score(doc=4540,freq=2.0), product of:
0.31615055 = queryWeight, product of:
6.30326 = idf(docFreq=219, maxDocs=44218)
0.050156675 = queryNorm
0.34820917 = fieldWeight in 4540, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
6.30326 = idf(docFreq=219, maxDocs=44218)
0.0390625 = fieldNorm(doc=4540)
0.033977687 = weight(_text_:22 in 4540) [ClassicSimilarity], result of:
0.033977687 = score(doc=4540,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.19345059 = fieldWeight in 4540, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=4540)
0.5 = coord(1/2)
- Abstract
- Purpose - This study intends to identify factors that affect relevance judgment of retrieved information as part of the 2007 TREC Legal track interactive task. Design/methodology/approach - Data were gathered and analyzed from the participants of the 2007 TREC Legal track interactive task using a questionnaire which includes not only a list of 80 relevance factors identified in prior research, but also a space for expressing their thoughts on relevance judgment in the process. Findings - This study finds that topicality remains a primary criterion, out of various options, for determining relevance, while specificity of the search request, task, or retrieved results also helps greatly in relevance judgment. Research limitations/implications - Relevance research should focus on the topicality and specificity of what is being evaluated as well as conducted in real environments. Practical implications - If multiple relevance factors are presented to assessors, the total number in a list should be below ten to take account of the limited processing capacity of human beings' short-term memory. Otherwise, the assessors might either completely ignore or inadequately consider some of the relevance factors when making judgment decisions. Originality/value - This study presents a method for reducing the artificiality of relevance research design, an apparent limitation in many related studies. Specifically, relevance judgment was made in this research as part of the 2007 TREC Legal track interactive task rather than a study devised for the sake of it. The assessors also served as searchers so that their searching experience would facilitate their subsequent relevance judgments.
- Date
- 12. 7.2011 18:29:22
-
Newby, G.B.: Cognitive space and information space (2001)
0.05
0.046705756 = product of:
0.09341151 = sum of:
0.09341151 = product of:
0.18682303 = sum of:
0.18682303 = weight(_text_:memory in 6977) [ClassicSimilarity], result of:
0.18682303 = score(doc=6977,freq=4.0), product of:
0.31615055 = queryWeight, product of:
6.30326 = idf(docFreq=219, maxDocs=44218)
0.050156675 = queryNorm
0.5909306 = fieldWeight in 6977, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
6.30326 = idf(docFreq=219, maxDocs=44218)
0.046875 = fieldNorm(doc=6977)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- This article works towards realization of exosomatic memory for information systems. In exosomatic memory systems, the information spaces of systems will be consistent with the cognitive spaces of their human users. A method for measuring concept relations in human cognitive space is presented: the paired comparison survey with Principal Components Analysis. A study to measure the cognitive spaces of 16 research participants is presented. Items measured include relations among seven TREC topic statements as well as 17 concepts from the topic statements. A method for automatically generating information spaces from document collections is presented that uses term cooccurrence, eigensystems analysis, and Principal Components Analysis. The extent of similarity between the cognitive spaces and the information spaces, which were derived independently from each other, is measured. A strong similarity between the information spaces and the cognitive spaces are found, indicating that the methods described may have good utility for working towards information systems that operate as exosomatic memories
-
Yerbury, H.; Parker, J.: Novice searchers' use of familiar structures in searching bibliographic information retrieval systems (1998)
0.03
0.033025958 = product of:
0.066051915 = sum of:
0.066051915 = product of:
0.13210383 = sum of:
0.13210383 = weight(_text_:memory in 2874) [ClassicSimilarity], result of:
0.13210383 = score(doc=2874,freq=2.0), product of:
0.31615055 = queryWeight, product of:
6.30326 = idf(docFreq=219, maxDocs=44218)
0.050156675 = queryNorm
0.41785103 = fieldWeight in 2874, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
6.30326 = idf(docFreq=219, maxDocs=44218)
0.046875 = fieldNorm(doc=2874)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Reports results of a study of the use of metaphors as problem solving mechanisms by novice searchers of bibliographic databases. Metaphors provide a framework or 'familiar structure' of credible associations within which relationships in other domains may be considered. 28 students taking an undergraduate course in information retrieval at Sydney University of Technology, were recorded as they 'talked through' a search on a bibliographic retrieval system. The transcripts were analyzed using conventional methods and the NUDIST software package for qualitative research. A range of metaphors was apparent from the language use by students in the search process. Those which predominated were: a journey; human interaction; a building or matching process; a problem solving process, and a search for a quantity. Many of the studentes experiencing the interaction as a problem solving process or a search for quantity perceived the outcomes as successful. Concludes that when memory for operating methods and procedures is incomplete an unconscious approach through the use of a conceptual system which is consonant with the task at hand may also lead to success in bibliographic searching
-
Fuhr, N.; Niewelt, B.: ¬Ein Retrievaltest mit automatisch indexierten Dokumenten (1984)
0.02
0.02378438 = product of:
0.04756876 = sum of:
0.04756876 = product of:
0.09513752 = sum of:
0.09513752 = weight(_text_:22 in 262) [ClassicSimilarity], result of:
0.09513752 = score(doc=262,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.5416616 = fieldWeight in 262, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=262)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 20.10.2000 12:22:23
-
Tomaiuolo, N.G.; Parker, J.: Maximizing relevant retrieval : keyword and natural language searching (1998)
0.02
0.02378438 = product of:
0.04756876 = sum of:
0.04756876 = product of:
0.09513752 = sum of:
0.09513752 = weight(_text_:22 in 6418) [ClassicSimilarity], result of:
0.09513752 = score(doc=6418,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.5416616 = fieldWeight in 6418, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6418)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Online. 22(1998) no.6, S.57-58
-
Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000)
0.02
0.02378438 = product of:
0.04756876 = sum of:
0.04756876 = product of:
0.09513752 = sum of:
0.09513752 = weight(_text_:22 in 6438) [ClassicSimilarity], result of:
0.09513752 = score(doc=6438,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.5416616 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 11. 8.2001 16:22:19
-
Dalrymple, P.W.: Retrieval by reformulation in two library catalogs : toward a cognitive model of searching behavior (1990)
0.02
0.02378438 = product of:
0.04756876 = sum of:
0.04756876 = product of:
0.09513752 = sum of:
0.09513752 = weight(_text_:22 in 5089) [ClassicSimilarity], result of:
0.09513752 = score(doc=5089,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.5416616 = fieldWeight in 5089, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=5089)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 22. 7.2006 18:43:54
-
Allan, J.; Callan, J.P.; Croft, W.B.; Ballesteros, L.; Broglio, J.; Xu, J.; Shu, H.: INQUERY at TREC-5 (1997)
0.02
0.016988844 = product of:
0.033977687 = sum of:
0.033977687 = product of:
0.067955375 = sum of:
0.067955375 = weight(_text_:22 in 3103) [ClassicSimilarity], result of:
0.067955375 = score(doc=3103,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.38690117 = fieldWeight in 3103, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3103)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 27. 2.1999 20:55:22
-
Ng, K.B.; Loewenstern, D.; Basu, C.; Hirsh, H.; Kantor, P.B.: Data fusion of machine-learning methods for the TREC5 routing tak (and other work) (1997)
0.02
0.016988844 = product of:
0.033977687 = sum of:
0.033977687 = product of:
0.067955375 = sum of:
0.067955375 = weight(_text_:22 in 3107) [ClassicSimilarity], result of:
0.067955375 = score(doc=3107,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.38690117 = fieldWeight in 3107, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3107)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 27. 2.1999 20:59:22
-
Saracevic, T.: On a method for studying the structure and nature of requests in information retrieval (1983)
0.02
0.016988844 = product of:
0.033977687 = sum of:
0.033977687 = product of:
0.067955375 = sum of:
0.067955375 = weight(_text_:22 in 2417) [ClassicSimilarity], result of:
0.067955375 = score(doc=2417,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.38690117 = fieldWeight in 2417, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=2417)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Pages
- S.22-25
-
Rijsbergen, C.J. van: ¬A test for the separation of relevant and non-relevant documents in experimental retrieval collections (1973)
0.01
0.013591074 = product of:
0.027182149 = sum of:
0.027182149 = product of:
0.054364298 = sum of:
0.054364298 = weight(_text_:22 in 5002) [ClassicSimilarity], result of:
0.054364298 = score(doc=5002,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.30952093 = fieldWeight in 5002, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=5002)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 19. 3.1996 11:22:12
-
Sanderson, M.: ¬The Reuters test collection (1996)
0.01
0.013591074 = product of:
0.027182149 = sum of:
0.027182149 = product of:
0.054364298 = sum of:
0.054364298 = weight(_text_:22 in 6971) [ClassicSimilarity], result of:
0.054364298 = score(doc=6971,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.30952093 = fieldWeight in 6971, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=6971)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Information retrieval: new systems and current research. Proceedings of the 16th Research Colloquium of the British Computer Society Information Retrieval Specialist Group, Drymen, Scotland, 22-23 Mar 94. Ed.: R. Leon
-
Lespinasse, K.: TREC: une conference pour l'evaluation des systemes de recherche d'information (1997)
0.01
0.013591074 = product of:
0.027182149 = sum of:
0.027182149 = product of:
0.054364298 = sum of:
0.054364298 = weight(_text_:22 in 744) [ClassicSimilarity], result of:
0.054364298 = score(doc=744,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.30952093 = fieldWeight in 744, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=744)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 1. 8.1996 22:01:00
-
¬The Fifth Text Retrieval Conference (TREC-5) (1997)
0.01
0.013591074 = product of:
0.027182149 = sum of:
0.027182149 = product of:
0.054364298 = sum of:
0.054364298 = weight(_text_:22 in 3087) [ClassicSimilarity], result of:
0.054364298 = score(doc=3087,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.30952093 = fieldWeight in 3087, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=3087)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Proceedings of the 5th TREC-confrerence held in Gaithersburgh, Maryland, Nov 20-22, 1996. Aim of the conference was discussion on retrieval techniques for large test collections. Different research groups used different techniques, such as automated thesauri, term weighting, natural language techniques, relevance feedback and advanced pattern matching, for information retrieval from the same large database. This procedure makes it possible to compare the results. The proceedings include papers, tables of the system results, and brief system descriptions including timing and storage information
-
Pemberton, J.K.; Ojala, M.; Garman, N.: Head to head : searching the Web versus traditional services (1998)
0.01
0.013591074 = product of:
0.027182149 = sum of:
0.027182149 = product of:
0.054364298 = sum of:
0.054364298 = weight(_text_:22 in 3572) [ClassicSimilarity], result of:
0.054364298 = score(doc=3572,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.30952093 = fieldWeight in 3572, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=3572)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Online. 22(1998) no.3, S.24-26,28
-
Dresel, R.; Hörnig, D.; Kaluza, H.; Peter, A.; Roßmann, A.; Sieber, W.: Evaluation deutscher Web-Suchwerkzeuge : Ein vergleichender Retrievaltest (2001)
0.01
0.013591074 = product of:
0.027182149 = sum of:
0.027182149 = product of:
0.054364298 = sum of:
0.054364298 = weight(_text_:22 in 261) [ClassicSimilarity], result of:
0.054364298 = score(doc=261,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.30952093 = fieldWeight in 261, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=261)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Die deutschen Suchmaschinen, Abacho, Acoon, Fireball und Lycos sowie die Web-Kataloge Web.de und Yahoo! werden einem Qualitätstest nach relativem Recall, Precision und Availability unterzogen. Die Methoden der Retrievaltests werden vorgestellt. Im Durchschnitt werden bei einem Cut-Off-Wert von 25 ein Recall von rund 22%, eine Precision von knapp 19% und eine Verfügbarkeit von 24% erreicht
-
Ellis, D.: Progress and problems in information retrieval (1996)
0.01
0.013591074 = product of:
0.027182149 = sum of:
0.027182149 = product of:
0.054364298 = sum of:
0.054364298 = weight(_text_:22 in 789) [ClassicSimilarity], result of:
0.054364298 = score(doc=789,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.30952093 = fieldWeight in 789, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=789)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Date
- 26. 7.2002 20:22:46
-
¬The Eleventh Text Retrieval Conference, TREC 2002 (2003)
0.01
0.013591074 = product of:
0.027182149 = sum of:
0.027182149 = product of:
0.054364298 = sum of:
0.054364298 = weight(_text_:22 in 4049) [ClassicSimilarity], result of:
0.054364298 = score(doc=4049,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.30952093 = fieldWeight in 4049, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=4049)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- Proceedings of the llth TREC-conference held in Gaithersburg, Maryland (USA), November 19-22, 2002. Aim of the conference was discussion an retrieval and related information-seeking tasks for large test collection. 93 research groups used different techniques, for information retrieval from the same large database. This procedure makes it possible to compare the results. The tasks are: Cross-language searching, filtering, interactive searching, searching for novelty, question answering, searching for video shots, and Web searching.
-
Blagden, J.F.: How much noise in a role-free and link-free co-ordinate indexing system? (1966)
0.01
0.01189219 = product of:
0.02378438 = sum of:
0.02378438 = product of:
0.04756876 = sum of:
0.04756876 = weight(_text_:22 in 2718) [ClassicSimilarity], result of:
0.04756876 = score(doc=2718,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.2708308 = fieldWeight in 2718, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=2718)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Source
- Journal of documentation. 22(1966), S.203-209
-
Smithson, S.: Information retrieval evaluation in practice : a case study approach (1994)
0.01
0.01189219 = product of:
0.02378438 = sum of:
0.02378438 = product of:
0.04756876 = sum of:
0.04756876 = weight(_text_:22 in 7302) [ClassicSimilarity], result of:
0.04756876 = score(doc=7302,freq=2.0), product of:
0.17564014 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.050156675 = queryNorm
0.2708308 = fieldWeight in 7302, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=7302)
0.5 = coord(1/2)
0.5 = coord(1/2)
- Abstract
- The evaluation of information retrieval systems is an important yet difficult operation. This paper describes an exploratory evaluation study that takes an interpretive approach to evaluation. The longitudinal study examines evaluation through the information-seeking behaviour of 22 case studies of 'real' users. The eclectic approach to data collection produced behavioral data that is compared with relevance judgements and satisfaction ratings. The study demonstrates considerable variations among the cases, among different evaluation measures within the same case, and among the same measures at different stages within a single case. It is argued that those involved in evaluation should be aware of the difficulties, and base any evaluation on a good understanding of the cases in question
