-
Smithson, S.: Information retrieval evaluation in practice : a case study approach (1994)
0.02
0.019313892 = product of:
0.11588335 = sum of:
0.1004296 = weight(_text_:205 in 7302) [ClassicSimilarity], result of:
0.1004296 = score(doc=7302,freq=2.0), product of:
0.2057144 = queryWeight, product of:
6.312392 = idf(docFreq=217, maxDocs=44218)
0.032588977 = queryNorm
0.48819917 = fieldWeight in 7302, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
6.312392 = idf(docFreq=217, maxDocs=44218)
0.0546875 = fieldNorm(doc=7302)
0.015453748 = product of:
0.030907497 = sum of:
0.030907497 = weight(_text_:22 in 7302) [ClassicSimilarity], result of:
0.030907497 = score(doc=7302,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.2708308 = fieldWeight in 7302, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=7302)
0.5 = coord(1/2)
0.16666667 = coord(2/12)
- Abstract
- The evaluation of information retrieval systems is an important yet difficult operation. This paper describes an exploratory evaluation study that takes an interpretive approach to evaluation. The longitudinal study examines evaluation through the information-seeking behaviour of 22 case studies of 'real' users. The eclectic approach to data collection produced behavioral data that is compared with relevance judgements and satisfaction ratings. The study demonstrates considerable variations among the cases, among different evaluation measures within the same case, and among the same measures at different stages within a single case. It is argued that those involved in evaluation should be aware of the difficulties, and base any evaluation on a good understanding of the cases in question
- Source
- Information processing and management. 30(1994) no.2, S.205-221
-
Frei, H.P.; Meienberg, S.; Schäuble, P.: ¬The perils of interpreting recall and precision values (1991)
0.01
0.006249511 = product of:
0.07499413 = sum of:
0.07499413 = weight(_text_:informatik in 786) [ClassicSimilarity], result of:
0.07499413 = score(doc=786,freq=2.0), product of:
0.1662844 = queryWeight, product of:
5.1024737 = idf(docFreq=730, maxDocs=44218)
0.032588977 = queryNorm
0.4509992 = fieldWeight in 786, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.1024737 = idf(docFreq=730, maxDocs=44218)
0.0625 = fieldNorm(doc=786)
0.083333336 = coord(1/12)
- Series
- Informatik-Fachberichte; 289
-
Wildemuth, B.M.; Jacob, E.K.; Fullington, A.;; Bliek, R. de; Friedman, C.P.: ¬A detailed analysis of end-user search behaviours (1991)
0.01
0.0059779524 = product of:
0.07173543 = sum of:
0.07173543 = weight(_text_:205 in 2423) [ClassicSimilarity], result of:
0.07173543 = score(doc=2423,freq=2.0), product of:
0.2057144 = queryWeight, product of:
6.312392 = idf(docFreq=217, maxDocs=44218)
0.032588977 = queryNorm
0.3487137 = fieldWeight in 2423, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
6.312392 = idf(docFreq=217, maxDocs=44218)
0.0390625 = fieldNorm(doc=2423)
0.083333336 = coord(1/12)
- Abstract
- Search statements in this revision process can be viewed as a 'move' in the overall search strategy. Very little is known about how end users develop and revise their search strategies. A study was conducted to analyse the moves made in 244 data base searches conducted by 26 medical students at the University of North Carolina at Chapel Hill. Students search INQUIRER, a data base of facts and concepts in microbiology. The searches were conducted during a 3-week period in spring 1990 and were recorded by the INQUIRER system. Each search statement was categorised, using Fidel's online searching moves (S. Online review 9(1985) S.61-74) and Bates' search tactics (s. JASIS 30(1979) S.205-214). Further analyses indicated that the most common moves were Browse/Specity, Select Exhaust, Intersect, and Vary, and that selection of moves varied by student and by problem. Analysis of search tactics (combinations of moves) identified 5 common search approaches. The results of this study have implcations for future research on search behaviours, for thedesign of system interfaces and data base structures, and for the training of end users
-
MacCall, S.L.; Cleveland, A.D.: ¬A relevance-based quantitative measure for Internet information retrieval evaluation (1999)
0.00
0.0035086013 = product of:
0.042103216 = sum of:
0.042103216 = weight(_text_:internet in 6689) [ClassicSimilarity], result of:
0.042103216 = score(doc=6689,freq=10.0), product of:
0.09621047 = queryWeight, product of:
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.032588977 = queryNorm
0.43761572 = fieldWeight in 6689, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.046875 = fieldNorm(doc=6689)
0.083333336 = coord(1/12)
- Abstract
- An important indicator of a maturating Internet is the development of metrics for its evaluation as a practical tool for enduser information retrieval. However, the Internet presents specific problems for traditional IR measures, such as the need to deal with the variety of classes of retrieval tools. This paper presents a metric for comparing the performance of common classes of Internet information retrieval tool, including human indexed catalogs of web resources and automatically indexed databases of web pages. The metric uses a relevance-based quantitative measure to compare the performance of endusers using these Internet information retrieval tools. The benefit of the proposed metric is that it is relevance-based (using enduser relevance judgments), and it facilitates the comparison of the performance of different classes of IIR tools
-
Harter, S.P.; Hert, C.A.: Evaluation of information retrieval systems : approaches, issues, and methods (1997)
0.00
0.0031707096 = product of:
0.038048513 = sum of:
0.038048513 = weight(_text_:internet in 2264) [ClassicSimilarity], result of:
0.038048513 = score(doc=2264,freq=6.0), product of:
0.09621047 = queryWeight, product of:
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.032588977 = queryNorm
0.39547163 = fieldWeight in 2264, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.0546875 = fieldNorm(doc=2264)
0.083333336 = coord(1/12)
- Abstract
- State of the art review of information retrieval systems, defined as systems retrieving documents a sopposed to numerical data. Explains the classic Cranfield studies that have served as a standard for retrieval testing since the 1960s and discusses the Cranfield model and its relevance based measures of retrieval effectiveness. Details sosme of the problems with the Cranfield instruments and issues of validity and reliability, generalizability, usefulness and basic concepts. Discusses the evaluation of the Internet search engines in light of the Cranfield model, noting the very real differences between batch systems (Cranfield) and interactive systems (Internet). Because the Internet collection is not fixed, it is impossible to determine recall as a measure of retrieval effectiveness. considers future directions in evaluating information retrieval systems
-
Davis, C.H.: From document retrieval to Web browsing : some universal concerns (1997)
0.00
0.0025888733 = product of:
0.03106648 = sum of:
0.03106648 = weight(_text_:internet in 399) [ClassicSimilarity], result of:
0.03106648 = score(doc=399,freq=4.0), product of:
0.09621047 = queryWeight, product of:
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.032588977 = queryNorm
0.32290122 = fieldWeight in 399, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.0546875 = fieldNorm(doc=399)
0.083333336 = coord(1/12)
- Abstract
- Computer based systems can produce enourmous retrieval sets even when good search logic is used. Sometimes this is desirable, more often it is not. Appropriate filters can limit search results, but they represent only a partial solution. Simple ranking techniques are needed that are both effective and easily understood by the humans doing the searching. Optimal search output, whether from a traditional database or the Internet, will result when intuitive interfaces are designed that inspire confidence while making the necessary mathematics transparent. Weighted term searching using powers of 2, a technique proposed early in the history of information retrieval, can be simplifies and used in combination with modern graphics and textual input to achieve these results
- Theme
- Internet
-
Tomaiuolo, N.G.; Parker, J.: Maximizing relevant retrieval : keyword and natural language searching (1998)
0.00
0.0025756247 = product of:
0.030907497 = sum of:
0.030907497 = product of:
0.061814994 = sum of:
0.061814994 = weight(_text_:22 in 6418) [ClassicSimilarity], result of:
0.061814994 = score(doc=6418,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.5416616 = fieldWeight in 6418, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6418)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Source
- Online. 22(1998) no.6, S.57-58
-
Dalrymple, P.W.: Retrieval by reformulation in two library catalogs : toward a cognitive model of searching behavior (1990)
0.00
0.0025756247 = product of:
0.030907497 = sum of:
0.030907497 = product of:
0.061814994 = sum of:
0.061814994 = weight(_text_:22 in 5089) [ClassicSimilarity], result of:
0.061814994 = score(doc=5089,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.5416616 = fieldWeight in 5089, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=5089)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Date
- 22. 7.2006 18:43:54
-
MacCall, S.L.; Cleveland, A.D.; Gibson, I.E.: Outline and preliminary evaluation of the classical digital library model (1999)
0.00
0.0022647926 = product of:
0.027177509 = sum of:
0.027177509 = weight(_text_:internet in 6541) [ClassicSimilarity], result of:
0.027177509 = score(doc=6541,freq=6.0), product of:
0.09621047 = queryWeight, product of:
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.032588977 = queryNorm
0.28247973 = fieldWeight in 6541, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.0390625 = fieldNorm(doc=6541)
0.083333336 = coord(1/12)
- Abstract
- The growing number of networked information resources and services offers unprecedented opportunities for delivering high quality information to the computer desktop of a wide range of individuals. However, currently there is a reliance on a database retrieval model, in which endusers use keywords to search large collections of automatically indexed resources in order to find needed information. As an alternative to the database retrieval model, this paper outlines the classical digital library model, which is derived from traditional practices of library and information science professionals. These practices include the selection and organization of information resources for local populations of users and the integration of advanced information retrieval tools, such as databases and the Internet into these collections. To evaluate this model, library and information professionals and endusers involved with primary care medicine were asked to respond to a series of questions comparing their experiences with a digital library developed for the primary care population to their experiences with general Internet use. Preliminary results are reported
- Theme
- Internet
-
Gilchrist, A.: Research and consultancy (1998)
0.00
0.0020921256 = product of:
0.025105506 = sum of:
0.025105506 = weight(_text_:internet in 1394) [ClassicSimilarity], result of:
0.025105506 = score(doc=1394,freq=2.0), product of:
0.09621047 = queryWeight, product of:
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.032588977 = queryNorm
0.2609436 = fieldWeight in 1394, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
2.9522398 = idf(docFreq=6276, maxDocs=44218)
0.0625 = fieldNorm(doc=1394)
0.083333336 = coord(1/12)
- Abstract
- State of the art review of literature published about research and consultancy in library and information science (LIS). Issues covered include: scope and definitions of what constitutes research and consultancy; funding of research and development; national LIS research and the funding agencies; electronic libraries; document delivery; multimedia document delivery; the Z39.50 standard for client server computer architecture, the Internet and WWW; electronic publishing; information retrieval; evaluation and evaluation techniques; the Text Retrieval Conferences (TREC); the user domain; management issues; decision support systems; information politics and organizational culture; and value for money issues
-
Allan, J.; Callan, J.P.; Croft, W.B.; Ballesteros, L.; Broglio, J.; Xu, J.; Shu, H.: INQUERY at TREC-5 (1997)
0.00
0.001839732 = product of:
0.022076784 = sum of:
0.022076784 = product of:
0.044153567 = sum of:
0.044153567 = weight(_text_:22 in 3103) [ClassicSimilarity], result of:
0.044153567 = score(doc=3103,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.38690117 = fieldWeight in 3103, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3103)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Date
- 27. 2.1999 20:55:22
-
Ng, K.B.; Loewenstern, D.; Basu, C.; Hirsh, H.; Kantor, P.B.: Data fusion of machine-learning methods for the TREC5 routing tak (and other work) (1997)
0.00
0.001839732 = product of:
0.022076784 = sum of:
0.022076784 = product of:
0.044153567 = sum of:
0.044153567 = weight(_text_:22 in 3107) [ClassicSimilarity], result of:
0.044153567 = score(doc=3107,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.38690117 = fieldWeight in 3107, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.078125 = fieldNorm(doc=3107)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Date
- 27. 2.1999 20:59:22
-
Sanderson, M.: ¬The Reuters test collection (1996)
0.00
0.0014717856 = product of:
0.017661426 = sum of:
0.017661426 = product of:
0.035322852 = sum of:
0.035322852 = weight(_text_:22 in 6971) [ClassicSimilarity], result of:
0.035322852 = score(doc=6971,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.30952093 = fieldWeight in 6971, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=6971)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Source
- Information retrieval: new systems and current research. Proceedings of the 16th Research Colloquium of the British Computer Society Information Retrieval Specialist Group, Drymen, Scotland, 22-23 Mar 94. Ed.: R. Leon
-
¬The Fifth Text Retrieval Conference (TREC-5) (1997)
0.00
0.0014717856 = product of:
0.017661426 = sum of:
0.017661426 = product of:
0.035322852 = sum of:
0.035322852 = weight(_text_:22 in 3087) [ClassicSimilarity], result of:
0.035322852 = score(doc=3087,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.30952093 = fieldWeight in 3087, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=3087)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Abstract
- Proceedings of the 5th TREC-confrerence held in Gaithersburgh, Maryland, Nov 20-22, 1996. Aim of the conference was discussion on retrieval techniques for large test collections. Different research groups used different techniques, such as automated thesauri, term weighting, natural language techniques, relevance feedback and advanced pattern matching, for information retrieval from the same large database. This procedure makes it possible to compare the results. The proceedings include papers, tables of the system results, and brief system descriptions including timing and storage information
-
Pemberton, J.K.; Ojala, M.; Garman, N.: Head to head : searching the Web versus traditional services (1998)
0.00
0.0014717856 = product of:
0.017661426 = sum of:
0.017661426 = product of:
0.035322852 = sum of:
0.035322852 = weight(_text_:22 in 3572) [ClassicSimilarity], result of:
0.035322852 = score(doc=3572,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.30952093 = fieldWeight in 3572, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=3572)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Source
- Online. 22(1998) no.3, S.24-26,28
-
Ellis, D.: Progress and problems in information retrieval (1996)
0.00
0.0014717856 = product of:
0.017661426 = sum of:
0.017661426 = product of:
0.035322852 = sum of:
0.035322852 = weight(_text_:22 in 789) [ClassicSimilarity], result of:
0.035322852 = score(doc=789,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.30952093 = fieldWeight in 789, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=789)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Date
- 26. 7.2002 20:22:46
-
Blair, D.C.: STAIRS Redux : thoughts on the STAIRS evaluation, ten years after (1996)
0.00
0.0012878124 = product of:
0.015453748 = sum of:
0.015453748 = product of:
0.030907497 = sum of:
0.030907497 = weight(_text_:22 in 3002) [ClassicSimilarity], result of:
0.030907497 = score(doc=3002,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.2708308 = fieldWeight in 3002, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=3002)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Source
- Journal of the American Society for Information Science. 47(1996) no.1, S.4-22
-
Losee, R.M.: Determining information retrieval and filtering performance without experimentation (1995)
0.00
0.0012878124 = product of:
0.015453748 = sum of:
0.015453748 = product of:
0.030907497 = sum of:
0.030907497 = weight(_text_:22 in 3368) [ClassicSimilarity], result of:
0.030907497 = score(doc=3368,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.2708308 = fieldWeight in 3368, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=3368)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Date
- 22. 2.1996 13:14:10
-
Brown, M.E.: By any other name : accounting for failure in the naming of subject categories (1995)
0.00
0.0012878124 = product of:
0.015453748 = sum of:
0.015453748 = product of:
0.030907497 = sum of:
0.030907497 = weight(_text_:22 in 5598) [ClassicSimilarity], result of:
0.030907497 = score(doc=5598,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.2708308 = fieldWeight in 5598, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=5598)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Date
- 2.11.1996 13:08:22
-
Iivonen, M.: Consistency in the selection of search concepts and search terms (1995)
0.00
0.0011038391 = product of:
0.01324607 = sum of:
0.01324607 = product of:
0.02649214 = sum of:
0.02649214 = weight(_text_:22 in 1757) [ClassicSimilarity], result of:
0.02649214 = score(doc=1757,freq=2.0), product of:
0.11412105 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.032588977 = queryNorm
0.23214069 = fieldWeight in 1757, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046875 = fieldNorm(doc=1757)
0.5 = coord(1/2)
0.083333336 = coord(1/12)
- Abstract
- Considers intersearcher and intrasearcher consistency in the selection of search terms. Based on an empirical study where 22 searchers from 4 different types of search environments analyzed altogether 12 search requests of 4 different types in 2 separate test situations between which 2 months elapsed. Statistically very significant differences in consistency were found according to the types of search environments and search requests. Consistency was also considered according to the extent of the scope of search concept. At level I search terms were compared character by character. At level II different search terms were accepted as the same search concept with a rather simple evaluation of linguistic expressions. At level III, in addition to level II, the hierarchical approach of the search request was also controlled. At level IV different search terms were accepted as the same search concept with a broad interpretation of the search concept. Both intersearcher and intrasearcher consistency grew most immediately after a rather simple evaluation of linguistic impressions
