-
Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996)
0.02
0.016621336 = product of:
0.077566236 = sum of:
0.032137483 = weight(_text_:wide in 3004) [ClassicSimilarity], result of:
0.032137483 = score(doc=3004,freq=2.0), product of:
0.1312982 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.029633347 = queryNorm
0.24476713 = fieldWeight in 3004, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.0390625 = fieldNorm(doc=3004)
0.008737902 = weight(_text_:information in 3004) [ClassicSimilarity], result of:
0.008737902 = score(doc=3004,freq=6.0), product of:
0.052020688 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.029633347 = queryNorm
0.16796975 = fieldWeight in 3004, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0390625 = fieldNorm(doc=3004)
0.036690846 = weight(_text_:retrieval in 3004) [ClassicSimilarity], result of:
0.036690846 = score(doc=3004,freq=12.0), product of:
0.08963835 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.029633347 = queryNorm
0.40932083 = fieldWeight in 3004, product of:
3.4641016 = tf(freq=12.0), with freq of:
12.0 = termFreq=12.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.0390625 = fieldNorm(doc=3004)
0.21428572 = coord(3/14)
- Abstract
- The purpose of this article is to bring attention to the problem of variations in relevance assessments and the effects that these may have on measures of retrieval effectiveness. Through an analytical review of the literature, I show that despite known wide variations in relevance assessments in experimental test collections, their effects on the measurement of retrieval performance are almost completely unstudied. I will further argue that what we know about tha many variables that have been found to affect relevance assessments under experimental conditions, as well as our new understanding of psychological, situational, user-based relevance, point to a single conclusion. We can no longer rest the evaluation of information retrieval systems on the assumption that such variations do not significantly affect the measurement of information retrieval performance. A series of thourough, rigorous, and extensive tests is needed, of precisely how, and under what conditions, variations in relevance assessments do, and do not, affect measures of retrieval performance. We need to develop approaches to evaluation that are sensitive to these variations and to human factors and individual differences more generally. Our approaches to evaluation must reflect the real world of real users
- Source
- Journal of the American Society for Information Science. 47(1996) no.1, S.37-49
-
Harter, S.P.; Hert, C.A.: Evaluation of information retrieval systems : approaches, issues, and methods (1997)
0.01
0.009356101 = product of:
0.065492705 = sum of:
0.014125523 = weight(_text_:information in 2264) [ClassicSimilarity], result of:
0.014125523 = score(doc=2264,freq=8.0), product of:
0.052020688 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.029633347 = queryNorm
0.27153665 = fieldWeight in 2264, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0546875 = fieldNorm(doc=2264)
0.05136718 = weight(_text_:retrieval in 2264) [ClassicSimilarity], result of:
0.05136718 = score(doc=2264,freq=12.0), product of:
0.08963835 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.029633347 = queryNorm
0.5730491 = fieldWeight in 2264, product of:
3.4641016 = tf(freq=12.0), with freq of:
12.0 = termFreq=12.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.0546875 = fieldNorm(doc=2264)
0.14285715 = coord(2/14)
- Abstract
- State of the art review of information retrieval systems, defined as systems retrieving documents a sopposed to numerical data. Explains the classic Cranfield studies that have served as a standard for retrieval testing since the 1960s and discusses the Cranfield model and its relevance based measures of retrieval effectiveness. Details sosme of the problems with the Cranfield instruments and issues of validity and reliability, generalizability, usefulness and basic concepts. Discusses the evaluation of the Internet search engines in light of the Cranfield model, noting the very real differences between batch systems (Cranfield) and interactive systems (Internet). Because the Internet collection is not fixed, it is impossible to determine recall as a measure of retrieval effectiveness. considers future directions in evaluating information retrieval systems
- Source
- Annual review of information science and technology. 32(1997), S.3-94
-
Harter, S.P.: Colinked descriptors (1993)
0.01
0.008236345 = product of:
0.05765441 = sum of:
0.016143454 = weight(_text_:information in 7963) [ClassicSimilarity], result of:
0.016143454 = score(doc=7963,freq=8.0), product of:
0.052020688 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.029633347 = queryNorm
0.3103276 = fieldWeight in 7963, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0625 = fieldNorm(doc=7963)
0.041510954 = weight(_text_:retrieval in 7963) [ClassicSimilarity], result of:
0.041510954 = score(doc=7963,freq=6.0), product of:
0.08963835 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.029633347 = queryNorm
0.46309367 = fieldWeight in 7963, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.0625 = fieldNorm(doc=7963)
0.14285715 = coord(2/14)
- Abstract
- Reports the preliminary results of an investigation into the effectiveness of colinked descriptors, a new concept and technique suitable for incorporating into the design of interfaces for information retrieval. The idea is borrowed from the analogous idea in bibliometrics-cocited references. Preliminary results suggest that the technique is extremely effective. As a retrieval technique, colinked descriptors can easily be incorporated into information retrieval interfaces, front-end systems, or standalone, pre-search systems
- Imprint
- Medford, NJ : Learned Information
- Source
- Integrating technologies - converging professions: proceedings of the 56th Annual Meeting of the American Society for Information Science, Columbus, OH, 24-28 October 1993. Ed.: S. Bonzi
-
Harter, S.P.: Search term combinations and retrieval overlap : a proposed methodology and case study (1990)
0.01
0.008009522 = product of:
0.05606665 = sum of:
0.014125523 = weight(_text_:information in 339) [ClassicSimilarity], result of:
0.014125523 = score(doc=339,freq=2.0), product of:
0.052020688 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.029633347 = queryNorm
0.27153665 = fieldWeight in 339, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=339)
0.04194113 = weight(_text_:retrieval in 339) [ClassicSimilarity], result of:
0.04194113 = score(doc=339,freq=2.0), product of:
0.08963835 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.029633347 = queryNorm
0.46789268 = fieldWeight in 339, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.109375 = fieldNorm(doc=339)
0.14285715 = coord(2/14)
- Source
- Journal of the American Society for Information Science. 41(1990) no.2, S.132-146
-
Harter, S.P.; Cheng, Y.-R.: Colinked descriptors : improving vocabulary selection for end-user searching (1996)
0.00
0.0048545036 = product of:
0.033981524 = sum of:
0.00856136 = weight(_text_:information in 4216) [ClassicSimilarity], result of:
0.00856136 = score(doc=4216,freq=4.0), product of:
0.052020688 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.029633347 = queryNorm
0.16457605 = fieldWeight in 4216, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046875 = fieldNorm(doc=4216)
0.025420163 = weight(_text_:retrieval in 4216) [ClassicSimilarity], result of:
0.025420163 = score(doc=4216,freq=4.0), product of:
0.08963835 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.029633347 = queryNorm
0.2835858 = fieldWeight in 4216, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.046875 = fieldNorm(doc=4216)
0.14285715 = coord(2/14)
- Abstract
- This article introduces a new concept and technique for information retrieval called 'colinked descriptors'. Borrowed from an analogous idea in bibliometrics - cocited references - colinked descriptors provide a theory and method for identifying search terms that, by hypothesis, will be superior to those entered initially by a searcher. The theory suggests a means of moving automatically from 2 or more initial search terms, to other terms that should be superior in retrieval performance to the 2 original terms. A research project designed to test this colinked descriptor hypothesis is reported. The results suggest that the approach is effective, although methodological problems in testing the idea are reported. Algorithms to generate colinked descriptors can be incorporated easily into system interfaces, front-end or pre-search systems, or help software, in any database that employs a thesaurus. The potential use of colinked descriptors is a strong argument for building richer and more complex thesauri that reflect as many legitimate links among descriptors as possible
- Source
- Journal of the American Society for Information Science. 47(1996) no.4, S.311-325
-
Harter, S.P.; Nisonger, T.E.; Weng, A.: Semantic relationsships between cited and citing articles in library and information science journals (1993)
0.00
0.0039051762 = product of:
0.027336232 = sum of:
0.012357258 = weight(_text_:information in 5644) [ClassicSimilarity], result of:
0.012357258 = score(doc=5644,freq=12.0), product of:
0.052020688 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.029633347 = queryNorm
0.23754507 = fieldWeight in 5644, product of:
3.4641016 = tf(freq=12.0), with freq of:
12.0 = termFreq=12.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0390625 = fieldNorm(doc=5644)
0.014978974 = weight(_text_:retrieval in 5644) [ClassicSimilarity], result of:
0.014978974 = score(doc=5644,freq=2.0), product of:
0.08963835 = queryWeight, product of:
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.029633347 = queryNorm
0.16710453 = fieldWeight in 5644, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.024915 = idf(docFreq=5836, maxDocs=44218)
0.0390625 = fieldNorm(doc=5644)
0.14285715 = coord(2/14)
- Abstract
- The act of referencing another author's work in a scholarly or research paper is usually assumed to signal a direct semantic relationship between the citing and cited work. The present article reports a study that examines this assumption directly. The purpose of the research is to investigate the semantic relationship between citing and cited documents for a sample of document pairs in three journals in library and information science: 'Library journal', 'College and research libraries' and 'Journal of the American Society for Information Science'. A macroanalysis, absed on a comparison of the Library of Congress class numbers assigned citing and cited documents, and a microanalysis, based on a comparison of descriptors assigned citing and cited documents by three indexing and abstracting journals, ERIC, LISA and LiLi, were conducted. Both analyses suggest that the subject similarity among pairs of cited and citing documents is typically very small, supporting a subjective, psychological view of relevance and a trial-and-error, heuristic understanding of the information search and research processes. The results of the study have implications for collection development, for an understanding of psychological relevance, and for the results of doing information retrieval using cited references. Several intriguing methodological questions are raised for future research, including the role of indexing depth, specifity, and quality on the measurement of document similarity
- Source
- Journal of the American Society for Information Science. 44(1993) no.9, S.543-552
-
Harter, S.P.: Scholarly communication and electronic journals : an impact study (1998)
0.00
0.0026825934 = product of:
0.018778153 = sum of:
0.008071727 = weight(_text_:information in 3035) [ClassicSimilarity], result of:
0.008071727 = score(doc=3035,freq=2.0), product of:
0.052020688 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.029633347 = queryNorm
0.1551638 = fieldWeight in 3035, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0625 = fieldNorm(doc=3035)
0.010706427 = product of:
0.032119278 = sum of:
0.032119278 = weight(_text_:22 in 3035) [ClassicSimilarity], result of:
0.032119278 = score(doc=3035,freq=2.0), product of:
0.103770934 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.029633347 = queryNorm
0.30952093 = fieldWeight in 3035, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=3035)
0.33333334 = coord(1/3)
0.14285715 = coord(2/14)
- Date
- 22. 2.1999 16:56:06
- Source
- Journal of the American Society for Information Science. 49(1998) no.6, S.507-516
-
Harter, S.P.: Psychological relevance and information science (1992)
0.00
0.0016307352 = product of:
0.022830293 = sum of:
0.022830293 = weight(_text_:information in 5355) [ClassicSimilarity], result of:
0.022830293 = score(doc=5355,freq=4.0), product of:
0.052020688 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.029633347 = queryNorm
0.43886948 = fieldWeight in 5355, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.125 = fieldNorm(doc=5355)
0.071428575 = coord(1/14)
- Source
- Journal of the American Society for Information Science. 43(1992) no.9, S.602-615
-
Harter, S.P.; Nisonger, T.E.: ISI's impact factor as misnomer : a proposed new measure to assess journal impact (1997)
0.00
8.64828E-4 = product of:
0.012107591 = sum of:
0.012107591 = weight(_text_:information in 6825) [ClassicSimilarity], result of:
0.012107591 = score(doc=6825,freq=2.0), product of:
0.052020688 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.029633347 = queryNorm
0.23274569 = fieldWeight in 6825, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=6825)
0.071428575 = coord(1/14)
- Source
- Journal of the American Society for Information Science. 48(1997) no.12, S.1146-1148
