-
Agata, T.: ¬A measure for evaluating search engines on the World Wide Web : retrieval test with ESL (Expected Search Length) (1997)
0.12
0.11957805 = product of:
0.2391561 = sum of:
0.07841912 = weight(_text_:world in 3892) [ClassicSimilarity], result of:
0.07841912 = score(doc=3892,freq=2.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.50960356 = fieldWeight in 3892, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.09375 = fieldNorm(doc=3892)
0.104204305 = weight(_text_:wide in 3892) [ClassicSimilarity], result of:
0.104204305 = score(doc=3892,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.5874411 = fieldWeight in 3892, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.09375 = fieldNorm(doc=3892)
0.056532677 = weight(_text_:web in 3892) [ClassicSimilarity], result of:
0.056532677 = score(doc=3892,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.43268442 = fieldWeight in 3892, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.09375 = fieldNorm(doc=3892)
0.5 = coord(3/6)
-
Lazonder, A.W.; Biemans, H.J.A.; Wopereis, I.G.J.H.: Differences between novice and experienced users in searching information on the World Wide Web (2000)
0.08
0.07725859 = product of:
0.15451717 = sum of:
0.03920956 = weight(_text_:world in 4598) [ClassicSimilarity], result of:
0.03920956 = score(doc=4598,freq=2.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.25480178 = fieldWeight in 4598, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.046875 = fieldNorm(doc=4598)
0.052102152 = weight(_text_:wide in 4598) [ClassicSimilarity], result of:
0.052102152 = score(doc=4598,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.29372054 = fieldWeight in 4598, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.046875 = fieldNorm(doc=4598)
0.06320546 = weight(_text_:web in 4598) [ClassicSimilarity], result of:
0.06320546 = score(doc=4598,freq=10.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.48375595 = fieldWeight in 4598, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=4598)
0.5 = coord(3/6)
- Abstract
- Searching for information on the WWW basically comes down to locating an appropriate Web site and to retrieving relevant information from that site. This study examined the effect of a user's WWW experience on both phases of the search process. 35 students from 2 schools for Dutch pre-university education were observed while performing 3 search tasks. The results indicate that subjects with WWW-experience are more proficient in locating Web sites than are novice WWW-users. The observed differences were ascribed to the experts' superior skills in operating Web search engines. However, on tasks that required subjects to locate information on specific Web sites, the performance of experienced and novice users was equivalent - a result that is in line with hypertext research. Based on these findings, implications for training and supporting students in searching for information on the WWW are identified. Finally, the role of the subjects' level of domain expertise is discussed and directions for future research are proposed
-
Wu, C.-J.: Experiments on using the Dublin Core to reduce the retrieval error ratio (1998)
0.07
0.06975387 = product of:
0.13950774 = sum of:
0.045744486 = weight(_text_:world in 5201) [ClassicSimilarity], result of:
0.045744486 = score(doc=5201,freq=2.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.29726875 = fieldWeight in 5201, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.0546875 = fieldNorm(doc=5201)
0.06078585 = weight(_text_:wide in 5201) [ClassicSimilarity], result of:
0.06078585 = score(doc=5201,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.342674 = fieldWeight in 5201, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.0546875 = fieldNorm(doc=5201)
0.0329774 = weight(_text_:web in 5201) [ClassicSimilarity], result of:
0.0329774 = score(doc=5201,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.25239927 = fieldWeight in 5201, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0546875 = fieldNorm(doc=5201)
0.5 = coord(3/6)
- Abstract
- In order to test the power of metadata on information retrieval, an experiment was designed and conducted on a group of 7 graduate students using the Dublin Core as the cataloguing metadata. Results show that, on average, the retrieval error rate is only 2.9 per cent for the MES system (http://140.136.85.194), which utilizes the Dublin Core to describe the documents on the World Wide Web, in contrast to 20.7 per cent for the 7 famous search engines including HOTBOT, GAIS, LYCOS, EXCITE, INFOSEEK, YAHOO, and OCTOPUS. The very low error rate indicates that the users can use the information of the Dublin Core to decide whether to retrieve the documents or not
-
Khan, K.; Locatis, C.: Searching through cyberspace : the effects of link display and link density on information retrieval from hypertext on the World Wide Web (1998)
0.06
0.059789024 = product of:
0.11957805 = sum of:
0.03920956 = weight(_text_:world in 446) [ClassicSimilarity], result of:
0.03920956 = score(doc=446,freq=2.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.25480178 = fieldWeight in 446, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.046875 = fieldNorm(doc=446)
0.052102152 = weight(_text_:wide in 446) [ClassicSimilarity], result of:
0.052102152 = score(doc=446,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.29372054 = fieldWeight in 446, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.046875 = fieldNorm(doc=446)
0.028266339 = weight(_text_:web in 446) [ClassicSimilarity], result of:
0.028266339 = score(doc=446,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.21634221 = fieldWeight in 446, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=446)
0.5 = coord(3/6)
-
Griesbaum, J.: Evaluierung hybrider Suchsysteme im WWW (2000)
0.06
0.059789024 = product of:
0.11957805 = sum of:
0.03920956 = weight(_text_:world in 2482) [ClassicSimilarity], result of:
0.03920956 = score(doc=2482,freq=2.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.25480178 = fieldWeight in 2482, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.046875 = fieldNorm(doc=2482)
0.052102152 = weight(_text_:wide in 2482) [ClassicSimilarity], result of:
0.052102152 = score(doc=2482,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.29372054 = fieldWeight in 2482, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.046875 = fieldNorm(doc=2482)
0.028266339 = weight(_text_:web in 2482) [ClassicSimilarity], result of:
0.028266339 = score(doc=2482,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.21634221 = fieldWeight in 2482, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=2482)
0.5 = coord(3/6)
- Abstract
- Der Ausgangspunkt dieser Arbeit ist die Suchproblematik im World Wide Web. Suchmaschinen sind einerseits unverzichtbar für erfolgreiches Information Retrieval, andererseits wird ihnen eine mäßige Leistungsfähigkeit vorgeworfen. Das Thema dieser Arbeit ist die Untersuchung der Retrievaleffektivität deutschsprachiger Suchmaschinen. Es soll festgestellt werden, welche Retrievaleffektivität Nutzer derzeit erwarten können. Ein Ansatz, um die Retrievaleffektivität von Suchmaschinen zu erhöhen besteht darin, redaktionell von Menschen erstellte und automatisch generierte Suchergebnisse in einer Trefferliste zu vermengen. Ziel dieser Arbeit ist es, die Retrievaleffektivität solcher hybrider Systeme im Vergleich zu rein roboterbasierten Suchmaschinen zu evaluieren. Zunächst werden hierzu die grundlegenden Problembereiche bei der Evaluation von Retrievalsystemen analysiert. In Anlehnung an die von Tague-Sutcliff vorgeschlagene Methodik wird unter Beachtung der webspezifischen Besonderheiten eine mögliche Vorgehensweise erschlossen. Darauf aufbauend wird das konkrete Setting für die Durchführung der Evaluation erarbeitet und ein Retrievaleffektivitätstest bei den Suchmaschinen Lycos.de, AItaVista.de und QualiGo durchgeführt.
-
Voorhees, E.M.; Harman, D.K.: ¬The Text REtrieval Conference (2005)
0.05
0.050759725 = product of:
0.076139584 = sum of:
0.022872243 = weight(_text_:world in 5082) [ClassicSimilarity], result of:
0.022872243 = score(doc=5082,freq=2.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.14863437 = fieldWeight in 5082, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.02734375 = fieldNorm(doc=5082)
0.030392924 = weight(_text_:wide in 5082) [ClassicSimilarity], result of:
0.030392924 = score(doc=5082,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.171337 = fieldWeight in 5082, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.02734375 = fieldNorm(doc=5082)
0.0164887 = weight(_text_:web in 5082) [ClassicSimilarity], result of:
0.0164887 = score(doc=5082,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.12619963 = fieldWeight in 5082, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02734375 = fieldNorm(doc=5082)
0.0063857157 = product of:
0.019157147 = sum of:
0.019157147 = weight(_text_:29 in 5082) [ClassicSimilarity], result of:
0.019157147 = score(doc=5082,freq=2.0), product of:
0.14083174 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.04003532 = queryNorm
0.13602862 = fieldWeight in 5082, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.02734375 = fieldNorm(doc=5082)
0.33333334 = coord(1/3)
0.6666667 = coord(4/6)
- Abstract
- Text retrieval technology targets a problem that is all too familiar: finding relevant information in large stores of electronic documents. The problem is an old one, with the first research conference devoted to the subject held in 1958 [11]. Since then the problem has continued to grow as more information is created in electronic form and more people gain electronic access. The advent of the World Wide Web, where anyone can publish so everyone must search, is a graphic illustration of the need for effective retrieval technology. The Text REtrieval Conference (TREC) is a workshop series designed to build the infrastructure necessary for the large-scale evaluation of text retrieval technology, thereby accelerating its transfer into the commercial sector. The series is sponsored by the U.S. National Institute of Standards and Technology (NIST) and the U.S. Department of Defense. At the time of this writing, there have been twelve TREC workshops and preparations for the thirteenth workshop are under way. Participants in the workshops have been drawn from the academic, commercial, and government sectors, and have included representatives from more than twenty different countries. These collective efforts have accomplished a great deal: a variety of large test collections have been built for both traditional ad hoc retrieval and related tasks such as cross-language retrieval, speech retrieval, and question answering; retrieval effectiveness has approximately doubled; and many commercial retrieval systems now contain technology first developed in TREC.
- Date
- 29. 3.1996 18:16:49
-
Kantor, P.; Kim, M.H.; Ibraev, U.; Atasoy, K.: Estimating the number of relevant documents in enormous collections (1999)
0.05
0.049824186 = product of:
0.09964837 = sum of:
0.032674633 = weight(_text_:world in 6690) [ClassicSimilarity], result of:
0.032674633 = score(doc=6690,freq=2.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.21233483 = fieldWeight in 6690, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.0390625 = fieldNorm(doc=6690)
0.043418463 = weight(_text_:wide in 6690) [ClassicSimilarity], result of:
0.043418463 = score(doc=6690,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.24476713 = fieldWeight in 6690, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.0390625 = fieldNorm(doc=6690)
0.023555283 = weight(_text_:web in 6690) [ClassicSimilarity], result of:
0.023555283 = score(doc=6690,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.18028519 = fieldWeight in 6690, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0390625 = fieldNorm(doc=6690)
0.5 = coord(3/6)
- Abstract
- In assessing information retrieval systems, it is important to know not only the precision of the retrieved set, but also to compare the number of retrieved relevant items to the total number of relevant items. For large collections, such as the TREC test collections, or the World Wide Web, it is not possible to enumerate the entire set of relevant documents. If the retrieved documents are evaluated, a variant of the statistical "capture-recapture" method can be used to estimate the total number of relevant documents, providing the several retrieval systems used are sufficiently independent. We show that the underlying signal detection model supporting such an analysis can be extended in two ways. First, assuming that there are two distinct performance characteristics (corresponding to the chance of retrieving a relevant, and retrieving a given non-relevant document), we show that if there are three or more independent systems available it is possible to estimate the number of relevant documents without actually having to decide whether each individual document is relevant. We report applications of this 3-system method to the TREC data, leading to the conclusion that the independence assumptions are not satisfied. We then extend the model to a multi-system, multi-problem model, and show that it is possible to include statistical dependencies of all orders in the model, and determine the number of relevant documents for each of the problems in the set. Application to the TREC setting will be presented
-
Hawking, D.; Craswell, N.: ¬The very large collection and Web tracks (2005)
0.03
0.026142187 = product of:
0.07842656 = sum of:
0.056532677 = weight(_text_:web in 5085) [ClassicSimilarity], result of:
0.056532677 = score(doc=5085,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.43268442 = fieldWeight in 5085, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.09375 = fieldNorm(doc=5085)
0.021893885 = product of:
0.06568165 = sum of:
0.06568165 = weight(_text_:29 in 5085) [ClassicSimilarity], result of:
0.06568165 = score(doc=5085,freq=2.0), product of:
0.14083174 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.04003532 = queryNorm
0.46638384 = fieldWeight in 5085, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.09375 = fieldNorm(doc=5085)
0.33333334 = coord(1/3)
0.33333334 = coord(2/6)
- Date
- 29. 3.1996 18:16:49
-
Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996)
0.03
0.025364365 = product of:
0.07609309 = sum of:
0.032674633 = weight(_text_:world in 3004) [ClassicSimilarity], result of:
0.032674633 = score(doc=3004,freq=2.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.21233483 = fieldWeight in 3004, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.0390625 = fieldNorm(doc=3004)
0.043418463 = weight(_text_:wide in 3004) [ClassicSimilarity], result of:
0.043418463 = score(doc=3004,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.24476713 = fieldWeight in 3004, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.0390625 = fieldNorm(doc=3004)
0.33333334 = coord(2/6)
- Abstract
- The purpose of this article is to bring attention to the problem of variations in relevance assessments and the effects that these may have on measures of retrieval effectiveness. Through an analytical review of the literature, I show that despite known wide variations in relevance assessments in experimental test collections, their effects on the measurement of retrieval performance are almost completely unstudied. I will further argue that what we know about tha many variables that have been found to affect relevance assessments under experimental conditions, as well as our new understanding of psychological, situational, user-based relevance, point to a single conclusion. We can no longer rest the evaluation of information retrieval systems on the assumption that such variations do not significantly affect the measurement of information retrieval performance. A series of thourough, rigorous, and extensive tests is needed, of precisely how, and under what conditions, variations in relevance assessments do, and do not, affect measures of retrieval performance. We need to develop approaches to evaluation that are sensitive to these variations and to human factors and individual differences more generally. Our approaches to evaluation must reflect the real world of real users
-
Dresel, R.; Hörnig, D.; Kaluza, H.; Peter, A.; Roßmann, A.; Sieber, W.: Evaluation deutscher Web-Suchwerkzeuge : Ein vergleichender Retrievaltest (2001)
0.02
0.022588048 = product of:
0.06776414 = sum of:
0.05329952 = weight(_text_:web in 261) [ClassicSimilarity], result of:
0.05329952 = score(doc=261,freq=4.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.4079388 = fieldWeight in 261, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0625 = fieldNorm(doc=261)
0.0144646205 = product of:
0.04339386 = sum of:
0.04339386 = weight(_text_:22 in 261) [ClassicSimilarity], result of:
0.04339386 = score(doc=261,freq=2.0), product of:
0.14019686 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04003532 = queryNorm
0.30952093 = fieldWeight in 261, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=261)
0.33333334 = coord(1/3)
0.33333334 = coord(2/6)
- Abstract
- Die deutschen Suchmaschinen, Abacho, Acoon, Fireball und Lycos sowie die Web-Kataloge Web.de und Yahoo! werden einem Qualitätstest nach relativem Recall, Precision und Availability unterzogen. Die Methoden der Retrievaltests werden vorgestellt. Im Durchschnitt werden bei einem Cut-Off-Wert von 25 ein Recall von rund 22%, eine Precision von knapp 19% und eine Verfügbarkeit von 24% erreicht
-
Breuer, T.; Tavakolpoursaleh, N.; Schaer, P.; Hienert, D.; Schaible, J.; Castro, L.J.: Online Information Retrieval Evaluation using the STELLA Framework (2022)
0.02
0.022491967 = product of:
0.0674759 = sum of:
0.03920956 = weight(_text_:world in 640) [ClassicSimilarity], result of:
0.03920956 = score(doc=640,freq=2.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.25480178 = fieldWeight in 640, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.046875 = fieldNorm(doc=640)
0.028266339 = weight(_text_:web in 640) [ClassicSimilarity], result of:
0.028266339 = score(doc=640,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.21634221 = fieldWeight in 640, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=640)
0.33333334 = coord(2/6)
- Abstract
- Involving users in early phases of software development has become a common strategy as it enables developers to consider user needs from the beginning. Once a system is in production, new opportunities to observe, evaluate and learn from users emerge as more information becomes available. Gathering information from users to continuously evaluate their behavior is a common practice for commercial software, while the Cranfield paradigm remains the preferred option for Information Retrieval (IR) and recommendation systems in the academic world. Here we introduce the Infrastructures for Living Labs STELLA project which aims to create an evaluation infrastructure allowing experimental systems to run along production web-based academic search systems with real users. STELLA combines user interactions and log files analyses to enable large-scale A/B experiments for academic search.
-
Crestani, F.; Rijsbergen, C.J. van: Information retrieval by imaging (1996)
0.02
0.022099718 = product of:
0.066299155 = sum of:
0.05545069 = weight(_text_:world in 6967) [ClassicSimilarity], result of:
0.05545069 = score(doc=6967,freq=4.0), product of:
0.1538826 = queryWeight, product of:
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.04003532 = queryNorm
0.36034414 = fieldWeight in 6967, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.8436708 = idf(docFreq=2573, maxDocs=44218)
0.046875 = fieldNorm(doc=6967)
0.010848465 = product of:
0.032545395 = sum of:
0.032545395 = weight(_text_:22 in 6967) [ClassicSimilarity], result of:
0.032545395 = score(doc=6967,freq=2.0), product of:
0.14019686 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04003532 = queryNorm
0.23214069 = fieldWeight in 6967, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046875 = fieldNorm(doc=6967)
0.33333334 = coord(1/3)
0.33333334 = coord(2/6)
- Abstract
- Explains briefly what constitutes the imaging process and explains how imaging can be used in information retrieval. Proposes an approach based on the concept of: 'a term is a possible world'; which enables the exploitation of term to term relationships which are estimated using an information theoretic measure. Reports results of an evaluation exercise to compare the performance of imaging retrieval, using possible world semantics, with a benchmark and using the Cranfield 2 document collection to measure precision and recall. Initially, the performance imaging retrieval was seen to be better but statistical analysis proved that the difference was not significant. The problem with imaging retrieval lies in the amount of computations needed to be performed at run time and a later experiement investigated the possibility of reducing this amount. Notes lines of further investigation
- Source
- Information retrieval: new systems and current research. Proceedings of the 16th Research Colloquium of the British Computer Society Information Retrieval Specialist Group, Drymen, Scotland, 22-23 Mar 94. Ed.: R. Leon
-
MacCall, S.L.; Cleveland, A.D.; Gibson, I.E.: Outline and preliminary evaluation of the classical digital library model (1999)
0.02
0.017513638 = product of:
0.052540913 = sum of:
0.043418463 = weight(_text_:wide in 6541) [ClassicSimilarity], result of:
0.043418463 = score(doc=6541,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.24476713 = fieldWeight in 6541, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.0390625 = fieldNorm(doc=6541)
0.009122452 = product of:
0.027367353 = sum of:
0.027367353 = weight(_text_:29 in 6541) [ClassicSimilarity], result of:
0.027367353 = score(doc=6541,freq=2.0), product of:
0.14083174 = queryWeight, product of:
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.04003532 = queryNorm
0.19432661 = fieldWeight in 6541, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5176873 = idf(docFreq=3565, maxDocs=44218)
0.0390625 = fieldNorm(doc=6541)
0.33333334 = coord(1/3)
0.33333334 = coord(2/6)
- Abstract
- The growing number of networked information resources and services offers unprecedented opportunities for delivering high quality information to the computer desktop of a wide range of individuals. However, currently there is a reliance on a database retrieval model, in which endusers use keywords to search large collections of automatically indexed resources in order to find needed information. As an alternative to the database retrieval model, this paper outlines the classical digital library model, which is derived from traditional practices of library and information science professionals. These practices include the selection and organization of information resources for local populations of users and the integration of advanced information retrieval tools, such as databases and the Internet into these collections. To evaluate this model, library and information professionals and endusers involved with primary care medicine were asked to respond to a series of questions comparing their experiences with a digital library developed for the primary care population to their experiences with general Internet use. Preliminary results are reported
- Date
- 29. 9.2001 20:12:49
-
Pemberton, J.K.; Ojala, M.; Garman, N.: Head to head : searching the Web versus traditional services (1998)
0.02
0.017384358 = product of:
0.052153073 = sum of:
0.037688453 = weight(_text_:web in 3572) [ClassicSimilarity], result of:
0.037688453 = score(doc=3572,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.2884563 = fieldWeight in 3572, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0625 = fieldNorm(doc=3572)
0.0144646205 = product of:
0.04339386 = sum of:
0.04339386 = weight(_text_:22 in 3572) [ClassicSimilarity], result of:
0.04339386 = score(doc=3572,freq=2.0), product of:
0.14019686 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04003532 = queryNorm
0.30952093 = fieldWeight in 3572, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=3572)
0.33333334 = coord(1/3)
0.33333334 = coord(2/6)
- Source
- Online. 22(1998) no.3, S.24-26,28
-
¬The Eleventh Text Retrieval Conference, TREC 2002 (2003)
0.02
0.017384358 = product of:
0.052153073 = sum of:
0.037688453 = weight(_text_:web in 4049) [ClassicSimilarity], result of:
0.037688453 = score(doc=4049,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.2884563 = fieldWeight in 4049, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0625 = fieldNorm(doc=4049)
0.0144646205 = product of:
0.04339386 = sum of:
0.04339386 = weight(_text_:22 in 4049) [ClassicSimilarity], result of:
0.04339386 = score(doc=4049,freq=2.0), product of:
0.14019686 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04003532 = queryNorm
0.30952093 = fieldWeight in 4049, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=4049)
0.33333334 = coord(1/3)
0.33333334 = coord(2/6)
- Abstract
- Proceedings of the llth TREC-conference held in Gaithersburg, Maryland (USA), November 19-22, 2002. Aim of the conference was discussion an retrieval and related information-seeking tasks for large test collection. 93 research groups used different techniques, for information retrieval from the same large database. This procedure makes it possible to compare the results. The tasks are: Cross-language searching, filtering, interactive searching, searching for novelty, question answering, searching for video shots, and Web searching.
-
Bar-Ilan, J.: ¬The Web as an information source on informetrics? : A content analysis (2000)
0.01
0.013324881 = product of:
0.07994928 = sum of:
0.07994928 = weight(_text_:web in 4587) [ClassicSimilarity], result of:
0.07994928 = score(doc=4587,freq=16.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.6119082 = fieldWeight in 4587, product of:
4.0 = tf(freq=16.0), with freq of:
16.0 = termFreq=16.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=4587)
0.16666667 = coord(1/6)
- Abstract
- This article addresses the question of whether the Web can serve as an information source for research. Specifically, it analyzes by way of content analysis the Web pages retrieved by the major search engines on a particular date (June 7, 1998), as a result of the query 'informetrics OR informetric'. In 807 out of the 942 retrieved pages, the search terms were mentioned in the context of information science. Over 70% of the pages contained only indirect information on the topic, in the form of hypertext links and bibliographical references without annotation. The bibliographical references extracted from the Web pages were analyzed, and lists of most productive authors, most cited authors, works, and sources were compiled. The list of reference obtained from the Web was also compared to data retrieved from commercial databases. For most cases, the list of references extracted from the Web outperformed the commercial, bibliographic databases. The results of these comparisons indicate that valuable, freely available data is hidden in the Web waiting to be extracted from the millions of Web pages
-
Clarke, S.J.; Willett, P.: Estimating the recall performance of Web search engines (1997)
0.01
0.012562818 = product of:
0.075376906 = sum of:
0.075376906 = weight(_text_:web in 760) [ClassicSimilarity], result of:
0.075376906 = score(doc=760,freq=8.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.5769126 = fieldWeight in 760, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0625 = fieldNorm(doc=760)
0.16666667 = coord(1/6)
- Abstract
- Reports a comparison of the retrieval effectiveness of the AltaVista, Excite and Lycos Web search engines. Describes a method for comparing the recall of the 3 sets of searches, despite the fact that they are carried out on non identical sets of Web pages. It is thus possible, unlike previous comparative studies of Web search engines, to consider both recall and precision when evaluating the effectiveness of search engines
-
MacFarlane, A.: Evaluation of web search for the information practitioner (2007)
0.01
0.012464285 = product of:
0.07478571 = sum of:
0.07478571 = weight(_text_:web in 817) [ClassicSimilarity], result of:
0.07478571 = score(doc=817,freq=14.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.57238775 = fieldWeight in 817, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=817)
0.16666667 = coord(1/6)
- Abstract
- Purpose - The aim of the paper is to put forward a structured mechanism for web search evaluation. The paper seeks to point to useful scientific research and show how information practitioners can use these methods in evaluation of search on the web for their users. Design/methodology/approach - The paper puts forward an approach which utilizes traditional laboratory-based evaluation measures such as average precision/precision at N documents, augmented with diagnostic measures such as link broken, etc., which are used to show why precision measures are depressed as well as the quality of the search engines crawling mechanism. Findings - The paper shows how to use diagnostic measures in conjunction with precision in order to evaluate web search. Practical implications - The methodology presented in this paper will be useful to any information professional who regularly uses web search as part of their information seeking and needs to evaluate web search services. Originality/value - The paper argues that the use of diagnostic measures is essential in web search, as precision measures on their own do not allow a searcher to understand why search results differ between search engines.
-
Frei, H.P.; Meienberg, S.; Schäuble, P.: ¬The perils of interpreting recall and precision values (1991)
0.01
0.011578257 = product of:
0.06946954 = sum of:
0.06946954 = weight(_text_:wide in 786) [ClassicSimilarity], result of:
0.06946954 = score(doc=786,freq=2.0), product of:
0.17738682 = queryWeight, product of:
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.04003532 = queryNorm
0.3916274 = fieldWeight in 786, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4307585 = idf(docFreq=1430, maxDocs=44218)
0.0625 = fieldNorm(doc=786)
0.16666667 = coord(1/6)
- Abstract
- The traditional recall and precision measure is inappropriate when retrieval algorithms that retrieve information from Wide Area Networks are evaluated. The principle reason is that information available in WANs is dynamic and its size os orders of magnitude greater than the size of the usual test collections. To overcome these problems, a new efffectiveness measure has been developed, which we call the 'usefulness measure'
-
Ravana, S.D.; Taheri, M.S.; Rajagopal, P.: Document-based approach to improve the accuracy of pairwise comparison in evaluating information retrieval systems (2015)
0.01
0.0108652245 = product of:
0.03259567 = sum of:
0.023555283 = weight(_text_:web in 2587) [ClassicSimilarity], result of:
0.023555283 = score(doc=2587,freq=2.0), product of:
0.13065568 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.04003532 = queryNorm
0.18028519 = fieldWeight in 2587, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0390625 = fieldNorm(doc=2587)
0.009040388 = product of:
0.027121164 = sum of:
0.027121164 = weight(_text_:22 in 2587) [ClassicSimilarity], result of:
0.027121164 = score(doc=2587,freq=2.0), product of:
0.14019686 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04003532 = queryNorm
0.19345059 = fieldWeight in 2587, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=2587)
0.33333334 = coord(1/3)
0.33333334 = coord(2/6)
- Abstract
- Purpose The purpose of this paper is to propose a method to have more accurate results in comparing performance of the paired information retrieval (IR) systems with reference to the current method, which is based on the mean effectiveness scores of the systems across a set of identified topics/queries. Design/methodology/approach Based on the proposed approach, instead of the classic method of using a set of topic scores, the documents level scores are considered as the evaluation unit. These document scores are the defined document's weight, which play the role of the mean average precision (MAP) score of the systems as a significance test's statics. The experiments were conducted using the TREC 9 Web track collection. Findings The p-values generated through the two types of significance tests, namely the Student's t-test and Mann-Whitney show that by using the document level scores as an evaluation unit, the difference between IR systems is more significant compared with utilizing topic scores. Originality/value Utilizing a suitable test collection is a primary prerequisite for IR systems comparative evaluation. However, in addition to reusable test collections, having an accurate statistical testing is a necessity for these evaluations. The findings of this study will assist IR researchers to evaluate their retrieval systems and algorithms more accurately.
- Date
- 20. 1.2015 18:30:22
