-
Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000)
0.05
0.047836047 = product of:
0.11959012 = sum of:
0.009535614 = weight(_text_:a in 6438) [ClassicSimilarity], result of:
0.009535614 = score(doc=6438,freq=2.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.17835285 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.1100545 = sum of:
0.022102704 = weight(_text_:information in 6438) [ClassicSimilarity], result of:
0.022102704 = score(doc=6438,freq=2.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.27153665 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.087951794 = weight(_text_:22 in 6438) [ClassicSimilarity], result of:
0.087951794 = score(doc=6438,freq=2.0), product of:
0.16237405 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046368346 = queryNorm
0.5416616 = fieldWeight in 6438, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.109375 = fieldNorm(doc=6438)
0.4 = coord(2/5)
- Date
- 11. 8.2001 16:22:19
- Source
- Information processing and management. 36(2000) no.1, S.3-36
- Type
- a
-
Dresel, R.; Hörnig, D.; Kaluza, H.; Peter, A.; Roßmann, A.; Sieber, W.: Evaluation deutscher Web-Suchwerkzeuge : Ein vergleichender Retrievaltest (2001)
0.03
0.028930439 = product of:
0.072326094 = sum of:
0.009437811 = weight(_text_:a in 261) [ClassicSimilarity], result of:
0.009437811 = score(doc=261,freq=6.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.17652355 = fieldWeight in 261, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.0625 = fieldNorm(doc=261)
0.06288828 = sum of:
0.012630116 = weight(_text_:information in 261) [ClassicSimilarity], result of:
0.012630116 = score(doc=261,freq=2.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.1551638 = fieldWeight in 261, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0625 = fieldNorm(doc=261)
0.050258167 = weight(_text_:22 in 261) [ClassicSimilarity], result of:
0.050258167 = score(doc=261,freq=2.0), product of:
0.16237405 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046368346 = queryNorm
0.30952093 = fieldWeight in 261, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=261)
0.4 = coord(2/5)
- Abstract
- Die deutschen Suchmaschinen, Abacho, Acoon, Fireball und Lycos sowie die Web-Kataloge Web.de und Yahoo! werden einem Qualitätstest nach relativem Recall, Precision und Availability unterzogen. Die Methoden der Retrievaltests werden vorgestellt. Im Durchschnitt werden bei einem Cut-Off-Wert von 25 ein Recall von rund 22%, eine Precision von knapp 19% und eine Verfügbarkeit von 24% erreicht
- Source
- nfd Information - Wissenschaft und Praxis. 52(2001) H.7, S.381-392
- Type
- a
-
Petrelli, D.: On the role of user-centred evaluation in the advancement of interactive information retrieval (2008)
0.02
0.024522701 = product of:
0.061306752 = sum of:
0.009010308 = weight(_text_:a in 2026) [ClassicSimilarity], result of:
0.009010308 = score(doc=2026,freq=14.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.1685276 = fieldWeight in 2026, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.0390625 = fieldNorm(doc=2026)
0.052296445 = sum of:
0.020885091 = weight(_text_:information in 2026) [ClassicSimilarity], result of:
0.020885091 = score(doc=2026,freq=14.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.256578 = fieldWeight in 2026, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0390625 = fieldNorm(doc=2026)
0.031411353 = weight(_text_:22 in 2026) [ClassicSimilarity], result of:
0.031411353 = score(doc=2026,freq=2.0), product of:
0.16237405 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046368346 = queryNorm
0.19345059 = fieldWeight in 2026, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=2026)
0.4 = coord(2/5)
- Abstract
- This paper discusses the role of user-centred evaluations as an essential method for researching interactive information retrieval. It draws mainly on the work carried out during the Clarity Project where different user-centred evaluations were run during the lifecycle of a cross-language information retrieval system. The iterative testing was not only instrumental to the development of a usable system, but it enhanced our knowledge of the potential, impact, and actual use of cross-language information retrieval technology. Indeed the role of the user evaluation was dual: by testing a specific prototype it was possible to gain a micro-view and assess the effectiveness of each component of the complex system; by cumulating the result of all the evaluations (in total 43 people were involved) it was possible to build a macro-view of how cross-language retrieval would impact on users and their tasks. By showing the richness of results that can be acquired, this paper aims at stimulating researchers into considering user-centred evaluations as a flexible, adaptable and comprehensive technique for investigating non-traditional information access systems.
- Footnote
- Beitrag eines Themenbereichs: Evaluation of Interactive Information Retrieval Systems
- Source
- Information processing and management. 44(2008) no.1, S.22-38
- Type
- a
-
King, D.W.: Blazing new trails : in celebration of an audacious career (2000)
0.02
0.023903001 = product of:
0.0597575 = sum of:
0.009010308 = weight(_text_:a in 1184) [ClassicSimilarity], result of:
0.009010308 = score(doc=1184,freq=14.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.1685276 = fieldWeight in 1184, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.0390625 = fieldNorm(doc=1184)
0.050747193 = sum of:
0.019335838 = weight(_text_:information in 1184) [ClassicSimilarity], result of:
0.019335838 = score(doc=1184,freq=12.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.23754507 = fieldWeight in 1184, product of:
3.4641016 = tf(freq=12.0), with freq of:
12.0 = termFreq=12.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0390625 = fieldNorm(doc=1184)
0.031411353 = weight(_text_:22 in 1184) [ClassicSimilarity], result of:
0.031411353 = score(doc=1184,freq=2.0), product of:
0.16237405 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046368346 = queryNorm
0.19345059 = fieldWeight in 1184, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=1184)
0.4 = coord(2/5)
- Abstract
- I had the distinct pleasure of working with Pauline Atherton (Cochrane) during the 1960s, a period that can be considered the heyday of automated information system design and evaluation in the United States. I first met Pauline at the 1962 American Documentation Institute annual meeting in North Hollywood, Florida. My company, Westat Research Analysts, had recently been awarded a contract by the U.S. Patent Office to provide statistical support for the design of experiments with automated information retrieval systems. I was asked to attend the meeting to learn more about information retrieval systems and to begin informing others of U.S. Patent Office activities in this area. At one session, Pauline and I questioned a speaker about the research that he presented. Pauline's questions concerned the logic of their approach and mine, the statistical aspects. After the session, she came over to talk to me and we began a professional and personal friendship that continues to this day. During the 1960s, Pauline was involved in several important information-retrieval projects including a series of studies for the American Institute of Physics, a dissertation examining the relevance of retrieved documents, and development and evaluation of an online information-retrieval system. I had the opportunity to work with Pauline and her colleagues an four of those projects and will briefly describe her work in the 1960s.
- Date
- 22. 9.1997 19:16:05
- Imprint
- Urbana-Champaign, IL : Illinois University at Urbana-Champaign, Graduate School of Library and Information Science
- Type
- a
-
Leininger, K.: Interindexer consistency in PsychINFO (2000)
0.02
0.021697827 = product of:
0.054244567 = sum of:
0.007078358 = weight(_text_:a in 2552) [ClassicSimilarity], result of:
0.007078358 = score(doc=2552,freq=6.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.13239266 = fieldWeight in 2552, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046875 = fieldNorm(doc=2552)
0.04716621 = sum of:
0.009472587 = weight(_text_:information in 2552) [ClassicSimilarity], result of:
0.009472587 = score(doc=2552,freq=2.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.116372846 = fieldWeight in 2552, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046875 = fieldNorm(doc=2552)
0.037693623 = weight(_text_:22 in 2552) [ClassicSimilarity], result of:
0.037693623 = score(doc=2552,freq=2.0), product of:
0.16237405 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046368346 = queryNorm
0.23214069 = fieldWeight in 2552, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046875 = fieldNorm(doc=2552)
0.4 = coord(2/5)
- Abstract
- Reports results of a study to examine interindexer consistency (the degree to which indexers, when assigning terms to a chosen record, will choose the same terms to reflect that record) in the PsycINFO database using 60 records that were inadvertently processed twice between 1996 and 1998. Five aspects of interindexer consistency were analysed. Two methods were used to calculate interindexer consistency: one posited by Hooper (1965) and the other by Rollin (1981). Aspects analysed were: checktag consistency (66.24% using Hooper's calculation and 77.17% using Rollin's); major-to-all term consistency (49.31% and 62.59% respectively); overall indexing consistency (49.02% and 63.32%); classification code consistency (44.17% and 45.00%); and major-to-major term consistency (43.24% and 56.09%). The average consistency across all categories was 50.4% using Hooper's method and 60.83% using Rollin's. Although comparison with previous studies is difficult due to methodological variations in the overall study of indexing consistency and the specific characteristics of the database, results generally support previous findings when trends and similar studies are analysed.
- Date
- 9. 2.1997 18:44:22
- Source
- Journal of librarianship and information science. 32(2000) no.1, S.4-8
- Type
- a
-
Larsen, B.; Ingwersen, P.; Lund, B.: Data fusion according to the principle of polyrepresentation (2009)
0.02
0.015803538 = product of:
0.039508846 = sum of:
0.005448922 = weight(_text_:a in 2752) [ClassicSimilarity], result of:
0.005448922 = score(doc=2752,freq=8.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.10191591 = fieldWeight in 2752, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.03125 = fieldNorm(doc=2752)
0.034059923 = sum of:
0.0089308405 = weight(_text_:information in 2752) [ClassicSimilarity], result of:
0.0089308405 = score(doc=2752,freq=4.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.10971737 = fieldWeight in 2752, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.03125 = fieldNorm(doc=2752)
0.025129084 = weight(_text_:22 in 2752) [ClassicSimilarity], result of:
0.025129084 = score(doc=2752,freq=2.0), product of:
0.16237405 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046368346 = queryNorm
0.15476047 = fieldWeight in 2752, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03125 = fieldNorm(doc=2752)
0.4 = coord(2/5)
- Abstract
- We report data fusion experiments carried out on the four best-performing retrieval models from TREC 5. Three were conceptually/algorithmically very different from one another; one was algorithmically similar to one of the former. The objective of the test was to observe the performance of the 11 logical data fusion combinations compared to the performance of the four individual models and their intermediate fusions when following the principle of polyrepresentation. This principle is based on cognitive IR perspective (Ingwersen & Järvelin, 2005) and implies that each retrieval model is regarded as a representation of a unique interpretation of information retrieval (IR). It predicts that only fusions of very different, but equally good, IR models may outperform each constituent as well as their intermediate fusions. Two kinds of experiments were carried out. One tested restricted fusions, which entails that only the inner disjoint overlap documents between fused models are ranked. The second set of experiments was based on traditional data fusion methods. The experiments involved the 30 TREC 5 topics that contain more than 44 relevant documents. In all tests, the Borda and CombSUM scoring methods were used. Performance was measured by precision and recall, with document cutoff values (DCVs) at 100 and 15 documents, respectively. Results show that restricted fusions made of two, three, or four cognitively/algorithmically very different retrieval models perform significantly better than do the individual models at DCV100. At DCV15, however, the results of polyrepresentative fusion were less predictable. The traditional fusion method based on polyrepresentation principles demonstrates a clear picture of performance at both DCV levels and verifies the polyrepresentation predictions for data fusion in IR. Data fusion improves retrieval performance over their constituent IR models only if the models all are quite conceptually/algorithmically dissimilar and equally and well performing, in that order of importance.
- Date
- 22. 3.2009 18:48:28
- Source
- Journal of the American Society for Information Science and Technology. 60(2009) no.4, S.646-654
- Type
- a
-
¬The Eleventh Text Retrieval Conference, TREC 2002 (2003)
0.01
0.014426835 = product of:
0.072134174 = sum of:
0.072134174 = sum of:
0.021876005 = weight(_text_:information in 4049) [ClassicSimilarity], result of:
0.021876005 = score(doc=4049,freq=6.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.2687516 = fieldWeight in 4049, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0625 = fieldNorm(doc=4049)
0.050258167 = weight(_text_:22 in 4049) [ClassicSimilarity], result of:
0.050258167 = score(doc=4049,freq=2.0), product of:
0.16237405 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046368346 = queryNorm
0.30952093 = fieldWeight in 4049, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=4049)
0.2 = coord(1/5)
- Abstract
- Proceedings of the llth TREC-conference held in Gaithersburg, Maryland (USA), November 19-22, 2002. Aim of the conference was discussion an retrieval and related information-seeking tasks for large test collection. 93 research groups used different techniques, for information retrieval from the same large database. This procedure makes it possible to compare the results. The tasks are: Cross-language searching, filtering, interactive searching, searching for novelty, question answering, searching for video shots, and Web searching.
- Imprint
- Gaithersburg, MD : National Institute of Standards / Information Technology Laboratory
-
Beaulieu, M.: Approaches to user-based studies in information seeking and retrieval : a Sheffield perspective (2003)
0.01
0.011645746 = product of:
0.029114366 = sum of:
0.013485395 = weight(_text_:a in 4692) [ClassicSimilarity], result of:
0.013485395 = score(doc=4692,freq=4.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.25222903 = fieldWeight in 4692, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.109375 = fieldNorm(doc=4692)
0.015628971 = product of:
0.031257942 = sum of:
0.031257942 = weight(_text_:information in 4692) [ClassicSimilarity], result of:
0.031257942 = score(doc=4692,freq=4.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.3840108 = fieldWeight in 4692, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=4692)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Source
- Journal of information science. 29(2003) no.4, S.239-248
- Type
- a
-
Cole, C.: Intelligent information retrieval : Part IV: Testing the timing of two information retrieval devices in a naturalistic setting (2001)
0.01
0.011186366 = product of:
0.027965914 = sum of:
0.01155891 = weight(_text_:a in 365) [ClassicSimilarity], result of:
0.01155891 = score(doc=365,freq=4.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.2161963 = fieldWeight in 365, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.09375 = fieldNorm(doc=365)
0.016407004 = product of:
0.032814007 = sum of:
0.032814007 = weight(_text_:information in 365) [ClassicSimilarity], result of:
0.032814007 = score(doc=365,freq=6.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.40312737 = fieldWeight in 365, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=365)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Source
- Information processing and management. 37(2001) no.1, S.163-182
- Type
- a
-
Rao, A.; Lu, A.; Meier, E.; Ahmed, S.; Pliske, D.: Query processing in TREC6 (2000)
0.01
0.011027008 = product of:
0.02756752 = sum of:
0.01651617 = weight(_text_:a in 6420) [ClassicSimilarity], result of:
0.01651617 = score(doc=6420,freq=6.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.3089162 = fieldWeight in 6420, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.109375 = fieldNorm(doc=6420)
0.011051352 = product of:
0.022102704 = sum of:
0.022102704 = weight(_text_:information in 6420) [ClassicSimilarity], result of:
0.022102704 = score(doc=6420,freq=2.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.27153665 = fieldWeight in 6420, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=6420)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Source
- Information processing and management. 36(2000) no.1, S.179-186
- Type
- a
-
Borlund, P.: ¬The IIR evaluation model : a framework for evaluation of interactive information retrieval systems (2003)
0.01
0.009982069 = product of:
0.024955172 = sum of:
0.01155891 = weight(_text_:a in 922) [ClassicSimilarity], result of:
0.01155891 = score(doc=922,freq=4.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.2161963 = fieldWeight in 922, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.09375 = fieldNorm(doc=922)
0.013396261 = product of:
0.026792523 = sum of:
0.026792523 = weight(_text_:information in 922) [ClassicSimilarity], result of:
0.026792523 = score(doc=922,freq=4.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.3291521 = fieldWeight in 922, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=922)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Source
- Information Research. 8(2003), no.3
- Type
- a
-
Foster, A.; Ford, N.: Serendipity and information seeking : an empirical study (2003)
0.01
0.009814699 = product of:
0.024536747 = sum of:
0.013485395 = weight(_text_:a in 1083) [ClassicSimilarity], result of:
0.013485395 = score(doc=1083,freq=4.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.25222903 = fieldWeight in 1083, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.109375 = fieldNorm(doc=1083)
0.011051352 = product of:
0.022102704 = sum of:
0.022102704 = weight(_text_:information in 1083) [ClassicSimilarity], result of:
0.022102704 = score(doc=1083,freq=2.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.27153665 = fieldWeight in 1083, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.109375 = fieldNorm(doc=1083)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Type
- a
-
Carterette, B.: Test collections (2009)
0.01
0.009248867 = product of:
0.023122165 = sum of:
0.012184162 = weight(_text_:a in 3891) [ClassicSimilarity], result of:
0.012184162 = score(doc=3891,freq=10.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.22789092 = fieldWeight in 3891, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.0625 = fieldNorm(doc=3891)
0.010938003 = product of:
0.021876005 = sum of:
0.021876005 = weight(_text_:information in 3891) [ClassicSimilarity], result of:
0.021876005 = score(doc=3891,freq=6.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.2687516 = fieldWeight in 3891, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0625 = fieldNorm(doc=3891)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Abstract
- Research and development of search engines and other information retrieval (IR) systems proceeds by a cycle of design, implementation, and experimentation, with the results of each experiment influencing design decisions in the next iteration of the cycle. Batch experiments on test collections help ensure that this process goes as smoothly and as quickly as possible. A test collection comprises a collection of documents, a set of information needs, and judgments of the relevance of documents to those needs.
- Source
- Encyclopedia of library and information sciences. 3rd ed. Ed.: M.J. Bates
- Type
- a
-
Della Mea, V.; Mizzaro, S.: Measuring retrieval effectiveness : a new proposal and a first experimental validation (2004)
0.01
0.009222459 = product of:
0.023056148 = sum of:
0.013485395 = weight(_text_:a in 2263) [ClassicSimilarity], result of:
0.013485395 = score(doc=2263,freq=16.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.25222903 = fieldWeight in 2263, product of:
4.0 = tf(freq=16.0), with freq of:
16.0 = termFreq=16.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.0546875 = fieldNorm(doc=2263)
0.009570752 = product of:
0.019141505 = sum of:
0.019141505 = weight(_text_:information in 2263) [ClassicSimilarity], result of:
0.019141505 = score(doc=2263,freq=6.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.23515764 = fieldWeight in 2263, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0546875 = fieldNorm(doc=2263)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Abstract
- Most common effectiveness measures for information retrieval systems are based an the assumptions of binary relevance (either a document is relevant to a given query or it is not) and binary retrieval (either a document is retrieved or it is not). In this article, these assumptions are questioned, and a new measure named ADM (average distance measure) is proposed, discussed from a conceptual point of view, and experimentally validated an Text Retrieval Conference (TREC) data. Both conceptual analysis and experimental evidence demonstrate ADM's adequacy in measuring the effectiveness of information retrieval systems. Some potential problems about precision and recall are also highlighted and discussed.
- Source
- Journal of the American Society for Information Science and Technology. 55(2004) no.6, S.530-543
- Type
- a
-
Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008)
0.01
0.009140301 = product of:
0.022850752 = sum of:
0.012260076 = weight(_text_:a in 2021) [ClassicSimilarity], result of:
0.012260076 = score(doc=2021,freq=18.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.22931081 = fieldWeight in 2021, product of:
4.2426405 = tf(freq=18.0), with freq of:
18.0 = termFreq=18.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046875 = fieldNorm(doc=2021)
0.010590675 = product of:
0.02118135 = sum of:
0.02118135 = weight(_text_:information in 2021) [ClassicSimilarity], result of:
0.02118135 = score(doc=2021,freq=10.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.2602176 = fieldWeight in 2021, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046875 = fieldNorm(doc=2021)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Abstract
- The strongest tradition of IR systems evaluation has focused on system effectiveness; more recently, there has been a growing interest in evaluation of Interactive IR systems, balancing system and user-oriented evaluation criteria. In this paper we shift the focus to considering how IR systems, and particularly digital libraries, can be evaluated to assess (and improve) their fit with users' broader work activities. Taking this focus, we answer a different set of evaluation questions that reveal more about the design of interfaces, user-system interactions and how systems may be deployed in the information working context. The planning and conduct of such evaluation studies share some features with the established methods for conducting IR evaluation studies, but come with a shift in emphasis; for example, a greater range of ethical considerations may be pertinent. We present the PRET A Rapporter framework for structuring user-centred evaluation studies and illustrate its application to three evaluation studies of digital library systems.
- Footnote
- Beitrag eines Themenbereichs: Evaluation of Interactive Information Retrieval Systems
- Source
- Information processing and management. 44(2008) no.1, S.4-21
- Theme
- Information Gateway
- Type
- a
-
Newby, G.B.: Cognitive space and information space (2001)
0.01
0.009013752 = product of:
0.022534382 = sum of:
0.009138121 = weight(_text_:a in 6977) [ClassicSimilarity], result of:
0.009138121 = score(doc=6977,freq=10.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.1709182 = fieldWeight in 6977, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046875 = fieldNorm(doc=6977)
0.013396261 = product of:
0.026792523 = sum of:
0.026792523 = weight(_text_:information in 6977) [ClassicSimilarity], result of:
0.026792523 = score(doc=6977,freq=16.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.3291521 = fieldWeight in 6977, product of:
4.0 = tf(freq=16.0), with freq of:
16.0 = termFreq=16.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046875 = fieldNorm(doc=6977)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Abstract
- This article works towards realization of exosomatic memory for information systems. In exosomatic memory systems, the information spaces of systems will be consistent with the cognitive spaces of their human users. A method for measuring concept relations in human cognitive space is presented: the paired comparison survey with Principal Components Analysis. A study to measure the cognitive spaces of 16 research participants is presented. Items measured include relations among seven TREC topic statements as well as 17 concepts from the topic statements. A method for automatically generating information spaces from document collections is presented that uses term cooccurrence, eigensystems analysis, and Principal Components Analysis. The extent of similarity between the cognitive spaces and the information spaces, which were derived independently from each other, is measured. A strong similarity between the information spaces and the cognitive spaces are found, indicating that the methods described may have good utility for working towards information systems that operate as exosomatic memories
- Source
- Journal of the American Society for Information Science and technology. 52(2001) no.12, S.1026-1048
- Type
- a
-
Buckley, C.; Voorhees, E.M.: Retrieval evaluation with incomplete information (2004)
0.01
0.008627858 = product of:
0.021569645 = sum of:
0.008173384 = weight(_text_:a in 4127) [ClassicSimilarity], result of:
0.008173384 = score(doc=4127,freq=2.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.15287387 = fieldWeight in 4127, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.09375 = fieldNorm(doc=4127)
0.013396261 = product of:
0.026792523 = sum of:
0.026792523 = weight(_text_:information in 4127) [ClassicSimilarity], result of:
0.026792523 = score(doc=4127,freq=4.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.3291521 = fieldWeight in 4127, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=4127)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Source
- SIGIR'04: Proceedings of the 27th Annual International ACM-SIGIR Conference an Research and Development in Information Retrieval. Ed.: K. Järvelin, u.a
- Type
- a
-
Robertson, S.E.; Walker, S.; Beaulieu, M.: Experimentation as a way of life : Okapi at TREC (2000)
0.01
0.008412599 = product of:
0.021031497 = sum of:
0.01155891 = weight(_text_:a in 6030) [ClassicSimilarity], result of:
0.01155891 = score(doc=6030,freq=4.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.2161963 = fieldWeight in 6030, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.09375 = fieldNorm(doc=6030)
0.009472587 = product of:
0.018945174 = sum of:
0.018945174 = weight(_text_:information in 6030) [ClassicSimilarity], result of:
0.018945174 = score(doc=6030,freq=2.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.23274569 = fieldWeight in 6030, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=6030)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Source
- Information processing and management. 36(2000) no.1, S.95-108
- Type
- a
-
Kuriyama, K.; Kando, N.; Nozue, T.; Eguchi, K.: Pooling for a large-scale test collection : an analysis of the search results from the First NTCIR Workshop (2002)
0.01
0.008412599 = product of:
0.021031497 = sum of:
0.01155891 = weight(_text_:a in 3830) [ClassicSimilarity], result of:
0.01155891 = score(doc=3830,freq=4.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.2161963 = fieldWeight in 3830, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.09375 = fieldNorm(doc=3830)
0.009472587 = product of:
0.018945174 = sum of:
0.018945174 = weight(_text_:information in 3830) [ClassicSimilarity], result of:
0.018945174 = score(doc=3830,freq=2.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.23274569 = fieldWeight in 3830, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=3830)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Source
- Information retrieval. 5(2002), S.41-59
- Type
- a
-
Allan, J.; Croft, W.B.; Callan, J.: ¬The University of Massachusetts and a dozen TRECs (2005)
0.01
0.008412599 = product of:
0.021031497 = sum of:
0.01155891 = weight(_text_:a in 5086) [ClassicSimilarity], result of:
0.01155891 = score(doc=5086,freq=4.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.2161963 = fieldWeight in 5086, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.09375 = fieldNorm(doc=5086)
0.009472587 = product of:
0.018945174 = sum of:
0.018945174 = weight(_text_:information in 5086) [ClassicSimilarity], result of:
0.018945174 = score(doc=5086,freq=2.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.23274569 = fieldWeight in 5086, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.09375 = fieldNorm(doc=5086)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Source
- TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman
- Type
- a
