Smithson, S.: Information retrieval evaluation in practice : a case study approach (1994)
0.01
0.009715946 = product of:
0.04857973 = sum of:
0.04857973 = weight(_text_:22 in 7302) [ClassicSimilarity], result of:
0.04857973 = score(doc=7302,freq=2.0), product of:
0.17937298 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.051222645 = queryNorm
0.2708308 = fieldWeight in 7302, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=7302)
0.2 = coord(1/5)
- Abstract
- The evaluation of information retrieval systems is an important yet difficult operation. This paper describes an exploratory evaluation study that takes an interpretive approach to evaluation. The longitudinal study examines evaluation through the information-seeking behaviour of 22 case studies of 'real' users. The eclectic approach to data collection produced behavioral data that is compared with relevance judgements and satisfaction ratings. The study demonstrates considerable variations among the cases, among different evaluation measures within the same case, and among the same measures at different stages within a single case. It is argued that those involved in evaluation should be aware of the difficulties, and base any evaluation on a good understanding of the cases in question
