-
Petrelli, D.: On the role of user-centred evaluation in the advancement of interactive information retrieval (2008)
0.02
0.016055118 = product of:
0.024082676 = sum of:
0.008779433 = weight(_text_:a in 2026) [ClassicSimilarity], result of:
0.008779433 = score(doc=2026,freq=14.0), product of:
0.05209492 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.045180224 = queryNorm
0.1685276 = fieldWeight in 2026, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.0390625 = fieldNorm(doc=2026)
0.015303242 = product of:
0.030606484 = sum of:
0.030606484 = weight(_text_:22 in 2026) [ClassicSimilarity], result of:
0.030606484 = score(doc=2026,freq=2.0), product of:
0.15821345 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.045180224 = queryNorm
0.19345059 = fieldWeight in 2026, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=2026)
0.5 = coord(1/2)
0.6666667 = coord(2/3)
- Abstract
- This paper discusses the role of user-centred evaluations as an essential method for researching interactive information retrieval. It draws mainly on the work carried out during the Clarity Project where different user-centred evaluations were run during the lifecycle of a cross-language information retrieval system. The iterative testing was not only instrumental to the development of a usable system, but it enhanced our knowledge of the potential, impact, and actual use of cross-language information retrieval technology. Indeed the role of the user evaluation was dual: by testing a specific prototype it was possible to gain a micro-view and assess the effectiveness of each component of the complex system; by cumulating the result of all the evaluations (in total 43 people were involved) it was possible to build a macro-view of how cross-language retrieval would impact on users and their tasks. By showing the richness of results that can be acquired, this paper aims at stimulating researchers into considering user-centred evaluations as a flexible, adaptable and comprehensive technique for investigating non-traditional information access systems.
- Source
- Information processing and management. 44(2008) no.1, S.22-38
- Type
- a
-
Petrelli, D.; Beaulieu, M.; Sanderson, M.; Demetriou, G.; Herring, P.; Hansen, P.: Observing users, designing clarity : a case study an the user-centered design of a cross-language information retrieval system (2004)
0.00
0.003754243 = product of:
0.011262729 = sum of:
0.011262729 = weight(_text_:a in 2506) [ClassicSimilarity], result of:
0.011262729 = score(doc=2506,freq=16.0), product of:
0.05209492 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.045180224 = queryNorm
0.2161963 = fieldWeight in 2506, product of:
4.0 = tf(freq=16.0), with freq of:
16.0 = termFreq=16.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046875 = fieldNorm(doc=2506)
0.33333334 = coord(1/3)
- Abstract
- This report presents a case study of the development of an interface for a novel and complex form of document retrieval: searching for texts written in foreign languages based on native language queries. Although the underlying technology for achieving such a search is relatively weIl understood, the appropriate interface design is not. A study involving users from the beginning of the design process is described, and it covers initial examination of user needs and tasks, preliminary design and testing of interface components, building, testing, and refining the interface, and, finally, conducting usability tests of the system. Lessons are learned at every stage of the process, leading to a much more informed view of how such an interface should be built.
- Type
- a
-
Petrelli, D.; Levin, S.; Beaulieu, M.; Sanderson, M.: Which user interaction for cross-language information retrieval? : design issues and reflections (2006)
0.00
0.0035117732 = product of:
0.010535319 = sum of:
0.010535319 = weight(_text_:a in 5053) [ClassicSimilarity], result of:
0.010535319 = score(doc=5053,freq=14.0), product of:
0.05209492 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.045180224 = queryNorm
0.20223314 = fieldWeight in 5053, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046875 = fieldNorm(doc=5053)
0.33333334 = coord(1/3)
- Abstract
- A novel and complex form of information access is cross-language information retrieval: searching for texts written in foreign languages based on native language queries. Although the underlying technology for achieving such a search is relatively well understood, the appropriate interface design is not. The authors present three user evaluations undertaken during the iterative design of Clarity, a cross-language retrieval system for lowdensity languages, and shows how the user-interaction design evolved depending on the results of usability tests. The first test was instrumental to identify weaknesses in both functionalities and interface; the second was run to determine if query translation should be shown or not; the final was a global assessment and focused on user satisfaction criteria. Lessons were learned at every stage of the process leading to a much more informed view of what a cross-language retrieval system should offer to users.
- Type
- a
-
Petrelli, D.; Lanfranchi, V.; Ciravegna, F.; Begdev, R.; Chapman, S.: Highly focused document retrieval in aerospace engineering : user interaction design and evaluation (2011)
0.00
0.002212209 = product of:
0.0066366266 = sum of:
0.0066366266 = weight(_text_:a in 4535) [ClassicSimilarity], result of:
0.0066366266 = score(doc=4535,freq=8.0), product of:
0.05209492 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.045180224 = queryNorm
0.12739488 = fieldWeight in 4535, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.0390625 = fieldNorm(doc=4535)
0.33333334 = coord(1/3)
- Abstract
- Purpose - This paper seeks to describe the preliminary studies (on both users and data), the design and evaluation of the K-Search system for searching legacy documents in aerospace engineering. Real-world reports of jet engine maintenance challenge the current indexing practice, while real users' tasks require retrieving the information in the proper context. K-Search is currently in use in Rolls-Royce plc and has evolved to include other tools for knowledge capture and management. Design/methodology/approach - Semantic Web techniques have been used to automatically extract information from the reports while maintaining the original context, allowing a more focused retrieval than with more traditional techniques. The paper combines semantic search with classical information retrieval to increase search effectiveness. An innovative user interface has been designed to take advantage of this hybrid search technique. The interface is designed to allow a flexible and personal approach to searching legacy data. Findings - The user evaluation showed that the system is effective and well received by users. It also shows that different people look at the same data in different ways and make different use of the same system depending on their individual needs, influenced by their job profile and personal attitude. Research limitations/implications - This study focuses on a specific case of an enterprise working in aerospace engineering. Although the findings are likely to be shared with other engineering domains (e.g. mechanical, electronic), the study does not expand the evaluation to different settings. Originality/value - The study shows how real context of use can provide new and unexpected challenges to researchers and how effective solutions can then be adopted and used in organizations.
- Type
- a
