Literatur zur Informationserschließung

Diese Datenbank enthält über 40.000 Dokumente zu Themen aus den Bereichen Formalerschließung – Inhaltserschließung – Information Retrieval.

© 2015 W. Gödert, TH Köln, Institut für Informationswissenschaft / Powered by litecat, BIS Oldenburg (Stand: 04. Juni 2021)

Suchergebnisse

• 1
  Balog, K. ; Schuth, A. ; Dekker, P. ; Tavakolpoursaleh, N. ; Schaer, P. ; Chuang, P.-Y.: Overview of the TREC 2016 Open Search track Academic Search Edition.
  In: TREC 2016, Gaithersburg, Unites States.
  
  Abstract: We present the TREC Open Search track, which represents a new evaluation paradigm for information retrieval. It offers the possibility for researchers to evaluate their approaches in a live setting, with real, unsuspecting users of an existing search engine. The first edition of the track focuses on the academic search domain and features the ad-hoc scientific literature search task. We report on experiments with three different academic search engines: Cite-SeerX, SSOAR, and Microsoft Academic Search.
  
  Inhalt: Vgl.: https://www.researchgate.net/publication/345253485_Overview_of_the_TREC_2016_Open_Search_track_Academic_Search_Edition.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC-2016
  
  
• 2
  Tamine, L. ; Chouquet, C. ; Palmer, T.: Analysis of biomedical and health queries : lessons learned from TREC and CLEF evaluation benchmarks.
  In: Journal of the Association for Information Science and Technology. 66(2015) no.12, S.2626-2642.
  
  Abstract: A large body of research work examined, from both the query side and the user behavior side, the characteristics of medical- and health-related searches. One of the core issues in medical information retrieval (IR) is diversity of tasks that lead to diversity of categories of information needs and queries. From the evaluation perspective, another related and challenging issue is the limited availability of appropriate test collections allowing the experimental validation of medically task oriented IR techniques and systems. In this paper, we explore the peculiarities of TREC and CLEF medically oriented tasks and queries through the analysis of the differences and the similarities between queries across tasks, with respect to length, specificity, and clarity features and then study their effect on retrieval performance. We show that, even for expert oriented queries, language specificity level varies significantly across tasks as well as search difficulty. Additional findings highlight that query clarity factors are task dependent and that query terms specificity based on domain-specific terminology resources is not significantly linked to term rareness in the document collection. The lessons learned from our study could serve as starting points for the design of future task-based medical information retrieval frameworks.
  
  Inhalt: Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23351/abstract.
  
  Themenfeld: Retrievalstudien
  Wissenschaftsfach: Medizin
  Objekt: TREC ; CLEF
  
  
• 3
  Ruthven, I.: Relevance behaviour in TREC.
  In: Journal of documentation. 70(2014) no.6, S.1098-1117.
  
  Abstract: Purpose - The purpose of this paper is to examine how various types of TREC data can be used to better understand relevance and serve as test-bed for exploring relevance. The author proposes that there are many interesting studies that can be performed on the TREC data collections that are not directly related to evaluating systems but to learning more about human judgements of information and relevance and that these studies can provide useful research questions for other types of investigation. Design/methodology/approach - Through several case studies the author shows how existing data from TREC can be used to learn more about the factors that may affect relevance judgements and interactive search decisions and answer new research questions for exploring relevance. Findings - The paper uncovers factors, such as familiarity, interest and strictness of relevance criteria, that affect the nature of relevance assessments within TREC, contrasting these against findings from user studies of relevance. Research limitations/implications - The research only considers certain uses of TREC data and assessment given by professional relevance assessors but motivates further exploration of the TREC data so that the research community can further exploit the effort involved in the construction of TREC test collections. Originality/value - The paper presents an original viewpoint on relevance investigations and TREC itself by motivating TREC as a source of inspiration on understanding relevance rather than purely as a source of evaluation material.
  
  Inhalt: Beitrag in einem Special Issue: Festschrift in honour of Nigel Ford
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 4
  Wildemuth, B. ; Freund, L. ; Toms, E.G.: Untangling search task complexity and difficulty in the context of interactive information retrieval studies.
  In: Journal of documentation. 70(2014) no.6, S.1118-1140.
  
  Abstract: Purpose - One core element of interactive information retrieval (IIR) experiments is the assignment of search tasks. The purpose of this paper is to provide an analytical review of current practice in developing those search tasks to test, observe or control task complexity and difficulty. Design/methodology/approach - Over 100 prior studies of IIR were examined in terms of how each defined task complexity and/or difficulty (or related concepts) and subsequently interpreted those concepts in the development of the assigned search tasks. Findings - Search task complexity is found to include three dimensions: multiplicity of subtasks or steps, multiplicity of facets, and indeterminability. Search task difficulty is based on an interaction between the search task and the attributes of the searcher or the attributes of the search situation. The paper highlights the anomalies in our use of these two concepts, concluding with suggestions for future methodological research related to search task complexity and difficulty. Originality/value - By analyzing and synthesizing current practices, this paper provides guidance for future experiments in IIR that involve these two constructs.
  
  Inhalt: Beitrag in einem Special Issue: Festschrift in honour of Nigel Ford
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 5
  Thornley, C.V. ; Johnson, A.C. ; Smeaton, A.F. ; Lee, H.: ¬The scholarly impact of TRECVid (2003-2009).
  In: Journal of the American Society for Information Science and Technology. 62(2011) no.4, S.613-627.
  
  Abstract: This paper reports on an investigation into the scholarly impact of the TRECVid (Text Retrieval and Evaluation Conference, Video Retrieval Evaluation) benchmarking conferences between 2003 and 2009. The contribution of TRECVid to research in video retrieval is assessed by analyzing publication content to show the development of techniques and approaches over time and by analyzing publication impact through publication numbers and citation analysis. Popular conference and journal venues for TRECVid publications are identified in terms of number of citations received. For a selection of participants at different career stages, the relative importance of TRECVid publications in terms of citations vis à vis their other publications is investigated. TRECVid, as an evaluation conference, provides data on which research teams 'scored' highly against the evaluation criteria and the relationship between 'top scoring' teams at TRECVid and the 'top scoring' papers in terms of citations is analyzed. A strong relationship was found between 'success' at TRECVid and 'success' at citations both for high scoring and low scoring teams. The implications of the study in terms of the value of TRECVid as a research activity, and the value of bibliometric analysis as a research evaluation tool, are discussed.
  
  Themenfeld: Retrievalstudien
  Objekt: TRECVid
  
  
• 6
  Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track.
  In: Journal of documentation. 67(2011) no.2, S.264-278.
  
  Abstract: Purpose - This study intends to identify factors that affect relevance judgment of retrieved information as part of the 2007 TREC Legal track interactive task. Design/methodology/approach - Data were gathered and analyzed from the participants of the 2007 TREC Legal track interactive task using a questionnaire which includes not only a list of 80 relevance factors identified in prior research, but also a space for expressing their thoughts on relevance judgment in the process. Findings - This study finds that topicality remains a primary criterion, out of various options, for determining relevance, while specificity of the search request, task, or retrieved results also helps greatly in relevance judgment. Research limitations/implications - Relevance research should focus on the topicality and specificity of what is being evaluated as well as conducted in real environments. Practical implications - If multiple relevance factors are presented to assessors, the total number in a list should be below ten to take account of the limited processing capacity of human beings' short-term memory. Otherwise, the assessors might either completely ignore or inadequately consider some of the relevance factors when making judgment decisions. Originality/value - This study presents a method for reducing the artificiality of relevance research design, an apparent limitation in many related studies. Specifically, relevance judgment was made in this research as part of the 2007 TREC Legal track interactive task rather than a study devised for the sake of it. The assessors also served as searchers so that their searching experience would facilitate their subsequent relevance judgments.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 7
  Järvelin, K.: Evaluation.
  In: Interactive information seeking, behaviour and retrieval. Eds.: Ruthven, I. u. D. Kelly. London : Facet Publ., 2011. S.113-138.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 8
  Robertson, S.: On the history of evaluation in IR.
  In: Information science in transition, Ed.: A. Gilchrist. London : Facet Publ., 2009. S.63-93.
  
  Abstract: This paper is a personal take on the history of evaluation experiments in information retrieval. It describes some of the early experiments that were formative in our understanding, and goes on to discuss the current dominance of TREC (the Text REtrieval Conference) and to assess its impact.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 9
  Voorhees, E.M.: Text REtrieval Conference (TREC).
  In: Encyclopedia of library and information sciences. 3rd ed. Ed.: M.J. Bates. London : Taylor & Francis, 2009. S.xx-xx.
  
  Abstract: This entry summarizes the history, results, and impact of the Text REtrieval Conference (TREC), a workshop series designed to support the information retrieval community by building the infrastructure necessary for large-scale evaluation of retrieval technology.
  
  Anmerkung: Vgl.: http://www.tandfonline.com/doi/book/10.1081/E-ELIS3.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 10
  Harman, D. ; Voorhees, E.: Social TREC : an overview.
  In: Annual review of information science and technology. 40(2006), S.xxx-xxx.
  
  Themenfeld: Literaturübersicht
  Objekt: TREC
  
  
• 11
  Mandl, T.: Neue Entwicklungen bei den Evaluierungsinitiativen im Information Retrieval.
  In: Effektive Information Retrieval Verfahren in Theorie und Praxis: ausgewählte und erweiterte Beiträge des Vierten Hildesheimer Evaluierungs- und Retrievalworkshop (HIER 2005), Hildesheim, 20.7.2005. Hrsg.: T. Mandl u. C. Womser-Hacker. Konstanz : UVK Verlagsgesellschaft, 2006. S.117-128.
  (Schriften zur Informationswissenschaft; Bd.45)
  
  Abstract: Im Information Retrieval tragen Evaluierungsinitiativen erheblich zur empirisch fundierten Forschung bei. Mit umfangreichen Kollektionen und Aufgaben unterstützen sie die Standardisierung und damit die Systementwicklung. Die wachsenden Anforderungen hinsichtlich der Korpora und Anwendungsszenarien führten zu einer starken Diversifizierung innerhalb der Evaluierungsinitiativen. Dieser Artikel gibt einen Überblick über den aktuellen Stand der wichtigsten Evaluierungsinitiativen und neuen Trends.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC ; CLEF ; NTCIR
  
  
• 12
  Vechtomova, O. ; Karamuftuoglu, M.: Elicitation and use of relevance feedback information.
  In: Information processing and management. 42(2006) no.1, S.191-206.
  
  Abstract: The paper presents two approaches to interactively refining user search formulations and their evaluation in the new High Accuracy Retrieval from Documents (HARD) track of TREC-12. The first method consists of asking the user to select a number of sentences that represent documents. The second method consists of showing to the user a list of noun phrases extracted from the initial document set. Both methods then expand the query based on the user feedback. The TREC results show that one of the methods is an effective means of interactive query expansion and yields significant performance improvements. The paper presents a comparison of the methods and detailed analysis of the evaluation results.
  
  Themenfeld: Retrievalalgorithmen
  Objekt: TREC-12
  
  
• 13
  Voorhees, E.M.: Question answering in TREC.
  In: TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman. Cambridge, MA : MIT Press, 2005. S.233-259.
  
  Themenfeld: Retrievalstudien ; Sprachretrieval
  Objekt: TREC
  
  
• 14
  Harman, D.K.: ¬The TREC test collections.
  In: TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman. Cambridge, MA : MIT Press, 2005. S.21-52.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 15
  Buckley, C. ; Voorhees, E.M.: Retrieval system evaluation.
  In: TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman. Cambridge, MA : MIT Press, 2005. S.53-78.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 16
  Harman, D.K.: ¬The TREC ad hoc experiments.
  In: TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman. Cambridge, MA : MIT Press, 2005. S.79-98.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 17
  Pomerantz, J.: ¬A linguistic analysis of question taxonomies.
  In: Journal of the American Society for Information Science and Technology. 56(2005) no.7, S.715-728.
  
  Abstract: Recent work in automatic question answering has called for question taxonomies as a critical component of the process of machine understanding of questions. There is a long tradition of classifying questions in library reference services, and digital reference services have a strong need for automation to support scalability. Digital reference and question answering systems have the potential to arrive at a highly fruitful symbiosis. To move towards this goal, an extensive review was conducted of bodies of literature from several fields that deal with questions, to identify question taxonomies that exist in these bodies of literature. In the course of this review, five question taxonomies were identified, at four levels of linguistic analysis.
  
  Themenfeld: Sprachretrieval ; Suchtaktik
  Objekt: TREC
  
  
• 18
  Cormack, G.V. ; Clarke, C.L.A. ; Palmer, C.R. ; Lynam, T.R.: MultiText experiments for TREC.
  In: TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman. Cambridge, MA : MIT Press, 2005. S.347-372.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 19
  Robertson, S. ; Callan, J.: Routing and filtering.
  In: TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman. Cambridge, MA : MIT Press, 2005. S.99-122.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC
  
  
• 20
  Harman, D.K.: Beyond English.
  In: TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman. Cambridge, MA : MIT Press, 2005. S.153-182.
  
  Themenfeld: Retrievalstudien
  Objekt: TREC