Search (62 results, page 1 of 4)

Cuadra, C.A.; Katter, R.V.: Experimental studies of relevance judgements: final report : Vol.2: description of individual studies (1967) 0.05

0.051207792 = product of:
  0.102415584 = sum of:
    0.102415584 = product of:
      0.20483117 = sum of:
        0.20483117 = weight(_text_:report in 5356) [ClassicSimilarity], result of:
          0.20483117 = score(doc=5356,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.8403548 = fieldWeight in 5356, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.125 = fieldNorm(doc=5356)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track (2011) 0.05

0.049372107 = product of:
  0.09874421 = sum of:
    0.09874421 = sum of:
      0.06400974 = weight(_text_:report in 4540) [ClassicSimilarity], result of:
        0.06400974 = score(doc=4540,freq=2.0), product of:
          0.24374367 = queryWeight, product of:
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.05127382 = queryNorm
          0.26261088 = fieldWeight in 4540, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.0390625 = fieldNorm(doc=4540)
      0.034734476 = weight(_text_:22 in 4540) [ClassicSimilarity], result of:
        0.034734476 = score(doc=4540,freq=2.0), product of:
          0.17955218 = queryWeight, product of:
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.05127382 = queryNorm
          0.19345059 = fieldWeight in 4540, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.0390625 = fieldNorm(doc=4540)
  0.5 = coord(1/2)

Date: 12. 7.2011 18:29:22

Robertson, S.E.; Thompson, C.L.: ¬An operational evaluation of weighting, ranking and relevance feedback via a front-end system (1987) 0.04

0.044806816 = product of:
  0.08961363 = sum of:
    0.08961363 = product of:
      0.17922726 = sum of:
        0.17922726 = weight(_text_:report in 3858) [ClassicSimilarity], result of:
          0.17922726 = score(doc=3858,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.73531044 = fieldWeight in 3858, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.109375 = fieldNorm(doc=3858)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Series: BLRDD report; no.5949

Hancock-Beaulieu, M.; McKenzie, L.; Irving, A.: Evaluative protocols for searching behaviour in online library catalogues (1991) 0.04

0.044806816 = product of:
  0.08961363 = sum of:
    0.08961363 = product of:
      0.17922726 = sum of:
        0.17922726 = weight(_text_:report in 347) [ClassicSimilarity], result of:
          0.17922726 = score(doc=347,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.73531044 = fieldWeight in 347, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.109375 = fieldNorm(doc=347)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Series: British Library research and development report; no.6031

Aitchison, T.M.: Comparative evaluation of index languages : Part I, Design. Part II, Results (1969) 0.04

0.044806816 = product of:
  0.08961363 = sum of:
    0.08961363 = product of:
      0.17922726 = sum of:
        0.17922726 = weight(_text_:report in 561) [ClassicSimilarity], result of:
          0.17922726 = score(doc=561,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.73531044 = fieldWeight in 561, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.109375 = fieldNorm(doc=561)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Series: OSTI report 5073

Larsen, B.; Ingwersen, P.; Lund, B.: Data fusion according to the principle of polyrepresentation (2009) 0.04
```
0.039497685 = product of:
  0.07899537 = sum of:
    0.07899537 = sum of:
      0.051207792 = weight(_text_:report in 2752) [ClassicSimilarity], result of:
        0.051207792 = score(doc=2752,freq=2.0), product of:
          0.24374367 = queryWeight, product of:
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.05127382 = queryNorm
          0.2100887 = fieldWeight in 2752, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.03125 = fieldNorm(doc=2752)
      0.02778758 = weight(_text_:22 in 2752) [ClassicSimilarity], result of:
        0.02778758 = score(doc=2752,freq=2.0), product of:
          0.17955218 = queryWeight, product of:
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.05127382 = queryNorm
          0.15476047 = fieldWeight in 2752, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.03125 = fieldNorm(doc=2752)
  0.5 = coord(1/2)
```
Abstract

We report data fusion experiments carried out on the four best-performing retrieval models from TREC 5. Three were conceptually/algorithmically very different from one another; one was algorithmically similar to one of the former. The objective of the test was to observe the performance of the 11 logical data fusion combinations compared to the performance of the four individual models and their intermediate fusions when following the principle of polyrepresentation. This principle is based on cognitive IR perspective (Ingwersen & Järvelin, 2005) and implies that each retrieval model is regarded as a representation of a unique interpretation of information retrieval (IR). It predicts that only fusions of very different, but equally good, IR models may outperform each constituent as well as their intermediate fusions. Two kinds of experiments were carried out. One tested restricted fusions, which entails that only the inner disjoint overlap documents between fused models are ranked. The second set of experiments was based on traditional data fusion methods. The experiments involved the 30 TREC 5 topics that contain more than 44 relevant documents. In all tests, the Borda and CombSUM scoring methods were used. Performance was measured by precision and recall, with document cutoff values (DCVs) at 100 and 15 documents, respectively. Results show that restricted fusions made of two, three, or four cognitively/algorithmically very different retrieval models perform significantly better than do the individual models at DCV100. At DCV15, however, the results of polyrepresentative fusion were less predictable. The traditional fusion method based on polyrepresentation principles demonstrates a clear picture of performance at both DCV levels and verifies the polyrepresentation predictions for data fusion in IR. Data fusion improves retrieval performance over their constituent IR models only if the models all are quite conceptually/algorithmically dissimilar and equally and well performing, in that order of importance.

Date

22. 3.2009 18:48:28

Strzalkowski, T.; Perez-Carballo, J.: Natural language information retrieval : TREC-4 report (1996) 0.04

0.038405843 = product of:
  0.076811686 = sum of:
    0.076811686 = product of:
      0.15362337 = sum of:
        0.15362337 = weight(_text_:report in 3211) [ClassicSimilarity], result of:
          0.15362337 = score(doc=3211,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.6302661 = fieldWeight in 3211, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.09375 = fieldNorm(doc=3211)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

TREC-1: The first text retrieval conference : Rockville, MD, USA, 4-6 Nov. 1993 (1993) 0.04

0.038405843 = product of:
  0.076811686 = sum of:
    0.076811686 = product of:
      0.15362337 = sum of:
        0.15362337 = weight(_text_:report in 1315) [ClassicSimilarity], result of:
          0.15362337 = score(doc=1315,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.6302661 = fieldWeight in 1315, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.09375 = fieldNorm(doc=1315)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract: The issue contains the 9 papers of this conference together with an introductory conference report by D.K. Harman

Lancaster, F.W.: MEDLARS : report on the evaluation of its operating effiency (1961) 0.04

0.038405843 = product of:
  0.076811686 = sum of:
    0.076811686 = product of:
      0.15362337 = sum of:
        0.15362337 = weight(_text_:report in 1931) [ClassicSimilarity], result of:
          0.15362337 = score(doc=1931,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.6302661 = fieldWeight in 1931, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.09375 = fieldNorm(doc=1931)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Sanderson, M.; Ruthven, I.: Report on the Glasgow IR group (glair4) submission (1997) 0.04

0.038405843 = product of:
  0.076811686 = sum of:
    0.076811686 = product of:
      0.15362337 = sum of:
        0.15362337 = weight(_text_:report in 3088) [ClassicSimilarity], result of:
          0.15362337 = score(doc=3088,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.6302661 = fieldWeight in 3088, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.09375 = fieldNorm(doc=3088)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Hawking, D.; Thistlewaite, P.; Bailey, P.: ANU/ACSys TREC-5 experiments : TREC-5 report (1997) 0.04

0.038405843 = product of:
  0.076811686 = sum of:
    0.076811686 = product of:
      0.15362337 = sum of:
        0.15362337 = weight(_text_:report in 3101) [ClassicSimilarity], result of:
          0.15362337 = score(doc=3101,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.6302661 = fieldWeight in 3101, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.09375 = fieldNorm(doc=3101)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Savoy, J.; Calvé, A. le; Vrajitoru, D.: Report on the TREC5 experiment : data fusion and collection fusion (1997) 0.04

0.038405843 = product of:
  0.076811686 = sum of:
    0.076811686 = product of:
      0.15362337 = sum of:
        0.15362337 = weight(_text_:report in 3108) [ClassicSimilarity], result of:
          0.15362337 = score(doc=3108,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.6302661 = fieldWeight in 3108, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.09375 = fieldNorm(doc=3108)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Strzalkowski, T.; Guthrie, L.; Karlgren, J.; Leistensnider, J.; Lin, F.; Perez-Carballo, J.; Straszheim, T.; Wang, J.; Wilding, J.: Natural language information retrieval : TREC-5 report (1997) 0.03

0.03200487 = product of:
  0.06400974 = sum of:
    0.06400974 = product of:
      0.12801948 = sum of:
        0.12801948 = weight(_text_:report in 3100) [ClassicSimilarity], result of:
          0.12801948 = score(doc=3100,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.52522177 = fieldWeight in 3100, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.078125 = fieldNorm(doc=3100)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Bates, M.J.: Document familiarity, relevance, and Bradford's law : the Getty Online Searching Project report; no.5 (1996) 0.03

0.025603896 = product of:
  0.051207792 = sum of:
    0.051207792 = product of:
      0.102415584 = sum of:
        0.102415584 = weight(_text_:report in 6978) [ClassicSimilarity], result of:
          0.102415584 = score(doc=6978,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.4201774 = fieldWeight in 6978, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.0625 = fieldNorm(doc=6978)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Balog, K.; Schuth, A.; Dekker, P.; Tavakolpoursaleh, N.; Schaer, P.; Chuang, P.-Y.: Overview of the TREC 2016 Open Search track Academic Search Edition (2016) 0.03

0.025603896 = product of:
  0.051207792 = sum of:
    0.051207792 = product of:
      0.102415584 = sum of:
        0.102415584 = weight(_text_:report in 43) [ClassicSimilarity], result of:
          0.102415584 = score(doc=43,freq=2.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.4201774 = fieldWeight in 43, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.0625 = fieldNorm(doc=43)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract: We present the TREC Open Search track, which represents a new evaluation paradigm for information retrieval. It offers the possibility for researchers to evaluate their approaches in a live setting, with real, unsuspecting users of an existing search engine. The first edition of the track focuses on the academic search domain and features the ad-hoc scientific literature search task. We report on experiments with three different academic search engines: Cite-SeerX, SSOAR, and Microsoft Academic Search.

Fuhr, N.; Niewelt, B.: ¬Ein Retrievaltest mit automatisch indexierten Dokumenten (1984) 0.02

0.024314132 = product of:
  0.048628263 = sum of:
    0.048628263 = product of:
      0.09725653 = sum of:
        0.09725653 = weight(_text_:22 in 262) [ClassicSimilarity], result of:
          0.09725653 = score(doc=262,freq=2.0), product of:
            0.17955218 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.05127382 = queryNorm
            0.5416616 = fieldWeight in 262, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.109375 = fieldNorm(doc=262)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Date: 20.10.2000 12:22:23

Tomaiuolo, N.G.; Parker, J.: Maximizing relevant retrieval : keyword and natural language searching (1998) 0.02

0.024314132 = product of:
  0.048628263 = sum of:
    0.048628263 = product of:
      0.09725653 = sum of:
        0.09725653 = weight(_text_:22 in 6418) [ClassicSimilarity], result of:
          0.09725653 = score(doc=6418,freq=2.0), product of:
            0.17955218 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.05127382 = queryNorm
            0.5416616 = fieldWeight in 6418, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.109375 = fieldNorm(doc=6418)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Source: Online. 22(1998) no.6, S.57-58

Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000) 0.02

0.024314132 = product of:
  0.048628263 = sum of:
    0.048628263 = product of:
      0.09725653 = sum of:
        0.09725653 = weight(_text_:22 in 6438) [ClassicSimilarity], result of:
          0.09725653 = score(doc=6438,freq=2.0), product of:
            0.17955218 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.05127382 = queryNorm
            0.5416616 = fieldWeight in 6438, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.109375 = fieldNorm(doc=6438)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Date: 11. 8.2001 16:22:19

Dalrymple, P.W.: Retrieval by reformulation in two library catalogs : toward a cognitive model of searching behavior (1990) 0.02

0.024314132 = product of:
  0.048628263 = sum of:
    0.048628263 = product of:
      0.09725653 = sum of:
        0.09725653 = weight(_text_:22 in 5089) [ClassicSimilarity], result of:
          0.09725653 = score(doc=5089,freq=2.0), product of:
            0.17955218 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.05127382 = queryNorm
            0.5416616 = fieldWeight in 5089, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.109375 = fieldNorm(doc=5089)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Date: 22. 7.2006 18:43:54

Ruthven, I.; Baillie, M.; Elsweiler, D.: ¬The relative effects of knowledge, interest and confidence in assessing relevance (2007) 0.02
```
0.022630861 = product of:
  0.045261722 = sum of:
    0.045261722 = product of:
      0.090523444 = sum of:
        0.090523444 = weight(_text_:report in 835) [ClassicSimilarity], result of:
          0.090523444 = score(doc=835,freq=4.0), product of:
            0.24374367 = queryWeight, product of:
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.05127382 = queryNorm
            0.37138787 = fieldWeight in 835, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              4.7537646 = idf(docFreq=1035, maxDocs=44218)
              0.0390625 = fieldNorm(doc=835)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
```
Abstract

Purpose - The purpose of this paper is to examine how different aspects of an assessor's context, in particular their knowledge of a search topic, their interest in the search topic and their confidence in assessing relevance for a topic, affect the relevance judgements made and the assessor's ability to predict which documents they will assess as being relevant. Design/methodology/approach - The study was conducted as part of the Text REtrieval Conference (TREC) HARD track. Using a specially constructed questionnaire information was sought on TREC assessors' personal context and, using the TREC assessments gathered, the responses were correlated to the questionnaire questions and the final relevance decisions. Findings - This study found that each of the three factors (interest, knowledge and confidence) had an affect on how many documents were assessed as relevant and the balance between how many documents were marked as marginally or highly relevant. Also these factors are shown to affect an assessors' ability to predict what information they will finally mark as being relevant. Research limitations/implications - The major limitation is that the research is conducted within the TREC initiative. This means that we can report on results but cannot report on discussions with the assessors. The research implications are numerous but mainly on the effect of personal context on the outcomes of a user study. Practical implications - One major consequence is that we should take more account of how we construct search tasks for IIR evaluation to create tasks that are interesting and relevant to experimental subjects. Originality/value - Examining different search variables within one study to compare the relative effects on these variables on the search outcomes.

Search (62 results, page 1 of 4)

Authors

Years

Languages

Types

Themes