Document (#4846)

Author

Janes, J.W.

Title

¬The binary nature of continous relevance judgements : a study of users' perceptions

Source

Journal of the American Society for Information Science. 42(1991) no.10, S.754-756

Year

1991

Abstract

Replicates a previous study by Eisenberg and Hu regarding users' perceptions of the binary or dichotomous nature of their relevance judgements. The studies examined the assumptions that searchers divide documents evenly into relevant and nonrelevant. 35 staff, faculty and doctoral students at Michigan Univ., School of Education and Dept. of Psychology conducted searchers and the retrieved documents submitted to the searchers in 3 incremental versions: title only; title and abstract; title, abstract and indexing information: At each stage the subjects were asked to judge the relevance of the document to the query. The findings support the earlier study and the break points between relevance and nonrelevance was not at or near 50%

Similar documents (author)

1. Janes, J.W.: ¬An alternative to precision (1991) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 3054) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 3054, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=3054)
   

2. Janes, J.W.: Relevance judgements and the incremental presentation of document representations (1991) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 3831) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 3831, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=3831)
   

3. Janes, J.W.: Towards a search theory of information (1989) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 4491) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 4491, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=4491)
   

4. Janes, J.W.: Other people's judgments : a comparison of users' and others' judgments of document relevance, topicality, and utility (1994) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 6929) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 6929, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=6929)
   

5. Janes, J.W.: Why I stopped teaching 'online searching' (1995) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 3135) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 3135, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=3135)
   

Similar documents (content)

1. Janes, J.W.: Relevance judgements and the incremental presentation of document representations (1991) 0.24

   0.24137051 = sum of:
     0.24137051 = product of:
       0.86203754 = sum of:
         0.01925831 = weight(abstract_txt:users in 3831) [ClassicSimilarity], result of:
           0.01925831 = score(doc=3831,freq=1.0), product of:
             0.069053695 = queryWeight, product of:
               1.09679 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0176369 = queryNorm
             0.2788889 = fieldWeight in 3831, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.078125 = fieldNorm(doc=3831)
         0.09986602 = weight(abstract_txt:doctoral in 3831) [ClassicSimilarity], result of:
           0.09986602 = score(doc=3831,freq=1.0), product of:
             0.16420132 = queryWeight, product of:
               1.1959233 = boost
               7.7848644 = idf(docFreq=49, maxDocs=44218)
               0.0176369 = queryNorm
             0.60819256 = fieldWeight in 3831, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7848644 = idf(docFreq=49, maxDocs=44218)
               0.078125 = fieldNorm(doc=3831)
         0.106727354 = weight(abstract_txt:incremental in 3831) [ClassicSimilarity], result of:
           0.106727354 = score(doc=3831,freq=1.0), product of:
             0.17163874 = queryWeight, product of:
               1.2227077 = boost
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.0176369 = queryNorm
             0.6218139 = fieldWeight in 3831, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.078125 = fieldNorm(doc=3831)
         0.029634533 = weight(abstract_txt:documents in 3831) [ClassicSimilarity], result of:
           0.029634533 = score(doc=3831,freq=1.0), product of:
             0.09203935 = queryWeight, product of:
               1.2662421 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0176369 = queryNorm
             0.32197678 = fieldWeight in 3831, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=3831)
         0.113039225 = weight(abstract_txt:perceptions in 3831) [ClassicSimilarity], result of:
           0.113039225 = score(doc=3831,freq=1.0), product of:
             0.22469544 = queryWeight, product of:
               1.9784594 = boost
               6.439392 = idf(docFreq=191, maxDocs=44218)
               0.0176369 = queryNorm
             0.5030775 = fieldWeight in 3831, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.439392 = idf(docFreq=191, maxDocs=44218)
               0.078125 = fieldNorm(doc=3831)
         0.34987435 = weight(abstract_txt:judgements in 3831) [ClassicSimilarity], result of:
           0.34987435 = score(doc=3831,freq=4.0), product of:
             0.3006281 = queryWeight, product of:
               2.2884676 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.0176369 = queryNorm
             1.1638112 = fieldWeight in 3831, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.078125 = fieldNorm(doc=3831)
         0.14363778 = weight(abstract_txt:relevance in 3831) [ClassicSimilarity], result of:
           0.14363778 = score(doc=3831,freq=2.0), product of:
             0.26360518 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0176369 = queryNorm
             0.5448974 = fieldWeight in 3831, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=3831)
       0.28 = coord(7/25)
   

2. Janes, J.W.; McKinney, R.: Relevance judgements of actual users and secondary judges : a comparative study (1992) 0.21

   0.20953894 = sum of:
     0.20953894 = product of:
       0.74835336 = sum of:
         0.040027644 = weight(abstract_txt:users in 4276) [ClassicSimilarity], result of:
           0.040027644 = score(doc=4276,freq=3.0), product of:
             0.069053695 = queryWeight, product of:
               1.09679 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0176369 = queryNorm
             0.5796597 = fieldWeight in 4276, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.099417776 = weight(abstract_txt:univ in 4276) [ClassicSimilarity], result of:
           0.099417776 = score(doc=4276,freq=1.0), product of:
             0.14497286 = queryWeight, product of:
               1.1237206 = boost
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.0176369 = queryNorm
             0.6857682 = fieldWeight in 4276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.12173432 = weight(abstract_txt:michigan in 4276) [ClassicSimilarity], result of:
           0.12173432 = score(doc=4276,freq=1.0), product of:
             0.16592787 = queryWeight, product of:
               1.2021943 = boost
               7.825686 = idf(docFreq=47, maxDocs=44218)
               0.0176369 = queryNorm
             0.7336581 = fieldWeight in 4276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.825686 = idf(docFreq=47, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.03556144 = weight(abstract_txt:documents in 4276) [ClassicSimilarity], result of:
           0.03556144 = score(doc=4276,freq=1.0), product of:
             0.09203935 = queryWeight, product of:
               1.2662421 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0176369 = queryNorm
             0.38637212 = fieldWeight in 4276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.030584013 = weight(abstract_txt:study in 4276) [ClassicSimilarity], result of:
           0.030584013 = score(doc=4276,freq=1.0), product of:
             0.0952827 = queryWeight, product of:
               1.5779116 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0176369 = queryNorm
             0.3209818 = fieldWeight in 4276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.20992462 = weight(abstract_txt:judgements in 4276) [ClassicSimilarity], result of:
           0.20992462 = score(doc=4276,freq=1.0), product of:
             0.3006281 = queryWeight, product of:
               2.2884676 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.0176369 = queryNorm
             0.6982868 = fieldWeight in 4276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.21110354 = weight(abstract_txt:relevance in 4276) [ClassicSimilarity], result of:
           0.21110354 = score(doc=4276,freq=3.0), product of:
             0.26360518 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0176369 = queryNorm
             0.80083233 = fieldWeight in 4276, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
       0.28 = coord(7/25)
   

3. Tang, R.; Solomon, P.: Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior (1998) 0.17

   0.16907494 = sum of:
     0.16907494 = product of:
       0.8453747 = sum of:
         0.05757622 = weight(abstract_txt:nature in 3268) [ClassicSimilarity], result of:
           0.05757622 = score(doc=3268,freq=1.0), product of:
             0.12690617 = queryWeight, product of:
               1.4868644 = boost
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.0176369 = queryNorm
             0.45369124 = fieldWeight in 3268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
         0.052973066 = weight(abstract_txt:study in 3268) [ClassicSimilarity], result of:
           0.052973066 = score(doc=3268,freq=3.0), product of:
             0.0952827 = queryWeight, product of:
               1.5779116 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0176369 = queryNorm
             0.5559568 = fieldWeight in 3268, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
         0.29687825 = weight(abstract_txt:judgements in 3268) [ClassicSimilarity], result of:
           0.29687825 = score(doc=3268,freq=2.0), product of:
             0.3006281 = queryWeight, product of:
               2.2884676 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.0176369 = queryNorm
             0.9875266 = fieldWeight in 3268, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
         0.16541366 = weight(abstract_txt:searchers in 3268) [ClassicSimilarity], result of:
           0.16541366 = score(doc=3268,freq=1.0), product of:
             0.29358375 = queryWeight, product of:
               2.7697568 = boost
               6.009912 = idf(docFreq=294, maxDocs=44218)
               0.0176369 = queryNorm
             0.56342924 = fieldWeight in 3268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.009912 = idf(docFreq=294, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
         0.2725335 = weight(abstract_txt:relevance in 3268) [ClassicSimilarity], result of:
           0.2725335 = score(doc=3268,freq=5.0), product of:
             0.26360518 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0176369 = queryNorm
             1.0338701 = fieldWeight in 3268, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
       0.2 = coord(5/25)
   

4. Spink, A.; Greisdorf, H.: Regions and levels : Measuring and mapping users' relevance judgements (2001) 0.15

   0.15278096 = sum of:
     0.15278096 = product of:
       0.6365874 = sum of:
         0.030813295 = weight(abstract_txt:users in 5586) [ClassicSimilarity], result of:
           0.030813295 = score(doc=5586,freq=4.0), product of:
             0.069053695 = queryWeight, product of:
               1.09679 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0176369 = queryNorm
             0.44622225 = fieldWeight in 5586, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0625 = fieldNorm(doc=5586)
         0.08389349 = weight(abstract_txt:judge in 5586) [ClassicSimilarity], result of:
           0.08389349 = score(doc=5586,freq=1.0), product of:
             0.16963822 = queryWeight, product of:
               1.2155613 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0176369 = queryNorm
             0.4945436 = fieldWeight in 5586, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0625 = fieldNorm(doc=5586)
         0.15063775 = weight(abstract_txt:dichotomous in 5586) [ClassicSimilarity], result of:
           0.15063775 = score(doc=5586,freq=1.0), product of:
             0.2506075 = queryWeight, product of:
               1.4774474 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0176369 = queryNorm
             0.6010904 = fieldWeight in 5586, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=5586)
         0.038384143 = weight(abstract_txt:nature in 5586) [ClassicSimilarity], result of:
           0.038384143 = score(doc=5586,freq=1.0), product of:
             0.12690617 = queryWeight, product of:
               1.4868644 = boost
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.0176369 = queryNorm
             0.30246082 = fieldWeight in 5586, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.0625 = fieldNorm(doc=5586)
         0.028834885 = weight(abstract_txt:study in 5586) [ClassicSimilarity], result of:
           0.028834885 = score(doc=5586,freq=2.0), product of:
             0.0952827 = queryWeight, product of:
               1.5779116 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0176369 = queryNorm
             0.30262455 = fieldWeight in 5586, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0625 = fieldNorm(doc=5586)
         0.30402386 = weight(abstract_txt:relevance in 5586) [ClassicSimilarity], result of:
           0.30402386 = score(doc=5586,freq=14.0), product of:
             0.26360518 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0176369 = queryNorm
             1.1533304 = fieldWeight in 5586, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5586)
       0.24 = coord(6/25)
   

5. Moreira Orengo, V.; Huyck, C.: Relevance feedback and cross-language information retrieval (2006) 0.14

   0.1365592 = sum of:
     0.1365592 = product of:
       0.56899667 = sum of:
         0.01925831 = weight(abstract_txt:users in 970) [ClassicSimilarity], result of:
           0.01925831 = score(doc=970,freq=1.0), product of:
             0.069053695 = queryWeight, product of:
               1.09679 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0176369 = queryNorm
             0.2788889 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.10486687 = weight(abstract_txt:judge in 970) [ClassicSimilarity], result of:
           0.10486687 = score(doc=970,freq=1.0), product of:
             0.16963822 = queryWeight, product of:
               1.2155613 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0176369 = queryNorm
             0.6181795 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.0784056 = weight(abstract_txt:documents in 970) [ClassicSimilarity], result of:
           0.0784056 = score(doc=970,freq=7.0), product of:
             0.09203935 = queryWeight, product of:
               1.2662421 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0176369 = queryNorm
             0.8518704 = fieldWeight in 970, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.02548668 = weight(abstract_txt:study in 970) [ClassicSimilarity], result of:
           0.02548668 = score(doc=970,freq=1.0), product of:
             0.0952827 = queryWeight, product of:
               1.5779116 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0176369 = queryNorm
             0.26748484 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.13784473 = weight(abstract_txt:searchers in 970) [ClassicSimilarity], result of:
           0.13784473 = score(doc=970,freq=1.0), product of:
             0.29358375 = queryWeight, product of:
               2.7697568 = boost
               6.009912 = idf(docFreq=294, maxDocs=44218)
               0.0176369 = queryNorm
             0.46952438 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.009912 = idf(docFreq=294, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.20313449 = weight(abstract_txt:relevance in 970) [ClassicSimilarity], result of:
           0.20313449 = score(doc=970,freq=4.0), product of:
             0.26360518 = queryWeight, product of:
               3.0305536 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0176369 = queryNorm
             0.7706013 = fieldWeight in 970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
       0.24 = coord(6/25)