Document (#3832)

Author

Janes, J.W.

Title

Relevance judgements and the incremental presentation of document representations

Source

Information processing and management. 27(1991) no.6, S.629-646

Year

1991

Abstract

Examines how users' judgements of the relevance of documents change as more information about the document is revealed to them. Subjects (university faculty and doctoral students) viewed 3 incremental versions of ducuments, and recorded ratio-level relevance judgements for each version. These judgements were analysed by a variety of methods, including graphical inspection and examination of the number and degree of changes of judgements as new information is seen. A questionnaire was aöso administered to obtain subjects' perceptions of the process and the individual fields of information presented. A consistent pattern of perception and importance of these fields is seen: Abstracts are by far the most important field and have the greatest impact, following by titles, bibliographic information and indexing

Similar documents (author)

1. Janes, J.W.: ¬An alternative to precision (1991) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 3054) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 3054, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=3054)
   

2. Janes, J.W.: Towards a search theory of information (1989) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 4491) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 4491, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=4491)
   

3. Janes, J.W.: ¬The binary nature of continous relevance judgements : a study of users' perceptions (1991) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 4845) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 4845, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=4845)
   

4. Janes, J.W.: Other people's judgments : a comparison of users' and others' judgments of document relevance, topicality, and utility (1994) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 6929) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 6929, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=6929)
   

5. Janes, J.W.: Why I stopped teaching 'online searching' (1995) 5.50

   5.504072 = sum of:
     5.504072 = weight(author_txt:janes in 3135) [ClassicSimilarity], result of:
       5.504072 = fieldWeight in 3135, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.806516 = idf(docFreq=17, maxDocs=44218)
         0.625 = fieldNorm(doc=3135)
   

Similar documents (content)

1. Janes, J.W.: ¬The binary nature of continous relevance judgements : a study of users' perceptions (1991) 0.53

   0.5257955 = sum of:
     0.5257955 = product of:
       1.3144888 = sum of:
         0.058628894 = weight(abstract_txt:versions in 4845) [ClassicSimilarity], result of:
           0.058628894 = score(doc=4845,freq=1.0), product of:
             0.10005758 = queryWeight, product of:
               1.0013752 = boost
               6.2501497 = idf(docFreq=231, maxDocs=44218)
               0.015986845 = queryNorm
             0.58595157 = fieldWeight in 4845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2501497 = idf(docFreq=231, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
         0.062323336 = weight(abstract_txt:faculty in 4845) [ClassicSimilarity], result of:
           0.062323336 = score(doc=4845,freq=1.0), product of:
             0.104217984 = queryWeight, product of:
               1.0219818 = boost
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.015986845 = queryNorm
             0.5980094 = fieldWeight in 4845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
         0.064117275 = weight(abstract_txt:perceptions in 4845) [ClassicSimilarity], result of:
           0.064117275 = score(doc=4845,freq=1.0), product of:
             0.106208414 = queryWeight, product of:
               1.0316949 = boost
               6.439392 = idf(docFreq=191, maxDocs=44218)
               0.015986845 = queryNorm
             0.603693 = fieldWeight in 4845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.439392 = idf(docFreq=191, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
         0.11329053 = weight(abstract_txt:doctoral in 4845) [ClassicSimilarity], result of:
           0.11329053 = score(doc=4845,freq=1.0), product of:
             0.15522844 = queryWeight, product of:
               1.2472614 = boost
               7.7848644 = idf(docFreq=49, maxDocs=44218)
               0.015986845 = queryNorm
             0.72983104 = fieldWeight in 4845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7848644 = idf(docFreq=49, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
         0.037986934 = weight(abstract_txt:document in 4845) [ClassicSimilarity], result of:
           0.037986934 = score(doc=4845,freq=1.0), product of:
             0.09439342 = queryWeight, product of:
               1.3754908 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.015986845 = queryNorm
             0.40243202 = fieldWeight in 4845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
         0.013628747 = weight(abstract_txt:information in 4845) [ClassicSimilarity], result of:
           0.013628747 = score(doc=4845,freq=1.0), product of:
             0.06004813 = queryWeight, product of:
               1.5514992 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015986845 = queryNorm
             0.22696373 = fieldWeight in 4845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
         0.07655598 = weight(abstract_txt:subjects in 4845) [ClassicSimilarity], result of:
           0.07655598 = score(doc=4845,freq=1.0), product of:
             0.15060462 = queryWeight, product of:
               1.7374246 = boost
               5.4221253 = idf(docFreq=530, maxDocs=44218)
               0.015986845 = queryNorm
             0.50832427 = fieldWeight in 4845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4221253 = idf(docFreq=530, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
         0.14967574 = weight(abstract_txt:relevance in 4845) [ClassicSimilarity], result of:
           0.14967574 = score(doc=4845,freq=3.0), product of:
             0.18690023 = queryWeight, product of:
               2.3704858 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015986845 = queryNorm
             0.80083233 = fieldWeight in 4845, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
         0.2421484 = weight(abstract_txt:incremental in 4845) [ClassicSimilarity], result of:
           0.2421484 = score(doc=4845,freq=1.0), product of:
             0.32451886 = queryWeight, product of:
               2.5503912 = boost
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.015986845 = queryNorm
             0.74617666 = fieldWeight in 4845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
         0.49613288 = weight(abstract_txt:judgements in 4845) [ClassicSimilarity], result of:
           0.49613288 = score(doc=4845,freq=1.0), product of:
             0.7105002 = queryWeight, product of:
               5.966765 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.015986845 = queryNorm
             0.6982868 = fieldWeight in 4845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.09375 = fieldNorm(doc=4845)
       0.4 = coord(10/25)
   

2. Janes, J.W.; McKinney, R.: Relevance judgements of actual users and secondary judges : a comparative study (1992) 0.20

   0.20332718 = sum of:
     0.20332718 = product of:
       0.8471966 = sum of:
         0.0728749 = weight(abstract_txt:analysed in 4276) [ClassicSimilarity], result of:
           0.0728749 = score(doc=4276,freq=1.0), product of:
             0.11567181 = queryWeight, product of:
               1.0766774 = boost
               6.7201533 = idf(docFreq=144, maxDocs=44218)
               0.015986845 = queryNorm
             0.63001436 = fieldWeight in 4276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7201533 = idf(docFreq=144, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.053721637 = weight(abstract_txt:document in 4276) [ClassicSimilarity], result of:
           0.053721637 = score(doc=4276,freq=2.0), product of:
             0.09439342 = queryWeight, product of:
               1.3754908 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.015986845 = queryNorm
             0.5691248 = fieldWeight in 4276, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.013628747 = weight(abstract_txt:information in 4276) [ClassicSimilarity], result of:
           0.013628747 = score(doc=4276,freq=1.0), product of:
             0.06004813 = queryWeight, product of:
               1.5514992 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015986845 = queryNorm
             0.22696373 = fieldWeight in 4276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.06116262 = weight(abstract_txt:fields in 4276) [ClassicSimilarity], result of:
           0.06116262 = score(doc=4276,freq=1.0), product of:
             0.12967102 = queryWeight, product of:
               1.6121606 = boost
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.015986845 = queryNorm
             0.4716753 = fieldWeight in 4276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.14967574 = weight(abstract_txt:relevance in 4276) [ClassicSimilarity], result of:
           0.14967574 = score(doc=4276,freq=3.0), product of:
             0.18690023 = queryWeight, product of:
               2.3704858 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015986845 = queryNorm
             0.80083233 = fieldWeight in 4276, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
         0.49613288 = weight(abstract_txt:judgements in 4276) [ClassicSimilarity], result of:
           0.49613288 = score(doc=4276,freq=1.0), product of:
             0.7105002 = queryWeight, product of:
               5.966765 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.015986845 = queryNorm
             0.6982868 = fieldWeight in 4276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.09375 = fieldNorm(doc=4276)
       0.24 = coord(6/25)
   

3. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.20

   0.20088878 = sum of:
     0.20088878 = product of:
       1.2555549 = sum of:
         0.037986934 = weight(abstract_txt:document in 3308) [ClassicSimilarity], result of:
           0.037986934 = score(doc=3308,freq=1.0), product of:
             0.09439342 = queryWeight, product of:
               1.3754908 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.015986845 = queryNorm
             0.40243202 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.013628747 = weight(abstract_txt:information in 3308) [ClassicSimilarity], result of:
           0.013628747 = score(doc=3308,freq=1.0), product of:
             0.06004813 = queryWeight, product of:
               1.5514992 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015986845 = queryNorm
             0.22696373 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.21167347 = weight(abstract_txt:relevance in 3308) [ClassicSimilarity], result of:
           0.21167347 = score(doc=3308,freq=6.0), product of:
             0.18690023 = queryWeight, product of:
               2.3704858 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015986845 = queryNorm
             1.132548 = fieldWeight in 3308, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.99226576 = weight(abstract_txt:judgements in 3308) [ClassicSimilarity], result of:
           0.99226576 = score(doc=3308,freq=4.0), product of:
             0.7105002 = queryWeight, product of:
               5.966765 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.015986845 = queryNorm
             1.3965735 = fieldWeight in 3308, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
       0.16 = coord(4/25)
   

4. Park, H.: Relevance of science information : origins and dimensions of relevance and their implications to information retrieval (1997) 0.16

   0.15576454 = sum of:
     0.15576454 = product of:
       0.9735283 = sum of:
         0.018340535 = weight(abstract_txt:these in 154) [ClassicSimilarity], result of:
           0.018340535 = score(doc=154,freq=2.0), product of:
             0.05206802 = queryWeight, product of:
               1.02158 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.015986845 = queryNorm
             0.35224184 = fieldWeight in 154, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.078125 = fieldNorm(doc=154)
         0.011357289 = weight(abstract_txt:information in 154) [ClassicSimilarity], result of:
           0.011357289 = score(doc=154,freq=1.0), product of:
             0.06004813 = queryWeight, product of:
               1.5514992 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015986845 = queryNorm
             0.18913643 = fieldWeight in 154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=154)
         0.22772439 = weight(abstract_txt:relevance in 154) [ClassicSimilarity], result of:
           0.22772439 = score(doc=154,freq=10.0), product of:
             0.18690023 = queryWeight, product of:
               2.3704858 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015986845 = queryNorm
             1.2184275 = fieldWeight in 154, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=154)
         0.7161061 = weight(abstract_txt:judgements in 154) [ClassicSimilarity], result of:
           0.7161061 = score(doc=154,freq=3.0), product of:
             0.7105002 = queryWeight, product of:
               5.966765 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.015986845 = queryNorm
             1.0078901 = fieldWeight in 154, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.078125 = fieldNorm(doc=154)
       0.16 = coord(4/25)
   

5. Barry, C.L.; Schamber, L.: Users' criteria for relevance evaluation : a cross-situational comparison (1998) 0.15

   0.15081681 = sum of:
     0.15081681 = product of:
       0.6284034 = sum of:
         0.05022225 = weight(abstract_txt:obtain in 3271) [ClassicSimilarity], result of:
           0.05022225 = score(doc=3271,freq=1.0), product of:
             0.10191243 = queryWeight, product of:
               1.0106143 = boost
               6.3078156 = idf(docFreq=218, maxDocs=44218)
               0.015986845 = queryNorm
             0.4927981 = fieldWeight in 3271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3078156 = idf(docFreq=218, maxDocs=44218)
               0.078125 = fieldNorm(doc=3271)
         0.012968718 = weight(abstract_txt:these in 3271) [ClassicSimilarity], result of:
           0.012968718 = score(doc=3271,freq=1.0), product of:
             0.05206802 = queryWeight, product of:
               1.02158 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.015986845 = queryNorm
             0.24907261 = fieldWeight in 3271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.078125 = fieldNorm(doc=3271)
         0.051936112 = weight(abstract_txt:faculty in 3271) [ClassicSimilarity], result of:
           0.051936112 = score(doc=3271,freq=1.0), product of:
             0.104217984 = queryWeight, product of:
               1.0219818 = boost
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.015986845 = queryNorm
             0.49834117 = fieldWeight in 3271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.078125 = fieldNorm(doc=3271)
         0.027819565 = weight(abstract_txt:information in 3271) [ClassicSimilarity], result of:
           0.027819565 = score(doc=3271,freq=6.0), product of:
             0.06004813 = queryWeight, product of:
               1.5514992 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015986845 = queryNorm
             0.46328777 = fieldWeight in 3271, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=3271)
         0.072012775 = weight(abstract_txt:relevance in 3271) [ClassicSimilarity], result of:
           0.072012775 = score(doc=3271,freq=1.0), product of:
             0.18690023 = queryWeight, product of:
               2.3704858 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015986845 = queryNorm
             0.38530064 = fieldWeight in 3271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=3271)
         0.41344404 = weight(abstract_txt:judgements in 3271) [ClassicSimilarity], result of:
           0.41344404 = score(doc=3271,freq=1.0), product of:
             0.7105002 = queryWeight, product of:
               5.966765 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.015986845 = queryNorm
             0.5819056 = fieldWeight in 3271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.078125 = fieldNorm(doc=3271)
       0.24 = coord(6/25)