Document (#24607)

Author

Bateman, J.

Title

Modelling the importance of end-user relevance criteria

Source

Knowledge: creation, organization and use. Proceedings of the 62nd Annual Meeting of the American Society for Information Science, 31.10.-4.11.1999. Ed.: L. Woods

Imprint

Medford, NJ : Information Today

Year

1999

Pages

S.396-406

Series

Proceedings of the American Society for Information Science; vol.36

Abstract

In most information retrieval research, the concept of relevance has been defined a priori as a single variable by the researcher and the meaning of relevance to the end-user who is making relevance judgments has not been taken into account. However, a number of criteria that users employ in making relevance judgments has been identified (Schamher, 1991; Barry, 1993). Understanding these criteria and their importance to end-users can help researchers better understand end-user evaluation behavior. This study reports end-users' ratings of the relative importance of 40 relevance criteria as used in their own information-seeking situations, and examines relationships between criteria that they rated most important. Data were collected from 210 graduate students who were instructed in a mail survey to rate 40 relevance criteria by importance in their selection of the most valuable information source for a recent or current paper or project. The criteria were selected from previous studies in which open-ended interviews were used to elicit criteria from end-users making judgments in their own information-seeking situations (Schamher, 1991; Su, 1992; Barry, 1993). A model of relevance with three constructs that contribute to the concept of relevance was proposed using the eleven criteria that survey respondents rated as most important (75 or more on a scale of 0 to 100). The development of this model was guided by similarities in criteria and criteria groupings from previous research (Barry & Schamher, 1998). Confirmatory factor analysis was used to confirm the model and verify that the constructs would produce reliable subscale scores. The three constructs are information quality, information credibility, and information completeness. Second-order factor analysis indicated that these constructs explain 48% of positive relevance judgments for these respondents. Three additional constructs, information availability, information topicality, and information currency are also suggested. The constructs developed from this analysis are thought to underlie the concept of relevance for this group of users

Theme

Retrievalstudien

Similar documents (author)

1. Bateman, J.A.: On the relationship between ontology construction and natural language : a socio-semiotic view (1995) 6.09

   6.094361 = sum of:
     6.094361 = weight(author_txt:bateman in 4785) [ClassicSimilarity], result of:
       6.094361 = fieldWeight in 4785, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.7509775 = idf(docFreq=6, maxDocs=44218)
         0.625 = fieldNorm(doc=4785)
   

2. Bateman, J.A.: Automated discourse generation (1998) 6.09

   6.094361 = sum of:
     6.094361 = weight(author_txt:bateman in 1308) [ClassicSimilarity], result of:
       6.094361 = fieldWeight in 1308, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.7509775 = idf(docFreq=6, maxDocs=44218)
         0.625 = fieldNorm(doc=1308)
   

3. Bateman, J.; Teich, E.: Selective information presentation in an integrated publication system : an application of genre-driven text generation (1995) 4.88

   4.8754888 = sum of:
     4.8754888 = weight(author_txt:bateman in 2928) [ClassicSimilarity], result of:
       4.8754888 = fieldWeight in 2928, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.7509775 = idf(docFreq=6, maxDocs=44218)
         0.5 = fieldNorm(doc=2928)
   

4. Schamber, L.; Bateman, J.: User criteria in relevance evaluation : toward development of a measurement scale (1996) 4.88

   4.8754888 = sum of:
     4.8754888 = weight(author_txt:bateman in 7351) [ClassicSimilarity], result of:
       4.8754888 = fieldWeight in 7351, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.7509775 = idf(docFreq=6, maxDocs=44218)
         0.5 = fieldNorm(doc=7351)
   

5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 4.88

   4.8754888 = sum of:
     4.8754888 = weight(author_txt:bateman in 6691) [ClassicSimilarity], result of:
       4.8754888 = fieldWeight in 6691, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.7509775 = idf(docFreq=6, maxDocs=44218)
         0.5 = fieldNorm(doc=6691)
   

Similar documents (content)

1. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.82

   0.82313055 = sum of:
     0.82313055 = product of:
       1.3718842 = sum of:
         0.01691256 = weight(abstract_txt:user in 2592) [ClassicSimilarity], result of:
           0.01691256 = score(doc=2592,freq=2.0), product of:
             0.05936636 = queryWeight, product of:
               1.0082109 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.015985386 = queryNorm
             0.28488457 = fieldWeight in 2592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.03116359 = weight(abstract_txt:factor in 2592) [ClassicSimilarity], result of:
           0.03116359 = score(doc=2592,freq=1.0), product of:
             0.09820767 = queryWeight, product of:
               1.0587862 = boost
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.015985386 = queryNorm
             0.3173234 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.010062139 = weight(abstract_txt:their in 2592) [ClassicSimilarity], result of:
           0.010062139 = score(doc=2592,freq=1.0), product of:
             0.058234986 = queryWeight, product of:
               1.1530352 = boost
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.015985386 = queryNorm
             0.17278512 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.008419849 = weight(abstract_txt:from in 2592) [ClassicSimilarity], result of:
           0.008419849 = score(doc=2592,freq=1.0), product of:
             0.055705313 = queryWeight, product of:
               1.2608223 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.015985386 = queryNorm
             0.15114984 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.009003226 = weight(abstract_txt:that in 2592) [ClassicSimilarity], result of:
           0.009003226 = score(doc=2592,freq=2.0), product of:
             0.049129568 = queryWeight, product of:
               1.2970827 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015985386 = queryNorm
             0.18325473 = fieldWeight in 2592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.02230341 = weight(abstract_txt:were in 2592) [ClassicSimilarity], result of:
           0.02230341 = score(doc=2592,freq=2.0), product of:
             0.07857685 = queryWeight, product of:
               1.3393617 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.015985386 = queryNorm
             0.283842 = fieldWeight in 2592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.042420216 = weight(abstract_txt:making in 2592) [ClassicSimilarity], result of:
           0.042420216 = score(doc=2592,freq=2.0), product of:
             0.10959299 = queryWeight, product of:
               1.3698486 = boost
               5.0048037 = idf(docFreq=805, maxDocs=44218)
               0.015985386 = queryNorm
             0.38707054 = fieldWeight in 2592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0048037 = idf(docFreq=805, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.019567924 = weight(abstract_txt:most in 2592) [ClassicSimilarity], result of:
           0.019567924 = score(doc=2592,freq=1.0), product of:
             0.090730555 = queryWeight, product of:
               1.4392205 = boost
               3.943693 = idf(docFreq=2328, maxDocs=44218)
               0.015985386 = queryNorm
             0.2156707 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.943693 = idf(docFreq=2328, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.04056525 = weight(abstract_txt:users in 2592) [ClassicSimilarity], result of:
           0.04056525 = score(doc=2592,freq=5.0), product of:
             0.092926554 = queryWeight, product of:
               1.628454 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.015985386 = queryNorm
             0.4365302 = fieldWeight in 2592, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.042279676 = weight(abstract_txt:importance in 2592) [ClassicSimilarity], result of:
           0.042279676 = score(doc=2592,freq=1.0), product of:
             0.15163921 = queryWeight, product of:
               1.8606142 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.015985386 = queryNorm
             0.27881756 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.022633981 = weight(abstract_txt:information in 2592) [ClassicSimilarity], result of:
           0.022633981 = score(doc=2592,freq=4.0), product of:
             0.08547866 = queryWeight, product of:
               2.2087646 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015985386 = queryNorm
             0.264791 = fieldWeight in 2592, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.23362538 = weight(abstract_txt:judgments in 2592) [ClassicSimilarity], result of:
           0.23362538 = score(doc=2592,freq=5.0), product of:
             0.27717057 = queryWeight, product of:
               2.5154989 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.015985386 = queryNorm
             0.8428939 = fieldWeight in 2592, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.19239968 = weight(abstract_txt:barry in 2592) [ClassicSimilarity], result of:
           0.19239968 = score(doc=2592,freq=1.0), product of:
             0.3783384 = queryWeight, product of:
               2.545197 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.015985386 = queryNorm
             0.5085386 = fieldWeight in 2592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.27844936 = weight(abstract_txt:relevance in 2592) [ClassicSimilarity], result of:
           0.27844936 = score(doc=2592,freq=7.0), product of:
             0.39021096 = queryWeight, product of:
               4.9495606 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015985386 = queryNorm
             0.7135867 = fieldWeight in 2592, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
         0.40207794 = weight(abstract_txt:criteria in 2592) [ClassicSimilarity], result of:
           0.40207794 = score(doc=2592,freq=7.0), product of:
             0.49851182 = queryWeight, product of:
               5.5944147 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.015985386 = queryNorm
             0.80655646 = fieldWeight in 2592, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2592)
       0.6 = coord(15/25)
   

2. Crystal, A.; Greenberg, J.: Relevance criteria identified by health information users during Web searches (2006) 0.59

   0.5940281 = sum of:
     0.5940281 = product of:
       1.1423618 = sum of:
         0.0133362 = weight(abstract_txt:analysis in 5909) [ClassicSimilarity], result of:
           0.0133362 = score(doc=5909,freq=1.0), product of:
             0.05840333 = queryWeight, product of:
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.015985386 = queryNorm
             0.22834657 = fieldWeight in 5909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.013667413 = weight(abstract_txt:user in 5909) [ClassicSimilarity], result of:
           0.013667413 = score(doc=5909,freq=1.0), product of:
             0.05936636 = queryWeight, product of:
               1.0082109 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.015985386 = queryNorm
             0.23022151 = fieldWeight in 5909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.016262872 = weight(abstract_txt:their in 5909) [ClassicSimilarity], result of:
           0.016262872 = score(doc=5909,freq=2.0), product of:
             0.058234986 = queryWeight, product of:
               1.1530352 = boost
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.015985386 = queryNorm
             0.27926293 = fieldWeight in 5909, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.04731596 = weight(abstract_txt:situations in 5909) [ClassicSimilarity], result of:
           0.04731596 = score(doc=5909,freq=1.0), product of:
             0.11868365 = queryWeight, product of:
               1.1639411 = boost
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.015985386 = queryNorm
             0.39867294 = fieldWeight in 5909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.009622684 = weight(abstract_txt:from in 5909) [ClassicSimilarity], result of:
           0.009622684 = score(doc=5909,freq=1.0), product of:
             0.055705313 = queryWeight, product of:
               1.2608223 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.015985386 = queryNorm
             0.17274266 = fieldWeight in 5909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.0126018915 = weight(abstract_txt:that in 5909) [ClassicSimilarity], result of:
           0.0126018915 = score(doc=5909,freq=3.0), product of:
             0.049129568 = queryWeight, product of:
               1.2970827 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015985386 = queryNorm
             0.2565032 = fieldWeight in 5909, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.025489612 = weight(abstract_txt:were in 5909) [ClassicSimilarity], result of:
           0.025489612 = score(doc=5909,freq=2.0), product of:
             0.07857685 = queryWeight, product of:
               1.3393617 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.015985386 = queryNorm
             0.32439086 = fieldWeight in 5909, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.031626537 = weight(abstract_txt:most in 5909) [ClassicSimilarity], result of:
           0.031626537 = score(doc=5909,freq=2.0), product of:
             0.090730555 = queryWeight, product of:
               1.4392205 = boost
               3.943693 = idf(docFreq=2328, maxDocs=44218)
               0.015985386 = queryNorm
             0.3485765 = fieldWeight in 5909, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.943693 = idf(docFreq=2328, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.06556334 = weight(abstract_txt:users in 5909) [ClassicSimilarity], result of:
           0.06556334 = score(doc=5909,freq=10.0), product of:
             0.092926554 = queryWeight, product of:
               1.628454 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.015985386 = queryNorm
             0.70553935 = fieldWeight in 5909, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.025867408 = weight(abstract_txt:information in 5909) [ClassicSimilarity], result of:
           0.025867408 = score(doc=5909,freq=4.0), product of:
             0.08547866 = queryWeight, product of:
               2.2087646 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015985386 = queryNorm
             0.3026183 = fieldWeight in 5909, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.11940622 = weight(abstract_txt:judgments in 5909) [ClassicSimilarity], result of:
           0.11940622 = score(doc=5909,freq=1.0), product of:
             0.27717057 = queryWeight, product of:
               2.5154989 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.015985386 = queryNorm
             0.43080413 = fieldWeight in 5909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.24055764 = weight(abstract_txt:relevance in 5909) [ClassicSimilarity], result of:
           0.24055764 = score(doc=5909,freq=4.0), product of:
             0.39021096 = queryWeight, product of:
               4.9495606 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015985386 = queryNorm
             0.616481 = fieldWeight in 5909, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
         0.521044 = weight(abstract_txt:criteria in 5909) [ClassicSimilarity], result of:
           0.521044 = score(doc=5909,freq=9.0), product of:
             0.49851182 = queryWeight, product of:
               5.5944147 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.015985386 = queryNorm
             1.0451989 = fieldWeight in 5909, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0625 = fieldNorm(doc=5909)
       0.52 = coord(13/25)
   

3. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.43

   0.43041834 = sum of:
     0.43041834 = product of:
       1.0760459 = sum of:
         0.0133362 = weight(abstract_txt:analysis in 614) [ClassicSimilarity], result of:
           0.0133362 = score(doc=614,freq=1.0), product of:
             0.05840333 = queryWeight, product of:
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.015985386 = queryNorm
             0.22834657 = fieldWeight in 614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.01932864 = weight(abstract_txt:user in 614) [ClassicSimilarity], result of:
           0.01932864 = score(doc=614,freq=2.0), product of:
             0.05936636 = queryWeight, product of:
               1.0082109 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.015985386 = queryNorm
             0.32558239 = fieldWeight in 614, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.009622684 = weight(abstract_txt:from in 614) [ClassicSimilarity], result of:
           0.009622684 = score(doc=614,freq=1.0), product of:
             0.055705313 = queryWeight, product of:
               1.2608223 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.015985386 = queryNorm
             0.17274266 = fieldWeight in 614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.0072757057 = weight(abstract_txt:that in 614) [ClassicSimilarity], result of:
           0.0072757057 = score(doc=614,freq=1.0), product of:
             0.049129568 = queryWeight, product of:
               1.2970827 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015985386 = queryNorm
             0.1480922 = fieldWeight in 614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.03121827 = weight(abstract_txt:were in 614) [ClassicSimilarity], result of:
           0.03121827 = score(doc=614,freq=3.0), product of:
             0.07857685 = queryWeight, product of:
               1.3393617 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.015985386 = queryNorm
             0.39729604 = fieldWeight in 614, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.034280714 = weight(abstract_txt:making in 614) [ClassicSimilarity], result of:
           0.034280714 = score(doc=614,freq=1.0), product of:
             0.10959299 = queryWeight, product of:
               1.3698486 = boost
               5.0048037 = idf(docFreq=805, maxDocs=44218)
               0.015985386 = queryNorm
             0.31280023 = fieldWeight in 614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0048037 = idf(docFreq=805, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.02236334 = weight(abstract_txt:most in 614) [ClassicSimilarity], result of:
           0.02236334 = score(doc=614,freq=1.0), product of:
             0.090730555 = queryWeight, product of:
               1.4392205 = boost
               3.943693 = idf(docFreq=2328, maxDocs=44218)
               0.015985386 = queryNorm
             0.24648081 = fieldWeight in 614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.943693 = idf(docFreq=2328, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.20681764 = weight(abstract_txt:judgments in 614) [ClassicSimilarity], result of:
           0.20681764 = score(doc=614,freq=3.0), product of:
             0.27717057 = queryWeight, product of:
               2.5154989 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.015985386 = queryNorm
             0.74617463 = fieldWeight in 614, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.24055764 = weight(abstract_txt:relevance in 614) [ClassicSimilarity], result of:
           0.24055764 = score(doc=614,freq=4.0), product of:
             0.39021096 = queryWeight, product of:
               4.9495606 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015985386 = queryNorm
             0.616481 = fieldWeight in 614, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.491245 = weight(abstract_txt:criteria in 614) [ClassicSimilarity], result of:
           0.491245 = score(doc=614,freq=8.0), product of:
             0.49851182 = queryWeight, product of:
               5.5944147 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.015985386 = queryNorm
             0.98542297 = fieldWeight in 614, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
       0.4 = coord(10/25)
   

4. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.41

   0.40711 = sum of:
     0.40711 = product of:
       1.130861 = sum of:
         0.0133362 = weight(abstract_txt:analysis in 3608) [ClassicSimilarity], result of:
           0.0133362 = score(doc=3608,freq=1.0), product of:
             0.05840333 = queryWeight, product of:
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.015985386 = queryNorm
             0.22834657 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.01932864 = weight(abstract_txt:user in 3608) [ClassicSimilarity], result of:
           0.01932864 = score(doc=3608,freq=2.0), product of:
             0.05936636 = queryWeight, product of:
               1.0082109 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.015985386 = queryNorm
             0.32558239 = fieldWeight in 3608, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.009622684 = weight(abstract_txt:from in 3608) [ClassicSimilarity], result of:
           0.009622684 = score(doc=3608,freq=1.0), product of:
             0.055705313 = queryWeight, product of:
               1.2608223 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.015985386 = queryNorm
             0.17274266 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.036047757 = weight(abstract_txt:were in 3608) [ClassicSimilarity], result of:
           0.036047757 = score(doc=3608,freq=4.0), product of:
             0.07857685 = queryWeight, product of:
               1.3393617 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.015985386 = queryNorm
             0.45875797 = fieldWeight in 3608, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.048319627 = weight(abstract_txt:importance in 3608) [ClassicSimilarity], result of:
           0.048319627 = score(doc=3608,freq=1.0), product of:
             0.15163921 = queryWeight, product of:
               1.8606142 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.015985386 = queryNorm
             0.31864864 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.025867408 = weight(abstract_txt:information in 3608) [ClassicSimilarity], result of:
           0.025867408 = score(doc=3608,freq=4.0), product of:
             0.08547866 = queryWeight, product of:
               2.2087646 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015985386 = queryNorm
             0.3026183 = fieldWeight in 3608, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.1688659 = weight(abstract_txt:judgments in 3608) [ClassicSimilarity], result of:
           0.1688659 = score(doc=3608,freq=2.0), product of:
             0.27717057 = queryWeight, product of:
               2.5154989 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.015985386 = queryNorm
             0.60924906 = fieldWeight in 3608, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.31822783 = weight(abstract_txt:relevance in 3608) [ClassicSimilarity], result of:
           0.31822783 = score(doc=3608,freq=7.0), product of:
             0.39021096 = queryWeight, product of:
               4.9495606 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015985386 = queryNorm
             0.8155277 = fieldWeight in 3608, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.491245 = weight(abstract_txt:criteria in 3608) [ClassicSimilarity], result of:
           0.491245 = score(doc=3608,freq=8.0), product of:
             0.49851182 = queryWeight, product of:
               5.5944147 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.015985386 = queryNorm
             0.98542297 = fieldWeight in 3608, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
       0.36 = coord(9/25)
   

5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 0.39

   0.39485723 = sum of:
     0.39485723 = product of:
       0.98714304 = sum of:
         0.014374484 = weight(abstract_txt:their in 6691) [ClassicSimilarity], result of:
           0.014374484 = score(doc=6691,freq=1.0), product of:
             0.058234986 = queryWeight, product of:
               1.1530352 = boost
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.015985386 = queryNorm
             0.24683589 = fieldWeight in 6691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
         0.05914495 = weight(abstract_txt:situations in 6691) [ClassicSimilarity], result of:
           0.05914495 = score(doc=6691,freq=1.0), product of:
             0.11868365 = queryWeight, product of:
               1.1639411 = boost
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.015985386 = queryNorm
             0.49834117 = fieldWeight in 6691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
         0.012861752 = weight(abstract_txt:that in 6691) [ClassicSimilarity], result of:
           0.012861752 = score(doc=6691,freq=2.0), product of:
             0.049129568 = queryWeight, product of:
               1.2970827 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015985386 = queryNorm
             0.26179248 = fieldWeight in 6691, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
         0.04285089 = weight(abstract_txt:making in 6691) [ClassicSimilarity], result of:
           0.04285089 = score(doc=6691,freq=1.0), product of:
             0.10959299 = queryWeight, product of:
               1.3698486 = boost
               5.0048037 = idf(docFreq=805, maxDocs=44218)
               0.015985386 = queryNorm
             0.39100027 = fieldWeight in 6691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0048037 = idf(docFreq=805, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
         0.05795035 = weight(abstract_txt:users in 6691) [ClassicSimilarity], result of:
           0.05795035 = score(doc=6691,freq=5.0), product of:
             0.092926554 = queryWeight, product of:
               1.628454 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.015985386 = queryNorm
             0.62361455 = fieldWeight in 6691, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
         0.060399532 = weight(abstract_txt:importance in 6691) [ClassicSimilarity], result of:
           0.060399532 = score(doc=6691,freq=1.0), product of:
             0.15163921 = queryWeight, product of:
               1.8606142 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.015985386 = queryNorm
             0.39831078 = fieldWeight in 6691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
         0.022863774 = weight(abstract_txt:information in 6691) [ClassicSimilarity], result of:
           0.022863774 = score(doc=6691,freq=2.0), product of:
             0.08547866 = queryWeight, product of:
               2.2087646 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015985386 = queryNorm
             0.2674793 = fieldWeight in 6691, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
         0.1492578 = weight(abstract_txt:judgments in 6691) [ClassicSimilarity], result of:
           0.1492578 = score(doc=6691,freq=1.0), product of:
             0.27717057 = queryWeight, product of:
               2.5154989 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.015985386 = queryNorm
             0.5385052 = fieldWeight in 6691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
         0.2604113 = weight(abstract_txt:relevance in 6691) [ClassicSimilarity], result of:
           0.2604113 = score(doc=6691,freq=3.0), product of:
             0.39021096 = queryWeight, product of:
               4.9495606 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015985386 = queryNorm
             0.6673603 = fieldWeight in 6691, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
         0.30702814 = weight(abstract_txt:criteria in 6691) [ClassicSimilarity], result of:
           0.30702814 = score(doc=6691,freq=2.0), product of:
             0.49851182 = queryWeight, product of:
               5.5944147 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.015985386 = queryNorm
             0.6158894 = fieldWeight in 6691, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.078125 = fieldNorm(doc=6691)
       0.4 = coord(10/25)