Document (#24605)

Author

Bateman, J.

Title

Modelling the importance of end-user relevance criteria

Source

Knowledge: creation, organization and use. Proceedings of the 62nd Annual Meeting of the American Society for Information Science, 31.10.-4.11.1999. Ed.: L. Woods

Imprint

Medford, NJ : Information Today

Year

1999

Pages

S.396-406

Series

Proceedings of the American Society for Information Science; vol.36

Abstract

In most information retrieval research, the concept of relevance has been defined a priori as a single variable by the researcher and the meaning of relevance to the end-user who is making relevance judgments has not been taken into account. However, a number of criteria that users employ in making relevance judgments has been identified (Schamher, 1991; Barry, 1993). Understanding these criteria and their importance to end-users can help researchers better understand end-user evaluation behavior. This study reports end-users' ratings of the relative importance of 40 relevance criteria as used in their own information-seeking situations, and examines relationships between criteria that they rated most important. Data were collected from 210 graduate students who were instructed in a mail survey to rate 40 relevance criteria by importance in their selection of the most valuable information source for a recent or current paper or project. The criteria were selected from previous studies in which open-ended interviews were used to elicit criteria from end-users making judgments in their own information-seeking situations (Schamher, 1991; Su, 1992; Barry, 1993). A model of relevance with three constructs that contribute to the concept of relevance was proposed using the eleven criteria that survey respondents rated as most important (75 or more on a scale of 0 to 100). The development of this model was guided by similarities in criteria and criteria groupings from previous research (Barry & Schamher, 1998). Confirmatory factor analysis was used to confirm the model and verify that the constructs would produce reliable subscale scores. The three constructs are information quality, information credibility, and information completeness. Second-order factor analysis indicated that these constructs explain 48% of positive relevance judgments for these respondents. Three additional constructs, information availability, information topicality, and information currency are also suggested. The constructs developed from this analysis are thought to underlie the concept of relevance for this group of users

Theme

Retrievalstudien

Similar documents (author)

1. Bateman, J.A.: On the relationship between ontology construction and natural language : a socio-semiotic view (1995) 6.08

   6.084933 = sum of:
     6.084933 = weight(author_txt:bateman in 4851) [ClassicSimilarity], result of:
       6.084933 = fieldWeight in 4851, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.735892 = idf(docFreq=6, maxDocs=43556)
         0.625 = fieldNorm(doc=4851)
   

2. Bateman, J.A.: Automated discourse generation (1998) 6.08

   6.084933 = sum of:
     6.084933 = weight(author_txt:bateman in 2306) [ClassicSimilarity], result of:
       6.084933 = fieldWeight in 2306, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.735892 = idf(docFreq=6, maxDocs=43556)
         0.625 = fieldNorm(doc=2306)
   

3. Bateman, J.; Teich, E.: Selective information presentation in an integrated publication system : an application of genre-driven text generation (1995) 4.87

   4.867946 = sum of:
     4.867946 = weight(author_txt:bateman in 2994) [ClassicSimilarity], result of:
       4.867946 = fieldWeight in 2994, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.735892 = idf(docFreq=6, maxDocs=43556)
         0.5 = fieldNorm(doc=2994)
   

4. Schamber, L.; Bateman, J.: User criteria in relevance evaluation : toward development of a measurement scale (1996) 4.87

   4.867946 = sum of:
     4.867946 = weight(author_txt:bateman in 418) [ClassicSimilarity], result of:
       4.867946 = fieldWeight in 418, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.735892 = idf(docFreq=6, maxDocs=43556)
         0.5 = fieldNorm(doc=418)
   

5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 4.87

   4.867946 = sum of:
     4.867946 = weight(author_txt:bateman in 689) [ClassicSimilarity], result of:
       4.867946 = fieldWeight in 689, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.735892 = idf(docFreq=6, maxDocs=43556)
         0.5 = fieldNorm(doc=689)
   

Similar documents (content)

1. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.83

   0.82532877 = sum of:
     0.82532877 = product of:
       1.3755479 = sum of:
         0.016845856 = weight(abstract_txt:user in 3590) [ClassicSimilarity], result of:
           0.016845856 = score(doc=3590,freq=2.0), product of:
             0.05917658 = queryWeight, product of:
               1.0033593 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.016023345 = queryNorm
             0.284671 = fieldWeight in 3590, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.031226547 = weight(abstract_txt:factor in 3590) [ClassicSimilarity], result of:
           0.031226547 = score(doc=3590,freq=1.0), product of:
             0.09828412 = queryWeight, product of:
               1.0557901 = boost
               5.8096848 = idf(docFreq=354, maxDocs=43556)
               0.016023345 = queryNorm
             0.31771713 = fieldWeight in 3590, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8096848 = idf(docFreq=354, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.010215667 = weight(abstract_txt:their in 3590) [ClassicSimilarity], result of:
           0.010215667 = score(doc=3590,freq=1.0), product of:
             0.058792487 = queryWeight, product of:
               1.1548134 = boost
               3.1772897 = idf(docFreq=4936, maxDocs=43556)
               0.016023345 = queryNorm
             0.17375803 = fieldWeight in 3590, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1772897 = idf(docFreq=4936, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.00853112 = weight(abstract_txt:from in 3590) [ClassicSimilarity], result of:
           0.00853112 = score(doc=3590,freq=1.0), product of:
             0.05616314 = queryWeight, product of:
               1.2619194 = boost
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.016023345 = queryNorm
             0.1518989 = fieldWeight in 3590, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.0091279 = weight(abstract_txt:that in 3590) [ClassicSimilarity], result of:
           0.0091279 = score(doc=3590,freq=2.0), product of:
             0.04955396 = queryWeight, product of:
               1.2984813 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.016023345 = queryNorm
             0.18420123 = fieldWeight in 3590, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.02246114 = weight(abstract_txt:were in 3590) [ClassicSimilarity], result of:
           0.02246114 = score(doc=3590,freq=2.0), product of:
             0.0789021 = queryWeight, product of:
               1.3378123 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.016023345 = queryNorm
             0.284671 = fieldWeight in 3590, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.042766348 = weight(abstract_txt:making in 3590) [ClassicSimilarity], result of:
           0.042766348 = score(doc=3590,freq=2.0), product of:
             0.11012584 = queryWeight, product of:
               1.3687564 = boost
               5.0212274 = idf(docFreq=780, maxDocs=43556)
               0.016023345 = queryNorm
             0.3883407 = fieldWeight in 3590, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0212274 = idf(docFreq=780, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.019646242 = weight(abstract_txt:most in 3590) [ClassicSimilarity], result of:
           0.019646242 = score(doc=3590,freq=1.0), product of:
             0.09092089 = queryWeight, product of:
               1.4360936 = boost
               3.9511886 = idf(docFreq=2276, maxDocs=43556)
               0.016023345 = queryNorm
             0.21608062 = fieldWeight in 3590, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9511886 = idf(docFreq=2276, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.040571123 = weight(abstract_txt:users in 3590) [ClassicSimilarity], result of:
           0.040571123 = score(doc=3590,freq=5.0), product of:
             0.09288282 = queryWeight, product of:
               1.6228322 = boost
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.016023345 = queryNorm
             0.43679902 = fieldWeight in 3590, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.04255501 = weight(abstract_txt:importance in 3590) [ClassicSimilarity], result of:
           0.04255501 = score(doc=3590,freq=1.0), product of:
             0.15221046 = queryWeight, product of:
               1.8581173 = boost
               5.1123214 = idf(docFreq=712, maxDocs=43556)
               0.016023345 = queryNorm
             0.2795801 = fieldWeight in 3590, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1123214 = idf(docFreq=712, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.02271612 = weight(abstract_txt:information in 3590) [ClassicSimilarity], result of:
           0.02271612 = score(doc=3590,freq=4.0), product of:
             0.08563674 = queryWeight, product of:
               2.2036924 = boost
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.016023345 = queryNorm
             0.26526138 = fieldWeight in 3590, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.23595525 = weight(abstract_txt:judgments in 3590) [ClassicSimilarity], result of:
           0.23595525 = score(doc=3590,freq=5.0), product of:
             0.27885202 = queryWeight, product of:
               2.514999 = boost
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.016023345 = queryNorm
             0.84616655 = fieldWeight in 3590, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.19113931 = weight(abstract_txt:barry in 3590) [ClassicSimilarity], result of:
           0.19113931 = score(doc=3590,freq=1.0), product of:
             0.37647063 = queryWeight, product of:
               2.5307374 = boost
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.016023345 = queryNorm
             0.50771374 = fieldWeight in 3590, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.283908 = idf(docFreq=10, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.2783764 = weight(abstract_txt:relevance in 3590) [ClassicSimilarity], result of:
           0.2783764 = score(doc=3590,freq=7.0), product of:
             0.3899215 = queryWeight, product of:
               4.931804 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.016023345 = queryNorm
             0.71392936 = fieldWeight in 3590, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
         0.40341386 = weight(abstract_txt:criteria in 3590) [ClassicSimilarity], result of:
           0.40341386 = score(doc=3590,freq=7.0), product of:
             0.49933207 = queryWeight, product of:
               5.5809994 = boost
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.016023345 = queryNorm
             0.807907 = fieldWeight in 3590, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.0546875 = fieldNorm(doc=3590)
       0.6 = coord(15/25)
   

2. Crystal, A.; Greenberg, J.: Relevance criteria identified by health information users during Web searches (2006) 0.60

   0.5960144 = sum of:
     0.5960144 = product of:
       1.1461816 = sum of:
         0.013477231 = weight(abstract_txt:analysis in 907) [ClassicSimilarity], result of:
           0.013477231 = score(doc=907,freq=1.0), product of:
             0.058780994 = queryWeight, product of:
               3.6684597 = idf(docFreq=3020, maxDocs=43556)
               0.016023345 = queryNorm
             0.22927873 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6684597 = idf(docFreq=3020, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.013613508 = weight(abstract_txt:user in 907) [ClassicSimilarity], result of:
           0.013613508 = score(doc=907,freq=1.0), product of:
             0.05917658 = queryWeight, product of:
               1.0033593 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.016023345 = queryNorm
             0.23004892 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.016511012 = weight(abstract_txt:their in 907) [ClassicSimilarity], result of:
           0.016511012 = score(doc=907,freq=2.0), product of:
             0.058792487 = queryWeight, product of:
               1.1548134 = boost
               3.1772897 = idf(docFreq=4936, maxDocs=43556)
               0.016023345 = queryNorm
             0.2808354 = fieldWeight in 907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1772897 = idf(docFreq=4936, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.047229502 = weight(abstract_txt:situations in 907) [ClassicSimilarity], result of:
           0.047229502 = score(doc=907,freq=1.0), product of:
             0.118471794 = queryWeight, product of:
               1.15916 = boost
               6.3784976 = idf(docFreq=200, maxDocs=43556)
               0.016023345 = queryNorm
             0.3986561 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3784976 = idf(docFreq=200, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.009749851 = weight(abstract_txt:from in 907) [ClassicSimilarity], result of:
           0.009749851 = score(doc=907,freq=1.0), product of:
             0.05616314 = queryWeight, product of:
               1.2619194 = boost
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.016023345 = queryNorm
             0.17359875 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.012776398 = weight(abstract_txt:that in 907) [ClassicSimilarity], result of:
           0.012776398 = score(doc=907,freq=3.0), product of:
             0.04955396 = queryWeight, product of:
               1.2984813 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.016023345 = queryNorm
             0.257828 = fieldWeight in 907, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.025669876 = weight(abstract_txt:were in 907) [ClassicSimilarity], result of:
           0.025669876 = score(doc=907,freq=2.0), product of:
             0.0789021 = queryWeight, product of:
               1.3378123 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.016023345 = queryNorm
             0.3253383 = fieldWeight in 907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.031753123 = weight(abstract_txt:most in 907) [ClassicSimilarity], result of:
           0.031753123 = score(doc=907,freq=2.0), product of:
             0.09092089 = queryWeight, product of:
               1.4360936 = boost
               3.9511886 = idf(docFreq=2276, maxDocs=43556)
               0.016023345 = queryNorm
             0.34923902 = fieldWeight in 907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9511886 = idf(docFreq=2276, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.06557284 = weight(abstract_txt:users in 907) [ClassicSimilarity], result of:
           0.06557284 = score(doc=907,freq=10.0), product of:
             0.09288282 = queryWeight, product of:
               1.6228322 = boost
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.016023345 = queryNorm
             0.70597386 = fieldWeight in 907, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.025961282 = weight(abstract_txt:information in 907) [ClassicSimilarity], result of:
           0.025961282 = score(doc=907,freq=4.0), product of:
             0.08563674 = queryWeight, product of:
               2.2036924 = boost
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.016023345 = queryNorm
             0.30315587 = fieldWeight in 907, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.12059703 = weight(abstract_txt:judgments in 907) [ClassicSimilarity], result of:
           0.12059703 = score(doc=907,freq=1.0), product of:
             0.27885202 = queryWeight, product of:
               2.514999 = boost
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.016023345 = queryNorm
             0.4324768 = fieldWeight in 907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.24049461 = weight(abstract_txt:relevance in 907) [ClassicSimilarity], result of:
           0.24049461 = score(doc=907,freq=4.0), product of:
             0.3899215 = queryWeight, product of:
               4.931804 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.016023345 = queryNorm
             0.616777 = fieldWeight in 907, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
         0.52277523 = weight(abstract_txt:criteria in 907) [ClassicSimilarity], result of:
           0.52277523 = score(doc=907,freq=9.0), product of:
             0.49933207 = queryWeight, product of:
               5.5809994 = boost
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.016023345 = queryNorm
             1.046949 = fieldWeight in 907, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.0625 = fieldNorm(doc=907)
       0.52 = coord(13/25)
   

3. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.43

   0.43222412 = sum of:
     0.43222412 = product of:
       1.0805603 = sum of:
         0.013477231 = weight(abstract_txt:analysis in 1737) [ClassicSimilarity], result of:
           0.013477231 = score(doc=1737,freq=1.0), product of:
             0.058780994 = queryWeight, product of:
               3.6684597 = idf(docFreq=3020, maxDocs=43556)
               0.016023345 = queryNorm
             0.22927873 = fieldWeight in 1737, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6684597 = idf(docFreq=3020, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
         0.019252408 = weight(abstract_txt:user in 1737) [ClassicSimilarity], result of:
           0.019252408 = score(doc=1737,freq=2.0), product of:
             0.05917658 = queryWeight, product of:
               1.0033593 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.016023345 = queryNorm
             0.3253383 = fieldWeight in 1737, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
         0.009749851 = weight(abstract_txt:from in 1737) [ClassicSimilarity], result of:
           0.009749851 = score(doc=1737,freq=1.0), product of:
             0.05616314 = queryWeight, product of:
               1.2619194 = boost
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.016023345 = queryNorm
             0.17359875 = fieldWeight in 1737, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
         0.0073764576 = weight(abstract_txt:that in 1737) [ClassicSimilarity], result of:
           0.0073764576 = score(doc=1737,freq=1.0), product of:
             0.04955396 = queryWeight, product of:
               1.2984813 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.016023345 = queryNorm
             0.14885707 = fieldWeight in 1737, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
         0.03143905 = weight(abstract_txt:were in 1737) [ClassicSimilarity], result of:
           0.03143905 = score(doc=1737,freq=3.0), product of:
             0.0789021 = queryWeight, product of:
               1.3378123 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.016023345 = queryNorm
             0.39845642 = fieldWeight in 1737, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
         0.03456043 = weight(abstract_txt:making in 1737) [ClassicSimilarity], result of:
           0.03456043 = score(doc=1737,freq=1.0), product of:
             0.11012584 = queryWeight, product of:
               1.3687564 = boost
               5.0212274 = idf(docFreq=780, maxDocs=43556)
               0.016023345 = queryNorm
             0.3138267 = fieldWeight in 1737, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0212274 = idf(docFreq=780, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
         0.022452848 = weight(abstract_txt:most in 1737) [ClassicSimilarity], result of:
           0.022452848 = score(doc=1737,freq=1.0), product of:
             0.09092089 = queryWeight, product of:
               1.4360936 = boost
               3.9511886 = idf(docFreq=2276, maxDocs=43556)
               0.016023345 = queryNorm
             0.24694929 = fieldWeight in 1737, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9511886 = idf(docFreq=2276, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
         0.20888017 = weight(abstract_txt:judgments in 1737) [ClassicSimilarity], result of:
           0.20888017 = score(doc=1737,freq=3.0), product of:
             0.27885202 = queryWeight, product of:
               2.514999 = boost
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.016023345 = queryNorm
             0.7490718 = fieldWeight in 1737, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
         0.24049461 = weight(abstract_txt:relevance in 1737) [ClassicSimilarity], result of:
           0.24049461 = score(doc=1737,freq=4.0), product of:
             0.3899215 = queryWeight, product of:
               4.931804 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.016023345 = queryNorm
             0.616777 = fieldWeight in 1737, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
         0.49287722 = weight(abstract_txt:criteria in 1737) [ClassicSimilarity], result of:
           0.49287722 = score(doc=1737,freq=8.0), product of:
             0.49933207 = queryWeight, product of:
               5.5809994 = boost
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.016023345 = queryNorm
             0.987073 = fieldWeight in 1737, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.0625 = fieldNorm(doc=1737)
       0.4 = coord(10/25)
   

4. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.41

   0.40858182 = sum of:
     0.40858182 = product of:
       1.1349494 = sum of:
         0.013477231 = weight(abstract_txt:analysis in 606) [ClassicSimilarity], result of:
           0.013477231 = score(doc=606,freq=1.0), product of:
             0.058780994 = queryWeight, product of:
               3.6684597 = idf(docFreq=3020, maxDocs=43556)
               0.016023345 = queryNorm
             0.22927873 = fieldWeight in 606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6684597 = idf(docFreq=3020, maxDocs=43556)
               0.0625 = fieldNorm(doc=606)
         0.019252408 = weight(abstract_txt:user in 606) [ClassicSimilarity], result of:
           0.019252408 = score(doc=606,freq=2.0), product of:
             0.05917658 = queryWeight, product of:
               1.0033593 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.016023345 = queryNorm
             0.3253383 = fieldWeight in 606, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0625 = fieldNorm(doc=606)
         0.009749851 = weight(abstract_txt:from in 606) [ClassicSimilarity], result of:
           0.009749851 = score(doc=606,freq=1.0), product of:
             0.05616314 = queryWeight, product of:
               1.2619194 = boost
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.016023345 = queryNorm
             0.17359875 = fieldWeight in 606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.0625 = fieldNorm(doc=606)
         0.03630269 = weight(abstract_txt:were in 606) [ClassicSimilarity], result of:
           0.03630269 = score(doc=606,freq=4.0), product of:
             0.0789021 = queryWeight, product of:
               1.3378123 = boost
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.016023345 = queryNorm
             0.46009785 = fieldWeight in 606, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6807828 = idf(docFreq=2983, maxDocs=43556)
               0.0625 = fieldNorm(doc=606)
         0.0486343 = weight(abstract_txt:importance in 606) [ClassicSimilarity], result of:
           0.0486343 = score(doc=606,freq=1.0), product of:
             0.15221046 = queryWeight, product of:
               1.8581173 = boost
               5.1123214 = idf(docFreq=712, maxDocs=43556)
               0.016023345 = queryNorm
             0.3195201 = fieldWeight in 606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1123214 = idf(docFreq=712, maxDocs=43556)
               0.0625 = fieldNorm(doc=606)
         0.025961282 = weight(abstract_txt:information in 606) [ClassicSimilarity], result of:
           0.025961282 = score(doc=606,freq=4.0), product of:
             0.08563674 = queryWeight, product of:
               2.2036924 = boost
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.016023345 = queryNorm
             0.30315587 = fieldWeight in 606, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.0625 = fieldNorm(doc=606)
         0.17054994 = weight(abstract_txt:judgments in 606) [ClassicSimilarity], result of:
           0.17054994 = score(doc=606,freq=2.0), product of:
             0.27885202 = queryWeight, product of:
               2.514999 = boost
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.016023345 = queryNorm
             0.6116145 = fieldWeight in 606, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.0625 = fieldNorm(doc=606)
         0.31814447 = weight(abstract_txt:relevance in 606) [ClassicSimilarity], result of:
           0.31814447 = score(doc=606,freq=7.0), product of:
             0.3899215 = queryWeight, product of:
               4.931804 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.016023345 = queryNorm
             0.8159193 = fieldWeight in 606, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.0625 = fieldNorm(doc=606)
         0.49287722 = weight(abstract_txt:criteria in 606) [ClassicSimilarity], result of:
           0.49287722 = score(doc=606,freq=8.0), product of:
             0.49933207 = queryWeight, product of:
               5.5809994 = boost
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.016023345 = queryNorm
             0.987073 = fieldWeight in 606, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.0625 = fieldNorm(doc=606)
       0.36 = coord(9/25)
   

5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 0.40

   0.39628282 = sum of:
     0.39628282 = product of:
       0.99070704 = sum of:
         0.01459381 = weight(abstract_txt:their in 689) [ClassicSimilarity], result of:
           0.01459381 = score(doc=689,freq=1.0), product of:
             0.058792487 = queryWeight, product of:
               1.1548134 = boost
               3.1772897 = idf(docFreq=4936, maxDocs=43556)
               0.016023345 = queryNorm
             0.24822576 = fieldWeight in 689, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1772897 = idf(docFreq=4936, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
         0.05903688 = weight(abstract_txt:situations in 689) [ClassicSimilarity], result of:
           0.05903688 = score(doc=689,freq=1.0), product of:
             0.118471794 = queryWeight, product of:
               1.15916 = boost
               6.3784976 = idf(docFreq=200, maxDocs=43556)
               0.016023345 = queryNorm
             0.49832013 = fieldWeight in 689, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3784976 = idf(docFreq=200, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
         0.013039858 = weight(abstract_txt:that in 689) [ClassicSimilarity], result of:
           0.013039858 = score(doc=689,freq=2.0), product of:
             0.04955396 = queryWeight, product of:
               1.2984813 = boost
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.016023345 = queryNorm
             0.2631446 = fieldWeight in 689, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
         0.043200538 = weight(abstract_txt:making in 689) [ClassicSimilarity], result of:
           0.043200538 = score(doc=689,freq=1.0), product of:
             0.11012584 = queryWeight, product of:
               1.3687564 = boost
               5.0212274 = idf(docFreq=780, maxDocs=43556)
               0.016023345 = queryNorm
             0.39228338 = fieldWeight in 689, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0212274 = idf(docFreq=780, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
         0.05795875 = weight(abstract_txt:users in 689) [ClassicSimilarity], result of:
           0.05795875 = score(doc=689,freq=5.0), product of:
             0.09288282 = queryWeight, product of:
               1.6228322 = boost
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.016023345 = queryNorm
             0.6239986 = fieldWeight in 689, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
         0.060792875 = weight(abstract_txt:importance in 689) [ClassicSimilarity], result of:
           0.060792875 = score(doc=689,freq=1.0), product of:
             0.15221046 = queryWeight, product of:
               1.8581173 = boost
               5.1123214 = idf(docFreq=712, maxDocs=43556)
               0.016023345 = queryNorm
             0.39940012 = fieldWeight in 689, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1123214 = idf(docFreq=712, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
         0.022946745 = weight(abstract_txt:information in 689) [ClassicSimilarity], result of:
           0.022946745 = score(doc=689,freq=2.0), product of:
             0.08563674 = queryWeight, product of:
               2.2036924 = boost
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.016023345 = queryNorm
             0.26795444 = fieldWeight in 689, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
         0.15074629 = weight(abstract_txt:judgments in 689) [ClassicSimilarity], result of:
           0.15074629 = score(doc=689,freq=1.0), product of:
             0.27885202 = queryWeight, product of:
               2.514999 = boost
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.016023345 = queryNorm
             0.540596 = fieldWeight in 689, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9196286 = idf(docFreq=116, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
         0.26034302 = weight(abstract_txt:relevance in 689) [ClassicSimilarity], result of:
           0.26034302 = score(doc=689,freq=3.0), product of:
             0.3899215 = queryWeight, product of:
               4.931804 = boost
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.016023345 = queryNorm
             0.6676806 = fieldWeight in 689, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.934216 = idf(docFreq=851, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
         0.30804828 = weight(abstract_txt:criteria in 689) [ClassicSimilarity], result of:
           0.30804828 = score(doc=689,freq=2.0), product of:
             0.49933207 = queryWeight, product of:
               5.5809994 = boost
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.016023345 = queryNorm
             0.61692065 = fieldWeight in 689, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5837283 = idf(docFreq=444, maxDocs=43556)
               0.078125 = fieldNorm(doc=689)
       0.4 = coord(10/25)