Document (#24608)

Author
Bateman, J.
Title
Modelling the importance of end-user relevance criteria
Source
Knowledge: creation, organization and use. Proceedings of the 62nd Annual Meeting of the American Society for Information Science, 31.10.-4.11.1999. Ed.: L. Woods
Imprint
Medford, NJ : Information Today
Year
1999
Pages
S.396-406
Series
Proceedings of the American Society for Information Science; vol.36
Abstract
In most information retrieval research, the concept of relevance has been defined a priori as a single variable by the researcher and the meaning of relevance to the end-user who is making relevance judgments has not been taken into account. However, a number of criteria that users employ in making relevance judgments has been identified (Schamher, 1991; Barry, 1993). Understanding these criteria and their importance to end-users can help researchers better understand end-user evaluation behavior. This study reports end-users' ratings of the relative importance of 40 relevance criteria as used in their own information-seeking situations, and examines relationships between criteria that they rated most important. Data were collected from 210 graduate students who were instructed in a mail survey to rate 40 relevance criteria by importance in their selection of the most valuable information source for a recent or current paper or project. The criteria were selected from previous studies in which open-ended interviews were used to elicit criteria from end-users making judgments in their own information-seeking situations (Schamher, 1991; Su, 1992; Barry, 1993). A model of relevance with three constructs that contribute to the concept of relevance was proposed using the eleven criteria that survey respondents rated as most important (75 or more on a scale of 0 to 100). The development of this model was guided by similarities in criteria and criteria groupings from previous research (Barry & Schamher, 1998). Confirmatory factor analysis was used to confirm the model and verify that the constructs would produce reliable subscale scores. The three constructs are information quality, information credibility, and information completeness. Second-order factor analysis indicated that these constructs explain 48% of positive relevance judgments for these respondents. Three additional constructs, information availability, information topicality, and information currency are also suggested. The constructs developed from this analysis are thought to underlie the concept of relevance for this group of users
Theme
Retrievalstudien

Similar documents (author)

  1. Bateman, J.A.: On the relationship between ontology construction and natural language : a socio-semiotic view (1995) 6.07
    6.0667334 = sum of:
      6.0667334 = weight(author_txt:bateman in 4854) [ClassicSimilarity], result of:
        6.0667334 = fieldWeight in 4854, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.706774 = idf(docFreq=6, maxDocs=42306)
          0.625 = fieldNorm(doc=4854)
    
  2. Bateman, J.A.: Automated discourse generation (1998) 6.07
    6.0667334 = sum of:
      6.0667334 = weight(author_txt:bateman in 2309) [ClassicSimilarity], result of:
        6.0667334 = fieldWeight in 2309, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.706774 = idf(docFreq=6, maxDocs=42306)
          0.625 = fieldNorm(doc=2309)
    
  3. Bateman, J.; Teich, E.: Selective information presentation in an integrated publication system : an application of genre-driven text generation (1995) 4.85
    4.853387 = sum of:
      4.853387 = weight(author_txt:bateman in 2997) [ClassicSimilarity], result of:
        4.853387 = fieldWeight in 2997, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.706774 = idf(docFreq=6, maxDocs=42306)
          0.5 = fieldNorm(doc=2997)
    
  4. Schamber, L.; Bateman, J.: User criteria in relevance evaluation : toward development of a measurement scale (1996) 4.85
    4.853387 = sum of:
      4.853387 = weight(author_txt:bateman in 421) [ClassicSimilarity], result of:
        4.853387 = fieldWeight in 421, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.706774 = idf(docFreq=6, maxDocs=42306)
          0.5 = fieldNorm(doc=421)
    
  5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 4.85
    4.853387 = sum of:
      4.853387 = weight(author_txt:bateman in 692) [ClassicSimilarity], result of:
        4.853387 = fieldWeight in 692, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.706774 = idf(docFreq=6, maxDocs=42306)
          0.5 = fieldNorm(doc=692)
    

Similar documents (content)

  1. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.83
    0.8254475 = sum of:
      0.8254475 = product of:
        1.3757458 = sum of:
          0.016691025 = weight(abstract_txt:user in 3593) [ClassicSimilarity], result of:
            0.016691025 = score(doc=3593,freq=2.0), product of:
              0.058663648 = queryWeight, product of:
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.015946236 = queryNorm
              0.28452075 = fieldWeight in 3593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.03150118 = weight(abstract_txt:factor in 3593) [ClassicSimilarity], result of:
            0.03150118 = score(doc=3593,freq=1.0), product of:
              0.09860778 = queryWeight, product of:
                1.0585842 = boost
                5.841543 = idf(docFreq=333, maxDocs=42306)
                0.015946236 = queryNorm
              0.31945938 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.841543 = idf(docFreq=333, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.010364304 = weight(abstract_txt:their in 3593) [ClassicSimilarity], result of:
            0.010364304 = score(doc=3593,freq=1.0), product of:
              0.05921023 = queryWeight, product of:
                1.1600673 = boost
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.015946236 = queryNorm
              0.17504247 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.008643799 = weight(abstract_txt:from in 3593) [ClassicSimilarity], result of:
            0.008643799 = score(doc=3593,freq=1.0), product of:
              0.05651231 = queryWeight, product of:
                1.2671014 = boost
                2.796878 = idf(docFreq=7014, maxDocs=42306)
                0.015946236 = queryNorm
              0.15295427 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.796878 = idf(docFreq=7014, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.009324966 = weight(abstract_txt:that in 3593) [ClassicSimilarity], result of:
            0.009324966 = score(doc=3593,freq=2.0), product of:
              0.05013664 = queryWeight, product of:
                1.3073988 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.015946236 = queryNorm
              0.18599105 = fieldWeight in 3593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.02267453 = weight(abstract_txt:were in 3593) [ClassicSimilarity], result of:
            0.02267453 = score(doc=3593,freq=2.0), product of:
              0.07919884 = queryWeight, product of:
                1.3416655 = boost
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.015946236 = queryNorm
              0.28629878 = fieldWeight in 3593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.04328139 = weight(abstract_txt:making in 3593) [ClassicSimilarity], result of:
            0.04328139 = score(doc=3593,freq=2.0), product of:
              0.11072555 = queryWeight, product of:
                1.3738502 = boost
                5.0541754 = idf(docFreq=733, maxDocs=42306)
                0.015946236 = queryNorm
              0.39088893 = fieldWeight in 3593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.0541754 = idf(docFreq=733, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.019772457 = weight(abstract_txt:most in 3593) [ClassicSimilarity], result of:
            0.019772457 = score(doc=3593,freq=1.0), product of:
              0.09107735 = queryWeight, product of:
                1.4387655 = boost
                3.969741 = idf(docFreq=2170, maxDocs=42306)
                0.015946236 = queryNorm
              0.21709521 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.969741 = idf(docFreq=2170, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.04047774 = weight(abstract_txt:users in 3593) [ClassicSimilarity], result of:
            0.04047774 = score(doc=3593,freq=5.0), product of:
              0.09250407 = queryWeight, product of:
                1.621139 = boost
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.015946236 = queryNorm
              0.43757796 = fieldWeight in 3593, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.042832535 = weight(abstract_txt:importance in 3593) [ClassicSimilarity], result of:
            0.042832535 = score(doc=3593,freq=1.0), product of:
              0.1524822 = queryWeight, product of:
                1.8616344 = boost
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.015946236 = queryNorm
              0.28090188 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.022840397 = weight(abstract_txt:information in 3593) [ClassicSimilarity], result of:
            0.022840397 = score(doc=3593,freq=4.0), product of:
              0.08572992 = queryWeight, product of:
                2.2070951 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.015946236 = queryNorm
              0.26642272 = fieldWeight in 3593, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.234733 = weight(abstract_txt:judgments in 3593) [ClassicSimilarity], result of:
            0.234733 = score(doc=3593,freq=5.0), product of:
              0.27718052 = queryWeight, product of:
                2.5099566 = boost
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.015946236 = queryNorm
              0.84685963 = fieldWeight in 3593, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.19376889 = weight(abstract_txt:barry in 3593) [ClassicSimilarity], result of:
            0.19376889 = score(doc=3593,freq=1.0), product of:
              0.3789481 = queryWeight, product of:
                2.541589 = boost
                9.3501 = idf(docFreq=9, maxDocs=42306)
                0.015946236 = queryNorm
              0.5113336 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.3501 = idf(docFreq=9, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.2773866 = weight(abstract_txt:relevance in 3593) [ClassicSimilarity], result of:
            0.2773866 = score(doc=3593,freq=7.0), product of:
              0.38800606 = queryWeight, product of:
                4.924594 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.015946236 = queryNorm
              0.71490276 = fieldWeight in 3593, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
          0.40145293 = weight(abstract_txt:criteria in 3593) [ClassicSimilarity], result of:
            0.40145293 = score(doc=3593,freq=7.0), product of:
              0.49644515 = queryWeight, product of:
                5.5704055 = boost
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.015946236 = queryNorm
              0.80865514 = fieldWeight in 3593, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3593)
        0.6 = coord(15/25)
    
  2. Crystal, A.; Greenberg, J.: Relevance criteria identified by health information users during Web searches (2006) 0.59
    0.5943764 = sum of:
      0.5943764 = product of:
        1.1430316 = sum of:
          0.013488386 = weight(abstract_txt:user in 910) [ClassicSimilarity], result of:
            0.013488386 = score(doc=910,freq=1.0), product of:
              0.058663648 = queryWeight, product of:
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.015946236 = queryNorm
              0.2299275 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.013723245 = weight(abstract_txt:analysis in 910) [ClassicSimilarity], result of:
            0.013723245 = score(doc=910,freq=1.0), product of:
              0.059342653 = queryWeight, product of:
                1.0057706 = boost
                3.7000692 = idf(docFreq=2842, maxDocs=42306)
                0.015946236 = queryNorm
              0.23125432 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7000692 = idf(docFreq=2842, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.046895765 = weight(abstract_txt:situations in 910) [ClassicSimilarity], result of:
            0.046895765 = score(doc=910,freq=1.0), product of:
              0.11761275 = queryWeight, product of:
                1.1561043 = boost
                6.3796844 = idf(docFreq=194, maxDocs=42306)
                0.015946236 = queryNorm
              0.39873028 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.3796844 = idf(docFreq=194, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.016751247 = weight(abstract_txt:their in 910) [ClassicSimilarity], result of:
            0.016751247 = score(doc=910,freq=2.0), product of:
              0.05921023 = queryWeight, product of:
                1.1600673 = boost
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.015946236 = queryNorm
              0.28291136 = fieldWeight in 910, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.009878628 = weight(abstract_txt:from in 910) [ClassicSimilarity], result of:
            0.009878628 = score(doc=910,freq=1.0), product of:
              0.05651231 = queryWeight, product of:
                1.2671014 = boost
                2.796878 = idf(docFreq=7014, maxDocs=42306)
                0.015946236 = queryNorm
              0.17480488 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.796878 = idf(docFreq=7014, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.013052234 = weight(abstract_txt:that in 910) [ClassicSimilarity], result of:
            0.013052234 = score(doc=910,freq=3.0), product of:
              0.05013664 = queryWeight, product of:
                1.3073988 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.015946236 = queryNorm
              0.26033324 = fieldWeight in 910, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.025913749 = weight(abstract_txt:were in 910) [ClassicSimilarity], result of:
            0.025913749 = score(doc=910,freq=2.0), product of:
              0.07919884 = queryWeight, product of:
                1.3416655 = boost
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.015946236 = queryNorm
              0.3271986 = fieldWeight in 910, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.031957116 = weight(abstract_txt:most in 910) [ClassicSimilarity], result of:
            0.031957116 = score(doc=910,freq=2.0), product of:
              0.09107735 = queryWeight, product of:
                1.4387655 = boost
                3.969741 = idf(docFreq=2170, maxDocs=42306)
                0.015946236 = queryNorm
              0.35087886 = fieldWeight in 910, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.969741 = idf(docFreq=2170, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.06542192 = weight(abstract_txt:users in 910) [ClassicSimilarity], result of:
            0.06542192 = score(doc=910,freq=10.0), product of:
              0.09250407 = queryWeight, product of:
                1.621139 = boost
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.015946236 = queryNorm
              0.70723283 = fieldWeight in 910, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.026103312 = weight(abstract_txt:information in 910) [ClassicSimilarity], result of:
            0.026103312 = score(doc=910,freq=4.0), product of:
              0.08572992 = queryWeight, product of:
                2.2070951 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.015946236 = queryNorm
              0.30448312 = fieldWeight in 910, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.119972326 = weight(abstract_txt:judgments in 910) [ClassicSimilarity], result of:
            0.119972326 = score(doc=910,freq=1.0), product of:
              0.27718052 = queryWeight, product of:
                2.5099566 = boost
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.015946236 = queryNorm
              0.43283102 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.23963952 = weight(abstract_txt:relevance in 910) [ClassicSimilarity], result of:
            0.23963952 = score(doc=910,freq=4.0), product of:
              0.38800606 = queryWeight, product of:
                4.924594 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.015946236 = queryNorm
              0.61761796 = fieldWeight in 910, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
          0.5202341 = weight(abstract_txt:criteria in 910) [ClassicSimilarity], result of:
            0.5202341 = score(doc=910,freq=9.0), product of:
              0.49644515 = queryWeight, product of:
                5.5704055 = boost
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.015946236 = queryNorm
              1.0479186 = fieldWeight in 910, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.0625 = fieldNorm(doc=910)
        0.52 = coord(13/25)
    
  3. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.43
    0.43097743 = sum of:
      0.43097743 = product of:
        1.0774436 = sum of:
          0.019075457 = weight(abstract_txt:user in 1740) [ClassicSimilarity], result of:
            0.019075457 = score(doc=1740,freq=2.0), product of:
              0.058663648 = queryWeight, product of:
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.015946236 = queryNorm
              0.32516658 = fieldWeight in 1740, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
          0.013723245 = weight(abstract_txt:analysis in 1740) [ClassicSimilarity], result of:
            0.013723245 = score(doc=1740,freq=1.0), product of:
              0.059342653 = queryWeight, product of:
                1.0057706 = boost
                3.7000692 = idf(docFreq=2842, maxDocs=42306)
                0.015946236 = queryNorm
              0.23125432 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7000692 = idf(docFreq=2842, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
          0.009878628 = weight(abstract_txt:from in 1740) [ClassicSimilarity], result of:
            0.009878628 = score(doc=1740,freq=1.0), product of:
              0.05651231 = queryWeight, product of:
                1.2671014 = boost
                2.796878 = idf(docFreq=7014, maxDocs=42306)
                0.015946236 = queryNorm
              0.17480488 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.796878 = idf(docFreq=7014, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
          0.007535711 = weight(abstract_txt:that in 1740) [ClassicSimilarity], result of:
            0.007535711 = score(doc=1740,freq=1.0), product of:
              0.05013664 = queryWeight, product of:
                1.3073988 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.015946236 = queryNorm
              0.15030347 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
          0.03173773 = weight(abstract_txt:were in 1740) [ClassicSimilarity], result of:
            0.03173773 = score(doc=1740,freq=3.0), product of:
              0.07919884 = queryWeight, product of:
                1.3416655 = boost
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.015946236 = queryNorm
              0.40073478 = fieldWeight in 1740, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
          0.034976646 = weight(abstract_txt:making in 1740) [ClassicSimilarity], result of:
            0.034976646 = score(doc=1740,freq=1.0), product of:
              0.11072555 = queryWeight, product of:
                1.3738502 = boost
                5.0541754 = idf(docFreq=733, maxDocs=42306)
                0.015946236 = queryNorm
              0.31588596 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0541754 = idf(docFreq=733, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
          0.022597093 = weight(abstract_txt:most in 1740) [ClassicSimilarity], result of:
            0.022597093 = score(doc=1740,freq=1.0), product of:
              0.09107735 = queryWeight, product of:
                1.4387655 = boost
                3.969741 = idf(docFreq=2170, maxDocs=42306)
                0.015946236 = queryNorm
              0.24810882 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.969741 = idf(docFreq=2170, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
          0.20779815 = weight(abstract_txt:judgments in 1740) [ClassicSimilarity], result of:
            0.20779815 = score(doc=1740,freq=3.0), product of:
              0.27718052 = queryWeight, product of:
                2.5099566 = boost
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.015946236 = queryNorm
              0.7496853 = fieldWeight in 1740, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
          0.23963952 = weight(abstract_txt:relevance in 1740) [ClassicSimilarity], result of:
            0.23963952 = score(doc=1740,freq=4.0), product of:
              0.38800606 = queryWeight, product of:
                4.924594 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.015946236 = queryNorm
              0.61761796 = fieldWeight in 1740, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
          0.4904814 = weight(abstract_txt:criteria in 1740) [ClassicSimilarity], result of:
            0.4904814 = score(doc=1740,freq=8.0), product of:
              0.49644515 = queryWeight, product of:
                5.5704055 = boost
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.015946236 = queryNorm
              0.9879871 = fieldWeight in 1740, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.0625 = fieldNorm(doc=1740)
        0.4 = coord(10/25)
    
  4. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.41
    0.40735474 = sum of:
      0.40735474 = product of:
        1.1315409 = sum of:
          0.019075457 = weight(abstract_txt:user in 609) [ClassicSimilarity], result of:
            0.019075457 = score(doc=609,freq=2.0), product of:
              0.058663648 = queryWeight, product of:
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.015946236 = queryNorm
              0.32516658 = fieldWeight in 609, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.67884 = idf(docFreq=2903, maxDocs=42306)
                0.0625 = fieldNorm(doc=609)
          0.013723245 = weight(abstract_txt:analysis in 609) [ClassicSimilarity], result of:
            0.013723245 = score(doc=609,freq=1.0), product of:
              0.059342653 = queryWeight, product of:
                1.0057706 = boost
                3.7000692 = idf(docFreq=2842, maxDocs=42306)
                0.015946236 = queryNorm
              0.23125432 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7000692 = idf(docFreq=2842, maxDocs=42306)
                0.0625 = fieldNorm(doc=609)
          0.009878628 = weight(abstract_txt:from in 609) [ClassicSimilarity], result of:
            0.009878628 = score(doc=609,freq=1.0), product of:
              0.05651231 = queryWeight, product of:
                1.2671014 = boost
                2.796878 = idf(docFreq=7014, maxDocs=42306)
                0.015946236 = queryNorm
              0.17480488 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.796878 = idf(docFreq=7014, maxDocs=42306)
                0.0625 = fieldNorm(doc=609)
          0.036647573 = weight(abstract_txt:were in 609) [ClassicSimilarity], result of:
            0.036647573 = score(doc=609,freq=4.0), product of:
              0.07919884 = queryWeight, product of:
                1.3416655 = boost
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.015946236 = queryNorm
              0.46272868 = fieldWeight in 609, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.7018294 = idf(docFreq=2837, maxDocs=42306)
                0.0625 = fieldNorm(doc=609)
          0.048951466 = weight(abstract_txt:importance in 609) [ClassicSimilarity], result of:
            0.048951466 = score(doc=609,freq=1.0), product of:
              0.1524822 = queryWeight, product of:
                1.8616344 = boost
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.015946236 = queryNorm
              0.3210307 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.0625 = fieldNorm(doc=609)
          0.026103312 = weight(abstract_txt:information in 609) [ClassicSimilarity], result of:
            0.026103312 = score(doc=609,freq=4.0), product of:
              0.08572992 = queryWeight, product of:
                2.2070951 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.015946236 = queryNorm
              0.30448312 = fieldWeight in 609, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.0625 = fieldNorm(doc=609)
          0.1696665 = weight(abstract_txt:judgments in 609) [ClassicSimilarity], result of:
            0.1696665 = score(doc=609,freq=2.0), product of:
              0.27718052 = queryWeight, product of:
                2.5099566 = boost
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.015946236 = queryNorm
              0.6121155 = fieldWeight in 609, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.0625 = fieldNorm(doc=609)
          0.31701326 = weight(abstract_txt:relevance in 609) [ClassicSimilarity], result of:
            0.31701326 = score(doc=609,freq=7.0), product of:
              0.38800606 = queryWeight, product of:
                4.924594 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.015946236 = queryNorm
              0.81703174 = fieldWeight in 609, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0625 = fieldNorm(doc=609)
          0.4904814 = weight(abstract_txt:criteria in 609) [ClassicSimilarity], result of:
            0.4904814 = score(doc=609,freq=8.0), product of:
              0.49644515 = queryWeight, product of:
                5.5704055 = boost
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.015946236 = queryNorm
              0.9879871 = fieldWeight in 609, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.0625 = fieldNorm(doc=609)
        0.36 = coord(9/25)
    
  5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 0.40
    0.3953955 = sum of:
      0.3953955 = product of:
        0.9884887 = sum of:
          0.058619704 = weight(abstract_txt:situations in 692) [ClassicSimilarity], result of:
            0.058619704 = score(doc=692,freq=1.0), product of:
              0.11761275 = queryWeight, product of:
                1.1561043 = boost
                6.3796844 = idf(docFreq=194, maxDocs=42306)
                0.015946236 = queryNorm
              0.49841285 = fieldWeight in 692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.3796844 = idf(docFreq=194, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
          0.01480615 = weight(abstract_txt:their in 692) [ClassicSimilarity], result of:
            0.01480615 = score(doc=692,freq=1.0), product of:
              0.05921023 = queryWeight, product of:
                1.1600673 = boost
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.015946236 = queryNorm
              0.25006068 = fieldWeight in 692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
          0.013321381 = weight(abstract_txt:that in 692) [ClassicSimilarity], result of:
            0.013321381 = score(doc=692,freq=2.0), product of:
              0.05013664 = queryWeight, product of:
                1.3073988 = boost
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.015946236 = queryNorm
              0.2657015 = fieldWeight in 692, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4048555 = idf(docFreq=10381, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
          0.04372081 = weight(abstract_txt:making in 692) [ClassicSimilarity], result of:
            0.04372081 = score(doc=692,freq=1.0), product of:
              0.11072555 = queryWeight, product of:
                1.3738502 = boost
                5.0541754 = idf(docFreq=733, maxDocs=42306)
                0.015946236 = queryNorm
              0.39485747 = fieldWeight in 692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0541754 = idf(docFreq=733, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
          0.05782535 = weight(abstract_txt:users in 692) [ClassicSimilarity], result of:
            0.05782535 = score(doc=692,freq=5.0), product of:
              0.09250407 = queryWeight, product of:
                1.621139 = boost
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.015946236 = queryNorm
              0.6251114 = fieldWeight in 692, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.5783465 = idf(docFreq=3210, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
          0.061189335 = weight(abstract_txt:importance in 692) [ClassicSimilarity], result of:
            0.061189335 = score(doc=692,freq=1.0), product of:
              0.1524822 = queryWeight, product of:
                1.8616344 = boost
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.015946236 = queryNorm
              0.4012884 = fieldWeight in 692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
          0.023072286 = weight(abstract_txt:information in 692) [ClassicSimilarity], result of:
            0.023072286 = score(doc=692,freq=2.0), product of:
              0.08572992 = queryWeight, product of:
                2.2070951 = boost
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.015946236 = queryNorm
              0.26912758 = fieldWeight in 692, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.435865 = idf(docFreq=10064, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
          0.1499654 = weight(abstract_txt:judgments in 692) [ClassicSimilarity], result of:
            0.1499654 = score(doc=692,freq=1.0), product of:
              0.27718052 = queryWeight, product of:
                2.5099566 = boost
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.015946236 = queryNorm
              0.54103875 = fieldWeight in 692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9252963 = idf(docFreq=112, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
          0.25941736 = weight(abstract_txt:relevance in 692) [ClassicSimilarity], result of:
            0.25941736 = score(doc=692,freq=3.0), product of:
              0.38800606 = queryWeight, product of:
                4.924594 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.015946236 = queryNorm
              0.668591 = fieldWeight in 692, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
          0.3065509 = weight(abstract_txt:criteria in 692) [ClassicSimilarity], result of:
            0.3065509 = score(doc=692,freq=2.0), product of:
              0.49644515 = queryWeight, product of:
                5.5704055 = boost
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.015946236 = queryNorm
              0.61749196 = fieldWeight in 692, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.078125 = fieldNorm(doc=692)
        0.4 = coord(10/25)