Document (#24608)

Author
Bateman, J.
Title
Modelling the importance of end-user relevance criteria
Source
Knowledge: creation, organization and use. Proceedings of the 62nd Annual Meeting of the American Society for Information Science, 31.10.-4.11.1999. Ed.: L. Woods
Imprint
Medford, NJ : Information Today
Year
1999
Pages
S.396-406
Series
Proceedings of the American Society for Information Science; vol.36
Abstract
In most information retrieval research, the concept of relevance has been defined a priori as a single variable by the researcher and the meaning of relevance to the end-user who is making relevance judgments has not been taken into account. However, a number of criteria that users employ in making relevance judgments has been identified (Schamher, 1991; Barry, 1993). Understanding these criteria and their importance to end-users can help researchers better understand end-user evaluation behavior. This study reports end-users' ratings of the relative importance of 40 relevance criteria as used in their own information-seeking situations, and examines relationships between criteria that they rated most important. Data were collected from 210 graduate students who were instructed in a mail survey to rate 40 relevance criteria by importance in their selection of the most valuable information source for a recent or current paper or project. The criteria were selected from previous studies in which open-ended interviews were used to elicit criteria from end-users making judgments in their own information-seeking situations (Schamher, 1991; Su, 1992; Barry, 1993). A model of relevance with three constructs that contribute to the concept of relevance was proposed using the eleven criteria that survey respondents rated as most important (75 or more on a scale of 0 to 100). The development of this model was guided by similarities in criteria and criteria groupings from previous research (Barry & Schamher, 1998). Confirmatory factor analysis was used to confirm the model and verify that the constructs would produce reliable subscale scores. The three constructs are information quality, information credibility, and information completeness. Second-order factor analysis indicated that these constructs explain 48% of positive relevance judgments for these respondents. Three additional constructs, information availability, information topicality, and information currency are also suggested. The constructs developed from this analysis are thought to underlie the concept of relevance for this group of users
Theme
Retrievalstudien

Similar documents (author)

  1. Bateman, J.A.: On the relationship between ontology construction and natural language : a socio-semiotic view (1995) 6.08
    6.0805845 = sum of:
      6.0805845 = weight(author_txt:bateman in 5854) [ClassicSimilarity], result of:
        6.0805845 = fieldWeight in 5854, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.728935 = idf(docFreq=6, maxDocs=43254)
          0.625 = fieldNorm(doc=5854)
    
  2. Bateman, J.A.: Automated discourse generation (1998) 6.08
    6.0805845 = sum of:
      6.0805845 = weight(author_txt:bateman in 3309) [ClassicSimilarity], result of:
        6.0805845 = fieldWeight in 3309, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.728935 = idf(docFreq=6, maxDocs=43254)
          0.625 = fieldNorm(doc=3309)
    
  3. Bateman, J.; Teich, E.: Selective information presentation in an integrated publication system : an application of genre-driven text generation (1995) 4.86
    4.8644676 = sum of:
      4.8644676 = weight(author_txt:bateman in 3997) [ClassicSimilarity], result of:
        4.8644676 = fieldWeight in 3997, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.728935 = idf(docFreq=6, maxDocs=43254)
          0.5 = fieldNorm(doc=3997)
    
  4. Schamber, L.; Bateman, J.: User criteria in relevance evaluation : toward development of a measurement scale (1996) 4.86
    4.8644676 = sum of:
      4.8644676 = weight(author_txt:bateman in 421) [ClassicSimilarity], result of:
        4.8644676 = fieldWeight in 421, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.728935 = idf(docFreq=6, maxDocs=43254)
          0.5 = fieldNorm(doc=421)
    
  5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 4.86
    4.8644676 = sum of:
      4.8644676 = weight(author_txt:bateman in 1692) [ClassicSimilarity], result of:
        4.8644676 = fieldWeight in 1692, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.728935 = idf(docFreq=6, maxDocs=43254)
          0.5 = fieldNorm(doc=1692)
    

Similar documents (content)

  1. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.82
    0.8246758 = sum of:
      0.8246758 = product of:
        1.3744596 = sum of:
          0.016816499 = weight(abstract_txt:user in 4593) [ClassicSimilarity], result of:
            0.016816499 = score(doc=4593,freq=2.0), product of:
              0.059098843 = queryWeight, product of:
                1.0015548 = boost
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.016038017 = queryNorm
              0.2845487 = fieldWeight in 4593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.031145718 = weight(abstract_txt:factor in 4593) [ClassicSimilarity], result of:
            0.031145718 = score(doc=4593,freq=1.0), product of:
              0.09809956 = queryWeight, product of:
                1.0535936 = boost
                5.805548 = idf(docFreq=353, maxDocs=43254)
                0.016038017 = queryNorm
              0.3174909 = fieldWeight in 4593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.805548 = idf(docFreq=353, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.010253981 = weight(abstract_txt:their in 4593) [ClassicSimilarity], result of:
            0.010253981 = score(doc=4593,freq=1.0), product of:
              0.058930457 = queryWeight, product of:
                1.1548471 = boost
                3.1817396 = idf(docFreq=4880, maxDocs=43254)
                0.016038017 = queryNorm
              0.17400138 = fieldWeight in 4593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.1817396 = idf(docFreq=4880, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.008554956 = weight(abstract_txt:from in 4593) [ClassicSimilarity], result of:
            0.008554956 = score(doc=4593,freq=1.0), product of:
              0.05625917 = queryWeight, product of:
                1.2615552 = boost
                2.7805862 = idf(docFreq=7289, maxDocs=43254)
                0.016038017 = queryNorm
              0.15206331 = fieldWeight in 4593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.7805862 = idf(docFreq=7289, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.009166371 = weight(abstract_txt:that in 4593) [ClassicSimilarity], result of:
            0.009166371 = score(doc=4593,freq=2.0), product of:
              0.04968556 = queryWeight, product of:
                1.2987194 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.016038017 = queryNorm
              0.18448763 = fieldWeight in 4593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.022489952 = weight(abstract_txt:were in 4593) [ClassicSimilarity], result of:
            0.022489952 = score(doc=4593,freq=2.0), product of:
              0.07895758 = queryWeight, product of:
                1.3367541 = boost
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.016038017 = queryNorm
              0.28483588 = fieldWeight in 4593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.042931736 = weight(abstract_txt:making in 4593) [ClassicSimilarity], result of:
            0.042931736 = score(doc=4593,freq=2.0), product of:
              0.11039283 = queryWeight, product of:
                1.3688494 = boost
                5.0284543 = idf(docFreq=769, maxDocs=43254)
                0.016038017 = queryNorm
              0.38889965 = fieldWeight in 4593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.0284543 = idf(docFreq=769, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.019684978 = weight(abstract_txt:most in 4593) [ClassicSimilarity], result of:
            0.019684978 = score(doc=4593,freq=1.0), product of:
              0.09102655 = queryWeight, product of:
                1.4352866 = boost
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.016038017 = queryNorm
              0.21625534 = fieldWeight in 4593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.040510774 = weight(abstract_txt:users in 4593) [ClassicSimilarity], result of:
            0.040510774 = score(doc=4593,freq=5.0), product of:
              0.09277661 = queryWeight, product of:
                1.6200516 = boost
                3.570746 = idf(docFreq=3307, maxDocs=43254)
                0.016038017 = queryNorm
              0.43664855 = fieldWeight in 4593, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.570746 = idf(docFreq=3307, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.042643722 = weight(abstract_txt:importance in 4593) [ClassicSimilarity], result of:
            0.042643722 = score(doc=4593,freq=1.0), product of:
              0.1523988 = queryWeight, product of:
                1.857143 = boost
                5.1166472 = idf(docFreq=704, maxDocs=43254)
                0.016038017 = queryNorm
              0.27981666 = fieldWeight in 4593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1166472 = idf(docFreq=704, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.022752807 = weight(abstract_txt:information in 4593) [ClassicSimilarity], result of:
            0.022752807 = score(doc=4593,freq=4.0), product of:
              0.08571591 = queryWeight, product of:
                2.2021928 = boost
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.016038017 = queryNorm
              0.26544437 = fieldWeight in 4593, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.23513721 = weight(abstract_txt:judgments in 4593) [ClassicSimilarity], result of:
            0.23513721 = score(doc=4593,freq=5.0), product of:
              0.27816492 = queryWeight, product of:
                2.5090296 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.016038017 = queryNorm
              0.8453158 = fieldWeight in 4593, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.1906231 = weight(abstract_txt:barry in 4593) [ClassicSimilarity], result of:
            0.1906231 = score(doc=4593,freq=1.0), product of:
              0.37573552 = queryWeight, product of:
                2.5253778 = boost
                9.27695 = idf(docFreq=10, maxDocs=43254)
                0.016038017 = queryNorm
              0.5073332 = fieldWeight in 4593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.27695 = idf(docFreq=10, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.27806845 = weight(abstract_txt:relevance in 4593) [ClassicSimilarity], result of:
            0.27806845 = score(doc=4593,freq=7.0), product of:
              0.3895748 = queryWeight, product of:
                4.923981 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.016038017 = queryNorm
              0.71377426 = fieldWeight in 4593, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.40367934 = weight(abstract_txt:criteria in 4593) [ClassicSimilarity], result of:
            0.40367934 = score(doc=4593,freq=7.0), product of:
              0.49947536 = queryWeight, product of:
                5.575425 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.016038017 = queryNorm
              0.80820674 = fieldWeight in 4593, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
        0.6 = coord(15/25)
    
  2. Crystal, A.; Greenberg, J.: Relevance criteria identified by health information users during Web searches (2006) 0.60
    0.595912 = sum of:
      0.595912 = product of:
        1.1459846 = sum of:
          0.013526593 = weight(abstract_txt:analysis in 910) [ClassicSimilarity], result of:
            0.013526593 = score(doc=910,freq=1.0), product of:
              0.058915496 = queryWeight, product of:
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.016038017 = queryNorm
              0.22959313 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.0135897845 = weight(abstract_txt:user in 910) [ClassicSimilarity], result of:
            0.0135897845 = score(doc=910,freq=1.0), product of:
              0.059098843 = queryWeight, product of:
                1.0015548 = boost
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.016038017 = queryNorm
              0.22995009 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.016572936 = weight(abstract_txt:their in 910) [ClassicSimilarity], result of:
            0.016572936 = score(doc=910,freq=2.0), product of:
              0.058930457 = queryWeight, product of:
                1.1548471 = boost
                3.1817396 = idf(docFreq=4880, maxDocs=43254)
                0.016038017 = queryNorm
              0.2812287 = fieldWeight in 910, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.1817396 = idf(docFreq=4880, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.047164295 = weight(abstract_txt:situations in 910) [ClassicSimilarity], result of:
            0.047164295 = score(doc=910,freq=1.0), product of:
              0.11834477 = queryWeight, product of:
                1.1572152 = boost
                6.376528 = idf(docFreq=199, maxDocs=43254)
                0.016038017 = queryNorm
              0.398533 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.376528 = idf(docFreq=199, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.009777092 = weight(abstract_txt:from in 910) [ClassicSimilarity], result of:
            0.009777092 = score(doc=910,freq=1.0), product of:
              0.05625917 = queryWeight, product of:
                1.2615552 = boost
                2.7805862 = idf(docFreq=7289, maxDocs=43254)
                0.016038017 = queryNorm
              0.17378664 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.7805862 = idf(docFreq=7289, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.012830246 = weight(abstract_txt:that in 910) [ClassicSimilarity], result of:
            0.012830246 = score(doc=910,freq=3.0), product of:
              0.04968556 = queryWeight, product of:
                1.2987194 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.016038017 = queryNorm
              0.25822887 = fieldWeight in 910, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.025702802 = weight(abstract_txt:were in 910) [ClassicSimilarity], result of:
            0.025702802 = score(doc=910,freq=2.0), product of:
              0.07895758 = queryWeight, product of:
                1.3367541 = boost
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.016038017 = queryNorm
              0.3255267 = fieldWeight in 910, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.031815726 = weight(abstract_txt:most in 910) [ClassicSimilarity], result of:
            0.031815726 = score(doc=910,freq=2.0), product of:
              0.09102655 = queryWeight, product of:
                1.4352866 = boost
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.016038017 = queryNorm
              0.3495214 = fieldWeight in 910, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.06547529 = weight(abstract_txt:users in 910) [ClassicSimilarity], result of:
            0.06547529 = score(doc=910,freq=10.0), product of:
              0.09277661 = queryWeight, product of:
                1.6200516 = boost
                3.570746 = idf(docFreq=3307, maxDocs=43254)
                0.016038017 = queryNorm
              0.7057306 = fieldWeight in 910, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                3.570746 = idf(docFreq=3307, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.026003206 = weight(abstract_txt:information in 910) [ClassicSimilarity], result of:
            0.026003206 = score(doc=910,freq=4.0), product of:
              0.08571591 = queryWeight, product of:
                2.2021928 = boost
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.016038017 = queryNorm
              0.303365 = fieldWeight in 910, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.120178916 = weight(abstract_txt:judgments in 910) [ClassicSimilarity], result of:
            0.120178916 = score(doc=910,freq=1.0), product of:
              0.27816492 = queryWeight, product of:
                2.5090296 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.016038017 = queryNorm
              0.43204194 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.24022858 = weight(abstract_txt:relevance in 910) [ClassicSimilarity], result of:
            0.24022858 = score(doc=910,freq=4.0), product of:
              0.3895748 = queryWeight, product of:
                4.923981 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.016038017 = queryNorm
              0.616643 = fieldWeight in 910, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.5231193 = weight(abstract_txt:criteria in 910) [ClassicSimilarity], result of:
            0.5231193 = score(doc=910,freq=9.0), product of:
              0.49947536 = queryWeight, product of:
                5.575425 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.016038017 = queryNorm
              1.0473375 = fieldWeight in 910, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
        0.52 = coord(13/25)
    
  3. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.43
    0.43207476 = sum of:
      0.43207476 = product of:
        1.0801868 = sum of:
          0.013526593 = weight(abstract_txt:analysis in 1740) [ClassicSimilarity], result of:
            0.013526593 = score(doc=1740,freq=1.0), product of:
              0.058915496 = queryWeight, product of:
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.016038017 = queryNorm
              0.22959313 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.019218856 = weight(abstract_txt:user in 1740) [ClassicSimilarity], result of:
            0.019218856 = score(doc=1740,freq=2.0), product of:
              0.059098843 = queryWeight, product of:
                1.0015548 = boost
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.016038017 = queryNorm
              0.32519853 = fieldWeight in 1740, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.009777092 = weight(abstract_txt:from in 1740) [ClassicSimilarity], result of:
            0.009777092 = score(doc=1740,freq=1.0), product of:
              0.05625917 = queryWeight, product of:
                1.2615552 = boost
                2.7805862 = idf(docFreq=7289, maxDocs=43254)
                0.016038017 = queryNorm
              0.17378664 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.7805862 = idf(docFreq=7289, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.0074075465 = weight(abstract_txt:that in 1740) [ClassicSimilarity], result of:
            0.0074075465 = score(doc=1740,freq=1.0), product of:
              0.04968556 = queryWeight, product of:
                1.2987194 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.016038017 = queryNorm
              0.14908852 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.031479374 = weight(abstract_txt:were in 1740) [ClassicSimilarity], result of:
            0.031479374 = score(doc=1740,freq=3.0), product of:
              0.07895758 = queryWeight, product of:
                1.3367541 = boost
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.016038017 = queryNorm
              0.39868718 = fieldWeight in 1740, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.034694083 = weight(abstract_txt:making in 1740) [ClassicSimilarity], result of:
            0.034694083 = score(doc=1740,freq=1.0), product of:
              0.11039283 = queryWeight, product of:
                1.3688494 = boost
                5.0284543 = idf(docFreq=769, maxDocs=43254)
                0.016038017 = queryNorm
              0.3142784 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0284543 = idf(docFreq=769, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.022497118 = weight(abstract_txt:most in 1740) [ClassicSimilarity], result of:
            0.022497118 = score(doc=1740,freq=1.0), product of:
              0.09102655 = queryWeight, product of:
                1.4352866 = boost
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.016038017 = queryNorm
              0.24714896 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.20815599 = weight(abstract_txt:judgments in 1740) [ClassicSimilarity], result of:
            0.20815599 = score(doc=1740,freq=3.0), product of:
              0.27816492 = queryWeight, product of:
                2.5090296 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.016038017 = queryNorm
              0.7483186 = fieldWeight in 1740, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.24022858 = weight(abstract_txt:relevance in 1740) [ClassicSimilarity], result of:
            0.24022858 = score(doc=1740,freq=4.0), product of:
              0.3895748 = queryWeight, product of:
                4.923981 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.016038017 = queryNorm
              0.616643 = fieldWeight in 1740, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.49320158 = weight(abstract_txt:criteria in 1740) [ClassicSimilarity], result of:
            0.49320158 = score(doc=1740,freq=8.0), product of:
              0.49947536 = queryWeight, product of:
                5.575425 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.016038017 = queryNorm
              0.9874393 = fieldWeight in 1740, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
        0.4 = coord(10/25)
    
  4. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.41
    0.40844285 = sum of:
      0.40844285 = product of:
        1.1345634 = sum of:
          0.013526593 = weight(abstract_txt:analysis in 73) [ClassicSimilarity], result of:
            0.013526593 = score(doc=73,freq=1.0), product of:
              0.058915496 = queryWeight, product of:
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.016038017 = queryNorm
              0.22959313 = fieldWeight in 73, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.019218856 = weight(abstract_txt:user in 73) [ClassicSimilarity], result of:
            0.019218856 = score(doc=73,freq=2.0), product of:
              0.059098843 = queryWeight, product of:
                1.0015548 = boost
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.016038017 = queryNorm
              0.32519853 = fieldWeight in 73, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6792014 = idf(docFreq=2967, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.009777092 = weight(abstract_txt:from in 73) [ClassicSimilarity], result of:
            0.009777092 = score(doc=73,freq=1.0), product of:
              0.05625917 = queryWeight, product of:
                1.2615552 = boost
                2.7805862 = idf(docFreq=7289, maxDocs=43254)
                0.016038017 = queryNorm
              0.17378664 = fieldWeight in 73, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.7805862 = idf(docFreq=7289, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.036349252 = weight(abstract_txt:were in 73) [ClassicSimilarity], result of:
            0.036349252 = score(doc=73,freq=4.0), product of:
              0.07895758 = queryWeight, product of:
                1.3367541 = boost
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.016038017 = queryNorm
              0.4603643 = fieldWeight in 73, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.04873568 = weight(abstract_txt:importance in 73) [ClassicSimilarity], result of:
            0.04873568 = score(doc=73,freq=1.0), product of:
              0.1523988 = queryWeight, product of:
                1.857143 = boost
                5.1166472 = idf(docFreq=704, maxDocs=43254)
                0.016038017 = queryNorm
              0.31979045 = fieldWeight in 73, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1166472 = idf(docFreq=704, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.026003206 = weight(abstract_txt:information in 73) [ClassicSimilarity], result of:
            0.026003206 = score(doc=73,freq=4.0), product of:
              0.08571591 = queryWeight, product of:
                2.2021928 = boost
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.016038017 = queryNorm
              0.303365 = fieldWeight in 73, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.16995865 = weight(abstract_txt:judgments in 73) [ClassicSimilarity], result of:
            0.16995865 = score(doc=73,freq=2.0), product of:
              0.27816492 = queryWeight, product of:
                2.5090296 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.016038017 = queryNorm
              0.6109996 = fieldWeight in 73, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.31779253 = weight(abstract_txt:relevance in 73) [ClassicSimilarity], result of:
            0.31779253 = score(doc=73,freq=7.0), product of:
              0.3895748 = queryWeight, product of:
                4.923981 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.016038017 = queryNorm
              0.815742 = fieldWeight in 73, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.49320158 = weight(abstract_txt:criteria in 73) [ClassicSimilarity], result of:
            0.49320158 = score(doc=73,freq=8.0), product of:
              0.49947536 = queryWeight, product of:
                5.575425 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.016038017 = queryNorm
              0.9874393 = fieldWeight in 73, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
        0.36 = coord(9/25)
    
  5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 0.40
    0.39614877 = sum of:
      0.39614877 = product of:
        0.99037194 = sum of:
          0.014648545 = weight(abstract_txt:their in 1692) [ClassicSimilarity], result of:
            0.014648545 = score(doc=1692,freq=1.0), product of:
              0.058930457 = queryWeight, product of:
                1.1548471 = boost
                3.1817396 = idf(docFreq=4880, maxDocs=43254)
                0.016038017 = queryNorm
              0.24857341 = fieldWeight in 1692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.1817396 = idf(docFreq=4880, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
          0.058955368 = weight(abstract_txt:situations in 1692) [ClassicSimilarity], result of:
            0.058955368 = score(doc=1692,freq=1.0), product of:
              0.11834477 = queryWeight, product of:
                1.1572152 = boost
                6.376528 = idf(docFreq=199, maxDocs=43254)
                0.016038017 = queryNorm
              0.49816623 = fieldWeight in 1692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.376528 = idf(docFreq=199, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
          0.013094815 = weight(abstract_txt:that in 1692) [ClassicSimilarity], result of:
            0.013094815 = score(doc=1692,freq=2.0), product of:
              0.04968556 = queryWeight, product of:
                1.2987194 = boost
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.016038017 = queryNorm
              0.26355374 = fieldWeight in 1692, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3854163 = idf(docFreq=10822, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
          0.043367602 = weight(abstract_txt:making in 1692) [ClassicSimilarity], result of:
            0.043367602 = score(doc=1692,freq=1.0), product of:
              0.11039283 = queryWeight, product of:
                1.3688494 = boost
                5.0284543 = idf(docFreq=769, maxDocs=43254)
                0.016038017 = queryNorm
              0.39284799 = fieldWeight in 1692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0284543 = idf(docFreq=769, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
          0.057872534 = weight(abstract_txt:users in 1692) [ClassicSimilarity], result of:
            0.057872534 = score(doc=1692,freq=5.0), product of:
              0.09277661 = queryWeight, product of:
                1.6200516 = boost
                3.570746 = idf(docFreq=3307, maxDocs=43254)
                0.016038017 = queryNorm
              0.62378365 = fieldWeight in 1692, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.570746 = idf(docFreq=3307, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
          0.0609196 = weight(abstract_txt:importance in 1692) [ClassicSimilarity], result of:
            0.0609196 = score(doc=1692,freq=1.0), product of:
              0.1523988 = queryWeight, product of:
                1.857143 = boost
                5.1166472 = idf(docFreq=704, maxDocs=43254)
                0.016038017 = queryNorm
              0.39973807 = fieldWeight in 1692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1166472 = idf(docFreq=704, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
          0.022983804 = weight(abstract_txt:information in 1692) [ClassicSimilarity], result of:
            0.022983804 = score(doc=1692,freq=2.0), product of:
              0.08571591 = queryWeight, product of:
                2.2021928 = boost
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.016038017 = queryNorm
              0.2681393 = fieldWeight in 1692, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.42692 = idf(docFreq=10382, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
          0.15022364 = weight(abstract_txt:judgments in 1692) [ClassicSimilarity], result of:
            0.15022364 = score(doc=1692,freq=1.0), product of:
              0.27816492 = queryWeight, product of:
                2.5090296 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.016038017 = queryNorm
              0.5400524 = fieldWeight in 1692, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
          0.26005507 = weight(abstract_txt:relevance in 1692) [ClassicSimilarity], result of:
            0.26005507 = score(doc=1692,freq=3.0), product of:
              0.3895748 = queryWeight, product of:
                4.923981 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.016038017 = queryNorm
              0.66753566 = fieldWeight in 1692, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
          0.308251 = weight(abstract_txt:criteria in 1692) [ClassicSimilarity], result of:
            0.308251 = score(doc=1692,freq=2.0), product of:
              0.49947536 = queryWeight, product of:
                5.575425 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.016038017 = queryNorm
              0.61714953 = fieldWeight in 1692, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.078125 = fieldNorm(doc=1692)
        0.4 = coord(10/25)