Document (#30215)

Author
Tang, R.
Solomon, P.
Title
Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies
Source
Journal of the American Society for Information Science and technology. 52(2001) no.8, S.676-687
Year
2001
Abstract
Tang and Solomon, based upon their review of the history of topical and other than topical criteria in relevance evaluation, decide to look at a two stage model where judgements are first made on surrogate records and then on full document text to determine if a criteria shift takes place and if so in what manner and to what degree. Both a controlled experiment and a naturalistic study were used to study the staging of relevance judgement criteria. In the controlled environment 90 undergraduate Psychology students were instructed to choose papers that would help them meet an assignment from 20 preselected papers on broader topic that included that assigned. They first selected on the basis of citation and abstract, then read the papers, and in each process filled out a questionnaire on the importance of each of 15 criteria at each stage of the two-stage process. In the naturalistic study 9 Ph.D. Psychology students conducted literature searches to support their own research and were asked to think aloud while making their decisions from retrieved surrogates, and later filled out a questionnaire while reading those materials that they selected and then interviewed at the end of the process. Apparently understandability is important at both stages. Importance increased at stage two. Cognitive criteria do not all follow the same pattern across stages. The controlled group thought quality of information was most important in stage one and topicality most important in stage 2. In the naturalistic study topicality was most frequent for stage one and research structure for stage two. A classification of criteria by their functionality is suggested as a better approach. First a division as to whether a criterion is objectively associated with the document as opposed to being subjectively associated with a person's expectations; then a division based on primary (essential) or secondary (for assistance) status.
Theme
Benutzerstudien

Similar documents (author)

  1. Tang, R.; Solomon, P.: Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior (1998) 5.96
    5.962449 = sum of:
      5.962449 = sum of:
        2.7324822 = weight(author_txt:tang in 4269) [ClassicSimilarity], result of:
          2.7324822 = score(doc=4269,freq=1.0), product of:
            0.6666904 = queryWeight, product of:
              8.197155 = idf(docFreq=31, maxDocs=42740)
              0.08133192 = queryNorm
            4.0985775 = fieldWeight in 4269, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.197155 = idf(docFreq=31, maxDocs=42740)
              0.5 = fieldNorm(doc=4269)
        3.2299669 = weight(author_txt:solomon in 4269) [ClassicSimilarity], result of:
          3.2299669 = score(doc=4269,freq=1.0), product of:
            0.7453347 = queryWeight, product of:
              1.0573374 = boost
              8.667158 = idf(docFreq=19, maxDocs=42740)
              0.08133192 = queryNorm
            4.333579 = fieldWeight in 4269, product of:
              1.0 = tf(freq=1.0), with freq of:
                1.0 = termFreq=1.0
              8.667158 = idf(docFreq=19, maxDocs=42740)
              0.5 = fieldNorm(doc=4269)
    
  2. Solomon, P.: Children's information retrieval behavior : a case analysis of an OPAC (1993) 2.02
    2.0187294 = sum of:
      2.0187294 = product of:
        4.037459 = sum of:
          4.037459 = weight(author_txt:solomon in 4349) [ClassicSimilarity], result of:
            4.037459 = score(doc=4349,freq=1.0), product of:
              0.7453347 = queryWeight, product of:
                1.0573374 = boost
                8.667158 = idf(docFreq=19, maxDocs=42740)
                0.08133192 = queryNorm
              5.416974 = fieldWeight in 4349, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.667158 = idf(docFreq=19, maxDocs=42740)
                0.625 = fieldNorm(doc=4349)
        0.5 = coord(1/2)
    
  3. Solomon, P.: On the dynamics of information system use : from novice to? (1992) 2.02
    2.0187294 = sum of:
      2.0187294 = product of:
        4.037459 = sum of:
          4.037459 = weight(author_txt:solomon in 4519) [ClassicSimilarity], result of:
            4.037459 = score(doc=4519,freq=1.0), product of:
              0.7453347 = queryWeight, product of:
                1.0573374 = boost
                8.667158 = idf(docFreq=19, maxDocs=42740)
                0.08133192 = queryNorm
              5.416974 = fieldWeight in 4519, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.667158 = idf(docFreq=19, maxDocs=42740)
                0.625 = fieldNorm(doc=4519)
        0.5 = coord(1/2)
    
  4. Solomon, P.: Children, technology, and instruction : a case study of elementary school children using an online public access catalog (OPAC) (1994) 2.02
    2.0187294 = sum of:
      2.0187294 = product of:
        4.037459 = sum of:
          4.037459 = weight(author_txt:solomon in 1492) [ClassicSimilarity], result of:
            4.037459 = score(doc=1492,freq=1.0), product of:
              0.7453347 = queryWeight, product of:
                1.0573374 = boost
                8.667158 = idf(docFreq=19, maxDocs=42740)
                0.08133192 = queryNorm
              5.416974 = fieldWeight in 1492, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.667158 = idf(docFreq=19, maxDocs=42740)
                0.625 = fieldNorm(doc=1492)
        0.5 = coord(1/2)
    
  5. Solomon, P.: Dicovering information bahavior in sense making : I. time and timing (1997) 2.02
    2.0187294 = sum of:
      2.0187294 = product of:
        4.037459 = sum of:
          4.037459 = weight(author_txt:solomon in 958) [ClassicSimilarity], result of:
            4.037459 = score(doc=958,freq=1.0), product of:
              0.7453347 = queryWeight, product of:
                1.0573374 = boost
                8.667158 = idf(docFreq=19, maxDocs=42740)
                0.08133192 = queryNorm
              5.416974 = fieldWeight in 958, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.667158 = idf(docFreq=19, maxDocs=42740)
                0.625 = fieldNorm(doc=958)
        0.5 = coord(1/2)
    

Similar documents (content)

  1. Wang, P.; White, M.D.: ¬A cognitive model of document use during a research project : Study II: Decisions at the reading and citing stages (1999) 0.36
    0.3550989 = sum of:
      0.3550989 = product of:
        0.80704296 = sum of:
          0.030486772 = weight(abstract_txt:selected in 3941) [ClassicSimilarity], result of:
            0.030486772 = score(doc=3941,freq=1.0), product of:
              0.093124546 = queryWeight, product of:
                1.0142146 = boost
                5.2380214 = idf(docFreq=616, maxDocs=42740)
                0.017529398 = queryNorm
              0.32737634 = fieldWeight in 3941, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2380214 = idf(docFreq=616, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.016015442 = weight(abstract_txt:were in 3941) [ClassicSimilarity], result of:
            0.016015442 = score(doc=3941,freq=1.0), product of:
              0.06940321 = queryWeight, product of:
                1.0723417 = boost
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.017529398 = queryNorm
              0.23075938 = fieldWeight in 3941, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.030463805 = weight(abstract_txt:process in 3941) [ClassicSimilarity], result of:
            0.030463805 = score(doc=3941,freq=2.0), product of:
              0.084566765 = queryWeight, product of:
                1.1837044 = boost
                4.07558 = idf(docFreq=1972, maxDocs=42740)
                0.017529398 = queryNorm
              0.36023378 = fieldWeight in 3941, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.07558 = idf(docFreq=1972, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.022463653 = weight(abstract_txt:each in 3941) [ClassicSimilarity], result of:
            0.022463653 = score(doc=3941,freq=1.0), product of:
              0.086964205 = queryWeight, product of:
                1.200366 = boost
                4.132947 = idf(docFreq=1862, maxDocs=42740)
                0.017529398 = queryNorm
              0.2583092 = fieldWeight in 3941, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.132947 = idf(docFreq=1862, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.023595897 = weight(abstract_txt:first in 3941) [ClassicSimilarity], result of:
            0.023595897 = score(doc=3941,freq=1.0), product of:
              0.089862384 = queryWeight, product of:
                1.2202039 = boost
                4.20125 = idf(docFreq=1739, maxDocs=42740)
                0.017529398 = queryNorm
              0.26257813 = fieldWeight in 3941, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.20125 = idf(docFreq=1739, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.013800462 = weight(abstract_txt:their in 3941) [ClassicSimilarity], result of:
            0.013800462 = score(doc=3941,freq=1.0), product of:
              0.06917178 = queryWeight, product of:
                1.2361673 = boost
                3.1921601 = idf(docFreq=4772, maxDocs=42740)
                0.017529398 = queryNorm
              0.19951001 = fieldWeight in 3941, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.1921601 = idf(docFreq=4772, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.055814926 = weight(abstract_txt:document in 3941) [ClassicSimilarity], result of:
            0.055814926 = score(doc=3941,freq=5.0), product of:
              0.09329618 = queryWeight, product of:
                1.2432984 = boost
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.017529398 = queryNorm
              0.5982552 = fieldWeight in 3941, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.04693589 = weight(abstract_txt:study in 3941) [ClassicSimilarity], result of:
            0.04693589 = score(doc=3941,freq=7.0), product of:
              0.08177814 = queryWeight, product of:
                1.3440994 = boost
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.017529398 = queryNorm
              0.57394177 = fieldWeight in 3941, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.081652634 = weight(abstract_txt:stages in 3941) [ClassicSimilarity], result of:
            0.081652634 = score(doc=3941,freq=1.0), product of:
              0.20558925 = queryWeight, product of:
                1.8456258 = boost
                6.354623 = idf(docFreq=201, maxDocs=42740)
                0.017529398 = queryNorm
              0.39716393 = fieldWeight in 3941, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.354623 = idf(docFreq=201, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.2892612 = weight(abstract_txt:criteria in 3941) [ClassicSimilarity], result of:
            0.2892612 = score(doc=3941,freq=5.0), product of:
              0.37058055 = queryWeight, product of:
                3.7850633 = boost
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.017529398 = queryNorm
              0.7805622 = fieldWeight in 3941, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
          0.19655225 = weight(abstract_txt:stage in 3941) [ClassicSimilarity], result of:
            0.19655225 = score(doc=3941,freq=1.0), product of:
              0.51206905 = queryWeight, product of:
                4.75655 = boost
                6.1414294 = idf(docFreq=249, maxDocs=42740)
                0.017529398 = queryNorm
              0.38383934 = fieldWeight in 3941, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1414294 = idf(docFreq=249, maxDocs=42740)
                0.0625 = fieldNorm(doc=3941)
        0.44 = coord(11/25)
    
  2. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.34
    0.33733705 = sum of:
      0.33733705 = product of:
        0.7666751 = sum of:
          0.025569951 = weight(abstract_txt:across in 3593) [ClassicSimilarity], result of:
            0.025569951 = score(doc=3593,freq=1.0), product of:
              0.09053248 = queryWeight, product of:
                5.1646085 = idf(docFreq=663, maxDocs=42740)
                0.017529398 = queryNorm
              0.28243953 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1646085 = idf(docFreq=663, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.019818097 = weight(abstract_txt:were in 3593) [ClassicSimilarity], result of:
            0.019818097 = score(doc=3593,freq=2.0), product of:
              0.06940321 = queryWeight, product of:
                1.0723417 = boost
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.017529398 = queryNorm
              0.28555015 = fieldWeight in 3593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.017300278 = weight(abstract_txt:most in 3593) [ClassicSimilarity], result of:
            0.017300278 = score(doc=3593,freq=1.0), product of:
              0.07986999 = queryWeight, product of:
                1.1503639 = boost
                3.960786 = idf(docFreq=2212, maxDocs=42740)
                0.017529398 = queryNorm
              0.21660548 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.960786 = idf(docFreq=2212, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.019655697 = weight(abstract_txt:each in 3593) [ClassicSimilarity], result of:
            0.019655697 = score(doc=3593,freq=1.0), product of:
              0.086964205 = queryWeight, product of:
                1.200366 = boost
                4.132947 = idf(docFreq=1862, maxDocs=42740)
                0.017529398 = queryNorm
              0.22602054 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.132947 = idf(docFreq=1862, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.030101193 = weight(abstract_txt:important in 3593) [ClassicSimilarity], result of:
            0.030101193 = score(doc=3593,freq=2.0), product of:
              0.09170522 = queryWeight, product of:
                1.2326518 = boost
                4.2441096 = idf(docFreq=1666, maxDocs=42740)
                0.017529398 = queryNorm
              0.3282386 = fieldWeight in 3593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.2441096 = idf(docFreq=1666, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.012075405 = weight(abstract_txt:their in 3593) [ClassicSimilarity], result of:
            0.012075405 = score(doc=3593,freq=1.0), product of:
              0.06917178 = queryWeight, product of:
                1.2361673 = boost
                3.1921601 = idf(docFreq=4772, maxDocs=42740)
                0.017529398 = queryNorm
              0.17457126 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.1921601 = idf(docFreq=4772, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.034709558 = weight(abstract_txt:study in 3593) [ClassicSimilarity], result of:
            0.034709558 = score(doc=3593,freq=5.0), product of:
              0.08177814 = queryWeight, product of:
                1.3440994 = boost
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.017529398 = queryNorm
              0.42443568 = fieldWeight in 3593, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.08849618 = weight(abstract_txt:relevance in 3593) [ClassicSimilarity], result of:
            0.08849618 = score(doc=3593,freq=7.0), product of:
              0.12395534 = queryWeight, product of:
                1.4330986 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.017529398 = queryNorm
              0.713936 = fieldWeight in 3593, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.14802662 = weight(abstract_txt:topicality in 3593) [ClassicSimilarity], result of:
            0.14802662 = score(doc=3593,freq=2.0), product of:
              0.23166889 = queryWeight, product of:
                1.5996746 = boost
                8.261693 = idf(docFreq=29, maxDocs=42740)
                0.017529398 = queryNorm
              0.6389577 = fieldWeight in 3593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                8.261693 = idf(docFreq=29, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.07144605 = weight(abstract_txt:stages in 3593) [ClassicSimilarity], result of:
            0.07144605 = score(doc=3593,freq=1.0), product of:
              0.20558925 = queryWeight, product of:
                1.8456258 = boost
                6.354623 = idf(docFreq=201, maxDocs=42740)
                0.017529398 = queryNorm
              0.34751844 = fieldWeight in 3593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.354623 = idf(docFreq=201, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
          0.29947612 = weight(abstract_txt:criteria in 3593) [ClassicSimilarity], result of:
            0.29947612 = score(doc=3593,freq=7.0), product of:
              0.37058055 = queryWeight, product of:
                3.7850633 = boost
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.017529398 = queryNorm
              0.8081269 = fieldWeight in 3593, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.0546875 = fieldNorm(doc=3593)
        0.44 = coord(11/25)
    
  3. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.30
    0.30279145 = sum of:
      0.30279145 = product of:
        0.94622326 = sum of:
          0.032030884 = weight(abstract_txt:were in 609) [ClassicSimilarity], result of:
            0.032030884 = score(doc=609,freq=4.0), product of:
              0.06940321 = queryWeight, product of:
                1.0723417 = boost
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.017529398 = queryNorm
              0.46151876 = fieldWeight in 609, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.048167508 = weight(abstract_txt:process in 609) [ClassicSimilarity], result of:
            0.048167508 = score(doc=609,freq=5.0), product of:
              0.084566765 = queryWeight, product of:
                1.1837044 = boost
                4.07558 = idf(docFreq=1972, maxDocs=42740)
                0.017529398 = queryNorm
              0.56957966 = fieldWeight in 609, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.07558 = idf(docFreq=1972, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.030726751 = weight(abstract_txt:study in 609) [ClassicSimilarity], result of:
            0.030726751 = score(doc=609,freq=3.0), product of:
              0.08177814 = queryWeight, product of:
                1.3440994 = boost
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.017529398 = queryNorm
              0.37573308 = fieldWeight in 609, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.10113849 = weight(abstract_txt:relevance in 609) [ClassicSimilarity], result of:
            0.10113849 = score(doc=609,freq=7.0), product of:
              0.12395534 = queryWeight, product of:
                1.4330986 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.017529398 = queryNorm
              0.81592685 = fieldWeight in 609, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.052094117 = weight(abstract_txt:controlled in 609) [ClassicSimilarity], result of:
            0.052094117 = score(doc=609,freq=1.0), product of:
              0.15236296 = queryWeight, product of:
                1.5888509 = boost
                5.470528 = idf(docFreq=488, maxDocs=42740)
                0.017529398 = queryNorm
              0.341908 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.470528 = idf(docFreq=488, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.11962358 = weight(abstract_txt:topicality in 609) [ClassicSimilarity], result of:
            0.11962358 = score(doc=609,freq=1.0), product of:
              0.23166889 = queryWeight, product of:
                1.5996746 = boost
                8.261693 = idf(docFreq=29, maxDocs=42740)
                0.017529398 = queryNorm
              0.5163558 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.261693 = idf(docFreq=29, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.36588967 = weight(abstract_txt:criteria in 609) [ClassicSimilarity], result of:
            0.36588967 = score(doc=609,freq=8.0), product of:
              0.37058055 = queryWeight, product of:
                3.7850633 = boost
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.017529398 = queryNorm
              0.98734176 = fieldWeight in 609, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.19655225 = weight(abstract_txt:stage in 609) [ClassicSimilarity], result of:
            0.19655225 = score(doc=609,freq=1.0), product of:
              0.51206905 = queryWeight, product of:
                4.75655 = boost
                6.1414294 = idf(docFreq=249, maxDocs=42740)
                0.017529398 = queryNorm
              0.38383934 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1414294 = idf(docFreq=249, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
        0.32 = coord(8/25)
    
  4. Bateman, J.: Modelling the importance of end-user relevance criteria (1999) 0.26
    0.2618872 = sum of:
      0.2618872 = product of:
        0.7274644 = sum of:
          0.026675927 = weight(abstract_txt:selected in 607) [ClassicSimilarity], result of:
            0.026675927 = score(doc=607,freq=1.0), product of:
              0.093124546 = queryWeight, product of:
                1.0142146 = boost
                5.2380214 = idf(docFreq=616, maxDocs=42740)
                0.017529398 = queryNorm
              0.2864543 = fieldWeight in 607, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2380214 = idf(docFreq=616, maxDocs=42740)
                0.0546875 = fieldNorm(doc=607)
          0.028027022 = weight(abstract_txt:were in 607) [ClassicSimilarity], result of:
            0.028027022 = score(doc=607,freq=4.0), product of:
              0.06940321 = queryWeight, product of:
                1.0723417 = boost
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.017529398 = queryNorm
              0.40382892 = fieldWeight in 607, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.0546875 = fieldNorm(doc=607)
          0.034600556 = weight(abstract_txt:most in 607) [ClassicSimilarity], result of:
            0.034600556 = score(doc=607,freq=4.0), product of:
              0.07986999 = queryWeight, product of:
                1.1503639 = boost
                3.960786 = idf(docFreq=2212, maxDocs=42740)
                0.017529398 = queryNorm
              0.43321097 = fieldWeight in 607, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.960786 = idf(docFreq=2212, maxDocs=42740)
                0.0546875 = fieldNorm(doc=607)
          0.030101193 = weight(abstract_txt:important in 607) [ClassicSimilarity], result of:
            0.030101193 = score(doc=607,freq=2.0), product of:
              0.09170522 = queryWeight, product of:
                1.2326518 = boost
                4.2441096 = idf(docFreq=1666, maxDocs=42740)
                0.017529398 = queryNorm
              0.3282386 = fieldWeight in 607, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.2441096 = idf(docFreq=1666, maxDocs=42740)
                0.0546875 = fieldNorm(doc=607)
          0.02415081 = weight(abstract_txt:their in 607) [ClassicSimilarity], result of:
            0.02415081 = score(doc=607,freq=4.0), product of:
              0.06917178 = queryWeight, product of:
                1.2361673 = boost
                3.1921601 = idf(docFreq=4772, maxDocs=42740)
                0.017529398 = queryNorm
              0.34914252 = fieldWeight in 607, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.1921601 = idf(docFreq=4772, maxDocs=42740)
                0.0546875 = fieldNorm(doc=607)
          0.015522587 = weight(abstract_txt:study in 607) [ClassicSimilarity], result of:
            0.015522587 = score(doc=607,freq=1.0), product of:
              0.08177814 = queryWeight, product of:
                1.3440994 = boost
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.017529398 = queryNorm
              0.1898134 = fieldWeight in 607, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.0546875 = fieldNorm(doc=607)
          0.105773166 = weight(abstract_txt:relevance in 607) [ClassicSimilarity], result of:
            0.105773166 = score(doc=607,freq=10.0), product of:
              0.12395534 = queryWeight, product of:
                1.4330986 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.017529398 = queryNorm
              0.8533167 = fieldWeight in 607, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.0546875 = fieldNorm(doc=607)
          0.10467063 = weight(abstract_txt:topicality in 607) [ClassicSimilarity], result of:
            0.10467063 = score(doc=607,freq=1.0), product of:
              0.23166889 = queryWeight, product of:
                1.5996746 = boost
                8.261693 = idf(docFreq=29, maxDocs=42740)
                0.017529398 = queryNorm
              0.45181134 = fieldWeight in 607, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.261693 = idf(docFreq=29, maxDocs=42740)
                0.0546875 = fieldNorm(doc=607)
          0.35794246 = weight(abstract_txt:criteria in 607) [ClassicSimilarity], result of:
            0.35794246 = score(doc=607,freq=10.0), product of:
              0.37058055 = queryWeight, product of:
                3.7850633 = boost
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.017529398 = queryNorm
              0.9658965 = fieldWeight in 607, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.0546875 = fieldNorm(doc=607)
        0.36 = coord(9/25)
    
  5. Ng, K.B.; Kantor, P.B.; Strzalkowski, T.; Wacholder, N.; Tang, R.; Bai, B.; Rittman,; Song, P.; Sun, Y.: Automated judgment of document qualities (2006) 0.24
    0.2355022 = sum of:
      0.2355022 = product of:
        0.7359444 = sum of:
          0.028311567 = weight(abstract_txt:were in 1308) [ClassicSimilarity], result of:
            0.028311567 = score(doc=1308,freq=2.0), product of:
              0.06940321 = queryWeight, product of:
                1.0723417 = boost
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.017529398 = queryNorm
              0.4079288 = fieldWeight in 1308, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.69215 = idf(docFreq=2894, maxDocs=42740)
                0.078125 = fieldNorm(doc=1308)
          0.030406797 = weight(abstract_txt:important in 1308) [ClassicSimilarity], result of:
            0.030406797 = score(doc=1308,freq=1.0), product of:
              0.09170522 = queryWeight, product of:
                1.2326518 = boost
                4.2441096 = idf(docFreq=1666, maxDocs=42740)
                0.017529398 = queryNorm
              0.33157107 = fieldWeight in 1308, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.2441096 = idf(docFreq=1666, maxDocs=42740)
                0.078125 = fieldNorm(doc=1308)
          0.017250577 = weight(abstract_txt:their in 1308) [ClassicSimilarity], result of:
            0.017250577 = score(doc=1308,freq=1.0), product of:
              0.06917178 = queryWeight, product of:
                1.2361673 = boost
                3.1921601 = idf(docFreq=4772, maxDocs=42740)
                0.017529398 = queryNorm
              0.2493875 = fieldWeight in 1308, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.1921601 = idf(docFreq=4772, maxDocs=42740)
                0.078125 = fieldNorm(doc=1308)
          0.062402982 = weight(abstract_txt:document in 1308) [ClassicSimilarity], result of:
            0.062402982 = score(doc=1308,freq=4.0), product of:
              0.09329618 = queryWeight, product of:
                1.2432984 = boost
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.017529398 = queryNorm
              0.6688697 = fieldWeight in 1308, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.280766 = idf(docFreq=1606, maxDocs=42740)
                0.078125 = fieldNorm(doc=1308)
          0.022175124 = weight(abstract_txt:study in 1308) [ClassicSimilarity], result of:
            0.022175124 = score(doc=1308,freq=1.0), product of:
              0.08177814 = queryWeight, product of:
                1.3440994 = boost
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.017529398 = queryNorm
              0.271162 = fieldWeight in 1308, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4708736 = idf(docFreq=3611, maxDocs=42740)
                0.078125 = fieldNorm(doc=1308)
          0.047783446 = weight(abstract_txt:relevance in 1308) [ClassicSimilarity], result of:
            0.047783446 = score(doc=1308,freq=1.0), product of:
              0.12395534 = queryWeight, product of:
                1.4330986 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.017529398 = queryNorm
              0.3854892 = fieldWeight in 1308, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.078125 = fieldNorm(doc=1308)
          0.10206579 = weight(abstract_txt:stages in 1308) [ClassicSimilarity], result of:
            0.10206579 = score(doc=1308,freq=1.0), product of:
              0.20558925 = queryWeight, product of:
                1.8456258 = boost
                6.354623 = idf(docFreq=201, maxDocs=42740)
                0.017529398 = queryNorm
              0.4964549 = fieldWeight in 1308, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.354623 = idf(docFreq=201, maxDocs=42740)
                0.078125 = fieldNorm(doc=1308)
          0.4255481 = weight(abstract_txt:stage in 1308) [ClassicSimilarity], result of:
            0.4255481 = score(doc=1308,freq=3.0), product of:
              0.51206905 = queryWeight, product of:
                4.75655 = boost
                6.1414294 = idf(docFreq=249, maxDocs=42740)
                0.017529398 = queryNorm
              0.83103657 = fieldWeight in 1308, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.1414294 = idf(docFreq=249, maxDocs=42740)
                0.078125 = fieldNorm(doc=1308)
        0.32 = coord(8/25)