Document (#30203)

Author
Maglaughlin, K.L.
Sonnenwald, D.H.
Title
User perspectives an relevance criteria : a comparison among relevant, partially relevant, and not-relevant judgements
Source
Journal of the American Society for Information Science and technology. 53(2002) no.5, S.327-342
Year
2002
Abstract
In this issue Maglaughin and Sonnenwald provided 12 graduate students with searches related to the student's work and asked them to judge the twenty most recent retrieved representations by highlighting passages thought to contribute to relevance, marking out passages detracting from relevance, and providing a relevant, partially relevant or relevant judgement on each. By recorded interview they were asked about how these decisions were made and to describe the three classes of judgement. The union of criteria identified in past studies did not seem to fully capture the information supplied so a new set was produced and coding agreement found to be adequate. Twenty-nine criteria were identified and grouped into six categories based upon the focus of the criterion. Multiple criteria are used for most judgements, and most criteria may have either a positive or negative effect. Content was the most frequently mentioned criterion.
Theme
Retrievalstudien
Benutzerstudien

Similar documents (author)

  1. Sonnenwald, D.H.: Scientific collaboration (2007) 5.69
    5.6936846 = sum of:
      5.6936846 = weight(author_txt:sonnenwald in 3179) [ClassicSimilarity], result of:
        5.6936846 = fieldWeight in 3179, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.109896 = idf(docFreq=12, maxDocs=43254)
          0.625 = fieldNorm(doc=3179)
    
  2. Sonnenwald, D.H.: Evolving perspectives of human information behaviour : contexts, situations, social networks and information horizons (1999) 5.69
    5.6936846 = sum of:
      5.6936846 = weight(author_txt:sonnenwald in 2294) [ClassicSimilarity], result of:
        5.6936846 = fieldWeight in 2294, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.109896 = idf(docFreq=12, maxDocs=43254)
          0.625 = fieldNorm(doc=2294)
    
  3. Sonnenwald, D.H.; Lievrouw, L.A.: Collaboration during the design process : a case study of communication, information behaviour, and project performance (1997) 4.55
    4.554948 = sum of:
      4.554948 = weight(author_txt:sonnenwald in 2310) [ClassicSimilarity], result of:
        4.554948 = fieldWeight in 2310, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.109896 = idf(docFreq=12, maxDocs=43254)
          0.5 = fieldNorm(doc=2310)
    
  4. Iivonen, M.; Sonnenwald, D.H.: Navigointi hekutermeja valittaessa (1997) 4.55
    4.554948 = sum of:
      4.554948 = weight(author_txt:sonnenwald in 3668) [ClassicSimilarity], result of:
        4.554948 = fieldWeight in 3668, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.109896 = idf(docFreq=12, maxDocs=43254)
          0.5 = fieldNorm(doc=3668)
    
  5. Iivonen, M.; Sonnenwald, D.H.: From translation to navigation of different discourses : a model of search term selection during the pre-online stage of the search process (1998) 4.55
    4.554948 = sum of:
      4.554948 = weight(author_txt:sonnenwald in 4882) [ClassicSimilarity], result of:
        4.554948 = fieldWeight in 4882, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.109896 = idf(docFreq=12, maxDocs=43254)
          0.5 = fieldNorm(doc=4882)
    

Similar documents (content)

  1. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 0.27
    0.26556537 = sum of:
      0.26556537 = product of:
        0.8298918 = sum of:
          0.03301143 = weight(abstract_txt:were in 214) [ClassicSimilarity], result of:
            0.03301143 = score(doc=214,freq=3.0), product of:
              0.094628945 = queryWeight, product of:
                1.6443986 = boost
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.015625188 = queryNorm
              0.3488513 = fieldWeight in 214, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.06069507 = weight(abstract_txt:asked in 214) [ClassicSimilarity], result of:
            0.06069507 = score(doc=214,freq=1.0), product of:
              0.17893422 = queryWeight, product of:
                1.846274 = boost
                6.2025743 = idf(docFreq=237, maxDocs=43254)
                0.015625188 = queryNorm
              0.33920327 = fieldWeight in 214, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.2025743 = idf(docFreq=237, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.06477615 = weight(abstract_txt:relevance in 214) [ClassicSimilarity], result of:
            0.06477615 = score(doc=214,freq=2.0), product of:
              0.16978069 = queryWeight, product of:
                2.2026184 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.015625188 = queryNorm
              0.38152838 = fieldWeight in 214, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.10417506 = weight(abstract_txt:judgements in 214) [ClassicSimilarity], result of:
            0.10417506 = score(doc=214,freq=1.0), product of:
              0.25650764 = queryWeight, product of:
                2.2105463 = boost
                7.4263496 = idf(docFreq=69, maxDocs=43254)
                0.015625188 = queryNorm
              0.4061285 = fieldWeight in 214, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4263496 = idf(docFreq=69, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.11632684 = weight(abstract_txt:criterion in 214) [ClassicSimilarity], result of:
            0.11632684 = score(doc=214,freq=1.0), product of:
              0.276086 = queryWeight, product of:
                2.293357 = boost
                7.704553 = idf(docFreq=52, maxDocs=43254)
                0.015625188 = queryNorm
              0.42134276 = fieldWeight in 214, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.704553 = idf(docFreq=52, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.12496165 = weight(abstract_txt:judgement in 214) [ClassicSimilarity], result of:
            0.12496165 = score(doc=214,freq=1.0), product of:
              0.2895847 = queryWeight, product of:
                2.3487525 = boost
                7.8906555 = idf(docFreq=43, maxDocs=43254)
                0.015625188 = queryNorm
              0.43152022 = fieldWeight in 214, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.8906555 = idf(docFreq=43, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.05448343 = weight(abstract_txt:most in 214) [ClassicSimilarity], result of:
            0.05448343 = score(doc=214,freq=3.0), product of:
              0.14545779 = queryWeight, product of:
                2.3541436 = boost
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.015625188 = queryNorm
              0.3745652 = fieldWeight in 214, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
          0.2714622 = weight(abstract_txt:criteria in 214) [ClassicSimilarity], result of:
            0.2714622 = score(doc=214,freq=6.0), product of:
              0.36279413 = queryWeight, product of:
                4.1567087 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.015625188 = queryNorm
              0.7482541 = fieldWeight in 214, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0546875 = fieldNorm(doc=214)
        0.32 = coord(8/25)
    
  2. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.22
    0.21882717 = sum of:
      0.21882717 = product of:
        0.9117799 = sum of:
          0.03527862 = weight(abstract_txt:identified in 73) [ClassicSimilarity], result of:
            0.03527862 = score(doc=73,freq=1.0), product of:
              0.114008576 = queryWeight, product of:
                1.473731 = boost
                4.9510126 = idf(docFreq=831, maxDocs=43254)
                0.015625188 = queryNorm
              0.3094383 = fieldWeight in 73, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.9510126 = idf(docFreq=831, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.04356379 = weight(abstract_txt:were in 73) [ClassicSimilarity], result of:
            0.04356379 = score(doc=73,freq=4.0), product of:
              0.094628945 = queryWeight, product of:
                1.6443986 = boost
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.015625188 = queryNorm
              0.4603643 = fieldWeight in 73, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.16111867 = weight(abstract_txt:partially in 73) [ClassicSimilarity], result of:
            0.16111867 = score(doc=73,freq=2.0), product of:
              0.24908662 = queryWeight, product of:
                2.178335 = boost
                7.318136 = idf(docFreq=77, maxDocs=43254)
                0.015625188 = queryNorm
              0.64683795 = fieldWeight in 73, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.318136 = idf(docFreq=77, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.13849723 = weight(abstract_txt:relevance in 73) [ClassicSimilarity], result of:
            0.13849723 = score(doc=73,freq=7.0), product of:
              0.16978069 = queryWeight, product of:
                2.2026184 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.015625188 = queryNorm
              0.815742 = fieldWeight in 73, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.17508443 = weight(abstract_txt:relevant in 73) [ClassicSimilarity], result of:
            0.17508443 = score(doc=73,freq=4.0), product of:
              0.30138057 = queryWeight, product of:
                4.1501875 = boost
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.015625188 = queryNorm
              0.5809413 = fieldWeight in 73, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.35823718 = weight(abstract_txt:criteria in 73) [ClassicSimilarity], result of:
            0.35823718 = score(doc=73,freq=8.0), product of:
              0.36279413 = queryWeight, product of:
                4.1567087 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.015625188 = queryNorm
              0.9874393 = fieldWeight in 73, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
        0.24 = coord(6/25)
    
  3. Crystal, A.; Greenberg, J.: Relevance criteria identified by health information users during Web searches (2006) 0.21
    0.21049213 = sum of:
      0.21049213 = product of:
        0.7517576 = sum of:
          0.05498063 = weight(abstract_txt:highlighting in 910) [ClassicSimilarity], result of:
            0.05498063 = score(doc=910,freq=1.0), product of:
              0.121635295 = queryWeight, product of:
                1.0763767 = boost
                7.232194 = idf(docFreq=84, maxDocs=43254)
                0.015625188 = queryNorm
              0.45201212 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.232194 = idf(docFreq=84, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.061104357 = weight(abstract_txt:identified in 910) [ClassicSimilarity], result of:
            0.061104357 = score(doc=910,freq=3.0), product of:
              0.114008576 = queryWeight, product of:
                1.473731 = boost
                4.9510126 = idf(docFreq=831, maxDocs=43254)
                0.015625188 = queryNorm
              0.5359628 = fieldWeight in 910, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.9510126 = idf(docFreq=831, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.03080425 = weight(abstract_txt:were in 910) [ClassicSimilarity], result of:
            0.03080425 = score(doc=910,freq=2.0), product of:
              0.094628945 = queryWeight, product of:
                1.6443986 = boost
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.015625188 = queryNorm
              0.3255267 = fieldWeight in 910, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.0693658 = weight(abstract_txt:asked in 910) [ClassicSimilarity], result of:
            0.0693658 = score(doc=910,freq=1.0), product of:
              0.17893422 = queryWeight, product of:
                1.846274 = boost
                6.2025743 = idf(docFreq=237, maxDocs=43254)
                0.015625188 = queryNorm
              0.3876609 = fieldWeight in 910, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.2025743 = idf(docFreq=237, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.104694076 = weight(abstract_txt:relevance in 910) [ClassicSimilarity], result of:
            0.104694076 = score(doc=910,freq=4.0), product of:
              0.16978069 = queryWeight, product of:
                2.2026184 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.015625188 = queryNorm
              0.616643 = fieldWeight in 910, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.05084061 = weight(abstract_txt:most in 910) [ClassicSimilarity], result of:
            0.05084061 = score(doc=910,freq=2.0), product of:
              0.14545779 = queryWeight, product of:
                2.3541436 = boost
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.015625188 = queryNorm
              0.3495214 = fieldWeight in 910, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
          0.3799679 = weight(abstract_txt:criteria in 910) [ClassicSimilarity], result of:
            0.3799679 = score(doc=910,freq=9.0), product of:
              0.36279413 = queryWeight, product of:
                4.1567087 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.015625188 = queryNorm
              1.0473375 = fieldWeight in 910, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0625 = fieldNorm(doc=910)
        0.28 = coord(7/25)
    
  4. Janes, J.W.: ¬The binary nature of continous relevance judgements : a study of users' perceptions (1991) 0.17
    0.16623211 = sum of:
      0.16623211 = product of:
        0.6926338 = sum of:
          0.11001154 = weight(abstract_txt:judge in 4845) [ClassicSimilarity], result of:
            0.11001154 = score(doc=4845,freq=1.0), product of:
              0.14739558 = queryWeight, product of:
                1.1848863 = boost
                7.9612727 = idf(docFreq=40, maxDocs=43254)
                0.015625188 = queryNorm
              0.7463693 = fieldWeight in 4845, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.9612727 = idf(docFreq=40, maxDocs=43254)
                0.09375 = fieldNorm(doc=4845)
          0.03267284 = weight(abstract_txt:were in 4845) [ClassicSimilarity], result of:
            0.03267284 = score(doc=4845,freq=1.0), product of:
              0.094628945 = queryWeight, product of:
                1.6443986 = boost
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.015625188 = queryNorm
              0.34527323 = fieldWeight in 4845, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.09375 = fieldNorm(doc=4845)
          0.1040487 = weight(abstract_txt:asked in 4845) [ClassicSimilarity], result of:
            0.1040487 = score(doc=4845,freq=1.0), product of:
              0.17893422 = queryWeight, product of:
                1.846274 = boost
                6.2025743 = idf(docFreq=237, maxDocs=43254)
                0.015625188 = queryNorm
              0.58149135 = fieldWeight in 4845, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.2025743 = idf(docFreq=237, maxDocs=43254)
                0.09375 = fieldNorm(doc=4845)
          0.1360016 = weight(abstract_txt:relevance in 4845) [ClassicSimilarity], result of:
            0.1360016 = score(doc=4845,freq=3.0), product of:
              0.16978069 = queryWeight, product of:
                2.2026184 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.015625188 = queryNorm
              0.8010428 = fieldWeight in 4845, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.09375 = fieldNorm(doc=4845)
          0.17858581 = weight(abstract_txt:judgements in 4845) [ClassicSimilarity], result of:
            0.17858581 = score(doc=4845,freq=1.0), product of:
              0.25650764 = queryWeight, product of:
                2.2105463 = boost
                7.4263496 = idf(docFreq=69, maxDocs=43254)
                0.015625188 = queryNorm
              0.6962203 = fieldWeight in 4845, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4263496 = idf(docFreq=69, maxDocs=43254)
                0.09375 = fieldNorm(doc=4845)
          0.13131332 = weight(abstract_txt:relevant in 4845) [ClassicSimilarity], result of:
            0.13131332 = score(doc=4845,freq=1.0), product of:
              0.30138057 = queryWeight, product of:
                4.1501875 = boost
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.015625188 = queryNorm
              0.435706 = fieldWeight in 4845, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.09375 = fieldNorm(doc=4845)
        0.24 = coord(6/25)
    
  5. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.16
    0.15977609 = sum of:
      0.15977609 = product of:
        0.66573375 = sum of:
          0.026953718 = weight(abstract_txt:were in 4593) [ClassicSimilarity], result of:
            0.026953718 = score(doc=4593,freq=2.0), product of:
              0.094628945 = queryWeight, product of:
                1.6443986 = boost
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.015625188 = queryNorm
              0.28483588 = fieldWeight in 4593, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6829145 = idf(docFreq=2956, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.12118509 = weight(abstract_txt:relevance in 4593) [ClassicSimilarity], result of:
            0.12118509 = score(doc=4593,freq=7.0), product of:
              0.16978069 = queryWeight, product of:
                2.2026184 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.015625188 = queryNorm
              0.71377426 = fieldWeight in 4593, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.11632684 = weight(abstract_txt:criterion in 4593) [ClassicSimilarity], result of:
            0.11632684 = score(doc=4593,freq=1.0), product of:
              0.276086 = queryWeight, product of:
                2.293357 = boost
                7.704553 = idf(docFreq=52, maxDocs=43254)
                0.015625188 = queryNorm
              0.42134276 = fieldWeight in 4593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.704553 = idf(docFreq=52, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.031456023 = weight(abstract_txt:most in 4593) [ClassicSimilarity], result of:
            0.031456023 = score(doc=4593,freq=1.0), product of:
              0.14545779 = queryWeight, product of:
                2.3541436 = boost
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.015625188 = queryNorm
              0.21625534 = fieldWeight in 4593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.9543834 = idf(docFreq=2253, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.07659944 = weight(abstract_txt:relevant in 4593) [ClassicSimilarity], result of:
            0.07659944 = score(doc=4593,freq=1.0), product of:
              0.30138057 = queryWeight, product of:
                4.1501875 = boost
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.015625188 = queryNorm
              0.25416183 = fieldWeight in 4593, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
          0.29321265 = weight(abstract_txt:criteria in 4593) [ClassicSimilarity], result of:
            0.29321265 = score(doc=4593,freq=7.0), product of:
              0.36279413 = queryWeight, product of:
                4.1567087 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.015625188 = queryNorm
              0.80820674 = fieldWeight in 4593, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0546875 = fieldNorm(doc=4593)
        0.24 = coord(6/25)