Document (#37381)

Author
Balatsoukas, P.
Ruthven, I.
Title
¬An eye-tracking approach to the analysis of relevance judgments on the Web : the case of Google search engine
Source
Journal of the American Society for Information Science and Technology. 63(2012) no.9, S.1728-1746
Year
2012
Abstract
Eye movement data can provide an in-depth view of human reasoning and the decision-making process, and modern information retrieval (IR) research can benefit from the analysis of this type of data. The aim of this research was to examine the relationship between relevance criteria use and visual behavior in the context of predictive relevance judgments. To address this objective, a multimethod research design was employed that involved observation of participants' eye movements, talk-aloud protocols, and postsearch interviews. Specifically, the results reported in this article came from the analysis of 281 predictive relevance judgments made by 24 participants using the Google search engine. We present a novel stepwise methodological framework for the analysis of relevance judgments and eye movements on the Web and show new patterns of relevance criteria use during predictive relevance judgment. For example, the findings showed an effect of ranking order and surrogate components (Title, Summary, and URL) on the use of relevance criteria. Also, differences were observed in the cognitive effort spent between very relevant and not relevant judgments. We conclude with the implications of this study for IR research.
Theme
Benutzerstudien
Object
Google

Similar documents (author)

  1. Balatsoukas, P.; Demian, P.: Effects of granularity of search results on the relevance judgment behavior of engineers : building systems for retrieval and understanding of context (2010) 2.01
    2.0100586 = sum of:
      2.0100586 = product of:
        4.0201173 = sum of:
          4.0201173 = weight(author_txt:balatsoukas in 420) [ClassicSimilarity], result of:
            4.0201173 = score(doc=420,freq=1.0), product of:
              0.81452006 = queryWeight, product of:
                1.1849122 = boost
                9.871131 = idf(docFreq=5, maxDocs=42740)
                0.06963839 = queryNorm
              4.9355655 = fieldWeight in 420, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.871131 = idf(docFreq=5, maxDocs=42740)
                0.5 = fieldNorm(doc=420)
        0.5 = coord(1/2)
    
  2. Ruthven, R.: Interactive information retrieval (2008) 1.51
    1.5102895 = sum of:
      1.5102895 = product of:
        3.020579 = sum of:
          3.020579 = weight(author_txt:ruthven in 2839) [ClassicSimilarity], result of:
            3.020579 = score(doc=2839,freq=1.0), product of:
              0.5801355 = queryWeight, product of:
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.06963839 = queryNorm
              5.2066784 = fieldWeight in 2839, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.625 = fieldNorm(doc=2839)
        0.5 = coord(1/2)
    
  3. Ruthven, I.: Integrating approaches to relevance (2005) 1.51
    1.5102895 = sum of:
      1.5102895 = product of:
        3.020579 = sum of:
          3.020579 = weight(author_txt:ruthven in 1764) [ClassicSimilarity], result of:
            3.020579 = score(doc=1764,freq=1.0), product of:
              0.5801355 = queryWeight, product of:
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.06963839 = queryNorm
              5.2066784 = fieldWeight in 1764, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.625 = fieldNorm(doc=1764)
        0.5 = coord(1/2)
    
  4. Ruthven, I.: Relevance behaviour in TREC (2014) 1.51
    1.5102895 = sum of:
      1.5102895 = product of:
        3.020579 = sum of:
          3.020579 = weight(author_txt:ruthven in 3786) [ClassicSimilarity], result of:
            3.020579 = score(doc=3786,freq=1.0), product of:
              0.5801355 = queryWeight, product of:
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.06963839 = queryNorm
              5.2066784 = fieldWeight in 3786, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.625 = fieldNorm(doc=3786)
        0.5 = coord(1/2)
    
  5. Ruthven, I.: ¬The language of information need : differentiating conscious and formalized information needs (2019) 1.51
    1.5102895 = sum of:
      1.5102895 = product of:
        3.020579 = sum of:
          3.020579 = weight(author_txt:ruthven in 1036) [ClassicSimilarity], result of:
            3.020579 = score(doc=1036,freq=1.0), product of:
              0.5801355 = queryWeight, product of:
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.06963839 = queryNorm
              5.2066784 = fieldWeight in 1036, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.330686 = idf(docFreq=27, maxDocs=42740)
                0.625 = fieldNorm(doc=1036)
        0.5 = coord(1/2)
    

Similar documents (content)

  1. Taylor, A.: User relevance criteria choices and the information search process (2012) 0.42
    0.41774115 = sum of:
      0.41774115 = product of:
        1.160392 = sum of:
          0.015591554 = weight(abstract_txt:between in 4746) [ClassicSimilarity], result of:
            0.015591554 = score(doc=4746,freq=2.0), product of:
              0.05057019 = queryWeight, product of:
                3.4881876 = idf(docFreq=3549, maxDocs=42740)
                0.014497555 = queryNorm
              0.30831513 = fieldWeight in 4746, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4881876 = idf(docFreq=3549, maxDocs=42740)
                0.0625 = fieldNorm(doc=4746)
          0.03577227 = weight(abstract_txt:search in 4746) [ClassicSimilarity], result of:
            0.03577227 = score(doc=4746,freq=8.0), product of:
              0.05541738 = queryWeight, product of:
                1.0468289 = boost
                3.6515355 = idf(docFreq=3014, maxDocs=42740)
                0.014497555 = queryNorm
              0.6455064 = fieldWeight in 4746, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                3.6515355 = idf(docFreq=3014, maxDocs=42740)
                0.0625 = fieldNorm(doc=4746)
          0.08867493 = weight(abstract_txt:judgment in 4746) [ClassicSimilarity], result of:
            0.08867493 = score(doc=4746,freq=3.0), product of:
              0.11171936 = queryWeight, product of:
                1.0509981 = boost
                7.332157 = idf(docFreq=75, maxDocs=42740)
                0.014497555 = queryNorm
              0.7937293 = fieldWeight in 4746, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                7.332157 = idf(docFreq=75, maxDocs=42740)
                0.0625 = fieldNorm(doc=4746)
          0.009468545 = weight(abstract_txt:this in 4746) [ClassicSimilarity], result of:
            0.009468545 = score(doc=4746,freq=1.0), product of:
              0.062012676 = queryWeight, product of:
                1.7509065 = boost
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.014497555 = queryNorm
              0.15268725 = fieldWeight in 4746, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.0625 = fieldNorm(doc=4746)
          0.017247766 = weight(abstract_txt:research in 4746) [ClassicSimilarity], result of:
            0.017247766 = score(doc=4746,freq=1.0), product of:
              0.08586382 = queryWeight, product of:
                1.8427771 = boost
                3.2139761 = idf(docFreq=4669, maxDocs=42740)
                0.014497555 = queryNorm
              0.20087351 = fieldWeight in 4746, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2139761 = idf(docFreq=4669, maxDocs=42740)
                0.0625 = fieldNorm(doc=4746)
          0.026067777 = weight(abstract_txt:analysis in 4746) [ClassicSimilarity], result of:
            0.026067777 = score(doc=4746,freq=1.0), product of:
              0.11308134 = queryWeight, product of:
                2.1147702 = boost
                3.6883576 = idf(docFreq=2905, maxDocs=42740)
                0.014497555 = queryNorm
              0.23052235 = fieldWeight in 4746, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6883576 = idf(docFreq=2905, maxDocs=42740)
                0.0625 = fieldNorm(doc=4746)
          0.16629124 = weight(abstract_txt:criteria in 4746) [ClassicSimilarity], result of:
            0.16629124 = score(doc=4746,freq=6.0), product of:
              0.19447832 = queryWeight, product of:
                2.401784 = boost
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.014497555 = queryNorm
              0.8550631 = fieldWeight in 4746, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.0625 = fieldNorm(doc=4746)
          0.42680308 = weight(abstract_txt:judgments in 4746) [ClassicSimilarity], result of:
            0.42680308 = score(doc=4746,freq=4.0), product of:
              0.49479276 = queryWeight, product of:
                4.9457755 = boost
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.014497555 = queryNorm
              0.8625896 = fieldWeight in 4746, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.0625 = fieldNorm(doc=4746)
          0.37447494 = weight(abstract_txt:relevance in 4746) [ClassicSimilarity], result of:
            0.37447494 = score(doc=4746,freq=9.0), product of:
              0.40476158 = queryWeight, product of:
                5.6582527 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.014497555 = queryNorm
              0.9251741 = fieldWeight in 4746, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.0625 = fieldNorm(doc=4746)
        0.36 = coord(9/25)
    
  2. Hughes, B.; Wareham, J.; Joshi, I.: Doctors' online information needs, cognitive search strategies, and judgments of information quality and cognitive authority : how predictive judgments introduce bias into cognitive search models (2010) 0.33
    0.32906944 = sum of:
      0.32906944 = product of:
        1.028342 = sum of:
          0.03577227 = weight(abstract_txt:search in 418) [ClassicSimilarity], result of:
            0.03577227 = score(doc=418,freq=8.0), product of:
              0.05541738 = queryWeight, product of:
                1.0468289 = boost
                3.6515355 = idf(docFreq=3014, maxDocs=42740)
                0.014497555 = queryNorm
              0.6455064 = fieldWeight in 418, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                3.6515355 = idf(docFreq=3014, maxDocs=42740)
                0.0625 = fieldNorm(doc=418)
          0.072402775 = weight(abstract_txt:judgment in 418) [ClassicSimilarity], result of:
            0.072402775 = score(doc=418,freq=2.0), product of:
              0.11171936 = queryWeight, product of:
                1.0509981 = boost
                7.332157 = idf(docFreq=75, maxDocs=42740)
                0.014497555 = queryNorm
              0.64807725 = fieldWeight in 418, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.332157 = idf(docFreq=75, maxDocs=42740)
                0.0625 = fieldNorm(doc=418)
          0.026161112 = weight(abstract_txt:relevant in 418) [ClassicSimilarity], result of:
            0.026161112 = score(doc=418,freq=1.0), product of:
              0.08996683 = queryWeight, product of:
                1.3338099 = boost
                4.652579 = idf(docFreq=1107, maxDocs=42740)
                0.014497555 = queryNorm
              0.29078618 = fieldWeight in 418, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.652579 = idf(docFreq=1107, maxDocs=42740)
                0.0625 = fieldNorm(doc=418)
          0.013390545 = weight(abstract_txt:this in 418) [ClassicSimilarity], result of:
            0.013390545 = score(doc=418,freq=2.0), product of:
              0.062012676 = queryWeight, product of:
                1.7509065 = boost
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.014497555 = queryNorm
              0.21593238 = fieldWeight in 418, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.0625 = fieldNorm(doc=418)
          0.017247766 = weight(abstract_txt:research in 418) [ClassicSimilarity], result of:
            0.017247766 = score(doc=418,freq=1.0), product of:
              0.08586382 = queryWeight, product of:
                1.8427771 = boost
                3.2139761 = idf(docFreq=4669, maxDocs=42740)
                0.014497555 = queryNorm
              0.20087351 = fieldWeight in 418, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2139761 = idf(docFreq=4669, maxDocs=42740)
                0.0625 = fieldNorm(doc=418)
          0.026067777 = weight(abstract_txt:analysis in 418) [ClassicSimilarity], result of:
            0.026067777 = score(doc=418,freq=1.0), product of:
              0.11308134 = queryWeight, product of:
                2.1147702 = boost
                3.6883576 = idf(docFreq=2905, maxDocs=42740)
                0.014497555 = queryNorm
              0.23052235 = fieldWeight in 418, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6883576 = idf(docFreq=2905, maxDocs=42740)
                0.0625 = fieldNorm(doc=418)
          0.31457475 = weight(abstract_txt:predictive in 418) [ClassicSimilarity], result of:
            0.31457475 = score(doc=418,freq=2.0), product of:
              0.4290237 = queryWeight, product of:
                3.5672946 = boost
                8.295595 = idf(docFreq=28, maxDocs=42740)
                0.014497555 = queryNorm
              0.7332339 = fieldWeight in 418, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                8.295595 = idf(docFreq=28, maxDocs=42740)
                0.0625 = fieldNorm(doc=418)
          0.5227249 = weight(abstract_txt:judgments in 418) [ClassicSimilarity], result of:
            0.5227249 = score(doc=418,freq=6.0), product of:
              0.49479276 = queryWeight, product of:
                4.9457755 = boost
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.014497555 = queryNorm
              1.0564523 = fieldWeight in 418, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.0625 = fieldNorm(doc=418)
        0.32 = coord(8/25)
    
  3. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.32
    0.31949228 = sum of:
      0.31949228 = product of:
        0.99841344 = sum of:
          0.072402775 = weight(abstract_txt:judgment in 1740) [ClassicSimilarity], result of:
            0.072402775 = score(doc=1740,freq=2.0), product of:
              0.11171936 = queryWeight, product of:
                1.0509981 = boost
                7.332157 = idf(docFreq=75, maxDocs=42740)
                0.014497555 = queryNorm
              0.64807725 = fieldWeight in 1740, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.332157 = idf(docFreq=75, maxDocs=42740)
                0.0625 = fieldNorm(doc=1740)
          0.061937764 = weight(abstract_txt:aloud in 1740) [ClassicSimilarity], result of:
            0.061937764 = score(doc=1740,freq=1.0), product of:
              0.1268446 = queryWeight, product of:
                1.1198857 = boost
                7.8127427 = idf(docFreq=46, maxDocs=42740)
                0.014497555 = queryNorm
              0.48829642 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.8127427 = idf(docFreq=46, maxDocs=42740)
                0.0625 = fieldNorm(doc=1740)
          0.009468545 = weight(abstract_txt:this in 1740) [ClassicSimilarity], result of:
            0.009468545 = score(doc=1740,freq=1.0), product of:
              0.062012676 = queryWeight, product of:
                1.7509065 = boost
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.014497555 = queryNorm
              0.15268725 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.0625 = fieldNorm(doc=1740)
          0.017247766 = weight(abstract_txt:research in 1740) [ClassicSimilarity], result of:
            0.017247766 = score(doc=1740,freq=1.0), product of:
              0.08586382 = queryWeight, product of:
                1.8427771 = boost
                3.2139761 = idf(docFreq=4669, maxDocs=42740)
                0.014497555 = queryNorm
              0.20087351 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2139761 = idf(docFreq=4669, maxDocs=42740)
                0.0625 = fieldNorm(doc=1740)
          0.026067777 = weight(abstract_txt:analysis in 1740) [ClassicSimilarity], result of:
            0.026067777 = score(doc=1740,freq=1.0), product of:
              0.11308134 = queryWeight, product of:
                2.1147702 = boost
                3.6883576 = idf(docFreq=2905, maxDocs=42740)
                0.014497555 = queryNorm
              0.23052235 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6883576 = idf(docFreq=2905, maxDocs=42740)
                0.0625 = fieldNorm(doc=1740)
          0.19201657 = weight(abstract_txt:criteria in 1740) [ClassicSimilarity], result of:
            0.19201657 = score(doc=1740,freq=8.0), product of:
              0.19447832 = queryWeight, product of:
                2.401784 = boost
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.014497555 = queryNorm
              0.98734176 = fieldWeight in 1740, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.0625 = fieldNorm(doc=1740)
          0.3696223 = weight(abstract_txt:judgments in 1740) [ClassicSimilarity], result of:
            0.3696223 = score(doc=1740,freq=3.0), product of:
              0.49479276 = queryWeight, product of:
                4.9457755 = boost
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.014497555 = queryNorm
              0.7470245 = fieldWeight in 1740, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.0625 = fieldNorm(doc=1740)
          0.24964996 = weight(abstract_txt:relevance in 1740) [ClassicSimilarity], result of:
            0.24964996 = score(doc=1740,freq=4.0), product of:
              0.40476158 = queryWeight, product of:
                5.6582527 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.014497555 = queryNorm
              0.6167827 = fieldWeight in 1740, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.0625 = fieldNorm(doc=1740)
        0.32 = coord(8/25)
    
  4. Rieh, S.Y.: Judgment of information quality and cognitive authority in the Web (2002) 0.31
    0.31476668 = sum of:
      0.31476668 = product of:
        1.1241667 = sum of:
          0.05544955 = weight(abstract_txt:protocols in 1203) [ClassicSimilarity], result of:
            0.05544955 = score(doc=1203,freq=1.0), product of:
              0.101537615 = queryWeight, product of:
                1.0019618 = boost
                6.9900618 = idf(docFreq=106, maxDocs=42740)
                0.014497555 = queryNorm
              0.5460986 = fieldWeight in 1203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9900618 = idf(docFreq=106, maxDocs=42740)
                0.078125 = fieldNorm(doc=1203)
          0.02235767 = weight(abstract_txt:search in 1203) [ClassicSimilarity], result of:
            0.02235767 = score(doc=1203,freq=2.0), product of:
              0.05541738 = queryWeight, product of:
                1.0468289 = boost
                3.6515355 = idf(docFreq=3014, maxDocs=42740)
                0.014497555 = queryNorm
              0.4034415 = fieldWeight in 1203, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6515355 = idf(docFreq=3014, maxDocs=42740)
                0.078125 = fieldNorm(doc=1203)
          0.15675662 = weight(abstract_txt:judgment in 1203) [ClassicSimilarity], result of:
            0.15675662 = score(doc=1203,freq=6.0), product of:
              0.11171936 = queryWeight, product of:
                1.0509981 = boost
                7.332157 = idf(docFreq=75, maxDocs=42740)
                0.014497555 = queryNorm
              1.4031285 = fieldWeight in 1203, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                7.332157 = idf(docFreq=75, maxDocs=42740)
                0.078125 = fieldNorm(doc=1203)
          0.13769193 = weight(abstract_txt:postsearch in 1203) [ClassicSimilarity], result of:
            0.13769193 = score(doc=1203,freq=1.0), product of:
              0.18619469 = queryWeight, product of:
                1.3568172 = boost
                9.465666 = idf(docFreq=8, maxDocs=42740)
                0.014497555 = queryNorm
              0.7395052 = fieldWeight in 1203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.465666 = idf(docFreq=8, maxDocs=42740)
                0.078125 = fieldNorm(doc=1203)
          0.011835681 = weight(abstract_txt:this in 1203) [ClassicSimilarity], result of:
            0.011835681 = score(doc=1203,freq=1.0), product of:
              0.062012676 = queryWeight, product of:
                1.7509065 = boost
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.014497555 = queryNorm
              0.19085906 = fieldWeight in 1203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.078125 = fieldNorm(doc=1203)
          0.2780474 = weight(abstract_txt:predictive in 1203) [ClassicSimilarity], result of:
            0.2780474 = score(doc=1203,freq=1.0), product of:
              0.4290237 = queryWeight, product of:
                3.5672946 = boost
                8.295595 = idf(docFreq=28, maxDocs=42740)
                0.014497555 = queryNorm
              0.64809334 = fieldWeight in 1203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.295595 = idf(docFreq=28, maxDocs=42740)
                0.078125 = fieldNorm(doc=1203)
          0.46202788 = weight(abstract_txt:judgments in 1203) [ClassicSimilarity], result of:
            0.46202788 = score(doc=1203,freq=3.0), product of:
              0.49479276 = queryWeight, product of:
                4.9457755 = boost
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.014497555 = queryNorm
              0.9337806 = fieldWeight in 1203, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.078125 = fieldNorm(doc=1203)
        0.28 = coord(7/25)
    
  5. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.31
    0.30947724 = sum of:
      0.30947724 = product of:
        0.96711636 = sum of:
          0.037942227 = weight(abstract_txt:search in 609) [ClassicSimilarity], result of:
            0.037942227 = score(doc=609,freq=9.0), product of:
              0.05541738 = queryWeight, product of:
                1.0468289 = boost
                3.6515355 = idf(docFreq=3014, maxDocs=42740)
                0.014497555 = queryNorm
              0.68466294 = fieldWeight in 609, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                3.6515355 = idf(docFreq=3014, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.052322224 = weight(abstract_txt:relevant in 609) [ClassicSimilarity], result of:
            0.052322224 = score(doc=609,freq=4.0), product of:
              0.08996683 = queryWeight, product of:
                1.3338099 = boost
                4.652579 = idf(docFreq=1107, maxDocs=42740)
                0.014497555 = queryNorm
              0.58157235 = fieldWeight in 609, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.652579 = idf(docFreq=1107, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.009468545 = weight(abstract_txt:this in 609) [ClassicSimilarity], result of:
            0.009468545 = score(doc=609,freq=1.0), product of:
              0.062012676 = queryWeight, product of:
                1.7509065 = boost
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.014497555 = queryNorm
              0.15268725 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.442996 = idf(docFreq=10095, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.017247766 = weight(abstract_txt:research in 609) [ClassicSimilarity], result of:
            0.017247766 = score(doc=609,freq=1.0), product of:
              0.08586382 = queryWeight, product of:
                1.8427771 = boost
                3.2139761 = idf(docFreq=4669, maxDocs=42740)
                0.014497555 = queryNorm
              0.20087351 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2139761 = idf(docFreq=4669, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.026067777 = weight(abstract_txt:analysis in 609) [ClassicSimilarity], result of:
            0.026067777 = score(doc=609,freq=1.0), product of:
              0.11308134 = queryWeight, product of:
                2.1147702 = boost
                3.6883576 = idf(docFreq=2905, maxDocs=42740)
                0.014497555 = queryNorm
              0.23052235 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6883576 = idf(docFreq=2905, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.19201657 = weight(abstract_txt:criteria in 609) [ClassicSimilarity], result of:
            0.19201657 = score(doc=609,freq=8.0), product of:
              0.19447832 = queryWeight, product of:
                2.401784 = boost
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.014497555 = queryNorm
              0.98734176 = fieldWeight in 609, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.5852485 = idf(docFreq=435, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.30179536 = weight(abstract_txt:judgments in 609) [ClassicSimilarity], result of:
            0.30179536 = score(doc=609,freq=2.0), product of:
              0.49479276 = queryWeight, product of:
                4.9457755 = boost
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.014497555 = queryNorm
              0.609943 = fieldWeight in 609, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.900717 = idf(docFreq=116, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
          0.33025584 = weight(abstract_txt:relevance in 609) [ClassicSimilarity], result of:
            0.33025584 = score(doc=609,freq=7.0), product of:
              0.40476158 = queryWeight, product of:
                5.6582527 = boost
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.014497555 = queryNorm
              0.81592685 = fieldWeight in 609, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.934262 = idf(docFreq=835, maxDocs=42740)
                0.0625 = fieldNorm(doc=609)
        0.32 = coord(8/25)