Document (#37381)

Author
Balatsoukas, P.
Ruthven, I.
Title
¬An eye-tracking approach to the analysis of relevance judgments on the Web : the case of Google search engine
Source
Journal of the American Society for Information Science and Technology. 63(2012) no.9, S.1728-1746
Year
2012
Abstract
Eye movement data can provide an in-depth view of human reasoning and the decision-making process, and modern information retrieval (IR) research can benefit from the analysis of this type of data. The aim of this research was to examine the relationship between relevance criteria use and visual behavior in the context of predictive relevance judgments. To address this objective, a multimethod research design was employed that involved observation of participants' eye movements, talk-aloud protocols, and postsearch interviews. Specifically, the results reported in this article came from the analysis of 281 predictive relevance judgments made by 24 participants using the Google search engine. We present a novel stepwise methodological framework for the analysis of relevance judgments and eye movements on the Web and show new patterns of relevance criteria use during predictive relevance judgment. For example, the findings showed an effect of ranking order and surrogate components (Title, Summary, and URL) on the use of relevance criteria. Also, differences were observed in the cognitive effort spent between very relevant and not relevant judgments. We conclude with the implications of this study for IR research.
Theme
Benutzerstudien
Object
Google

Similar documents (author)

  1. Balatsoukas, P.; Demian, P.: Effects of granularity of search results on the relevance judgment behavior of engineers : building systems for retrieval and understanding of context (2010) 2.02
    2.0233512 = sum of:
      2.0233512 = product of:
        4.0467024 = sum of:
          4.0467024 = weight(author_txt:balatsoukas in 420) [ClassicSimilarity], result of:
            4.0467024 = score(doc=420,freq=1.0), product of:
              0.81891483 = queryWeight, product of:
                1.1945258 = boost
                9.883085 = idf(docFreq=5, maxDocs=43254)
                0.069366634 = queryNorm
              4.9415426 = fieldWeight in 420, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.883085 = idf(docFreq=5, maxDocs=43254)
                0.5 = fieldNorm(doc=420)
        0.5 = coord(1/2)
    
  2. Garoufallou, E.; Siatri, R.; Balatsoukas, P.: Virtual maps-virtual worlds : testing the usability of a greek virtual cultural map (2008) 1.52
    1.5175134 = sum of:
      1.5175134 = product of:
        3.0350268 = sum of:
          3.0350268 = weight(author_txt:balatsoukas in 3380) [ClassicSimilarity], result of:
            3.0350268 = score(doc=3380,freq=1.0), product of:
              0.81891483 = queryWeight, product of:
                1.1945258 = boost
                9.883085 = idf(docFreq=5, maxDocs=43254)
                0.069366634 = queryNorm
              3.706157 = fieldWeight in 3380, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.883085 = idf(docFreq=5, maxDocs=43254)
                0.375 = fieldNorm(doc=3380)
        0.5 = coord(1/2)
    
  3. Gaitanou, P.; Garoufallou, E.; Balatsoukas, P.: ¬The effectiveness of big data in health care : a systematic review (2014) 1.52
    1.5175134 = sum of:
      1.5175134 = product of:
        3.0350268 = sum of:
          3.0350268 = weight(author_txt:balatsoukas in 3044) [ClassicSimilarity], result of:
            3.0350268 = score(doc=3044,freq=1.0), product of:
              0.81891483 = queryWeight, product of:
                1.1945258 = boost
                9.883085 = idf(docFreq=5, maxDocs=43254)
                0.069366634 = queryNorm
              3.706157 = fieldWeight in 3044, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.883085 = idf(docFreq=5, maxDocs=43254)
                0.375 = fieldNorm(doc=3044)
        0.5 = coord(1/2)
    
  4. Ruthven, R.: Interactive information retrieval (2008) 1.48
    1.4838659 = sum of:
      1.4838659 = product of:
        2.9677317 = sum of:
          2.9677317 = weight(author_txt:ruthven in 2839) [ClassicSimilarity], result of:
            2.9677317 = score(doc=2839,freq=1.0), product of:
              0.57391506 = queryWeight, product of:
                8.273647 = idf(docFreq=29, maxDocs=43254)
                0.069366634 = queryNorm
              5.1710296 = fieldWeight in 2839, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.273647 = idf(docFreq=29, maxDocs=43254)
                0.625 = fieldNorm(doc=2839)
        0.5 = coord(1/2)
    
  5. Ruthven, I.: Integrating approaches to relevance (2005) 1.48
    1.4838659 = sum of:
      1.4838659 = product of:
        2.9677317 = sum of:
          2.9677317 = weight(author_txt:ruthven in 1764) [ClassicSimilarity], result of:
            2.9677317 = score(doc=1764,freq=1.0), product of:
              0.57391506 = queryWeight, product of:
                8.273647 = idf(docFreq=29, maxDocs=43254)
                0.069366634 = queryNorm
              5.1710296 = fieldWeight in 1764, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.273647 = idf(docFreq=29, maxDocs=43254)
                0.625 = fieldNorm(doc=1764)
        0.5 = coord(1/2)
    

Similar documents (content)

  1. Taylor, A.: User relevance criteria choices and the information search process (2012) 0.42
    0.4213565 = sum of:
      0.4213565 = product of:
        1.1704347 = sum of:
          0.015586228 = weight(abstract_txt:between in 4210) [ClassicSimilarity], result of:
            0.015586228 = score(doc=4210,freq=2.0), product of:
              0.050687008 = queryWeight, product of:
                3.4789596 = idf(docFreq=3625, maxDocs=43254)
                0.014569588 = queryNorm
              0.30749947 = fieldWeight in 4210, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4789596 = idf(docFreq=3625, maxDocs=43254)
                0.0625 = fieldNorm(doc=4210)
          0.036086746 = weight(abstract_txt:search in 4210) [ClassicSimilarity], result of:
            0.036086746 = score(doc=4210,freq=8.0), product of:
              0.05588318 = queryWeight, product of:
                1.0500071 = boost
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.014569588 = queryNorm
              0.64575326 = fieldWeight in 4210, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.0625 = fieldNorm(doc=4210)
          0.089311056 = weight(abstract_txt:judgment in 4210) [ClassicSimilarity], result of:
            0.089311056 = score(doc=4210,freq=3.0), product of:
              0.11253795 = queryWeight, product of:
                1.0536252 = boost
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.014569588 = queryNorm
              0.7936083 = fieldWeight in 4210, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.0625 = fieldNorm(doc=4210)
          0.009406272 = weight(abstract_txt:this in 4210) [ClassicSimilarity], result of:
            0.009406272 = score(doc=4210,freq=1.0), product of:
              0.061897196 = queryWeight, product of:
                1.7472585 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.014569588 = queryNorm
              0.15196605 = fieldWeight in 4210, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.0625 = fieldNorm(doc=4210)
          0.017105766 = weight(abstract_txt:research in 4210) [ClassicSimilarity], result of:
            0.017105766 = score(doc=4210,freq=1.0), product of:
              0.085608646 = queryWeight, product of:
                1.8379153 = boost
                3.1970165 = idf(docFreq=4806, maxDocs=43254)
                0.014569588 = queryNorm
              0.19981353 = fieldWeight in 4210, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.1970165 = idf(docFreq=4806, maxDocs=43254)
                0.0625 = fieldNorm(doc=4210)
          0.025950428 = weight(abstract_txt:analysis in 4210) [ClassicSimilarity], result of:
            0.025950428 = score(doc=4210,freq=1.0), product of:
              0.11302789 = queryWeight, product of:
                2.1118326 = boost
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.014569588 = queryNorm
              0.22959313 = fieldWeight in 4210, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.0625 = fieldNorm(doc=4210)
          0.1676104 = weight(abstract_txt:criteria in 4210) [ClassicSimilarity], result of:
            0.1676104 = score(doc=4210,freq=6.0), product of:
              0.19600174 = queryWeight, product of:
                2.4083924 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.014569588 = queryNorm
              0.85514754 = fieldWeight in 4210, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0625 = fieldNorm(doc=4210)
          0.43230033 = weight(abstract_txt:judgments in 4210) [ClassicSimilarity], result of:
            0.43230033 = score(doc=4210,freq=4.0), product of:
              0.50029904 = queryWeight, product of:
                4.9674845 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.014569588 = queryNorm
              0.8640839 = fieldWeight in 4210, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.0625 = fieldNorm(doc=4210)
          0.3770775 = weight(abstract_txt:relevance in 4210) [ClassicSimilarity], result of:
            0.3770775 = score(doc=4210,freq=9.0), product of:
              0.40766695 = queryWeight, product of:
                5.6719766 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.014569588 = queryNorm
              0.92496455 = fieldWeight in 4210, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0625 = fieldNorm(doc=4210)
        0.36 = coord(9/25)
    
  2. Hughes, B.; Wareham, J.; Joshi, I.: Doctors' online information needs, cognitive search strategies, and judgments of information quality and cognitive authority : how predictive judgments introduce bias into cognitive search models (2010) 0.33
    0.3279438 = sum of:
      0.3279438 = product of:
        1.0248244 = sum of:
          0.036086746 = weight(abstract_txt:search in 418) [ClassicSimilarity], result of:
            0.036086746 = score(doc=418,freq=8.0), product of:
              0.05588318 = queryWeight, product of:
                1.0500071 = boost
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.014569588 = queryNorm
              0.64575326 = fieldWeight in 418, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.0625 = fieldNorm(doc=418)
          0.07292216 = weight(abstract_txt:judgment in 418) [ClassicSimilarity], result of:
            0.07292216 = score(doc=418,freq=2.0), product of:
              0.11253795 = queryWeight, product of:
                1.0536252 = boost
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.014569588 = queryNorm
              0.6479784 = fieldWeight in 418, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.0625 = fieldNorm(doc=418)
          0.026275119 = weight(abstract_txt:relevant in 418) [ClassicSimilarity], result of:
            0.026275119 = score(doc=418,freq=1.0), product of:
              0.09045705 = queryWeight, product of:
                1.3358967 = boost
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.014569588 = queryNorm
              0.29047066 = fieldWeight in 418, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.0625 = fieldNorm(doc=418)
          0.013302478 = weight(abstract_txt:this in 418) [ClassicSimilarity], result of:
            0.013302478 = score(doc=418,freq=2.0), product of:
              0.061897196 = queryWeight, product of:
                1.7472585 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.014569588 = queryNorm
              0.21491244 = fieldWeight in 418, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.0625 = fieldNorm(doc=418)
          0.017105766 = weight(abstract_txt:research in 418) [ClassicSimilarity], result of:
            0.017105766 = score(doc=418,freq=1.0), product of:
              0.085608646 = queryWeight, product of:
                1.8379153 = boost
                3.1970165 = idf(docFreq=4806, maxDocs=43254)
                0.014569588 = queryNorm
              0.19981353 = fieldWeight in 418, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.1970165 = idf(docFreq=4806, maxDocs=43254)
                0.0625 = fieldNorm(doc=418)
          0.025950428 = weight(abstract_txt:analysis in 418) [ClassicSimilarity], result of:
            0.025950428 = score(doc=418,freq=1.0), product of:
              0.11302789 = queryWeight, product of:
                2.1118326 = boost
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.014569588 = queryNorm
              0.22959313 = fieldWeight in 418, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.0625 = fieldNorm(doc=418)
          0.30372405 = weight(abstract_txt:predictive in 418) [ClassicSimilarity], result of:
            0.30372405 = score(doc=418,freq=2.0), product of:
              0.42016432 = queryWeight, product of:
                3.5261996 = boost
                8.178337 = idf(docFreq=32, maxDocs=43254)
                0.014569588 = queryNorm
              0.7228697 = fieldWeight in 418, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                8.178337 = idf(docFreq=32, maxDocs=43254)
                0.0625 = fieldNorm(doc=418)
          0.5294576 = weight(abstract_txt:judgments in 418) [ClassicSimilarity], result of:
            0.5294576 = score(doc=418,freq=6.0), product of:
              0.50029904 = queryWeight, product of:
                4.9674845 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.014569588 = queryNorm
              1.0582824 = fieldWeight in 418, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.0625 = fieldNorm(doc=418)
        0.32 = coord(8/25)
    
  3. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.32
    0.32220328 = sum of:
      0.32220328 = product of:
        1.0068853 = sum of:
          0.07292216 = weight(abstract_txt:judgment in 1740) [ClassicSimilarity], result of:
            0.07292216 = score(doc=1740,freq=2.0), product of:
              0.11253795 = queryWeight, product of:
                1.0536252 = boost
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.014569588 = queryNorm
              0.6479784 = fieldWeight in 1740, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.062192824 = weight(abstract_txt:aloud in 1740) [ClassicSimilarity], result of:
            0.062192824 = score(doc=1740,freq=1.0), product of:
              0.12751545 = queryWeight, product of:
                1.1215485 = boost
                7.803644 = idf(docFreq=47, maxDocs=43254)
                0.014569588 = queryNorm
              0.48772776 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.803644 = idf(docFreq=47, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.009406272 = weight(abstract_txt:this in 1740) [ClassicSimilarity], result of:
            0.009406272 = score(doc=1740,freq=1.0), product of:
              0.061897196 = queryWeight, product of:
                1.7472585 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.014569588 = queryNorm
              0.15196605 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.017105766 = weight(abstract_txt:research in 1740) [ClassicSimilarity], result of:
            0.017105766 = score(doc=1740,freq=1.0), product of:
              0.085608646 = queryWeight, product of:
                1.8379153 = boost
                3.1970165 = idf(docFreq=4806, maxDocs=43254)
                0.014569588 = queryNorm
              0.19981353 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.1970165 = idf(docFreq=4806, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.025950428 = weight(abstract_txt:analysis in 1740) [ClassicSimilarity], result of:
            0.025950428 = score(doc=1740,freq=1.0), product of:
              0.11302789 = queryWeight, product of:
                2.1118326 = boost
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.014569588 = queryNorm
              0.22959313 = fieldWeight in 1740, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.19353981 = weight(abstract_txt:criteria in 1740) [ClassicSimilarity], result of:
            0.19353981 = score(doc=1740,freq=8.0), product of:
              0.19600174 = queryWeight, product of:
                2.4083924 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.014569588 = queryNorm
              0.9874393 = fieldWeight in 1740, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.3743831 = weight(abstract_txt:judgments in 1740) [ClassicSimilarity], result of:
            0.3743831 = score(doc=1740,freq=3.0), product of:
              0.50029904 = queryWeight, product of:
                4.9674845 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.014569588 = queryNorm
              0.7483186 = fieldWeight in 1740, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
          0.25138497 = weight(abstract_txt:relevance in 1740) [ClassicSimilarity], result of:
            0.25138497 = score(doc=1740,freq=4.0), product of:
              0.40766695 = queryWeight, product of:
                5.6719766 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.014569588 = queryNorm
              0.616643 = fieldWeight in 1740, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0625 = fieldNorm(doc=1740)
        0.32 = coord(8/25)
    
  4. Rieh, S.Y.: Judgment of information quality and cognitive authority in the Web (2002) 0.31
    0.31473628 = sum of:
      0.31473628 = product of:
        1.1240581 = sum of:
          0.056160014 = weight(abstract_txt:protocols in 2203) [ClassicSimilarity], result of:
            0.056160014 = score(doc=2203,freq=1.0), product of:
              0.10266303 = queryWeight, product of:
                1.0063376 = boost
                7.002016 = idf(docFreq=106, maxDocs=43254)
                0.014569588 = queryNorm
              0.5470325 = fieldWeight in 2203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.002016 = idf(docFreq=106, maxDocs=43254)
                0.078125 = fieldNorm(doc=2203)
          0.022554217 = weight(abstract_txt:search in 2203) [ClassicSimilarity], result of:
            0.022554217 = score(doc=2203,freq=2.0), product of:
              0.05588318 = queryWeight, product of:
                1.0500071 = boost
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.014569588 = queryNorm
              0.4035958 = fieldWeight in 2203, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.078125 = fieldNorm(doc=2203)
          0.15788113 = weight(abstract_txt:judgment in 2203) [ClassicSimilarity], result of:
            0.15788113 = score(doc=2203,freq=6.0), product of:
              0.11253795 = queryWeight, product of:
                1.0536252 = boost
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.014569588 = queryNorm
              1.4029145 = fieldWeight in 2203, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                7.3310394 = idf(docFreq=76, maxDocs=43254)
                0.078125 = fieldNorm(doc=2203)
          0.13926943 = weight(abstract_txt:postsearch in 2203) [ClassicSimilarity], result of:
            0.13926943 = score(doc=2203,freq=1.0), product of:
              0.18809034 = queryWeight, product of:
                1.3621342 = boost
                9.47762 = idf(docFreq=8, maxDocs=43254)
                0.014569588 = queryNorm
              0.74043906 = fieldWeight in 2203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.47762 = idf(docFreq=8, maxDocs=43254)
                0.078125 = fieldNorm(doc=2203)
          0.01175784 = weight(abstract_txt:this in 2203) [ClassicSimilarity], result of:
            0.01175784 = score(doc=2203,freq=1.0), product of:
              0.061897196 = queryWeight, product of:
                1.7472585 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.014569588 = queryNorm
              0.18995756 = fieldWeight in 2203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.078125 = fieldNorm(doc=2203)
          0.26845667 = weight(abstract_txt:predictive in 2203) [ClassicSimilarity], result of:
            0.26845667 = score(doc=2203,freq=1.0), product of:
              0.42016432 = queryWeight, product of:
                3.5261996 = boost
                8.178337 = idf(docFreq=32, maxDocs=43254)
                0.014569588 = queryNorm
              0.6389326 = fieldWeight in 2203, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.178337 = idf(docFreq=32, maxDocs=43254)
                0.078125 = fieldNorm(doc=2203)
          0.46797886 = weight(abstract_txt:judgments in 2203) [ClassicSimilarity], result of:
            0.46797886 = score(doc=2203,freq=3.0), product of:
              0.50029904 = queryWeight, product of:
                4.9674845 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.014569588 = queryNorm
              0.9353983 = fieldWeight in 2203, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.078125 = fieldNorm(doc=2203)
        0.28 = coord(7/25)
    
  5. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.31
    0.31201977 = sum of:
      0.31201977 = product of:
        0.97506183 = sum of:
          0.038275775 = weight(abstract_txt:search in 73) [ClassicSimilarity], result of:
            0.038275775 = score(doc=73,freq=9.0), product of:
              0.05588318 = queryWeight, product of:
                1.0500071 = boost
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.014569588 = queryNorm
              0.6849248 = fieldWeight in 73, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                3.6529322 = idf(docFreq=3046, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.052550238 = weight(abstract_txt:relevant in 73) [ClassicSimilarity], result of:
            0.052550238 = score(doc=73,freq=4.0), product of:
              0.09045705 = queryWeight, product of:
                1.3358967 = boost
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.014569588 = queryNorm
              0.5809413 = fieldWeight in 73, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.6475306 = idf(docFreq=1126, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.009406272 = weight(abstract_txt:this in 73) [ClassicSimilarity], result of:
            0.009406272 = score(doc=73,freq=1.0), product of:
              0.061897196 = queryWeight, product of:
                1.7472585 = boost
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.014569588 = queryNorm
              0.15196605 = fieldWeight in 73, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4314568 = idf(docFreq=10335, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.017105766 = weight(abstract_txt:research in 73) [ClassicSimilarity], result of:
            0.017105766 = score(doc=73,freq=1.0), product of:
              0.085608646 = queryWeight, product of:
                1.8379153 = boost
                3.1970165 = idf(docFreq=4806, maxDocs=43254)
                0.014569588 = queryNorm
              0.19981353 = fieldWeight in 73, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.1970165 = idf(docFreq=4806, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.025950428 = weight(abstract_txt:analysis in 73) [ClassicSimilarity], result of:
            0.025950428 = score(doc=73,freq=1.0), product of:
              0.11302789 = queryWeight, product of:
                2.1118326 = boost
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.014569588 = queryNorm
              0.22959313 = fieldWeight in 73, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.67349 = idf(docFreq=2984, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.19353981 = weight(abstract_txt:criteria in 73) [ClassicSimilarity], result of:
            0.19353981 = score(doc=73,freq=8.0), product of:
              0.19600174 = queryWeight, product of:
                2.4083924 = boost
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.014569588 = queryNorm
              0.9874393 = fieldWeight in 73, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                5.5858 = idf(docFreq=440, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.3056825 = weight(abstract_txt:judgments in 73) [ClassicSimilarity], result of:
            0.3056825 = score(doc=73,freq=2.0), product of:
              0.50029904 = queryWeight, product of:
                4.9674845 = boost
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.014569588 = queryNorm
              0.6109996 = fieldWeight in 73, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.912671 = idf(docFreq=116, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
          0.33255106 = weight(abstract_txt:relevance in 73) [ClassicSimilarity], result of:
            0.33255106 = score(doc=73,freq=7.0), product of:
              0.40766695 = queryWeight, product of:
                5.6719766 = boost
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.014569588 = queryNorm
              0.815742 = fieldWeight in 73, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.933144 = idf(docFreq=846, maxDocs=43254)
                0.0625 = fieldNorm(doc=73)
        0.32 = coord(8/25)