Document (#37380)

Author

Balatsoukas, P.
Ruthven, I.

Title

¬An eye-tracking approach to the analysis of relevance judgments on the Web : the case of Google search engine

Source

Journal of the American Society for Information Science and Technology. 63(2012) no.9, S.1728-1746

Year

2012

Abstract

Eye movement data can provide an in-depth view of human reasoning and the decision-making process, and modern information retrieval (IR) research can benefit from the analysis of this type of data. The aim of this research was to examine the relationship between relevance criteria use and visual behavior in the context of predictive relevance judgments. To address this objective, a multimethod research design was employed that involved observation of participants' eye movements, talk-aloud protocols, and postsearch interviews. Specifically, the results reported in this article came from the analysis of 281 predictive relevance judgments made by 24 participants using the Google search engine. We present a novel stepwise methodological framework for the analysis of relevance judgments and eye movements on the Web and show new patterns of relevance criteria use during predictive relevance judgment. For example, the findings showed an effect of ranking order and surrogate components (Title, Summary, and URL) on the use of relevance criteria. Also, differences were observed in the cognitive effort spent between very relevant and not relevant judgments. We conclude with the implications of this study for IR research.

Theme

Benutzerstudien

Object

Google

Similar documents (author)

1. Balatsoukas, P.; Demian, P.: Effects of granularity of search results on the relevance judgment behavior of engineers : building systems for retrieval and understanding of context (2010) 2.04

   2.0376453 = sum of:
     2.0376453 = product of:
       4.0752907 = sum of:
         4.0752907 = weight(author_txt:balatsoukas in 3419) [ClassicSimilarity], result of:
           4.0752907 = score(doc=3419,freq=1.0), product of:
             0.82286483 = queryWeight, product of:
               1.2033708 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.06903494 = queryNorm
             4.952564 = fieldWeight in 3419, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.5 = fieldNorm(doc=3419)
       0.5 = coord(1/2)
   

2. Garoufallou, E.; Siatri, R.; Balatsoukas, P.: Virtual maps-virtual worlds : testing the usability of a greek virtual cultural map (2008) 1.53

   1.5282339 = sum of:
     1.5282339 = product of:
       3.0564678 = sum of:
         3.0564678 = weight(author_txt:balatsoukas in 1379) [ClassicSimilarity], result of:
           3.0564678 = score(doc=1379,freq=1.0), product of:
             0.82286483 = queryWeight, product of:
               1.2033708 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.06903494 = queryNorm
             3.7144227 = fieldWeight in 1379, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.375 = fieldNorm(doc=1379)
       0.5 = coord(1/2)
   

3. Gaitanou, P.; Garoufallou, E.; Balatsoukas, P.: ¬The effectiveness of big data in health care : a systematic review (2014) 1.53

   1.5282339 = sum of:
     1.5282339 = product of:
       3.0564678 = sum of:
         3.0564678 = weight(author_txt:balatsoukas in 1579) [ClassicSimilarity], result of:
           3.0564678 = score(doc=1579,freq=1.0), product of:
             0.82286483 = queryWeight, product of:
               1.2033708 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.06903494 = queryNorm
             3.7144227 = fieldWeight in 1579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.375 = fieldNorm(doc=1579)
       0.5 = coord(1/2)
   

4. Ruthven, R.: Interactive information retrieval (2008) 1.46

   1.4616392 = sum of:
     1.4616392 = product of:
       2.9232783 = sum of:
         2.9232783 = weight(author_txt:ruthven in 2839) [ClassicSimilarity], result of:
           2.9232783 = score(doc=2839,freq=1.0), product of:
             0.56823707 = queryWeight, product of:
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.06903494 = queryNorm
             5.1444697 = fieldWeight in 2839, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.625 = fieldNorm(doc=2839)
       0.5 = coord(1/2)
   

5. Ruthven, I.: Integrating approaches to relevance (2005) 1.46

   1.4616392 = sum of:
     1.4616392 = product of:
       2.9232783 = sum of:
         2.9232783 = weight(author_txt:ruthven in 638) [ClassicSimilarity], result of:
           2.9232783 = score(doc=638,freq=1.0), product of:
             0.56823707 = queryWeight, product of:
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.06903494 = queryNorm
             5.1444697 = fieldWeight in 638, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.625 = fieldNorm(doc=638)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Taylor, A.: User relevance criteria choices and the information search process (2012) 0.42

   0.42422262 = sum of:
     0.42422262 = product of:
       1.1783961 = sum of:
         0.015559616 = weight(abstract_txt:between in 2745) [ClassicSimilarity], result of:
           0.015559616 = score(doc=2745,freq=2.0), product of:
             0.050828017 = queryWeight, product of:
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.014675824 = queryNorm
             0.3061228 = fieldWeight in 2745, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.0625 = fieldNorm(doc=2745)
         0.036667105 = weight(abstract_txt:search in 2745) [ClassicSimilarity], result of:
           0.036667105 = score(doc=2745,freq=8.0), product of:
             0.05670243 = queryWeight, product of:
               1.0562075 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014675824 = queryNorm
             0.6466584 = fieldWeight in 2745, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=2745)
         0.09070523 = weight(abstract_txt:judgment in 2745) [ClassicSimilarity], result of:
           0.09070523 = score(doc=2745,freq=3.0), product of:
             0.11415241 = queryWeight, product of:
               1.059683 = boost
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.014675824 = queryNorm
             0.7945976 = fieldWeight in 2745, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.0625 = fieldNorm(doc=2745)
         0.009302577 = weight(abstract_txt:this in 2745) [ClassicSimilarity], result of:
           0.009302577 = score(doc=2745,freq=1.0), product of:
             0.061682615 = queryWeight, product of:
               1.7418061 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.014675824 = queryNorm
             0.1508136 = fieldWeight in 2745, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=2745)
         0.016878294 = weight(abstract_txt:research in 2745) [ClassicSimilarity], result of:
           0.016878294 = score(doc=2745,freq=1.0), product of:
             0.08518104 = queryWeight, product of:
               1.8307747 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.014675824 = queryNorm
             0.19814612 = fieldWeight in 2745, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2745)
         0.025831835 = weight(abstract_txt:analysis in 2745) [ClassicSimilarity], result of:
           0.025831835 = score(doc=2745,freq=1.0), product of:
             0.11312557 = queryWeight, product of:
               2.1098123 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.014675824 = queryNorm
             0.22834657 = fieldWeight in 2745, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=2745)
         0.16855505 = weight(abstract_txt:criteria in 2745) [ClassicSimilarity], result of:
           0.16855505 = score(doc=2745,freq=6.0), product of:
             0.1975097 = queryWeight, product of:
               2.4142835 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.014675824 = queryNorm
             0.85340136 = fieldWeight in 2745, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0625 = fieldNorm(doc=2745)
         0.43366203 = weight(abstract_txt:judgments in 2745) [ClassicSimilarity], result of:
           0.43366203 = score(doc=2745,freq=4.0), product of:
             0.50331694 = queryWeight, product of:
               4.9755282 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.014675824 = queryNorm
             0.86160827 = fieldWeight in 2745, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=2745)
         0.38123444 = weight(abstract_txt:relevance in 2745) [ClassicSimilarity], result of:
           0.38123444 = score(doc=2745,freq=9.0), product of:
             0.41226947 = queryWeight, product of:
               5.695987 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.014675824 = queryNorm
             0.9247215 = fieldWeight in 2745, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=2745)
       0.36 = coord(9/25)
   

2. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.32

   0.3241271 = sum of:
     0.3241271 = product of:
       1.0128973 = sum of:
         0.074060515 = weight(abstract_txt:judgment in 614) [ClassicSimilarity], result of:
           0.074060515 = score(doc=614,freq=2.0), product of:
             0.11415241 = queryWeight, product of:
               1.059683 = boost
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.014675824 = queryNorm
             0.64878625 = fieldWeight in 614, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.06247482 = weight(abstract_txt:aloud in 614) [ClassicSimilarity], result of:
           0.06247482 = score(doc=614,freq=1.0), product of:
             0.12840264 = queryWeight, product of:
               1.1238812 = boost
               7.7848644 = idf(docFreq=49, maxDocs=44218)
               0.014675824 = queryNorm
             0.48655403 = fieldWeight in 614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7848644 = idf(docFreq=49, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.009302577 = weight(abstract_txt:this in 614) [ClassicSimilarity], result of:
           0.009302577 = score(doc=614,freq=1.0), product of:
             0.061682615 = queryWeight, product of:
               1.7418061 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.014675824 = queryNorm
             0.1508136 = fieldWeight in 614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.016878294 = weight(abstract_txt:research in 614) [ClassicSimilarity], result of:
           0.016878294 = score(doc=614,freq=1.0), product of:
             0.08518104 = queryWeight, product of:
               1.8307747 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.014675824 = queryNorm
             0.19814612 = fieldWeight in 614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.025831835 = weight(abstract_txt:analysis in 614) [ClassicSimilarity], result of:
           0.025831835 = score(doc=614,freq=1.0), product of:
             0.11312557 = queryWeight, product of:
               2.1098123 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.014675824 = queryNorm
             0.22834657 = fieldWeight in 614, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.19463061 = weight(abstract_txt:criteria in 614) [ClassicSimilarity], result of:
           0.19463061 = score(doc=614,freq=8.0), product of:
             0.1975097 = queryWeight, product of:
               2.4142835 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.014675824 = queryNorm
             0.98542297 = fieldWeight in 614, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.37556234 = weight(abstract_txt:judgments in 614) [ClassicSimilarity], result of:
           0.37556234 = score(doc=614,freq=3.0), product of:
             0.50331694 = queryWeight, product of:
               4.9755282 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.014675824 = queryNorm
             0.74617463 = fieldWeight in 614, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
         0.2541563 = weight(abstract_txt:relevance in 614) [ClassicSimilarity], result of:
           0.2541563 = score(doc=614,freq=4.0), product of:
             0.41226947 = queryWeight, product of:
               5.695987 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.014675824 = queryNorm
             0.616481 = fieldWeight in 614, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=614)
       0.32 = coord(8/25)
   

3. Hughes, B.; Wareham, J.; Joshi, I.: Doctors' online information needs, cognitive search strategies, and judgments of information quality and cognitive authority : how predictive judgments introduce bias into cognitive search models (2010) 0.32

   0.32403526 = sum of:
     0.32403526 = product of:
       1.0126102 = sum of:
         0.036667105 = weight(abstract_txt:search in 3417) [ClassicSimilarity], result of:
           0.036667105 = score(doc=3417,freq=8.0), product of:
             0.05670243 = queryWeight, product of:
               1.0562075 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014675824 = queryNorm
             0.6466584 = fieldWeight in 3417, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=3417)
         0.074060515 = weight(abstract_txt:judgment in 3417) [ClassicSimilarity], result of:
           0.074060515 = score(doc=3417,freq=2.0), product of:
             0.11415241 = queryWeight, product of:
               1.059683 = boost
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.014675824 = queryNorm
             0.64878625 = fieldWeight in 3417, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.0625 = fieldNorm(doc=3417)
         0.026380708 = weight(abstract_txt:relevant in 3417) [ClassicSimilarity], result of:
           0.026380708 = score(doc=3417,freq=1.0), product of:
             0.09105523 = queryWeight, product of:
               1.338446 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.014675824 = queryNorm
             0.28972206 = fieldWeight in 3417, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=3417)
         0.01315583 = weight(abstract_txt:this in 3417) [ClassicSimilarity], result of:
           0.01315583 = score(doc=3417,freq=2.0), product of:
             0.061682615 = queryWeight, product of:
               1.7418061 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.014675824 = queryNorm
             0.21328263 = fieldWeight in 3417, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3417)
         0.016878294 = weight(abstract_txt:research in 3417) [ClassicSimilarity], result of:
           0.016878294 = score(doc=3417,freq=1.0), product of:
             0.08518104 = queryWeight, product of:
               1.8307747 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.014675824 = queryNorm
             0.19814612 = fieldWeight in 3417, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=3417)
         0.025831835 = weight(abstract_txt:analysis in 3417) [ClassicSimilarity], result of:
           0.025831835 = score(doc=3417,freq=1.0), product of:
             0.11312557 = queryWeight, product of:
               2.1098123 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.014675824 = queryNorm
             0.22834657 = fieldWeight in 3417, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=3417)
         0.2885105 = weight(abstract_txt:predictive in 3417) [ClassicSimilarity], result of:
           0.2885105 = score(doc=3417,freq=2.0), product of:
             0.40760747 = queryWeight, product of:
               3.4682877 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.014675824 = queryNorm
             0.7078146 = fieldWeight in 3417, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.0625 = fieldNorm(doc=3417)
         0.53112537 = weight(abstract_txt:judgments in 3417) [ClassicSimilarity], result of:
           0.53112537 = score(doc=3417,freq=6.0), product of:
             0.50331694 = queryWeight, product of:
               4.9755282 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.014675824 = queryNorm
             1.0552503 = fieldWeight in 3417, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=3417)
       0.32 = coord(8/25)
   

4. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.31

   0.31397074 = sum of:
     0.31397074 = product of:
       0.9811586 = sum of:
         0.038891338 = weight(abstract_txt:search in 3608) [ClassicSimilarity], result of:
           0.038891338 = score(doc=3608,freq=9.0), product of:
             0.05670243 = queryWeight, product of:
               1.0562075 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014675824 = queryNorm
             0.68588483 = fieldWeight in 3608, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.052761417 = weight(abstract_txt:relevant in 3608) [ClassicSimilarity], result of:
           0.052761417 = score(doc=3608,freq=4.0), product of:
             0.09105523 = queryWeight, product of:
               1.338446 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.014675824 = queryNorm
             0.5794441 = fieldWeight in 3608, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.009302577 = weight(abstract_txt:this in 3608) [ClassicSimilarity], result of:
           0.009302577 = score(doc=3608,freq=1.0), product of:
             0.061682615 = queryWeight, product of:
               1.7418061 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.014675824 = queryNorm
             0.1508136 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.016878294 = weight(abstract_txt:research in 3608) [ClassicSimilarity], result of:
           0.016878294 = score(doc=3608,freq=1.0), product of:
             0.08518104 = queryWeight, product of:
               1.8307747 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.014675824 = queryNorm
             0.19814612 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.025831835 = weight(abstract_txt:analysis in 3608) [ClassicSimilarity], result of:
           0.025831835 = score(doc=3608,freq=1.0), product of:
             0.11312557 = queryWeight, product of:
               2.1098123 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.014675824 = queryNorm
             0.22834657 = fieldWeight in 3608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.19463061 = weight(abstract_txt:criteria in 3608) [ClassicSimilarity], result of:
           0.19463061 = score(doc=3608,freq=8.0), product of:
             0.1975097 = queryWeight, product of:
               2.4142835 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.014675824 = queryNorm
             0.98542297 = fieldWeight in 3608, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.30664536 = weight(abstract_txt:judgments in 3608) [ClassicSimilarity], result of:
           0.30664536 = score(doc=3608,freq=2.0), product of:
             0.50331694 = queryWeight, product of:
               4.9755282 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.014675824 = queryNorm
             0.60924906 = fieldWeight in 3608, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
         0.33621716 = weight(abstract_txt:relevance in 3608) [ClassicSimilarity], result of:
           0.33621716 = score(doc=3608,freq=7.0), product of:
             0.41226947 = queryWeight, product of:
               5.695987 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.014675824 = queryNorm
             0.8155277 = fieldWeight in 3608, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=3608)
       0.32 = coord(8/25)
   

5. Rieh, S.Y.: Judgment of information quality and cognitive authority in the Web (2002) 0.31

   0.31308606 = sum of:
     0.31308606 = product of:
       1.1181645 = sum of:
         0.05690974 = weight(abstract_txt:protocols in 202) [ClassicSimilarity], result of:
           0.05690974 = score(doc=202,freq=1.0), product of:
             0.103981234 = queryWeight, product of:
               1.011372 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.014675824 = queryNorm
             0.5473078 = fieldWeight in 202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.078125 = fieldNorm(doc=202)
         0.022916941 = weight(abstract_txt:search in 202) [ClassicSimilarity], result of:
           0.022916941 = score(doc=202,freq=2.0), product of:
             0.05670243 = queryWeight, product of:
               1.0562075 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014675824 = queryNorm
             0.4041615 = fieldWeight in 202, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=202)
         0.16034572 = weight(abstract_txt:judgment in 202) [ClassicSimilarity], result of:
           0.16034572 = score(doc=202,freq=6.0), product of:
             0.11415241 = queryWeight, product of:
               1.059683 = boost
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.014675824 = queryNorm
             1.4046634 = fieldWeight in 202, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.078125 = fieldNorm(doc=202)
         0.14190131 = weight(abstract_txt:postsearch in 202) [ClassicSimilarity], result of:
           0.14190131 = score(doc=202,freq=1.0), product of:
             0.19120014 = queryWeight, product of:
               1.3714422 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.014675824 = queryNorm
             0.74216115 = fieldWeight in 202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.078125 = fieldNorm(doc=202)
         0.011628221 = weight(abstract_txt:this in 202) [ClassicSimilarity], result of:
           0.011628221 = score(doc=202,freq=1.0), product of:
             0.061682615 = queryWeight, product of:
               1.7418061 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.014675824 = queryNorm
             0.18851699 = fieldWeight in 202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=202)
         0.25500968 = weight(abstract_txt:predictive in 202) [ClassicSimilarity], result of:
           0.25500968 = score(doc=202,freq=1.0), product of:
             0.40760747 = queryWeight, product of:
               3.4682877 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.014675824 = queryNorm
             0.6256256 = fieldWeight in 202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.078125 = fieldNorm(doc=202)
         0.46945292 = weight(abstract_txt:judgments in 202) [ClassicSimilarity], result of:
           0.46945292 = score(doc=202,freq=3.0), product of:
             0.50331694 = queryWeight, product of:
               4.9755282 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.014675824 = queryNorm
             0.9327183 = fieldWeight in 202, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.078125 = fieldNorm(doc=202)
       0.28 = coord(7/25)