-
Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Analysis of change in users' assessment of search results over time (2017)
0.02
0.024920205 = product of:
0.06230051 = sum of:
0.022587063 = weight(_text_:j in 3593) [ClassicSimilarity], result of:
0.022587063 = score(doc=3593,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.17553353 = fieldWeight in 3593, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0390625 = fieldNorm(doc=3593)
0.03971345 = weight(_text_:b in 3593) [ClassicSimilarity], result of:
0.03971345 = score(doc=3593,freq=4.0), product of:
0.1434766 = queryWeight, product of:
3.542962 = idf(docFreq=3476, maxDocs=44218)
0.04049623 = queryNorm
0.2767939 = fieldWeight in 3593, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.542962 = idf(docFreq=3476, maxDocs=44218)
0.0390625 = fieldNorm(doc=3593)
0.4 = coord(2/5)
- Abstract
- We present the first systematic study of the influence of time on user judgements for rankings and relevance grades of web search engine results. The goal of this study is to evaluate the change in user assessment of search results and explore how users' judgements change. To this end, we conducted a large-scale user study with 86 participants who evaluated 2 different queries and 4 diverse result sets twice with an interval of 2 months. To analyze the results we investigate whether 2 types of patterns of user behavior from the theory of categorical thinking hold for the case of evaluation of search results: (a) coarseness and (b) locality. To quantify these patterns we devised 2 new measures of change in user judgements and distinguish between local (when users swap between close ranks and relevance values) and nonlocal changes. Two types of judgements were considered in this study: (a) relevance on a 4-point scale, and (b) ranking on a 10-point scale without ties. We found that users tend to change their judgements of the results over time in about 50% of cases for relevance and in 85% of cases for ranking. However, the majority of these changes were local.
-
Bar-Ilan, J.; Gutman,T.: How do search engines respond to some non-English queries? (2005)
0.01
0.012648756 = product of:
0.06324378 = sum of:
0.06324378 = weight(_text_:j in 4653) [ClassicSimilarity], result of:
0.06324378 = score(doc=4653,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.4914939 = fieldWeight in 4653, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.109375 = fieldNorm(doc=4653)
0.2 = coord(1/5)
-
Bar-Ilan, J.: Methods for measuring search engine performance over time (2002)
0.01
0.0072278604 = product of:
0.036139302 = sum of:
0.036139302 = weight(_text_:j in 305) [ClassicSimilarity], result of:
0.036139302 = score(doc=305,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.28085366 = fieldWeight in 305, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0625 = fieldNorm(doc=305)
0.2 = coord(1/5)
-
Bar-Ilan, J.: Evaluating the stability of the search tools Hotbot and Snap : a case study (2000)
0.01
0.006324378 = product of:
0.03162189 = sum of:
0.03162189 = weight(_text_:j in 1180) [ClassicSimilarity], result of:
0.03162189 = score(doc=1180,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.24574696 = fieldWeight in 1180, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0546875 = fieldNorm(doc=1180)
0.2 = coord(1/5)
-
Bar-Ilan, J.: On the overlap, the precision and estimated recall of search engines : a case study of the query 'Erdös' (1998)
0.01
0.006324378 = product of:
0.03162189 = sum of:
0.03162189 = weight(_text_:j in 3753) [ClassicSimilarity], result of:
0.03162189 = score(doc=3753,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.24574696 = fieldWeight in 3753, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0546875 = fieldNorm(doc=3753)
0.2 = coord(1/5)
-
Bar-Ilan, J.: ¬The use of Web search engines in information science research (2003)
0.01
0.0054208953 = product of:
0.027104476 = sum of:
0.027104476 = weight(_text_:j in 4271) [ClassicSimilarity], result of:
0.027104476 = score(doc=4271,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.21064025 = fieldWeight in 4271, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.046875 = fieldNorm(doc=4271)
0.2 = coord(1/5)
-
Bar-Ilan, J.: Web links and search engine ranking : the case of Google and the query "Jew" (2006)
0.00
0.0045174127 = product of:
0.022587063 = sum of:
0.022587063 = weight(_text_:j in 6104) [ClassicSimilarity], result of:
0.022587063 = score(doc=6104,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.17553353 = fieldWeight in 6104, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0390625 = fieldNorm(doc=6104)
0.2 = coord(1/5)
-
Bar-Ilan, J.; Belous, Y.: Children as architects of Web directories : an exploratory study (2007)
0.00
0.0045174127 = product of:
0.022587063 = sum of:
0.022587063 = weight(_text_:j in 289) [ClassicSimilarity], result of:
0.022587063 = score(doc=289,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.17553353 = fieldWeight in 289, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0390625 = fieldNorm(doc=289)
0.2 = coord(1/5)
-
Bar-Ilan, J.; Keenoy, K.; Yaari, E.; Levene, M.: User rankings of search engine results (2007)
0.00
0.0045174127 = product of:
0.022587063 = sum of:
0.022587063 = weight(_text_:j in 470) [ClassicSimilarity], result of:
0.022587063 = score(doc=470,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.17553353 = fieldWeight in 470, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0390625 = fieldNorm(doc=470)
0.2 = coord(1/5)
-
Bar-Ilan, J.: Comparing rankings of search results on the Web (2005)
0.00
0.0045174127 = product of:
0.022587063 = sum of:
0.022587063 = weight(_text_:j in 1068) [ClassicSimilarity], result of:
0.022587063 = score(doc=1068,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.17553353 = fieldWeight in 1068, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0390625 = fieldNorm(doc=1068)
0.2 = coord(1/5)
-
Bar-Ilan, J.; Levene, M.; Mat-Hassan, M.: Methods for evaluating dynamic changes in search engine rankings : a case study (2006)
0.00
0.0036139302 = product of:
0.018069651 = sum of:
0.018069651 = weight(_text_:j in 616) [ClassicSimilarity], result of:
0.018069651 = score(doc=616,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.14042683 = fieldWeight in 616, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.03125 = fieldNorm(doc=616)
0.2 = coord(1/5)
