-
Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Analysis of change in users' assessment of search results over time (2017)
0.02
0.024920205 = product of:
0.06230051 = sum of:
0.022587063 = weight(_text_:j in 3593) [ClassicSimilarity], result of:
0.022587063 = score(doc=3593,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.17553353 = fieldWeight in 3593, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0390625 = fieldNorm(doc=3593)
0.03971345 = weight(_text_:b in 3593) [ClassicSimilarity], result of:
0.03971345 = score(doc=3593,freq=4.0), product of:
0.1434766 = queryWeight, product of:
3.542962 = idf(docFreq=3476, maxDocs=44218)
0.04049623 = queryNorm
0.2767939 = fieldWeight in 3593, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.542962 = idf(docFreq=3476, maxDocs=44218)
0.0390625 = fieldNorm(doc=3593)
0.4 = coord(2/5)
- Abstract
- We present the first systematic study of the influence of time on user judgements for rankings and relevance grades of web search engine results. The goal of this study is to evaluate the change in user assessment of search results and explore how users' judgements change. To this end, we conducted a large-scale user study with 86 participants who evaluated 2 different queries and 4 diverse result sets twice with an interval of 2 months. To analyze the results we investigate whether 2 types of patterns of user behavior from the theory of categorical thinking hold for the case of evaluation of search results: (a) coarseness and (b) locality. To quantify these patterns we devised 2 new measures of change in user judgements and distinguish between local (when users swap between close ranks and relevance values) and nonlocal changes. Two types of judgements were considered in this study: (a) relevance on a 4-point scale, and (b) ranking on a 10-point scale without ties. We found that users tend to change their judgements of the results over time in about 50% of cases for relevance and in 85% of cases for ranking. However, the majority of these changes were local.
-
Zhitomirsky-Geffet, M.; Bar-Ilan, J.: Towards maximal unification of semantically diverse ontologies for controversial domains (2014)
0.01
0.011617205 = product of:
0.029043011 = sum of:
0.018069651 = weight(_text_:j in 1634) [ClassicSimilarity], result of:
0.018069651 = score(doc=1634,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.14042683 = fieldWeight in 1634, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.03125 = fieldNorm(doc=1634)
0.01097336 = product of:
0.02194672 = sum of:
0.02194672 = weight(_text_:22 in 1634) [ClassicSimilarity], result of:
0.02194672 = score(doc=1634,freq=2.0), product of:
0.1418109 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04049623 = queryNorm
0.15476047 = fieldWeight in 1634, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03125 = fieldNorm(doc=1634)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Date
- 20. 1.2015 18:30:22
-
Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016)
0.01
0.011617205 = product of:
0.029043011 = sum of:
0.018069651 = weight(_text_:j in 3071) [ClassicSimilarity], result of:
0.018069651 = score(doc=3071,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.14042683 = fieldWeight in 3071, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.03125 = fieldNorm(doc=3071)
0.01097336 = product of:
0.02194672 = sum of:
0.02194672 = weight(_text_:22 in 3071) [ClassicSimilarity], result of:
0.02194672 = score(doc=3071,freq=2.0), product of:
0.1418109 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.04049623 = queryNorm
0.15476047 = fieldWeight in 3071, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03125 = fieldNorm(doc=3071)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Date
- 20. 1.2015 18:30:22
-
Bar-Ilan, J.; Zhitomirsky-Geffet, M.; Miller, Y.; Shoham, S.: ¬The effects of background information and social interaction on image tagging (2010)
0.00
0.0045174127 = product of:
0.022587063 = sum of:
0.022587063 = weight(_text_:j in 3453) [ClassicSimilarity], result of:
0.022587063 = score(doc=3453,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.17553353 = fieldWeight in 3453, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0390625 = fieldNorm(doc=3453)
0.2 = coord(1/5)
-
Zhitomirsky-Geffet, M.; Erez, E.S.; Bar-Ilan, J.: Toward multiviewpoint ontology construction by collaboration of non-experts and crowdsourcing : the case of the effect of diet on health (2017)
0.00
0.0045174127 = product of:
0.022587063 = sum of:
0.022587063 = weight(_text_:j in 3439) [ClassicSimilarity], result of:
0.022587063 = score(doc=3439,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.17553353 = fieldWeight in 3439, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0390625 = fieldNorm(doc=3439)
0.2 = coord(1/5)
-
Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Categorical relevance judgment (2018)
0.00
0.0045174127 = product of:
0.022587063 = sum of:
0.022587063 = weight(_text_:j in 4457) [ClassicSimilarity], result of:
0.022587063 = score(doc=4457,freq=2.0), product of:
0.12867662 = queryWeight, product of:
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.04049623 = queryNorm
0.17553353 = fieldWeight in 4457, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1774964 = idf(docFreq=5010, maxDocs=44218)
0.0390625 = fieldNorm(doc=4457)
0.2 = coord(1/5)
