Document (#37520)

Author

Smith, G.
Brien, C.
Ashman, H.

Title

Evaluating implicit judgments from image search clickthrough data

Source

Journal of the American Society for Information Science and Technology. 63(2012) no.12, S.2451-2462

Year

2012

Abstract

The interactions of users with search engines can be seen as implicit relevance feedback by the user on the results offered to them. In particular, the selection of results by users can be interpreted as a confirmation of the relevance of those results, and used to reorder or prioritize subsequent search results. This collection of search/result pairings is called clickthrough data, and many uses for it have been proposed. However, the reliability of clickthrough data has been challenged and it has been suggested that clickthrough data are not a completely accurate measure of relevance between search term and results. This paper reports on an experiment evaluating the reliability of clickthrough data as a measure of the mutual relevance of search term and result. The experiment comprised a user study involving over 67 participants and determines the reliability of image search clickthrough data, using factors identified in previous similar studies. A major difference in this work to previous work is that the source of clickthrough data comes from image searches, rather than the traditional text page searches. Image search clickthrough data were rarely examined in prior works but has differences that impact the accuracy of clickthrough data. These differences include a more complete representation of the results in image search, allowing users to scrutinize the results more closely before selecting them, as well as presenting the results in a less obviously ordered way. The experiment reported here demonstrates that image clickthrough data can be more reliable as a relevance feedback measure than has been the case with traditional text-based search. There is also evidence that the precision of the search system influences the accuracy of click data when users make searches in an information-seeking capacity.

Similar documents (author)

1. Smith, M.P.; Smith, M.: ¬The use of genetic programming to build Boolean queries for text retrieval through relevance feedback (1997) 4.57

   4.567121 = sum of:
     4.567121 = weight(author_txt:smith in 1762) [ClassicSimilarity], result of:
       4.567121 = score(doc=1762,freq=2.0), product of:
         1.0000001 = queryWeight, product of:
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.15482552 = queryNorm
         4.5671206 = fieldWeight in 1762, product of:
           1.4142135 = tf(freq=2.0), with freq of:
             2.0 = termFreq=2.0
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.5 = fieldNorm(doc=1762)
   

2. Smith, E.H.: Enhancing subject accessibiliy to the online catalog (1991) 4.04

   4.036803 = sum of:
     4.036803 = weight(author_txt:smith in 1069) [ClassicSimilarity], result of:
       4.036803 = score(doc=1069,freq=1.0), product of:
         1.0000001 = queryWeight, product of:
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.15482552 = queryNorm
         4.0368023 = fieldWeight in 1069, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.625 = fieldNorm(doc=1069)
   

3. Smith, L.C.: UNISIST revisited: campatibility in the context of collaboratories (1992) 4.04

   4.036803 = sum of:
     4.036803 = weight(author_txt:smith in 2113) [ClassicSimilarity], result of:
       4.036803 = score(doc=2113,freq=1.0), product of:
         1.0000001 = queryWeight, product of:
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.15482552 = queryNorm
         4.0368023 = fieldWeight in 2113, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.625 = fieldNorm(doc=2113)
   

4. Smith, M.M.: Knowledge management : a guide to resources on the Internet (2004) 4.04

   4.036803 = sum of:
     4.036803 = weight(author_txt:smith in 2805) [ClassicSimilarity], result of:
       4.036803 = score(doc=2805,freq=1.0), product of:
         1.0000001 = queryWeight, product of:
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.15482552 = queryNorm
         4.0368023 = fieldWeight in 2805, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.625 = fieldNorm(doc=2805)
   

5. Smith, L.C.: Citation analysis (1981) 4.04

   4.036803 = sum of:
     4.036803 = weight(author_txt:smith in 2833) [ClassicSimilarity], result of:
       4.036803 = score(doc=2833,freq=1.0), product of:
         1.0000001 = queryWeight, product of:
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.15482552 = queryNorm
         4.0368023 = fieldWeight in 2833, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.458884 = idf(docFreq=181, maxDocs=42740)
           0.625 = fieldNorm(doc=2833)
   

Similar documents (content)

1. Zhang, Y.; Jansen, B.J.; Spink, A.: Identification of factors predicting clickthrough in Web searching using neural network analysis (2009) 0.41

   0.41052943 = sum of:
     0.41052943 = product of:
       1.7105393 = sum of:
         0.019668965 = weight(abstract_txt:result in 4743) [ClassicSimilarity], result of:
           0.019668965 = score(doc=4743,freq=1.0), product of:
             0.04912683 = queryWeight, product of:
               1.1683646 = boost
               5.1247506 = idf(docFreq=690, maxDocs=42740)
               0.008204793 = queryNorm
             0.40037113 = fieldWeight in 4743, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1247506 = idf(docFreq=690, maxDocs=42740)
               0.078125 = fieldNorm(doc=4743)
         0.008812383 = weight(abstract_txt:more in 4743) [ClassicSimilarity], result of:
           0.008812383 = score(doc=4743,freq=1.0), product of:
             0.03292737 = queryWeight, product of:
               1.1715024 = boost
               3.4256759 = idf(docFreq=3778, maxDocs=42740)
               0.008204793 = queryNorm
             0.26763093 = fieldWeight in 4743, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4256759 = idf(docFreq=3778, maxDocs=42740)
               0.078125 = fieldNorm(doc=4743)
         0.0070949467 = weight(abstract_txt:that in 4743) [ClassicSimilarity], result of:
           0.0070949467 = score(doc=4743,freq=2.0), product of:
             0.026816403 = queryWeight, product of:
               1.3648638 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.008204793 = queryNorm
             0.2645749 = fieldWeight in 4743, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.078125 = fieldNorm(doc=4743)
         0.03566442 = weight(abstract_txt:results in 4743) [ClassicSimilarity], result of:
           0.03566442 = score(doc=4743,freq=2.0), product of:
             0.09203744 = queryWeight, product of:
               3.198389 = boost
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.008204793 = queryNorm
             0.38749906 = fieldWeight in 4743, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.078125 = fieldNorm(doc=4743)
         0.06778182 = weight(abstract_txt:search in 4743) [ClassicSimilarity], result of:
           0.06778182 = score(doc=4743,freq=3.0), product of:
             0.13717881 = queryWeight, product of:
               4.5787177 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.008204793 = queryNorm
             0.4941129 = fieldWeight in 4743, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.078125 = fieldNorm(doc=4743)
         1.5715169 = weight(abstract_txt:clickthrough in 4743) [ClassicSimilarity], result of:
           1.5715169 = score(doc=4743,freq=5.0), product of:
             0.911333 = queryWeight, product of:
               11.252334 = boost
               9.871131 = idf(docFreq=5, maxDocs=42740)
               0.008204793 = queryNorm
             1.7244155 = fieldWeight in 4743, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               9.871131 = idf(docFreq=5, maxDocs=42740)
               0.078125 = fieldNorm(doc=4743)
       0.24 = coord(6/25)
   

2. Mat-Hassan, M.; Levene, M.: Associating search and navigation behavior through log analysis (2005) 0.31

   0.31404895 = sum of:
     0.31404895 = product of:
       0.981403 = sum of:
         0.009970074 = weight(abstract_txt:more in 4682) [ClassicSimilarity], result of:
           0.009970074 = score(doc=4682,freq=2.0), product of:
             0.03292737 = queryWeight, product of:
               1.1715024 = boost
               3.4256759 = idf(docFreq=3778, maxDocs=42740)
               0.008204793 = queryNorm
             0.30278984 = fieldWeight in 4682, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4256759 = idf(docFreq=3778, maxDocs=42740)
               0.0625 = fieldNorm(doc=4682)
         0.0069516 = weight(abstract_txt:that in 4682) [ClassicSimilarity], result of:
           0.0069516 = score(doc=4682,freq=3.0), product of:
             0.026816403 = queryWeight, product of:
               1.3648638 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.008204793 = queryNorm
             0.2592294 = fieldWeight in 4682, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.0625 = fieldNorm(doc=4682)
         0.02823527 = weight(abstract_txt:users in 4682) [ClassicSimilarity], result of:
           0.02823527 = score(doc=4682,freq=7.0), product of:
             0.047779657 = queryWeight, product of:
               1.6295044 = boost
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.008204793 = queryNorm
             0.5909475 = fieldWeight in 4682, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.0625 = fieldNorm(doc=4682)
         0.011246388 = weight(abstract_txt:been in 4682) [ClassicSimilarity], result of:
           0.011246388 = score(doc=4682,freq=1.0), product of:
             0.049479254 = queryWeight, product of:
               1.6582332 = boost
               3.6367204 = idf(docFreq=3059, maxDocs=42740)
               0.008204793 = queryNorm
             0.22729503 = fieldWeight in 4682, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6367204 = idf(docFreq=3059, maxDocs=42740)
               0.0625 = fieldNorm(doc=4682)
         0.028531538 = weight(abstract_txt:results in 4682) [ClassicSimilarity], result of:
           0.028531538 = score(doc=4682,freq=2.0), product of:
             0.09203744 = queryWeight, product of:
               3.198389 = boost
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.008204793 = queryNorm
             0.30999926 = fieldWeight in 4682, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.0625 = fieldNorm(doc=4682)
         0.024650116 = weight(abstract_txt:data in 4682) [ClassicSimilarity], result of:
           0.024650116 = score(doc=4682,freq=1.0), product of:
             0.11696914 = queryWeight, product of:
               4.22801 = boost
               3.3718455 = idf(docFreq=3987, maxDocs=42740)
               0.008204793 = queryNorm
             0.21074034 = fieldWeight in 4682, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3718455 = idf(docFreq=3987, maxDocs=42740)
               0.0625 = fieldNorm(doc=4682)
         0.076686375 = weight(abstract_txt:search in 4682) [ClassicSimilarity], result of:
           0.076686375 = score(doc=4682,freq=6.0), product of:
             0.13717881 = queryWeight, product of:
               4.5787177 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.008204793 = queryNorm
             0.55902493 = fieldWeight in 4682, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.0625 = fieldNorm(doc=4682)
         0.7951316 = weight(abstract_txt:clickthrough in 4682) [ClassicSimilarity], result of:
           0.7951316 = score(doc=4682,freq=2.0), product of:
             0.911333 = queryWeight, product of:
               11.252334 = boost
               9.871131 = idf(docFreq=5, maxDocs=42740)
               0.008204793 = queryNorm
             0.8724929 = fieldWeight in 4682, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.871131 = idf(docFreq=5, maxDocs=42740)
               0.0625 = fieldNorm(doc=4682)
       0.32 = coord(8/25)
   

3. Lewandowski, D.; Drechsler, J.; Mach, S. von: Deriving query intents from web search engine queries (2012) 0.21

   0.20869346 = sum of:
     0.20869346 = product of:
       0.7453338 = sum of:
         0.0069516 = weight(abstract_txt:that in 2386) [ClassicSimilarity], result of:
           0.0069516 = score(doc=2386,freq=3.0), product of:
             0.026816403 = queryWeight, product of:
               1.3648638 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.008204793 = queryNorm
             0.2592294 = fieldWeight in 2386, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.0625 = fieldNorm(doc=2386)
         0.010671929 = weight(abstract_txt:users in 2386) [ClassicSimilarity], result of:
           0.010671929 = score(doc=2386,freq=1.0), product of:
             0.047779657 = queryWeight, product of:
               1.6295044 = boost
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.008204793 = queryNorm
             0.22335717 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.0625 = fieldNorm(doc=2386)
         0.058060188 = weight(abstract_txt:reliability in 2386) [ClassicSimilarity], result of:
           0.058060188 = score(doc=2386,freq=1.0), product of:
             0.13428283 = queryWeight, product of:
               2.365783 = boost
               6.9179583 = idf(docFreq=114, maxDocs=42740)
               0.008204793 = queryNorm
             0.4323724 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9179583 = idf(docFreq=114, maxDocs=42740)
               0.0625 = fieldNorm(doc=2386)
         0.028531538 = weight(abstract_txt:results in 2386) [ClassicSimilarity], result of:
           0.028531538 = score(doc=2386,freq=2.0), product of:
             0.09203744 = queryWeight, product of:
               3.198389 = boost
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.008204793 = queryNorm
             0.30999926 = fieldWeight in 2386, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.0625 = fieldNorm(doc=2386)
         0.024650116 = weight(abstract_txt:data in 2386) [ClassicSimilarity], result of:
           0.024650116 = score(doc=2386,freq=1.0), product of:
             0.11696914 = queryWeight, product of:
               4.22801 = boost
               3.3718455 = idf(docFreq=3987, maxDocs=42740)
               0.008204793 = queryNorm
             0.21074034 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3718455 = idf(docFreq=3987, maxDocs=42740)
               0.0625 = fieldNorm(doc=2386)
         0.054225456 = weight(abstract_txt:search in 2386) [ClassicSimilarity], result of:
           0.054225456 = score(doc=2386,freq=3.0), product of:
             0.13717881 = queryWeight, product of:
               4.5787177 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.008204793 = queryNorm
             0.39529032 = fieldWeight in 2386, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.0625 = fieldNorm(doc=2386)
         0.562243 = weight(abstract_txt:clickthrough in 2386) [ClassicSimilarity], result of:
           0.562243 = score(doc=2386,freq=1.0), product of:
             0.911333 = queryWeight, product of:
               11.252334 = boost
               9.871131 = idf(docFreq=5, maxDocs=42740)
               0.008204793 = queryNorm
             0.6169457 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.871131 = idf(docFreq=5, maxDocs=42740)
               0.0625 = fieldNorm(doc=2386)
       0.28 = coord(7/25)
   

4. Jung, S.; Herlocker, J.L.; Webster, J.: Click data as implicit relevance feedback in web search (2007) 0.18

   0.1785804 = sum of:
     0.1785804 = product of:
       0.446451 = sum of:
         0.008723814 = weight(abstract_txt:more in 2913) [ClassicSimilarity], result of:
           0.008723814 = score(doc=2913,freq=2.0), product of:
             0.03292737 = queryWeight, product of:
               1.1715024 = boost
               3.4256759 = idf(docFreq=3778, maxDocs=42740)
               0.008204793 = queryNorm
             0.2649411 = fieldWeight in 2913, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4256759 = idf(docFreq=3778, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
         0.05679828 = weight(abstract_txt:feedback in 2913) [ClassicSimilarity], result of:
           0.05679828 = score(doc=2913,freq=7.0), product of:
             0.06605766 = queryWeight, product of:
               1.3548169 = boost
               5.942579 = idf(docFreq=304, maxDocs=42740)
               0.008204793 = queryNorm
             0.8598288 = fieldWeight in 2913, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.942579 = idf(docFreq=304, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
         0.009291401 = weight(abstract_txt:that in 2913) [ClassicSimilarity], result of:
           0.009291401 = score(doc=2913,freq=7.0), product of:
             0.026816403 = queryWeight, product of:
               1.3648638 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.008204793 = queryNorm
             0.346482 = fieldWeight in 2913, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
         0.03096212 = weight(abstract_txt:implicit in 2913) [ClassicSimilarity], result of:
           0.03096212 = score(doc=2913,freq=1.0), product of:
             0.08432432 = queryWeight, product of:
               1.5307189 = boost
               6.7141304 = idf(docFreq=140, maxDocs=42740)
               0.008204793 = queryNorm
             0.367179 = fieldWeight in 2913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7141304 = idf(docFreq=140, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
         0.009337937 = weight(abstract_txt:users in 2913) [ClassicSimilarity], result of:
           0.009337937 = score(doc=2913,freq=1.0), product of:
             0.047779657 = queryWeight, product of:
               1.6295044 = boost
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.008204793 = queryNorm
             0.19543752 = fieldWeight in 2913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
         0.050802663 = weight(abstract_txt:reliability in 2913) [ClassicSimilarity], result of:
           0.050802663 = score(doc=2913,freq=1.0), product of:
             0.13428283 = queryWeight, product of:
               2.365783 = boost
               6.9179583 = idf(docFreq=114, maxDocs=42740)
               0.008204793 = queryNorm
             0.37832585 = fieldWeight in 2913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9179583 = idf(docFreq=114, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
         0.08128622 = weight(abstract_txt:relevance in 2913) [ClassicSimilarity], result of:
           0.08128622 = score(doc=2913,freq=7.0), product of:
             0.11385646 = queryWeight, product of:
               2.8123403 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.008204793 = queryNorm
             0.713936 = fieldWeight in 2913, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
         0.039473284 = weight(abstract_txt:results in 2913) [ClassicSimilarity], result of:
           0.039473284 = score(doc=2913,freq=5.0), product of:
             0.09203744 = queryWeight, product of:
               3.198389 = boost
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.008204793 = queryNorm
             0.4288829 = fieldWeight in 2913, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5072412 = idf(docFreq=3482, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
         0.061005924 = weight(abstract_txt:data in 2913) [ClassicSimilarity], result of:
           0.061005924 = score(doc=2913,freq=8.0), product of:
             0.11696914 = queryWeight, product of:
               4.22801 = boost
               3.3718455 = idf(docFreq=3987, maxDocs=42740)
               0.008204793 = queryNorm
             0.5215557 = fieldWeight in 2913, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.3718455 = idf(docFreq=3987, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
         0.09876937 = weight(abstract_txt:search in 2913) [ClassicSimilarity], result of:
           0.09876937 = score(doc=2913,freq=13.0), product of:
             0.13717881 = queryWeight, product of:
               4.5787177 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.008204793 = queryNorm
             0.72000456 = fieldWeight in 2913, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.0546875 = fieldNorm(doc=2913)
       0.4 = coord(10/25)
   

5. Ortiz-Cordova, A.; Jansen, B.J.: Classifying web search queries to identify high revenue generating customers (2012) 0.13

   0.13020259 = sum of:
     0.13020259 = product of:
       0.65101296 = sum of:
         0.0070499065 = weight(abstract_txt:more in 2280) [ClassicSimilarity], result of:
           0.0070499065 = score(doc=2280,freq=1.0), product of:
             0.03292737 = queryWeight, product of:
               1.1715024 = boost
               3.4256759 = idf(docFreq=3778, maxDocs=42740)
               0.008204793 = queryNorm
             0.21410474 = fieldWeight in 2280, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4256759 = idf(docFreq=3778, maxDocs=42740)
               0.0625 = fieldNorm(doc=2280)
         0.004013508 = weight(abstract_txt:that in 2280) [ClassicSimilarity], result of:
           0.004013508 = score(doc=2280,freq=1.0), product of:
             0.026816403 = queryWeight, product of:
               1.3648638 = boost
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.008204793 = queryNorm
             0.14966616 = fieldWeight in 2280, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3946586 = idf(docFreq=10595, maxDocs=42740)
               0.0625 = fieldNorm(doc=2280)
         0.015092386 = weight(abstract_txt:users in 2280) [ClassicSimilarity], result of:
           0.015092386 = score(doc=2280,freq=2.0), product of:
             0.047779657 = queryWeight, product of:
               1.6295044 = boost
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.008204793 = queryNorm
             0.31587473 = fieldWeight in 2280, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5737147 = idf(docFreq=3258, maxDocs=42740)
               0.0625 = fieldNorm(doc=2280)
         0.06261416 = weight(abstract_txt:search in 2280) [ClassicSimilarity], result of:
           0.06261416 = score(doc=2280,freq=4.0), product of:
             0.13717881 = queryWeight, product of:
               4.5787177 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.008204793 = queryNorm
             0.45644194 = fieldWeight in 2280, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.0625 = fieldNorm(doc=2280)
         0.562243 = weight(abstract_txt:clickthrough in 2280) [ClassicSimilarity], result of:
           0.562243 = score(doc=2280,freq=1.0), product of:
             0.911333 = queryWeight, product of:
               11.252334 = boost
               9.871131 = idf(docFreq=5, maxDocs=42740)
               0.008204793 = queryNorm
             0.6169457 = fieldWeight in 2280, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.871131 = idf(docFreq=5, maxDocs=42740)
               0.0625 = fieldNorm(doc=2280)
       0.2 = coord(5/25)