Document (#24537)

Author

Smith, J.R.

Title

Quantitative assessment of image retrieval effectiveness

Source

Journal of the American Society for Information Science and technology. 52(2001) no.11, S.969-979

Year

2001

Abstract

Content-based retrieval (CBR) promises to greatly improve capabilities for searching for images based on semantic features and visual appearance. However, developing a framework for evaluating image retrieval effectiveness remains a significant challenge. Difficulties include determining how matching at different description levels affects relevance, designing meaningful benchmark queries of large image collections, and developing suitable quantitative metrics for measuring retrieval effectiveness. This article studies the problems of developing a framework and testbed for quantitative assessment of image retrieval effectiveness. In order to better harness the extensive research on CBR and improve capabilities of image retrieval systems, this article advocates the establishment of common image retrieval testbeds consisting of standardized image collections, benchmark queries, relevance assessments, and quantitative evaluation methods

Form

Bilder

Similar documents (author)

1. Smith, M.P.; Smith, M.: ¬The use of genetic programming to build Boolean queries for text retrieval through relevance feedback (1997) 4.56

   4.564473 = sum of:
     4.564473 = weight(author_txt:smith in 761) [ClassicSimilarity], result of:
       4.564473 = fieldWeight in 761, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         6.45514 = idf(docFreq=188, maxDocs=44218)
         0.5 = fieldNorm(doc=761)
   

2. Smith, E.H.: Enhancing subject accessibiliy to the online catalog (1991) 4.03

   4.0344625 = sum of:
     4.0344625 = weight(author_txt:smith in 1069) [ClassicSimilarity], result of:
       4.0344625 = fieldWeight in 1069, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.45514 = idf(docFreq=188, maxDocs=44218)
         0.625 = fieldNorm(doc=1069)
   

3. Smith, L.C.: UNISIST revisited: campatibility in the context of collaboratories (1992) 4.03

   4.0344625 = sum of:
     4.0344625 = weight(author_txt:smith in 2113) [ClassicSimilarity], result of:
       4.0344625 = fieldWeight in 2113, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.45514 = idf(docFreq=188, maxDocs=44218)
         0.625 = fieldNorm(doc=2113)
   

4. Smith, M.M.: Knowledge management : a guide to resources on the Internet (2004) 4.03

   4.0344625 = sum of:
     4.0344625 = weight(author_txt:smith in 2805) [ClassicSimilarity], result of:
       4.0344625 = fieldWeight in 2805, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.45514 = idf(docFreq=188, maxDocs=44218)
         0.625 = fieldNorm(doc=2805)
   

5. Smith, L.C.: Citation analysis (1981) 4.03

   4.0344625 = sum of:
     4.0344625 = weight(author_txt:smith in 2833) [ClassicSimilarity], result of:
       4.0344625 = fieldWeight in 2833, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.45514 = idf(docFreq=188, maxDocs=44218)
         0.625 = fieldNorm(doc=2833)
   

Similar documents (content)

1. Yoon, J.W.: Utilizing quantitative users' reactions to represent affective meanings of an image (2010) 0.22

   0.22131497 = sum of:
     0.22131497 = product of:
       0.9221457 = sum of:
         0.037887633 = weight(abstract_txt:improve in 3584) [ClassicSimilarity], result of:
           0.037887633 = score(doc=3584,freq=1.0), product of:
             0.122220136 = queryWeight, product of:
               1.4606017 = boost
               4.9599204 = idf(docFreq=842, maxDocs=44218)
               0.016870823 = queryNorm
             0.30999503 = fieldWeight in 3584, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9599204 = idf(docFreq=842, maxDocs=44218)
               0.0625 = fieldNorm(doc=3584)
         0.059237637 = weight(abstract_txt:assessment in 3584) [ClassicSimilarity], result of:
           0.059237637 = score(doc=3584,freq=1.0), product of:
             0.16464287 = queryWeight, product of:
               1.6952426 = boost
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.016870823 = queryNorm
             0.35979474 = fieldWeight in 3584, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.0625 = fieldNorm(doc=3584)
         0.08229993 = weight(abstract_txt:effectiveness in 3584) [ClassicSimilarity], result of:
           0.08229993 = score(doc=3584,freq=1.0), product of:
             0.258278 = queryWeight, product of:
               3.0027497 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.016870823 = queryNorm
             0.31864864 = fieldWeight in 3584, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=3584)
         0.18656923 = weight(abstract_txt:quantitative in 3584) [ClassicSimilarity], result of:
           0.18656923 = score(doc=3584,freq=2.0), product of:
             0.35375652 = queryWeight, product of:
               3.5142095 = boost
               5.9667873 = idf(docFreq=307, maxDocs=44218)
               0.016870823 = queryNorm
             0.5273945 = fieldWeight in 3584, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9667873 = idf(docFreq=307, maxDocs=44218)
               0.0625 = fieldNorm(doc=3584)
         0.07899848 = weight(abstract_txt:retrieval in 3584) [ClassicSimilarity], result of:
           0.07899848 = score(doc=3584,freq=3.0), product of:
             0.20999351 = queryWeight, product of:
               3.5817673 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016870823 = queryNorm
             0.37619486 = fieldWeight in 3584, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3584)
         0.4771528 = weight(abstract_txt:image in 3584) [ClassicSimilarity], result of:
           0.4771528 = score(doc=3584,freq=8.0), product of:
             0.5022371 = queryWeight, product of:
               5.5392227 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.016870823 = queryNorm
             0.9500549 = fieldWeight in 3584, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.0625 = fieldNorm(doc=3584)
       0.24 = coord(6/25)
   

2. Ostermann, F.O.; Tomko, M.; Purves, R.: User evaluation of automatically generated keywords and toponyms for geo-referenced images (2013) 0.18

   0.18272918 = sum of:
     0.18272918 = product of:
       0.6526042 = sum of:
         0.055140182 = weight(abstract_txt:standardized in 663) [ClassicSimilarity], result of:
           0.055140182 = score(doc=663,freq=1.0), product of:
             0.1245795 = queryWeight, product of:
               1.0427223 = boost
               7.0817666 = idf(docFreq=100, maxDocs=44218)
               0.016870823 = queryNorm
             0.4426104 = fieldWeight in 663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0817666 = idf(docFreq=100, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.02960579 = weight(abstract_txt:article in 663) [ClassicSimilarity], result of:
           0.02960579 = score(doc=663,freq=3.0), product of:
             0.071893305 = queryWeight, product of:
               1.1202234 = boost
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.016870823 = queryNorm
             0.41180176 = fieldWeight in 663, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.037887633 = weight(abstract_txt:improve in 663) [ClassicSimilarity], result of:
           0.037887633 = score(doc=663,freq=1.0), product of:
             0.122220136 = queryWeight, product of:
               1.4606017 = boost
               4.9599204 = idf(docFreq=842, maxDocs=44218)
               0.016870823 = queryNorm
             0.30999503 = fieldWeight in 663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9599204 = idf(docFreq=842, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.041349027 = weight(abstract_txt:queries in 663) [ClassicSimilarity], result of:
           0.041349027 = score(doc=663,freq=1.0), product of:
             0.12955514 = queryWeight, product of:
               1.5037919 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.016870823 = queryNorm
             0.31916162 = fieldWeight in 663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.13192438 = weight(abstract_txt:quantitative in 663) [ClassicSimilarity], result of:
           0.13192438 = score(doc=663,freq=1.0), product of:
             0.35375652 = queryWeight, product of:
               3.5142095 = boost
               5.9667873 = idf(docFreq=307, maxDocs=44218)
               0.016870823 = queryNorm
             0.3729242 = fieldWeight in 663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9667873 = idf(docFreq=307, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.064501986 = weight(abstract_txt:retrieval in 663) [ClassicSimilarity], result of:
           0.064501986 = score(doc=663,freq=2.0), product of:
             0.20999351 = queryWeight, product of:
               3.5817673 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016870823 = queryNorm
             0.3071618 = fieldWeight in 663, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.2921952 = weight(abstract_txt:image in 663) [ClassicSimilarity], result of:
           0.2921952 = score(doc=663,freq=3.0), product of:
             0.5022371 = queryWeight, product of:
               5.5392227 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.016870823 = queryNorm
             0.5817874 = fieldWeight in 663, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
       0.28 = coord(7/25)
   

3. Sun, A.; Bhowmick, S.S.; Nguyen, K.T.N.; Bai, G.: Tag-based social image retrieval : an empirical evaluation (2011) 0.16

   0.16153781 = sum of:
     0.16153781 = product of:
       0.57692075 = sum of:
         0.014956296 = weight(abstract_txt:article in 4938) [ClassicSimilarity], result of:
           0.014956296 = score(doc=4938,freq=1.0), product of:
             0.071893305 = queryWeight, product of:
               1.1202234 = boost
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.016870823 = queryNorm
             0.20803462 = fieldWeight in 4938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4938)
         0.036215052 = weight(abstract_txt:framework in 4938) [ClassicSimilarity], result of:
           0.036215052 = score(doc=4938,freq=2.0), product of:
             0.10289363 = queryWeight, product of:
               1.3401538 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.016870823 = queryNorm
             0.35196593 = fieldWeight in 4938, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4938)
         0.03259196 = weight(abstract_txt:relevance in 4938) [ClassicSimilarity], result of:
           0.03259196 = score(doc=4938,freq=1.0), product of:
             0.12084056 = queryWeight, product of:
               1.4523349 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016870823 = queryNorm
             0.26971045 = fieldWeight in 4938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4938)
         0.051166814 = weight(abstract_txt:queries in 4938) [ClassicSimilarity], result of:
           0.051166814 = score(doc=4938,freq=2.0), product of:
             0.12955514 = queryWeight, product of:
               1.5037919 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.016870823 = queryNorm
             0.39494237 = fieldWeight in 4938, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4938)
         0.07201245 = weight(abstract_txt:effectiveness in 4938) [ClassicSimilarity], result of:
           0.07201245 = score(doc=4938,freq=1.0), product of:
             0.258278 = queryWeight, product of:
               3.0027497 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.016870823 = queryNorm
             0.27881756 = fieldWeight in 4938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4938)
         0.03990857 = weight(abstract_txt:retrieval in 4938) [ClassicSimilarity], result of:
           0.03990857 = score(doc=4938,freq=1.0), product of:
             0.20999351 = queryWeight, product of:
               3.5817673 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016870823 = queryNorm
             0.19004668 = fieldWeight in 4938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4938)
         0.3300696 = weight(abstract_txt:image in 4938) [ClassicSimilarity], result of:
           0.3300696 = score(doc=4938,freq=5.0), product of:
             0.5022371 = queryWeight, product of:
               5.5392227 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.016870823 = queryNorm
             0.6571988 = fieldWeight in 4938, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4938)
       0.28 = coord(7/25)
   

4. Bodoff, D.; Kambil, A.: Partial coordination : II. A preliminary evaluation and failure analysis (1998) 0.16

   0.15612102 = sum of:
     0.15612102 = product of:
       0.55757505 = sum of:
         0.03021628 = weight(abstract_txt:article in 2323) [ClassicSimilarity], result of:
           0.03021628 = score(doc=2323,freq=2.0), product of:
             0.071893305 = queryWeight, product of:
               1.1202234 = boost
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.016870823 = queryNorm
             0.4202934 = fieldWeight in 2323, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.14094964 = weight(abstract_txt:testbed in 2323) [ClassicSimilarity], result of:
           0.14094964 = score(doc=2323,freq=1.0), product of:
             0.20071064 = queryWeight, product of:
               1.3235203 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.016870823 = queryNorm
             0.7022529 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.036582727 = weight(abstract_txt:framework in 2323) [ClassicSimilarity], result of:
           0.036582727 = score(doc=2323,freq=1.0), product of:
             0.10289363 = queryWeight, product of:
               1.3401538 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.016870823 = queryNorm
             0.3555393 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.040138688 = weight(abstract_txt:collections in 2323) [ClassicSimilarity], result of:
           0.040138688 = score(doc=2323,freq=1.0), product of:
             0.10945776 = queryWeight, product of:
               1.3822408 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.016870823 = queryNorm
             0.36670482 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.07932956 = weight(abstract_txt:developing in 2323) [ClassicSimilarity], result of:
           0.07932956 = score(doc=2323,freq=1.0), product of:
             0.19732928 = queryWeight, product of:
               2.2730124 = boost
               5.145807 = idf(docFreq=699, maxDocs=44218)
               0.016870823 = queryNorm
             0.40201616 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.145807 = idf(docFreq=699, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.10287492 = weight(abstract_txt:effectiveness in 2323) [ClassicSimilarity], result of:
           0.10287492 = score(doc=2323,freq=1.0), product of:
             0.258278 = queryWeight, product of:
               3.0027497 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.016870823 = queryNorm
             0.39831078 = fieldWeight in 2323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
         0.12748326 = weight(abstract_txt:retrieval in 2323) [ClassicSimilarity], result of:
           0.12748326 = score(doc=2323,freq=5.0), product of:
             0.20999351 = queryWeight, product of:
               3.5817673 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016870823 = queryNorm
             0.6070819 = fieldWeight in 2323, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=2323)
       0.28 = coord(7/25)
   

5. McLean, S.; Spring, M.B.; Rasmussen, E.; Williams, J.G.: Online image databases : usabiblity and performance (1995) 0.15

   0.14980249 = sum of:
     0.14980249 = product of:
       0.7490124 = sum of:
         0.05683145 = weight(abstract_txt:improve in 1192) [ClassicSimilarity], result of:
           0.05683145 = score(doc=1192,freq=1.0), product of:
             0.122220136 = queryWeight, product of:
               1.4606017 = boost
               4.9599204 = idf(docFreq=842, maxDocs=44218)
               0.016870823 = queryNorm
             0.46499252 = fieldWeight in 1192, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9599204 = idf(docFreq=842, maxDocs=44218)
               0.09375 = fieldNorm(doc=1192)
         0.06202354 = weight(abstract_txt:queries in 1192) [ClassicSimilarity], result of:
           0.06202354 = score(doc=1192,freq=1.0), product of:
             0.12955514 = queryWeight, product of:
               1.5037919 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.016870823 = queryNorm
             0.47874242 = fieldWeight in 1192, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.09375 = fieldNorm(doc=1192)
         0.12344991 = weight(abstract_txt:effectiveness in 1192) [ClassicSimilarity], result of:
           0.12344991 = score(doc=1192,freq=1.0), product of:
             0.258278 = queryWeight, product of:
               3.0027497 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.016870823 = queryNorm
             0.47797295 = fieldWeight in 1192, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.09375 = fieldNorm(doc=1192)
         0.06841469 = weight(abstract_txt:retrieval in 1192) [ClassicSimilarity], result of:
           0.06841469 = score(doc=1192,freq=1.0), product of:
             0.20999351 = queryWeight, product of:
               3.5817673 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016870823 = queryNorm
             0.3257943 = fieldWeight in 1192, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=1192)
         0.43829283 = weight(abstract_txt:image in 1192) [ClassicSimilarity], result of:
           0.43829283 = score(doc=1192,freq=3.0), product of:
             0.5022371 = queryWeight, product of:
               5.5392227 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.016870823 = queryNorm
             0.87268114 = fieldWeight in 1192, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.09375 = fieldNorm(doc=1192)
       0.2 = coord(5/25)