Document (#37662)

Author
Ostermann, F.O.
Tomko, M.
Purves, R.
Title
User evaluation of automatically generated keywords and toponyms for geo-referenced images
Source
Journal of the American Society for Information Science and Technology. 64(2013) no.3, S.480-499
Year
2013
Abstract
This article presents the results of a user evaluation of automatically generated concept keywords and place names (toponyms) for geo-referenced images. Automatically annotating images is becoming indispensable for effective information retrieval, since the number of geo-referenced images available online is growing, yet many images are insufficiently tagged or captioned to be efficiently searchable by standard information retrieval procedures. The Tripod project developed original methods for automatically annotating geo-referenced images by generating representations of the likely visible footprint of a geo-referenced image, and using this footprint to query spatial databases and web resources. These queries return raw lists of potential keywords and toponyms, which are subsequently filtered and ranked. This article reports on user experiments designed to evaluate the quality of the generated annotations. The experiments combined quantitative and qualitative approaches: To retrieve a large number of responses, participants rated the annotations in standardized online questionnaires that showed an image and its corresponding keywords. In addition, several focus groups provided rich qualitative information in open discussions. The results of the evaluation show that currently the annotation method performs better on rural images than on urban ones. Further, for each image at least one suitable keyword could be generated. The integration of heterogeneous data sources resulted in some images having a high level of noise in the form of obviously wrong or spurious keywords. The article discusses the evaluation itself and methods to improve the automatic generation of annotations.
Field
Geowissenschaften
Form
Bilder

Similar documents (author)

  1. Purves, R.S.; Sanderson, M.: ¬A methodology to allow avalanche forecasting on an information retrieval system (1998) 4.95
    4.9450216 = sum of:
      4.9450216 = weight(author_txt:purves in 2071) [ClassicSimilarity], result of:
        4.9450216 = fieldWeight in 2071, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.890043 = idf(docFreq=5, maxDocs=43556)
          0.5 = fieldNorm(doc=2071)
    
  2. Purves, D.; Lotto, R.B.; Nundy, S.: Richtiges Sehen - eine optische Täuschung? (2003) 3.71
    3.7087662 = sum of:
      3.7087662 = weight(author_txt:purves in 2889) [ClassicSimilarity], result of:
        3.7087662 = fieldWeight in 2889, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.890043 = idf(docFreq=5, maxDocs=43556)
          0.375 = fieldNorm(doc=2889)
    
  3. Purves, R.S.; Winter, S.; Kuhn, W.: Places in information science (2019) 3.71
    3.7087662 = sum of:
      3.7087662 = weight(author_txt:purves in 1719) [ClassicSimilarity], result of:
        3.7087662 = fieldWeight in 1719, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.890043 = idf(docFreq=5, maxDocs=43556)
          0.375 = fieldNorm(doc=1719)
    
  4. Reichenbacher, T.; Sabbata, S. de; Purves, R.S.; Fabrikant, S.I.: Assessing geographic relevance for mobile search : a computational model and its validation via crowdsourcing (2016) 3.09
    3.0906386 = sum of:
      3.0906386 = weight(author_txt:purves in 143) [ClassicSimilarity], result of:
        3.0906386 = fieldWeight in 143, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.890043 = idf(docFreq=5, maxDocs=43556)
          0.3125 = fieldNorm(doc=143)
    

Similar documents (content)

  1. Tsai, C.-F.; McGarry, K.; Tait, J.: Qualitative evaluation of automatic assignment of keywords to images (2006) 0.28
    0.28251147 = sum of:
      0.28251147 = product of:
        0.7847541 = sum of:
          0.0287295 = weight(abstract_txt:methods in 2961) [ClassicSimilarity], result of:
            0.0287295 = score(doc=2961,freq=4.0), product of:
              0.055271342 = queryWeight, product of:
                1.0530578 = boost
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.012622046 = queryNorm
              0.5197902 = fieldWeight in 2961, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.0625 = fieldNorm(doc=2961)
          0.021133468 = weight(abstract_txt:user in 2961) [ClassicSimilarity], result of:
            0.021133468 = score(doc=2961,freq=2.0), product of:
              0.06495844 = queryWeight, product of:
                1.3981881 = boost
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.012622046 = queryNorm
              0.3253383 = fieldWeight in 2961, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.0625 = fieldNorm(doc=2961)
          0.034529317 = weight(abstract_txt:qualitative in 2961) [ClassicSimilarity], result of:
            0.034529317 = score(doc=2961,freq=1.0), product of:
              0.09918057 = queryWeight, product of:
                1.4106377 = boost
                5.5703354 = idf(docFreq=450, maxDocs=43556)
                0.012622046 = queryNorm
              0.34814596 = fieldWeight in 2961, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5703354 = idf(docFreq=450, maxDocs=43556)
                0.0625 = fieldNorm(doc=2961)
          0.080541015 = weight(abstract_txt:image in 2961) [ClassicSimilarity], result of:
            0.080541015 = score(doc=2961,freq=3.0), product of:
              0.13845311 = queryWeight, product of:
                2.041264 = boost
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.012622046 = queryNorm
              0.58172053 = fieldWeight in 2961, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.0625 = fieldNorm(doc=2961)
          0.102527715 = weight(abstract_txt:evaluation in 2961) [ClassicSimilarity], result of:
            0.102527715 = score(doc=2961,freq=8.0), product of:
              0.129075 = queryWeight, product of:
                2.275822 = boost
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.012622046 = queryNorm
              0.79432666 = fieldWeight in 2961, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.0625 = fieldNorm(doc=2961)
          0.06691862 = weight(abstract_txt:automatically in 2961) [ClassicSimilarity], result of:
            0.06691862 = score(doc=2961,freq=1.0), product of:
              0.19424176 = queryWeight, product of:
                2.791827 = boost
                5.5121922 = idf(docFreq=477, maxDocs=43556)
                0.012622046 = queryNorm
              0.34451202 = fieldWeight in 2961, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5121922 = idf(docFreq=477, maxDocs=43556)
                0.0625 = fieldNorm(doc=2961)
          0.11968291 = weight(abstract_txt:annotations in 2961) [ClassicSimilarity], result of:
            0.11968291 = score(doc=2961,freq=1.0), product of:
              0.2600278 = queryWeight, product of:
                2.7974203 = boost
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.012622046 = queryNorm
              0.46026966 = fieldWeight in 2961, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.0625 = fieldNorm(doc=2961)
          0.11004549 = weight(abstract_txt:keywords in 2961) [ClassicSimilarity], result of:
            0.11004549 = score(doc=2961,freq=1.0), product of:
              0.29151627 = queryWeight, product of:
                3.8238742 = boost
                6.0398955 = idf(docFreq=281, maxDocs=43556)
                0.012622046 = queryNorm
              0.37749347 = fieldWeight in 2961, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.0398955 = idf(docFreq=281, maxDocs=43556)
                0.0625 = fieldNorm(doc=2961)
          0.22064608 = weight(abstract_txt:images in 2961) [ClassicSimilarity], result of:
            0.22064608 = score(doc=2961,freq=3.0), product of:
              0.37590522 = queryWeight, product of:
                5.4925165 = boost
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.012622046 = queryNorm
              0.58697265 = fieldWeight in 2961, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.0625 = fieldNorm(doc=2961)
        0.36 = coord(9/25)
    
  2. Jörgensen, C.; Jaimes, A.; Benitez, A.B.; Chang, S.-F.: ¬A conceptual framework and empirical research for classifying visual descriptors (2001) 0.12
    0.123464555 = sum of:
      0.123464555 = product of:
        0.51443565 = sum of:
          0.05273276 = weight(abstract_txt:experiments in 530) [ClassicSimilarity], result of:
            0.05273276 = score(doc=530,freq=3.0), product of:
              0.09119713 = queryWeight, product of:
                1.3526729 = boost
                5.3414435 = idf(docFreq=566, maxDocs=43556)
                0.012622046 = queryNorm
              0.57822824 = fieldWeight in 530, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.3414435 = idf(docFreq=566, maxDocs=43556)
                0.0625 = fieldNorm(doc=530)
          0.01670518 = weight(abstract_txt:article in 530) [ClassicSimilarity], result of:
            0.01670518 = score(doc=530,freq=1.0), product of:
              0.06996795 = queryWeight, product of:
                1.4511001 = boost
                3.8200758 = idf(docFreq=2595, maxDocs=43556)
                0.012622046 = queryNorm
              0.23875473 = fieldWeight in 530, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.8200758 = idf(docFreq=2595, maxDocs=43556)
                0.0625 = fieldNorm(doc=530)
          0.080541015 = weight(abstract_txt:image in 530) [ClassicSimilarity], result of:
            0.080541015 = score(doc=530,freq=3.0), product of:
              0.13845311 = queryWeight, product of:
                2.041264 = boost
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.012622046 = queryNorm
              0.58172053 = fieldWeight in 530, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.0625 = fieldNorm(doc=530)
          0.06691862 = weight(abstract_txt:automatically in 530) [ClassicSimilarity], result of:
            0.06691862 = score(doc=530,freq=1.0), product of:
              0.19424176 = queryWeight, product of:
                2.791827 = boost
                5.5121922 = idf(docFreq=477, maxDocs=43556)
                0.012622046 = queryNorm
              0.34451202 = fieldWeight in 530, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5121922 = idf(docFreq=477, maxDocs=43556)
                0.0625 = fieldNorm(doc=530)
          0.117381275 = weight(abstract_txt:generated in 530) [ClassicSimilarity], result of:
            0.117381275 = score(doc=530,freq=3.0), product of:
              0.19588602 = queryWeight, product of:
                2.8036184 = boost
                5.5354733 = idf(docFreq=466, maxDocs=43556)
                0.012622046 = queryNorm
              0.59923255 = fieldWeight in 530, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.5354733 = idf(docFreq=466, maxDocs=43556)
                0.0625 = fieldNorm(doc=530)
          0.18015677 = weight(abstract_txt:images in 530) [ClassicSimilarity], result of:
            0.18015677 = score(doc=530,freq=2.0), product of:
              0.37590522 = queryWeight, product of:
                5.4925165 = boost
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.012622046 = queryNorm
              0.47926116 = fieldWeight in 530, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.0625 = fieldNorm(doc=530)
        0.24 = coord(6/25)
    
  3. Rasmussen, E.M.: Indexing images (1997) 0.12
    0.11907265 = sum of:
      0.11907265 = product of:
        0.59536326 = sum of:
          0.017955938 = weight(abstract_txt:methods in 3213) [ClassicSimilarity], result of:
            0.017955938 = score(doc=3213,freq=1.0), product of:
              0.055271342 = queryWeight, product of:
                1.0530578 = boost
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.012622046 = queryNorm
              0.32486886 = fieldWeight in 3213, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.078125 = fieldNorm(doc=3213)
          0.12997252 = weight(abstract_txt:image in 3213) [ClassicSimilarity], result of:
            0.12997252 = score(doc=3213,freq=5.0), product of:
              0.13845311 = queryWeight, product of:
                2.041264 = boost
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.012622046 = queryNorm
              0.9387475 = fieldWeight in 3213, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.078125 = fieldNorm(doc=3213)
          0.045311276 = weight(abstract_txt:evaluation in 3213) [ClassicSimilarity], result of:
            0.045311276 = score(doc=3213,freq=1.0), product of:
              0.129075 = queryWeight, product of:
                2.275822 = boost
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.012622046 = queryNorm
              0.3510461 = fieldWeight in 3213, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.078125 = fieldNorm(doc=3213)
          0.08364827 = weight(abstract_txt:automatically in 3213) [ClassicSimilarity], result of:
            0.08364827 = score(doc=3213,freq=1.0), product of:
              0.19424176 = queryWeight, product of:
                2.791827 = boost
                5.5121922 = idf(docFreq=477, maxDocs=43556)
                0.012622046 = queryNorm
              0.43064 = fieldWeight in 3213, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5121922 = idf(docFreq=477, maxDocs=43556)
                0.078125 = fieldNorm(doc=3213)
          0.31847522 = weight(abstract_txt:images in 3213) [ClassicSimilarity], result of:
            0.31847522 = score(doc=3213,freq=4.0), product of:
              0.37590522 = queryWeight, product of:
                5.4925165 = boost
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.012622046 = queryNorm
              0.8472221 = fieldWeight in 3213, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.078125 = fieldNorm(doc=3213)
        0.2 = coord(5/25)
    
  4. Rowe, N.C.: Precise and efficient retrieval of captioned images : the MARIE project (1999) 0.12
    0.11698275 = sum of:
      0.11698275 = product of:
        0.58491373 = sum of:
          0.02539353 = weight(abstract_txt:methods in 1970) [ClassicSimilarity], result of:
            0.02539353 = score(doc=1970,freq=2.0), product of:
              0.055271342 = queryWeight, product of:
                1.0530578 = boost
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.012622046 = queryNorm
              0.45943394 = fieldWeight in 1970, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.078125 = fieldNorm(doc=1970)
          0.12078654 = weight(abstract_txt:captioned in 1970) [ClassicSimilarity], result of:
            0.12078654 = score(doc=1970,freq=1.0), product of:
              0.15632567 = queryWeight, product of:
                1.2522826 = boost
                9.890043 = idf(docFreq=5, maxDocs=43556)
                0.012622046 = queryNorm
              0.77265966 = fieldWeight in 1970, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.890043 = idf(docFreq=5, maxDocs=43556)
                0.078125 = fieldNorm(doc=1970)
          0.03805659 = weight(abstract_txt:experiments in 1970) [ClassicSimilarity], result of:
            0.03805659 = score(doc=1970,freq=1.0), product of:
              0.09119713 = queryWeight, product of:
                1.3526729 = boost
                5.3414435 = idf(docFreq=566, maxDocs=43556)
                0.012622046 = queryNorm
              0.41730028 = fieldWeight in 1970, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3414435 = idf(docFreq=566, maxDocs=43556)
                0.078125 = fieldNorm(doc=1970)
          0.08220183 = weight(abstract_txt:image in 1970) [ClassicSimilarity], result of:
            0.08220183 = score(doc=1970,freq=2.0), product of:
              0.13845311 = queryWeight, product of:
                2.041264 = boost
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.012622046 = queryNorm
              0.593716 = fieldWeight in 1970, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.078125 = fieldNorm(doc=1970)
          0.31847522 = weight(abstract_txt:images in 1970) [ClassicSimilarity], result of:
            0.31847522 = score(doc=1970,freq=4.0), product of:
              0.37590522 = queryWeight, product of:
                5.4925165 = boost
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.012622046 = queryNorm
              0.8472221 = fieldWeight in 1970, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.078125 = fieldNorm(doc=1970)
        0.2 = coord(5/25)
    
  5. Dolin, R.; Agrawal, D.; El Abbadi, A.; Pearlman, J.: Using automated classification for summarizing and selecting heterogeneous information sources (1998) 0.12
    0.11677815 = sum of:
      0.11677815 = product of:
        0.36493173 = sum of:
          0.0070103407 = weight(abstract_txt:number in 3251) [ClassicSimilarity], result of:
            0.0070103407 = score(doc=3251,freq=1.0), product of:
              0.054385196 = queryWeight, product of:
                1.044582 = boost
                4.124852 = idf(docFreq=1913, maxDocs=43556)
                0.012622046 = queryNorm
              0.12890163 = fieldWeight in 3251, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.124852 = idf(docFreq=1913, maxDocs=43556)
                0.03125 = fieldNorm(doc=3251)
          0.007182375 = weight(abstract_txt:methods in 3251) [ClassicSimilarity], result of:
            0.007182375 = score(doc=3251,freq=1.0), product of:
              0.055271342 = queryWeight, product of:
                1.0530578 = boost
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.012622046 = queryNorm
              0.12994754 = fieldWeight in 3251, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1583214 = idf(docFreq=1850, maxDocs=43556)
                0.03125 = fieldNorm(doc=3251)
          0.010566734 = weight(abstract_txt:user in 3251) [ClassicSimilarity], result of:
            0.010566734 = score(doc=3251,freq=2.0), product of:
              0.06495844 = queryWeight, product of:
                1.3981881 = boost
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.012622046 = queryNorm
              0.16266915 = fieldWeight in 3251, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.03125 = fieldNorm(doc=3251)
          0.02325019 = weight(abstract_txt:image in 3251) [ClassicSimilarity], result of:
            0.02325019 = score(doc=3251,freq=1.0), product of:
              0.13845311 = queryWeight, product of:
                2.041264 = boost
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.012622046 = queryNorm
              0.16792826 = fieldWeight in 3251, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3737044 = idf(docFreq=548, maxDocs=43556)
                0.03125 = fieldNorm(doc=3251)
          0.06691862 = weight(abstract_txt:automatically in 3251) [ClassicSimilarity], result of:
            0.06691862 = score(doc=3251,freq=4.0), product of:
              0.19424176 = queryWeight, product of:
                2.791827 = boost
                5.5121922 = idf(docFreq=477, maxDocs=43556)
                0.012622046 = queryNorm
              0.34451202 = fieldWeight in 3251, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.5121922 = idf(docFreq=477, maxDocs=43556)
                0.03125 = fieldNorm(doc=3251)
          0.055022746 = weight(abstract_txt:keywords in 3251) [ClassicSimilarity], result of:
            0.055022746 = score(doc=3251,freq=1.0), product of:
              0.29151627 = queryWeight, product of:
                3.8238742 = boost
                6.0398955 = idf(docFreq=281, maxDocs=43556)
                0.012622046 = queryNorm
              0.18874674 = fieldWeight in 3251, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.0398955 = idf(docFreq=281, maxDocs=43556)
                0.03125 = fieldNorm(doc=3251)
          0.13128568 = weight(abstract_txt:referenced in 3251) [ClassicSimilarity], result of:
            0.13128568 = score(doc=3251,freq=1.0), product of:
              0.5205305 = queryWeight, product of:
                5.109699 = boost
                8.070885 = idf(docFreq=36, maxDocs=43556)
                0.012622046 = queryNorm
              0.25221515 = fieldWeight in 3251, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.070885 = idf(docFreq=36, maxDocs=43556)
                0.03125 = fieldNorm(doc=3251)
          0.063695036 = weight(abstract_txt:images in 3251) [ClassicSimilarity], result of:
            0.063695036 = score(doc=3251,freq=1.0), product of:
              0.37590522 = queryWeight, product of:
                5.4925165 = boost
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.012622046 = queryNorm
              0.16944441 = fieldWeight in 3251, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.422221 = idf(docFreq=522, maxDocs=43556)
                0.03125 = fieldNorm(doc=3251)
        0.32 = coord(8/25)