Document (#15694)

Author

Guglielmo, E.J.
Rowe, N.C.

Title

Natural-language retrieval of images based on descriptive captions

Source

ACM transactions on information systems. 14(1996) no.3, S.237-267

Year

1996

Abstract

Describes a prototype intelligent information retrieval system that uses natural-language understanding to efficiently locate captioned data. Multimedia data generally requires captions to explain its features and significance. Such descriptive captions often rely on long nominal compunds (strings of consecutive nouns) which create problems of ambiguous word sense. Presents a system in which captions and user queries are parsed and interpreted to produce a logical form, using a detailed theory of the meaning of nominal compounds. A fine-grain match can then compare the logical form of the query to the logical forms for each caption. To improve system efficiency, the system performs a coarse-grain match with index files, using nouns and verbs extracted from the query. Experiments with randomly selected queries and captions from an existing image library show an increase of 30% in precision and 50% in recall over the keyphrase approach currently used. Processing times have a median of 7 seconds as compared to 8 minutes for the existing system

Theme

Retrievalstudien

Form

Bilder

Similar documents (author)

1. Rowe, G.R.: Multimedia technology as the catalyst for a new form of literacy (1992) 5.94

   5.937289 = sum of:
     5.937289 = weight(author_txt:rowe in 6392) [ClassicSimilarity], result of:
       5.937289 = fieldWeight in 6392, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.625 = fieldNorm(doc=6392)
   

2. Rowe, N.C.: Inferring depictions in natural-language captions for efficient access to picture data (1994) 5.94

   5.937289 = sum of:
     5.937289 = weight(author_txt:rowe in 7296) [ClassicSimilarity], result of:
       5.937289 = fieldWeight in 7296, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.625 = fieldNorm(doc=7296)
   

3. Rowe, N.C.: Using local optimality criteria for efficient information retrieval with redundant information filters (1996) 5.94

   5.937289 = sum of:
     5.937289 = weight(author_txt:rowe in 5594) [ClassicSimilarity], result of:
       5.937289 = fieldWeight in 5594, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.625 = fieldNorm(doc=5594)
   

4. Rowe, D.E.: Is (Was) mathematics an art or a science? (2002) 5.94

   5.937289 = sum of:
     5.937289 = weight(author_txt:rowe in 6885) [ClassicSimilarity], result of:
       5.937289 = fieldWeight in 6885, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.625 = fieldNorm(doc=6885)
   

5. Rowe, N.C.: Precise and efficient retrieval of captioned images : the MARIE project (1999) 5.94

   5.937289 = sum of:
     5.937289 = weight(author_txt:rowe in 847) [ClassicSimilarity], result of:
       5.937289 = fieldWeight in 847, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.625 = fieldNorm(doc=847)
   

Similar documents (content)

1. Rowe, N.C.; Guglielma, E.J.: Exploiting captions in retrieval of multimedia data (1993) 0.45

   0.44998136 = sum of:
     0.44998136 = product of:
       1.4061918 = sum of:
         0.021841137 = weight(abstract_txt:language in 5815) [ClassicSimilarity], result of:
           0.021841137 = score(doc=5815,freq=1.0), product of:
             0.06684857 = queryWeight, product of:
               1.1141489 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.014346826 = queryNorm
             0.32672557 = fieldWeight in 5815, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         0.100104734 = weight(abstract_txt:caption in 5815) [ClassicSimilarity], result of:
           0.100104734 = score(doc=5815,freq=1.0), product of:
             0.14639796 = queryWeight, product of:
               1.1658688 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.014346826 = queryNorm
             0.683785 = fieldWeight in 5815, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         0.032078125 = weight(abstract_txt:query in 5815) [ClassicSimilarity], result of:
           0.032078125 = score(doc=5815,freq=1.0), product of:
             0.08637365 = queryWeight, product of:
               1.2664492 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.014346826 = queryNorm
             0.37138787 = fieldWeight in 5815, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         0.03913406 = weight(abstract_txt:natural in 5815) [ClassicSimilarity], result of:
           0.03913406 = score(doc=5815,freq=1.0), product of:
             0.098615505 = queryWeight, product of:
               1.3532242 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.014346826 = queryNorm
             0.39683473 = fieldWeight in 5815, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         0.06887292 = weight(abstract_txt:queries in 5815) [ClassicSimilarity], result of:
           0.06887292 = score(doc=5815,freq=3.0), product of:
             0.09967064 = queryWeight, product of:
               1.3604443 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.014346826 = queryNorm
             0.6910051 = fieldWeight in 5815, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         0.058755506 = weight(abstract_txt:descriptive in 5815) [ClassicSimilarity], result of:
           0.058755506 = score(doc=5815,freq=1.0), product of:
             0.12930273 = queryWeight, product of:
               1.5495335 = boost
               5.8163543 = idf(docFreq=357, maxDocs=44218)
               0.014346826 = queryNorm
             0.4544027 = fieldWeight in 5815, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8163543 = idf(docFreq=357, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         0.028629769 = weight(abstract_txt:system in 5815) [ClassicSimilarity], result of:
           0.028629769 = score(doc=5815,freq=1.0), product of:
             0.10866772 = queryWeight, product of:
               2.2460396 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.014346826 = queryNorm
             0.2634616 = fieldWeight in 5815, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         1.0567756 = weight(abstract_txt:captions in 5815) [ClassicSimilarity], result of:
           1.0567756 = score(doc=5815,freq=6.0), product of:
             0.66296923 = queryWeight, product of:
               5.547711 = boost
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.014346826 = queryNorm
             1.5940039 = fieldWeight in 5815, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
       0.32 = coord(8/25)
   

2. Rowe, N.C.: Inferring depictions in natural-language captions for efficient access to picture data (1994) 0.28

   0.28129727 = sum of:
     0.28129727 = product of:
       1.1720719 = sum of:
         0.026209366 = weight(abstract_txt:language in 7296) [ClassicSimilarity], result of:
           0.026209366 = score(doc=7296,freq=1.0), product of:
             0.06684857 = queryWeight, product of:
               1.1141489 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.014346826 = queryNorm
             0.3920707 = fieldWeight in 7296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.09375 = fieldNorm(doc=7296)
         0.12012567 = weight(abstract_txt:caption in 7296) [ClassicSimilarity], result of:
           0.12012567 = score(doc=7296,freq=1.0), product of:
             0.14639796 = queryWeight, product of:
               1.1658688 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.014346826 = queryNorm
             0.820542 = fieldWeight in 7296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.09375 = fieldNorm(doc=7296)
         0.046960868 = weight(abstract_txt:natural in 7296) [ClassicSimilarity], result of:
           0.046960868 = score(doc=7296,freq=1.0), product of:
             0.098615505 = queryWeight, product of:
               1.3532242 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.014346826 = queryNorm
             0.47620165 = fieldWeight in 7296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.09375 = fieldNorm(doc=7296)
         0.047716565 = weight(abstract_txt:queries in 7296) [ClassicSimilarity], result of:
           0.047716565 = score(doc=7296,freq=1.0), product of:
             0.09967064 = queryWeight, product of:
               1.3604443 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.014346826 = queryNorm
             0.47874242 = fieldWeight in 7296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.09375 = fieldNorm(doc=7296)
         0.034355722 = weight(abstract_txt:system in 7296) [ClassicSimilarity], result of:
           0.034355722 = score(doc=7296,freq=1.0), product of:
             0.10866772 = queryWeight, product of:
               2.2460396 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.014346826 = queryNorm
             0.3161539 = fieldWeight in 7296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.09375 = fieldNorm(doc=7296)
         0.8967037 = weight(abstract_txt:captions in 7296) [ClassicSimilarity], result of:
           0.8967037 = score(doc=7296,freq=3.0), product of:
             0.66296923 = queryWeight, product of:
               5.547711 = boost
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.014346826 = queryNorm
             1.3525571 = fieldWeight in 7296, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.09375 = fieldNorm(doc=7296)
       0.24 = coord(6/25)
   

3. Rowe, N.C.: Precise and efficient retrieval of captioned images : the MARIE project (1999) 0.19

   0.1892322 = sum of:
     0.1892322 = product of:
       0.946161 = sum of:
         0.100104734 = weight(abstract_txt:caption in 847) [ClassicSimilarity], result of:
           0.100104734 = score(doc=847,freq=1.0), product of:
             0.14639796 = queryWeight, product of:
               1.1658688 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.014346826 = queryNorm
             0.683785 = fieldWeight in 847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.078125 = fieldNorm(doc=847)
         0.032078125 = weight(abstract_txt:query in 847) [ClassicSimilarity], result of:
           0.032078125 = score(doc=847,freq=1.0), product of:
             0.08637365 = queryWeight, product of:
               1.2664492 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.014346826 = queryNorm
             0.37138787 = fieldWeight in 847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=847)
         0.14509292 = weight(abstract_txt:captioned in 847) [ClassicSimilarity], result of:
           0.14509292 = score(doc=847,freq=1.0), product of:
             0.18749776 = queryWeight, product of:
               1.3194113 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.014346826 = queryNorm
             0.7738381 = fieldWeight in 847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.078125 = fieldNorm(doc=847)
         0.058755506 = weight(abstract_txt:descriptive in 847) [ClassicSimilarity], result of:
           0.058755506 = score(doc=847,freq=1.0), product of:
             0.12930273 = queryWeight, product of:
               1.5495335 = boost
               5.8163543 = idf(docFreq=357, maxDocs=44218)
               0.014346826 = queryNorm
             0.4544027 = fieldWeight in 847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8163543 = idf(docFreq=357, maxDocs=44218)
               0.078125 = fieldNorm(doc=847)
         0.61012965 = weight(abstract_txt:captions in 847) [ClassicSimilarity], result of:
           0.61012965 = score(doc=847,freq=2.0), product of:
             0.66296923 = queryWeight, product of:
               5.547711 = boost
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.014346826 = queryNorm
             0.9202986 = fieldWeight in 847, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.078125 = fieldNorm(doc=847)
       0.2 = coord(5/25)
   

4. Jones, I.; Cunliffe, D.; Tudhope, D.: Natural language processing and knowledge organization systems as an aid to retrieval (2004) 0.11

   0.10913601 = sum of:
     0.10913601 = product of:
       0.45473337 = sum of:
         0.06316923 = weight(abstract_txt:ambiguous in 2677) [ClassicSimilarity], result of:
           0.06316923 = score(doc=2677,freq=1.0), product of:
             0.10770496 = queryWeight, product of:
               7.5072327 = idf(docFreq=65, maxDocs=44218)
               0.014346826 = queryNorm
             0.58650255 = fieldWeight in 2677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5072327 = idf(docFreq=65, maxDocs=44218)
               0.078125 = fieldNorm(doc=2677)
         0.021841137 = weight(abstract_txt:language in 2677) [ClassicSimilarity], result of:
           0.021841137 = score(doc=2677,freq=1.0), product of:
             0.06684857 = queryWeight, product of:
               1.1141489 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.014346826 = queryNorm
             0.32672557 = fieldWeight in 2677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=2677)
         0.08972358 = weight(abstract_txt:compounds in 2677) [ClassicSimilarity], result of:
           0.08972358 = score(doc=2677,freq=1.0), product of:
             0.13609318 = queryWeight, product of:
               1.124088 = boost
               8.43879 = idf(docFreq=25, maxDocs=44218)
               0.014346826 = queryNorm
             0.6592805 = fieldWeight in 2677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.43879 = idf(docFreq=25, maxDocs=44218)
               0.078125 = fieldNorm(doc=2677)
         0.03913406 = weight(abstract_txt:natural in 2677) [ClassicSimilarity], result of:
           0.03913406 = score(doc=2677,freq=1.0), product of:
             0.098615505 = queryWeight, product of:
               1.3532242 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.014346826 = queryNorm
             0.39683473 = fieldWeight in 2677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.078125 = fieldNorm(doc=2677)
         0.028629769 = weight(abstract_txt:system in 2677) [ClassicSimilarity], result of:
           0.028629769 = score(doc=2677,freq=1.0), product of:
             0.10866772 = queryWeight, product of:
               2.2460396 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.014346826 = queryNorm
             0.2634616 = fieldWeight in 2677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=2677)
         0.2122356 = weight(abstract_txt:nominal in 2677) [ClassicSimilarity], result of:
           0.2122356 = score(doc=2677,freq=1.0), product of:
             0.30440664 = queryWeight, product of:
               2.37752 = boost
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.014346826 = queryNorm
             0.6972108 = fieldWeight in 2677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.078125 = fieldNorm(doc=2677)
       0.24 = coord(6/25)
   

5. Green, R.: Relational aspects of subject authority control : the contributions of classificatory structure (2015) 0.11

   0.105320334 = sum of:
     0.105320334 = product of:
       0.5266017 = sum of:
         0.024710426 = weight(abstract_txt:language in 2282) [ClassicSimilarity], result of:
           0.024710426 = score(doc=2282,freq=2.0), product of:
             0.06684857 = queryWeight, product of:
               1.1141489 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.014346826 = queryNorm
             0.3696478 = fieldWeight in 2282, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=2282)
         0.08008379 = weight(abstract_txt:caption in 2282) [ClassicSimilarity], result of:
           0.08008379 = score(doc=2282,freq=1.0), product of:
             0.14639796 = queryWeight, product of:
               1.1658688 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.014346826 = queryNorm
             0.547028 = fieldWeight in 2282, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.0625 = fieldNorm(doc=2282)
         0.044275127 = weight(abstract_txt:natural in 2282) [ClassicSimilarity], result of:
           0.044275127 = score(doc=2282,freq=2.0), product of:
             0.098615505 = queryWeight, product of:
               1.3532242 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.014346826 = queryNorm
             0.44896722 = fieldWeight in 2282, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.0625 = fieldNorm(doc=2282)
         0.03239089 = weight(abstract_txt:system in 2282) [ClassicSimilarity], result of:
           0.03239089 = score(doc=2282,freq=2.0), product of:
             0.10866772 = queryWeight, product of:
               2.2460396 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.014346826 = queryNorm
             0.2980728 = fieldWeight in 2282, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=2282)
         0.34514144 = weight(abstract_txt:captions in 2282) [ClassicSimilarity], result of:
           0.34514144 = score(doc=2282,freq=1.0), product of:
             0.66296923 = queryWeight, product of:
               5.547711 = boost
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.014346826 = queryNorm
             0.5205995 = fieldWeight in 2282, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.0625 = fieldNorm(doc=2282)
       0.2 = coord(5/25)