Document (#11314)

Author

Srihari, R.K.

Title

Computational models for integrating linguistic and visual information : a survey

Source

Artificial intelligence review. 8(1994/95) nos.5/6, S.349-369

Year

1994/95

Abstract

Surveys research in developing computational models for integrating linguistic and visual information. It begins with a discussion of systems which have been actually implemented and continues with computationally motivated theories of human cognition. Since existing research spans several disciplines (eg natural language understanding, computer vision, knowledge representation), as well as several application areas, categorizes existing research based on inputs and objectives. Outlines some key issues related to integrating information from 2 such diverse sources and relates it to existing research. Throughout, the key issue addressed is the correspondence problem, ie how to associate visual events with words and vice verse

Theme

Information

Similar documents (content)

1. Partridge, D.: Language and vision : a single perception mechanism? (1995) 0.12

   0.115483284 = sum of:
     0.115483284 = product of:
       0.5774164 = sum of:
         0.012895597 = weight(abstract_txt:information in 3884) [ClassicSimilarity], result of:
           0.012895597 = score(doc=3884,freq=1.0), product of:
             0.056817878 = queryWeight, product of:
               1.1377196 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020628354 = queryNorm
             0.22696373 = fieldWeight in 3884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=3884)
         0.056988344 = weight(abstract_txt:several in 3884) [ClassicSimilarity], result of:
           0.056988344 = score(doc=3884,freq=1.0), product of:
             0.13366498 = queryWeight, product of:
               1.4248066 = boost
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.020628354 = queryNorm
             0.42635208 = fieldWeight in 3884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.09375 = fieldNorm(doc=3884)
         0.060588546 = weight(abstract_txt:models in 3884) [ClassicSimilarity], result of:
           0.060588546 = score(doc=3884,freq=1.0), product of:
             0.13923678 = queryWeight, product of:
               1.4541999 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.020628354 = queryNorm
             0.43514758 = fieldWeight in 3884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.09375 = fieldNorm(doc=3884)
         0.16933465 = weight(abstract_txt:linguistic in 3884) [ClassicSimilarity], result of:
           0.16933465 = score(doc=3884,freq=2.0), product of:
             0.21927083 = queryWeight, product of:
               1.8248936 = boost
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.020628354 = queryNorm
             0.7722626 = fieldWeight in 3884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.09375 = fieldNorm(doc=3884)
         0.27760926 = weight(abstract_txt:visual in 3884) [ClassicSimilarity], result of:
           0.27760926 = score(doc=3884,freq=3.0), product of:
             0.30486408 = queryWeight, product of:
               2.635396 = boost
               5.6078424 = idf(docFreq=440, maxDocs=44218)
               0.020628354 = queryNorm
             0.9106001 = fieldWeight in 3884, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.6078424 = idf(docFreq=440, maxDocs=44218)
               0.09375 = fieldNorm(doc=3884)
       0.2 = coord(5/25)
   

2. Multilingual information management : current levels and future abilities. A report Commissioned by the US National Science Foundation and also delivered to the European Commission's Language Engineering Office and the US Defense Advanced Research Projects Agency, April 1999 (1999) 0.11

   0.10537734 = sum of:
     0.10537734 = product of:
       0.37634763 = sum of:
         0.046186414 = weight(abstract_txt:vision in 6068) [ClassicSimilarity], result of:
           0.046186414 = score(doc=6068,freq=1.0), product of:
             0.13209364 = queryWeight, product of:
               1.001551 = boost
               6.3935823 = idf(docFreq=200, maxDocs=44218)
               0.020628354 = queryNorm
             0.34964904 = fieldWeight in 6068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3935823 = idf(docFreq=200, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6068)
         0.02127665 = weight(abstract_txt:information in 6068) [ClassicSimilarity], result of:
           0.02127665 = score(doc=6068,freq=8.0), product of:
             0.056817878 = queryWeight, product of:
               1.1377196 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020628354 = queryNorm
             0.37447104 = fieldWeight in 6068, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6068)
         0.016562039 = weight(abstract_txt:with in 6068) [ClassicSimilarity], result of:
           0.016562039 = score(doc=6068,freq=4.0), product of:
             0.0605762 = queryWeight, product of:
               1.1747454 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.020628354 = queryNorm
             0.27340835 = fieldWeight in 6068, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6068)
         0.03534332 = weight(abstract_txt:models in 6068) [ClassicSimilarity], result of:
           0.03534332 = score(doc=6068,freq=1.0), product of:
             0.13923678 = queryWeight, product of:
               1.4541999 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.020628354 = queryNorm
             0.2538361 = fieldWeight in 6068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6068)
         0.031854667 = weight(abstract_txt:research in 6068) [ClassicSimilarity], result of:
           0.031854667 = score(doc=6068,freq=2.0), product of:
             0.12991655 = queryWeight, product of:
               1.9865265 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.020628354 = queryNorm
             0.2451933 = fieldWeight in 6068, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6068)
         0.09089699 = weight(abstract_txt:computational in 6068) [ClassicSimilarity], result of:
           0.09089699 = score(doc=6068,freq=1.0), product of:
             0.26136577 = queryWeight, product of:
               1.9923768 = boost
               6.3593493 = idf(docFreq=207, maxDocs=44218)
               0.020628354 = queryNorm
             0.34777692 = fieldWeight in 6068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3593493 = idf(docFreq=207, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6068)
         0.13422754 = weight(abstract_txt:integrating in 6068) [ClassicSimilarity], result of:
           0.13422754 = score(doc=6068,freq=1.0), product of:
             0.38797814 = queryWeight, product of:
               2.97301 = boost
               6.326249 = idf(docFreq=214, maxDocs=44218)
               0.020628354 = queryNorm
             0.34596676 = fieldWeight in 6068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.326249 = idf(docFreq=214, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6068)
       0.28 = coord(7/25)
   

3. Beverley, C.A.; Bath, P.A.; Barber, R.: Can two established information models explain the information behaviour of visually impaired people seeking health and social care information? (2007) 0.10

   0.09989604 = sum of:
     0.09989604 = product of:
       0.3567716 = sum of:
         0.027186306 = weight(abstract_txt:information in 738) [ClassicSimilarity], result of:
           0.027186306 = score(doc=738,freq=10.0), product of:
             0.056817878 = queryWeight, product of:
               1.1377196 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020628354 = queryNorm
             0.47848153 = fieldWeight in 738, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=738)
         0.0133841485 = weight(abstract_txt:with in 738) [ClassicSimilarity], result of:
           0.0133841485 = score(doc=738,freq=2.0), product of:
             0.0605762 = queryWeight, product of:
               1.1747454 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.020628354 = queryNorm
             0.22094731 = fieldWeight in 738, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=738)
         0.03799223 = weight(abstract_txt:several in 738) [ClassicSimilarity], result of:
           0.03799223 = score(doc=738,freq=1.0), product of:
             0.13366498 = queryWeight, product of:
               1.4248066 = boost
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.020628354 = queryNorm
             0.28423473 = fieldWeight in 738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.0625 = fieldNorm(doc=738)
         0.040392365 = weight(abstract_txt:models in 738) [ClassicSimilarity], result of:
           0.040392365 = score(doc=738,freq=1.0), product of:
             0.13923678 = queryWeight, product of:
               1.4541999 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.020628354 = queryNorm
             0.2900984 = fieldWeight in 738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=738)
         0.02574246 = weight(abstract_txt:research in 738) [ClassicSimilarity], result of:
           0.02574246 = score(doc=738,freq=1.0), product of:
             0.12991655 = queryWeight, product of:
               1.9865265 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.020628354 = queryNorm
             0.19814612 = fieldWeight in 738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=738)
         0.060962766 = weight(abstract_txt:existing in 738) [ClassicSimilarity], result of:
           0.060962766 = score(doc=738,freq=1.0), product of:
             0.20971426 = queryWeight, product of:
               2.1857815 = boost
               4.6511106 = idf(docFreq=1147, maxDocs=44218)
               0.020628354 = queryNorm
             0.29069442 = fieldWeight in 738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6511106 = idf(docFreq=1147, maxDocs=44218)
               0.0625 = fieldNorm(doc=738)
         0.15111133 = weight(abstract_txt:visual in 738) [ClassicSimilarity], result of:
           0.15111133 = score(doc=738,freq=2.0), product of:
             0.30486408 = queryWeight, product of:
               2.635396 = boost
               5.6078424 = idf(docFreq=440, maxDocs=44218)
               0.020628354 = queryNorm
             0.4956679 = fieldWeight in 738, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6078424 = idf(docFreq=440, maxDocs=44218)
               0.0625 = fieldNorm(doc=738)
       0.28 = coord(7/25)
   

4. Luhmann, J.; Burghardt, M.: Digital humanities - A discipline in its own right? : an analysis of the role and position of digital humanities in the academic landscape (2022) 0.10

   0.09929892 = sum of:
     0.09929892 = product of:
       0.354639 = sum of:
         0.008597065 = weight(abstract_txt:information in 460) [ClassicSimilarity], result of:
           0.008597065 = score(doc=460,freq=1.0), product of:
             0.056817878 = queryWeight, product of:
               1.1377196 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020628354 = queryNorm
             0.15130915 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=460)
         0.016392166 = weight(abstract_txt:with in 460) [ClassicSimilarity], result of:
           0.016392166 = score(doc=460,freq=3.0), product of:
             0.0605762 = queryWeight, product of:
               1.1747454 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.020628354 = queryNorm
             0.27060407 = fieldWeight in 460, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=460)
         0.040392365 = weight(abstract_txt:models in 460) [ClassicSimilarity], result of:
           0.040392365 = score(doc=460,freq=1.0), product of:
             0.13923678 = queryWeight, product of:
               1.4541999 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.020628354 = queryNorm
             0.2900984 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=460)
         0.079825126 = weight(abstract_txt:linguistic in 460) [ClassicSimilarity], result of:
           0.079825126 = score(doc=460,freq=1.0), product of:
             0.21927083 = queryWeight, product of:
               1.8248936 = boost
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.020628354 = queryNorm
             0.3640481 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.0625 = fieldNorm(doc=460)
         0.044587247 = weight(abstract_txt:research in 460) [ClassicSimilarity], result of:
           0.044587247 = score(doc=460,freq=3.0), product of:
             0.12991655 = queryWeight, product of:
               1.9865265 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.020628354 = queryNorm
             0.34319913 = fieldWeight in 460, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=460)
         0.10388226 = weight(abstract_txt:computational in 460) [ClassicSimilarity], result of:
           0.10388226 = score(doc=460,freq=1.0), product of:
             0.26136577 = queryWeight, product of:
               1.9923768 = boost
               6.3593493 = idf(docFreq=207, maxDocs=44218)
               0.020628354 = queryNorm
             0.39745933 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3593493 = idf(docFreq=207, maxDocs=44218)
               0.0625 = fieldNorm(doc=460)
         0.060962766 = weight(abstract_txt:existing in 460) [ClassicSimilarity], result of:
           0.060962766 = score(doc=460,freq=1.0), product of:
             0.20971426 = queryWeight, product of:
               2.1857815 = boost
               4.6511106 = idf(docFreq=1147, maxDocs=44218)
               0.020628354 = queryNorm
             0.29069442 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6511106 = idf(docFreq=1147, maxDocs=44218)
               0.0625 = fieldNorm(doc=460)
       0.28 = coord(7/25)
   

5. Zhang, P.; Soergel, D.: Towards a comprehensive model of the cognitive process and mechanisms of individual sensemaking (2014) 0.10

   0.096776 = sum of:
     0.096776 = product of:
       0.40323335 = sum of:
         0.07203235 = weight(abstract_txt:cognition in 1344) [ClassicSimilarity], result of:
           0.07203235 = score(doc=1344,freq=1.0), product of:
             0.16251601 = queryWeight, product of:
               1.1109134 = boost
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.020628354 = queryNorm
             0.44323233 = fieldWeight in 1344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.0625 = fieldNorm(doc=1344)
         0.012158086 = weight(abstract_txt:information in 1344) [ClassicSimilarity], result of:
           0.012158086 = score(doc=1344,freq=2.0), product of:
             0.056817878 = queryWeight, product of:
               1.1377196 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.020628354 = queryNorm
             0.21398345 = fieldWeight in 1344, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=1344)
         0.009464022 = weight(abstract_txt:with in 1344) [ClassicSimilarity], result of:
           0.009464022 = score(doc=1344,freq=1.0), product of:
             0.0605762 = queryWeight, product of:
               1.1747454 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.020628354 = queryNorm
             0.15623334 = fieldWeight in 1344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=1344)
         0.06996162 = weight(abstract_txt:models in 1344) [ClassicSimilarity], result of:
           0.06996162 = score(doc=1344,freq=3.0), product of:
             0.13923678 = queryWeight, product of:
               1.4541999 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.020628354 = queryNorm
             0.5024651 = fieldWeight in 1344, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=1344)
         0.08621436 = weight(abstract_txt:existing in 1344) [ClassicSimilarity], result of:
           0.08621436 = score(doc=1344,freq=2.0), product of:
             0.20971426 = queryWeight, product of:
               2.1857815 = boost
               4.6511106 = idf(docFreq=1147, maxDocs=44218)
               0.020628354 = queryNorm
             0.41110396 = fieldWeight in 1344, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6511106 = idf(docFreq=1147, maxDocs=44218)
               0.0625 = fieldNorm(doc=1344)
         0.1534029 = weight(abstract_txt:integrating in 1344) [ClassicSimilarity], result of:
           0.1534029 = score(doc=1344,freq=1.0), product of:
             0.38797814 = queryWeight, product of:
               2.97301 = boost
               6.326249 = idf(docFreq=214, maxDocs=44218)
               0.020628354 = queryNorm
             0.39539057 = fieldWeight in 1344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.326249 = idf(docFreq=214, maxDocs=44218)
               0.0625 = fieldNorm(doc=1344)
       0.24 = coord(6/25)