Document (#41687)

Author
Kim, H.H.
Kim, Y.H.
Title
Video summarization using event-related potential responses to shot boundaries in real-time video watching
Source
Journal of the Association for Information Science and Technology. 70(2019) no.2, S.164-175
Year
2019
Abstract
Our aim was to develop an event-related potential (ERP)-based method to construct a video skim consisting of key shots to bridge the semantic gap between the topic inferred from a whole video and that from its summary. Mayer's cognitive model was examined, wherein the topic integration process of a user evoked by a visual stimulus can be associated with long-latency ERP components. We determined that long-latency ERP components are suitable for measuring a user's neuronal response through a literature review. We hypothesized that N300 is specific to the categorization of all shots regardless of topic relevance, N400 is specific for the semantic mismatching process for topic-irrelevant shots, and P600 is specific for the context updating process for topic-relevant shots. In our experiment, the N400 component led to more negative ERP signals in response to topic-irrelevant shots than to topic-relevant shots and showed a fronto-central scalp pattern. P600 elicited more positive ERP signals for topic-relevant shots than for topic-irrelevant shots and showed a fronto-central scalp pattern. We used discriminant and artificial neural network (ANN) analyses to decode video shot relevance and observed that the ANN produced particularly high success rates: 91.3% from the training set and 100% from the test set.
Content
Vgl.: https://onlinelibrary.wiley.com/doi/10.1002/asi.24103.
Theme
Automatisches Abstracting
Form
Videos

Similar documents (content)

  1. Chua, T.-S.; Ruan, L.-Q.: ¬A video retrieval and sequencing system (1995) 0.35
    0.3488102 = sum of:
      0.3488102 = product of:
        1.4533758 = sum of:
          0.020450344 = weight(abstract_txt:process in 3907) [ClassicSimilarity], result of:
            0.020450344 = score(doc=3907,freq=1.0), product of:
              0.06382558 = queryWeight, product of:
                1.376801 = boost
                4.1012464 = idf(docFreq=1887, maxDocs=41962)
                0.011303364 = queryNorm
              0.32040986 = fieldWeight in 3907, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1012464 = idf(docFreq=1887, maxDocs=41962)
                0.078125 = fieldNorm(doc=3907)
          0.024233906 = weight(abstract_txt:specific in 3907) [ClassicSimilarity], result of:
            0.024233906 = score(doc=3907,freq=1.0), product of:
              0.0714732 = queryWeight, product of:
                1.4569526 = boost
                4.340004 = idf(docFreq=1486, maxDocs=41962)
                0.011303364 = queryNorm
              0.3390628 = fieldWeight in 3907, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.340004 = idf(docFreq=1486, maxDocs=41962)
                0.078125 = fieldNorm(doc=3907)
          0.03024815 = weight(abstract_txt:relevant in 3907) [ClassicSimilarity], result of:
            0.03024815 = score(doc=3907,freq=1.0), product of:
              0.08285655 = queryWeight, product of:
                1.5686903 = boost
                4.672851 = idf(docFreq=1065, maxDocs=41962)
                0.011303364 = queryNorm
              0.3650665 = fieldWeight in 3907, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.672851 = idf(docFreq=1065, maxDocs=41962)
                0.078125 = fieldNorm(doc=3907)
          0.13520186 = weight(abstract_txt:shot in 3907) [ClassicSimilarity], result of:
            0.13520186 = score(doc=3907,freq=1.0), product of:
              0.1964049 = queryWeight, product of:
                1.9719882 = boost
                8.811306 = idf(docFreq=16, maxDocs=41962)
                0.011303364 = queryNorm
              0.6883833 = fieldWeight in 3907, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.811306 = idf(docFreq=16, maxDocs=41962)
                0.078125 = fieldNorm(doc=3907)
          0.32464662 = weight(abstract_txt:video in 3907) [ClassicSimilarity], result of:
            0.32464662 = score(doc=3907,freq=8.0), product of:
              0.23899446 = queryWeight, product of:
                3.4394743 = boost
                6.1473513 = idf(docFreq=243, maxDocs=41962)
                0.011303364 = queryNorm
              1.3583856 = fieldWeight in 3907, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                6.1473513 = idf(docFreq=243, maxDocs=41962)
                0.078125 = fieldNorm(doc=3907)
          0.9185949 = weight(abstract_txt:shots in 3907) [ClassicSimilarity], result of:
            0.9185949 = score(doc=3907,freq=3.0), product of:
              0.7754602 = queryWeight, product of:
                7.8367844 = boost
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.011303364 = queryNorm
              1.1845803 = fieldWeight in 3907, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.078125 = fieldNorm(doc=3907)
        0.24 = coord(6/25)
    
  2. Kannan, R.; Ghinea, G.; Swaminathan, S.: What do you wish to see? : A summarization system for movies based on user preferences (2015) 0.27
    0.2731416 = sum of:
      0.2731416 = product of:
        0.97550565 = sum of:
          0.014244618 = weight(abstract_txt:potential in 4684) [ClassicSimilarity], result of:
            0.014244618 = score(doc=4684,freq=1.0), product of:
              0.055573244 = queryWeight, product of:
                1.0489651 = boost
                4.687022 = idf(docFreq=1050, maxDocs=41962)
                0.011303364 = queryNorm
              0.25632152 = fieldWeight in 4684, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.687022 = idf(docFreq=1050, maxDocs=41962)
                0.0546875 = fieldNorm(doc=4684)
          0.003883665 = weight(abstract_txt:that in 4684) [ClassicSimilarity], result of:
            0.003883665 = score(doc=4684,freq=1.0), product of:
              0.029439904 = queryWeight, product of:
                1.0797205 = boost
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.011303364 = queryNorm
              0.1319184 = fieldWeight in 4684, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.0546875 = fieldNorm(doc=4684)
          0.016804148 = weight(abstract_txt:relevance in 4684) [ClassicSimilarity], result of:
            0.016804148 = score(doc=4684,freq=1.0), product of:
              0.062045388 = queryWeight, product of:
                1.1083653 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.011303364 = queryNorm
              0.27083635 = fieldWeight in 4684, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0546875 = fieldNorm(doc=4684)
          0.0061089788 = weight(abstract_txt:from in 4684) [ClassicSimilarity], result of:
            0.0061089788 = score(doc=4684,freq=1.0), product of:
              0.03981875 = queryWeight, product of:
                1.2557031 = boost
                2.805388 = idf(docFreq=6898, maxDocs=41962)
                0.011303364 = queryNorm
              0.15341966 = fieldWeight in 4684, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.805388 = idf(docFreq=6898, maxDocs=41962)
                0.0546875 = fieldNorm(doc=4684)
          0.0946413 = weight(abstract_txt:shot in 4684) [ClassicSimilarity], result of:
            0.0946413 = score(doc=4684,freq=1.0), product of:
              0.1964049 = queryWeight, product of:
                1.9719882 = boost
                8.811306 = idf(docFreq=16, maxDocs=41962)
                0.011303364 = queryNorm
              0.4818683 = fieldWeight in 4684, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.811306 = idf(docFreq=16, maxDocs=41962)
                0.0546875 = fieldNorm(doc=4684)
          0.19680656 = weight(abstract_txt:video in 4684) [ClassicSimilarity], result of:
            0.19680656 = score(doc=4684,freq=6.0), product of:
              0.23899446 = queryWeight, product of:
                3.4394743 = boost
                6.1473513 = idf(docFreq=243, maxDocs=41962)
                0.011303364 = queryNorm
              0.8234775 = fieldWeight in 4684, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.1473513 = idf(docFreq=243, maxDocs=41962)
                0.0546875 = fieldNorm(doc=4684)
          0.6430164 = weight(abstract_txt:shots in 4684) [ClassicSimilarity], result of:
            0.6430164 = score(doc=4684,freq=3.0), product of:
              0.7754602 = queryWeight, product of:
                7.8367844 = boost
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.011303364 = queryNorm
              0.8292062 = fieldWeight in 4684, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.0546875 = fieldNorm(doc=4684)
        0.28 = coord(7/25)
    
  3. Turner, J.M.: Comparing user-assigned terms with indexer-assigned terms for storage and retrieval of moving images : research results (1995) 0.25
    0.25455353 = sum of:
      0.25455353 = product of:
        1.5909595 = sum of:
          0.018138964 = weight(abstract_txt:from in 3900) [ClassicSimilarity], result of:
            0.018138964 = score(doc=3900,freq=3.0), product of:
              0.03981875 = queryWeight, product of:
                1.2557031 = boost
                2.805388 = idf(docFreq=6898, maxDocs=41962)
                0.011303364 = queryNorm
              0.45553824 = fieldWeight in 3900, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.805388 = idf(docFreq=6898, maxDocs=41962)
                0.09375 = fieldNorm(doc=3900)
          0.16224222 = weight(abstract_txt:shot in 3900) [ClassicSimilarity], result of:
            0.16224222 = score(doc=3900,freq=1.0), product of:
              0.1964049 = queryWeight, product of:
                1.9719882 = boost
                8.811306 = idf(docFreq=16, maxDocs=41962)
                0.011303364 = queryNorm
              0.82605994 = fieldWeight in 3900, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.811306 = idf(docFreq=16, maxDocs=41962)
                0.09375 = fieldNorm(doc=3900)
          0.1377359 = weight(abstract_txt:video in 3900) [ClassicSimilarity], result of:
            0.1377359 = score(doc=3900,freq=1.0), product of:
              0.23899446 = queryWeight, product of:
                3.4394743 = boost
                6.1473513 = idf(docFreq=243, maxDocs=41962)
                0.011303364 = queryNorm
              0.5763142 = fieldWeight in 3900, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.1473513 = idf(docFreq=243, maxDocs=41962)
                0.09375 = fieldNorm(doc=3900)
          1.2728424 = weight(abstract_txt:shots in 3900) [ClassicSimilarity], result of:
            1.2728424 = score(doc=3900,freq=4.0), product of:
              0.7754602 = queryWeight, product of:
                7.8367844 = boost
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.011303364 = queryNorm
              1.6414027 = fieldWeight in 3900, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.09375 = fieldNorm(doc=3900)
        0.16 = coord(4/25)
    
  4. Turner, J.M.: Cross-language transfer of indexing concepts for storage and retrieval of moving images : preliminary results (1996) 0.17
    0.17006557 = sum of:
      0.17006557 = product of:
        0.85032785 = sum of:
          0.03453417 = weight(abstract_txt:potential in 470) [ClassicSimilarity], result of:
            0.03453417 = score(doc=470,freq=2.0), product of:
              0.055573244 = queryWeight, product of:
                1.0489651 = boost
                4.687022 = idf(docFreq=1050, maxDocs=41962)
                0.011303364 = queryNorm
              0.6214172 = fieldWeight in 470, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.687022 = idf(docFreq=1050, maxDocs=41962)
                0.09375 = fieldNorm(doc=470)
          0.0066577117 = weight(abstract_txt:that in 470) [ClassicSimilarity], result of:
            0.0066577117 = score(doc=470,freq=1.0), product of:
              0.029439904 = queryWeight, product of:
                1.0797205 = boost
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.011303364 = queryNorm
              0.22614583 = fieldWeight in 470, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.09375 = fieldNorm(doc=470)
          0.010472535 = weight(abstract_txt:from in 470) [ClassicSimilarity], result of:
            0.010472535 = score(doc=470,freq=1.0), product of:
              0.03981875 = queryWeight, product of:
                1.2557031 = boost
                2.805388 = idf(docFreq=6898, maxDocs=41962)
                0.011303364 = queryNorm
              0.26300514 = fieldWeight in 470, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.805388 = idf(docFreq=6898, maxDocs=41962)
                0.09375 = fieldNorm(doc=470)
          0.16224222 = weight(abstract_txt:shot in 470) [ClassicSimilarity], result of:
            0.16224222 = score(doc=470,freq=1.0), product of:
              0.1964049 = queryWeight, product of:
                1.9719882 = boost
                8.811306 = idf(docFreq=16, maxDocs=41962)
                0.011303364 = queryNorm
              0.82605994 = fieldWeight in 470, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.811306 = idf(docFreq=16, maxDocs=41962)
                0.09375 = fieldNorm(doc=470)
          0.6364212 = weight(abstract_txt:shots in 470) [ClassicSimilarity], result of:
            0.6364212 = score(doc=470,freq=1.0), product of:
              0.7754602 = queryWeight, product of:
                7.8367844 = boost
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.011303364 = queryNorm
              0.82070136 = fieldWeight in 470, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.09375 = fieldNorm(doc=470)
        0.2 = coord(5/25)
    
  5. Wittbrock, M.J.; Hauptmann, A.G.: Speech recognition for a digital video library (1998) 0.17
    0.16652913 = sum of:
      0.16652913 = product of:
        0.6938714 = sum of:
          0.00992473 = weight(abstract_txt:that in 2287) [ClassicSimilarity], result of:
            0.00992473 = score(doc=2287,freq=5.0), product of:
              0.029439904 = queryWeight, product of:
                1.0797205 = boost
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.011303364 = queryNorm
              0.3371183 = fieldWeight in 2287, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.0625 = fieldNorm(doc=2287)
          0.00698169 = weight(abstract_txt:from in 2287) [ClassicSimilarity], result of:
            0.00698169 = score(doc=2287,freq=1.0), product of:
              0.03981875 = queryWeight, product of:
                1.2557031 = boost
                2.805388 = idf(docFreq=6898, maxDocs=41962)
                0.011303364 = queryNorm
              0.17533675 = fieldWeight in 2287, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.805388 = idf(docFreq=6898, maxDocs=41962)
                0.0625 = fieldNorm(doc=2287)
          0.027972456 = weight(abstract_txt:components in 2287) [ClassicSimilarity], result of:
            0.027972456 = score(doc=2287,freq=1.0), product of:
              0.07972435 = queryWeight, product of:
                1.2563876 = boost
                5.6138344 = idf(docFreq=415, maxDocs=41962)
                0.011303364 = queryNorm
              0.35086465 = fieldWeight in 2287, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6138344 = idf(docFreq=415, maxDocs=41962)
                0.0625 = fieldNorm(doc=2287)
          0.019387124 = weight(abstract_txt:specific in 2287) [ClassicSimilarity], result of:
            0.019387124 = score(doc=2287,freq=1.0), product of:
              0.0714732 = queryWeight, product of:
                1.4569526 = boost
                4.340004 = idf(docFreq=1486, maxDocs=41962)
                0.011303364 = queryNorm
              0.27125025 = fieldWeight in 2287, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.340004 = idf(docFreq=1486, maxDocs=41962)
                0.0625 = fieldNorm(doc=2287)
          0.20532456 = weight(abstract_txt:video in 2287) [ClassicSimilarity], result of:
            0.20532456 = score(doc=2287,freq=5.0), product of:
              0.23899446 = queryWeight, product of:
                3.4394743 = boost
                6.1473513 = idf(docFreq=243, maxDocs=41962)
                0.011303364 = queryNorm
              0.85911846 = fieldWeight in 2287, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                6.1473513 = idf(docFreq=243, maxDocs=41962)
                0.0625 = fieldNorm(doc=2287)
          0.4242808 = weight(abstract_txt:shots in 2287) [ClassicSimilarity], result of:
            0.4242808 = score(doc=2287,freq=1.0), product of:
              0.7754602 = queryWeight, product of:
                7.8367844 = boost
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.011303364 = queryNorm
              0.5471342 = fieldWeight in 2287, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.754148 = idf(docFreq=17, maxDocs=41962)
                0.0625 = fieldNorm(doc=2287)
        0.24 = coord(6/25)