Document (#27068)

Author

Liu, L.-J.
Shen, X.-B.
Zou, X.-C.

Title

¬An improved fast encoding algorithm for vector quantization

Source

Journal of the American Society for Information Science and technology. 55(2004) no.1, S.81-87

Year

2004

Abstract

In the current information age, people have to access various information. With the popularization of the Internet in all kinds of information fields and the development of communication technology, more and more information has to be processed in high speed. Data compression is one of the techniques in information data processing applications and spreading images. The objective of data compression is to reduce data rate for transmission and storage. Vector quantization (VQ) is a very powerful method for data compression. One of the key problems for the basic VQ method, i.e., full search algorithm, is that it is computationally intensive and is difficult for real time processing. Many fast encoding algorithms have been developed for this reason. In this paper, we present a reasonable half-L2-norm pyramid data structure and a new method of searching and processing codewords to significantly speed up the searching process especially for high dimensional vectors and codebook with large size; reduce the actual requirement for memory, which is preferred in hardware implementation system, e.g., SOC (system-on-chip); and produce the same encoded image quality as full search algorithm. Simulation results show that the proposed method outperforms some existing related fast encoding algorithms.

Similar documents (author)

1. Shen, Z.: CJK: the unique need of Chinese, Japanese, and Korean language cataloging (1993) 5.35

   5.3508706 = sum of:
     5.3508706 = weight(author_txt:shen in 3726) [ClassicSimilarity], result of:
       5.3508706 = fieldWeight in 3726, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.561393 = idf(docFreq=22, maxDocs=44218)
         0.625 = fieldNorm(doc=3726)
   

2. Shen, Y.: Scholarly communication in scientific research practice : a study of computer sciences faculty (2006) 5.35

   5.3508706 = sum of:
     5.3508706 = weight(author_txt:shen in 5060) [ClassicSimilarity], result of:
       5.3508706 = fieldWeight in 5060, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.561393 = idf(docFreq=22, maxDocs=44218)
         0.625 = fieldNorm(doc=5060)
   

3. Shen, Y.: Create synergies and inspire collaborations around the development of intelligent infrastructure for human-centered communities (2019) 5.35

   5.3508706 = sum of:
     5.3508706 = weight(author_txt:shen in 5251) [ClassicSimilarity], result of:
       5.3508706 = fieldWeight in 5251, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.561393 = idf(docFreq=22, maxDocs=44218)
         0.625 = fieldNorm(doc=5251)
   

4. Shen, X.; Li, D.; Shen, C.: Evaluating China's university library Web sites using correspondence analysis (2006) 4.54

   4.5403643 = sum of:
     4.5403643 = weight(author_txt:shen in 5277) [ClassicSimilarity], result of:
       4.5403643 = fieldWeight in 5277, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         8.561393 = idf(docFreq=22, maxDocs=44218)
         0.375 = fieldNorm(doc=5277)
   

5. Liu, S.Q.; Shen, Z.G.: ¬The development of cataloging in China (2003) 4.28

   4.2806964 = sum of:
     4.2806964 = weight(author_txt:shen in 4065) [ClassicSimilarity], result of:
       4.2806964 = fieldWeight in 4065, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.561393 = idf(docFreq=22, maxDocs=44218)
         0.5 = fieldNorm(doc=4065)
   

Similar documents (content)

1. Bell, T.C.; Moffat, A.; Nevill-Manning, C.G.; Witten, I.H.; Zobel, J.: Data compression in full-text retrieval system (1993) 0.21

   0.21184734 = sum of:
     0.21184734 = product of:
       0.8826972 = sum of:
         0.033175666 = weight(abstract_txt:searching in 5643) [ClassicSimilarity], result of:
           0.033175666 = score(doc=5643,freq=1.0), product of:
             0.082589574 = queryWeight, product of:
               1.1713138 = boost
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.016456172 = queryNorm
             0.40169317 = fieldWeight in 5643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.09375 = fieldNorm(doc=5643)
         0.08713871 = weight(abstract_txt:full in 5643) [ClassicSimilarity], result of:
           0.08713871 = score(doc=5643,freq=3.0), product of:
             0.10901321 = queryWeight, product of:
               1.345706 = boost
               4.922663 = idf(docFreq=874, maxDocs=44218)
               0.016456172 = queryNorm
             0.79934084 = fieldWeight in 5643, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.922663 = idf(docFreq=874, maxDocs=44218)
               0.09375 = fieldNorm(doc=5643)
         0.12075152 = weight(abstract_txt:speed in 5643) [ClassicSimilarity], result of:
           0.12075152 = score(doc=5643,freq=1.0), product of:
             0.19542219 = queryWeight, product of:
               1.8017626 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.016456172 = queryNorm
             0.6179008 = fieldWeight in 5643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.09375 = fieldNorm(doc=5643)
         0.12237356 = weight(abstract_txt:fast in 5643) [ClassicSimilarity], result of:
           0.12237356 = score(doc=5643,freq=1.0), product of:
             0.2257014 = queryWeight, product of:
               2.3715014 = boost
               5.7833843 = idf(docFreq=369, maxDocs=44218)
               0.016456172 = queryNorm
             0.5421923 = fieldWeight in 5643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7833843 = idf(docFreq=369, maxDocs=44218)
               0.09375 = fieldNorm(doc=5643)
         0.04698783 = weight(abstract_txt:data in 5643) [ClassicSimilarity], result of:
           0.04698783 = score(doc=5643,freq=1.0), product of:
             0.1502252 = queryWeight, product of:
               2.7361674 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016456172 = queryNorm
             0.31278262 = fieldWeight in 5643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.09375 = fieldNorm(doc=5643)
         0.47226995 = weight(abstract_txt:compression in 5643) [ClassicSimilarity], result of:
           0.47226995 = score(doc=5643,freq=3.0), product of:
             0.38503096 = queryWeight, product of:
               3.0974483 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.016456172 = queryNorm
             1.2265766 = fieldWeight in 5643, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.09375 = fieldNorm(doc=5643)
       0.24 = coord(6/25)
   

2. Cheng, C.-S.; Chung, C.-P.; Shann, J.J.-J.: Fast query evaluation through document identifier assignment for inverted file-based information retrieval systems (2006) 0.15

   0.15103364 = sum of:
     0.15103364 = product of:
       0.62930685 = sum of:
         0.03226623 = weight(abstract_txt:high in 979) [ClassicSimilarity], result of:
           0.03226623 = score(doc=979,freq=1.0), product of:
             0.10623601 = queryWeight, product of:
               1.328454 = boost
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.016456172 = queryNorm
             0.30372214 = fieldWeight in 979, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.0625 = fieldNorm(doc=979)
         0.01410488 = weight(abstract_txt:information in 979) [ClassicSimilarity], result of:
           0.01410488 = score(doc=979,freq=2.0), product of:
             0.065915756 = queryWeight, product of:
               1.6545323 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.016456172 = queryNorm
             0.21398345 = fieldWeight in 979, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=979)
         0.08762739 = weight(abstract_txt:processing in 979) [ClassicSimilarity], result of:
           0.08762739 = score(doc=979,freq=3.0), product of:
             0.16413058 = queryWeight, product of:
               2.0223253 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016456172 = queryNorm
             0.5338882 = fieldWeight in 979, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=979)
         0.15665478 = weight(abstract_txt:algorithm in 979) [ClassicSimilarity], result of:
           0.15665478 = score(doc=979,freq=4.0), product of:
             0.21965738 = queryWeight, product of:
               2.3395329 = boost
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.016456172 = queryNorm
             0.71317786 = fieldWeight in 979, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.0625 = fieldNorm(doc=979)
         0.081582375 = weight(abstract_txt:fast in 979) [ClassicSimilarity], result of:
           0.081582375 = score(doc=979,freq=1.0), product of:
             0.2257014 = queryWeight, product of:
               2.3715014 = boost
               5.7833843 = idf(docFreq=369, maxDocs=44218)
               0.016456172 = queryNorm
             0.36146152 = fieldWeight in 979, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7833843 = idf(docFreq=369, maxDocs=44218)
               0.0625 = fieldNorm(doc=979)
         0.2570712 = weight(abstract_txt:compression in 979) [ClassicSimilarity], result of:
           0.2570712 = score(doc=979,freq=2.0), product of:
             0.38503096 = queryWeight, product of:
               3.0974483 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.016456172 = queryNorm
             0.6676637 = fieldWeight in 979, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.0625 = fieldNorm(doc=979)
       0.24 = coord(6/25)
   

3. Kishida, K.: High-speed rough clustering for very large document collections (2010) 0.15

   0.1485289 = sum of:
     0.1485289 = product of:
       0.53046036 = sum of:
         0.066843435 = weight(abstract_txt:vectors in 3463) [ClassicSimilarity], result of:
           0.066843435 = score(doc=3463,freq=1.0), product of:
             0.13702573 = queryWeight, product of:
               1.0668336 = boost
               7.805067 = idf(docFreq=48, maxDocs=44218)
               0.016456172 = queryNorm
             0.4878167 = fieldWeight in 3463, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.805067 = idf(docFreq=48, maxDocs=44218)
               0.0625 = fieldNorm(doc=3463)
         0.045631338 = weight(abstract_txt:high in 3463) [ClassicSimilarity], result of:
           0.045631338 = score(doc=3463,freq=2.0), product of:
             0.10623601 = queryWeight, product of:
               1.328454 = boost
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.016456172 = queryNorm
             0.42952797 = fieldWeight in 3463, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.0625 = fieldNorm(doc=3463)
         0.052287012 = weight(abstract_txt:algorithms in 3463) [ClassicSimilarity], result of:
           0.052287012 = score(doc=3463,freq=1.0), product of:
             0.14656676 = queryWeight, product of:
               1.5603728 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.016456172 = queryNorm
             0.35674536 = fieldWeight in 3463, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0625 = fieldNorm(doc=3463)
         0.098938845 = weight(abstract_txt:reduce in 3463) [ClassicSimilarity], result of:
           0.098938845 = score(doc=3463,freq=2.0), product of:
             0.17796756 = queryWeight, product of:
               1.7194164 = boost
               6.2897153 = idf(docFreq=222, maxDocs=44218)
               0.016456172 = queryNorm
             0.5559375 = fieldWeight in 3463, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.2897153 = idf(docFreq=222, maxDocs=44218)
               0.0625 = fieldNorm(doc=3463)
         0.08050102 = weight(abstract_txt:speed in 3463) [ClassicSimilarity], result of:
           0.08050102 = score(doc=3463,freq=1.0), product of:
             0.19542219 = queryWeight, product of:
               1.8017626 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.016456172 = queryNorm
             0.41193387 = fieldWeight in 3463, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.0625 = fieldNorm(doc=3463)
         0.050591692 = weight(abstract_txt:processing in 3463) [ClassicSimilarity], result of:
           0.050591692 = score(doc=3463,freq=1.0), product of:
             0.16413058 = queryWeight, product of:
               2.0223253 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016456172 = queryNorm
             0.3082405 = fieldWeight in 3463, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=3463)
         0.13566701 = weight(abstract_txt:algorithm in 3463) [ClassicSimilarity], result of:
           0.13566701 = score(doc=3463,freq=3.0), product of:
             0.21965738 = queryWeight, product of:
               2.3395329 = boost
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.016456172 = queryNorm
             0.6176301 = fieldWeight in 3463, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.0625 = fieldNorm(doc=3463)
       0.28 = coord(7/25)
   

4. Akman, K.I.: ¬A new text compression technique based on natural language structure (1995) 0.15

   0.14589676 = sum of:
     0.14589676 = product of:
       0.6079032 = sum of:
         0.017203575 = weight(abstract_txt:search in 1860) [ClassicSimilarity], result of:
           0.017203575 = score(doc=1860,freq=1.0), product of:
             0.06019754 = queryWeight, product of:
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016456172 = queryNorm
             0.28578535 = fieldWeight in 1860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=1860)
         0.027646389 = weight(abstract_txt:searching in 1860) [ClassicSimilarity], result of:
           0.027646389 = score(doc=1860,freq=1.0), product of:
             0.082589574 = queryWeight, product of:
               1.1713138 = boost
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.016456172 = queryNorm
             0.3347443 = fieldWeight in 1860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.284727 = idf(docFreq=1655, maxDocs=44218)
               0.078125 = fieldNorm(doc=1860)
         0.13846457 = weight(abstract_txt:algorithm in 1860) [ClassicSimilarity], result of:
           0.13846457 = score(doc=1860,freq=2.0), product of:
             0.21965738 = queryWeight, product of:
               2.3395329 = boost
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.016456172 = queryNorm
             0.63036615 = fieldWeight in 1860, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.078125 = fieldNorm(doc=1860)
         0.06409313 = weight(abstract_txt:method in 1860) [ClassicSimilarity], result of:
           0.06409313 = score(doc=1860,freq=1.0), product of:
             0.18227087 = queryWeight, product of:
               2.460845 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.016456172 = queryNorm
             0.3516367 = fieldWeight in 1860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.078125 = fieldNorm(doc=1860)
         0.03915653 = weight(abstract_txt:data in 1860) [ClassicSimilarity], result of:
           0.03915653 = score(doc=1860,freq=1.0), product of:
             0.1502252 = queryWeight, product of:
               2.7361674 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016456172 = queryNorm
             0.26065218 = fieldWeight in 1860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.078125 = fieldNorm(doc=1860)
         0.32133898 = weight(abstract_txt:compression in 1860) [ClassicSimilarity], result of:
           0.32133898 = score(doc=1860,freq=2.0), product of:
             0.38503096 = queryWeight, product of:
               3.0974483 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.016456172 = queryNorm
             0.8345796 = fieldWeight in 1860, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.078125 = fieldNorm(doc=1860)
       0.24 = coord(6/25)
   

5. Leek, M.R.: MPEG Q & A (1994) 0.15

   0.14583547 = sum of:
     0.14583547 = product of:
       0.72917736 = sum of:
         0.102852575 = weight(abstract_txt:requirement in 8407) [ClassicSimilarity], result of:
           0.102852575 = score(doc=8407,freq=1.0), product of:
             0.1257615 = queryWeight, product of:
               1.0220437 = boost
               7.4773793 = idf(docFreq=67, maxDocs=44218)
               0.016456172 = queryNorm
             0.8178384 = fieldWeight in 8407, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4773793 = idf(docFreq=67, maxDocs=44218)
               0.109375 = fieldNorm(doc=8407)
         0.0564659 = weight(abstract_txt:high in 8407) [ClassicSimilarity], result of:
           0.0564659 = score(doc=8407,freq=1.0), product of:
             0.10623601 = queryWeight, product of:
               1.328454 = boost
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.016456172 = queryNorm
             0.53151375 = fieldWeight in 8407, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.109375 = fieldNorm(doc=8407)
         0.0174539 = weight(abstract_txt:information in 8407) [ClassicSimilarity], result of:
           0.0174539 = score(doc=8407,freq=1.0), product of:
             0.065915756 = queryWeight, product of:
               1.6545323 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.016456172 = queryNorm
             0.264791 = fieldWeight in 8407, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.109375 = fieldNorm(doc=8407)
         0.23429562 = weight(abstract_txt:encoding in 8407) [ClassicSimilarity], result of:
           0.23429562 = score(doc=8407,freq=1.0), product of:
             0.31401768 = queryWeight, product of:
               2.7972631 = boost
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.016456172 = queryNorm
             0.74612236 = fieldWeight in 8407, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.109375 = fieldNorm(doc=8407)
         0.31810936 = weight(abstract_txt:compression in 8407) [ClassicSimilarity], result of:
           0.31810936 = score(doc=8407,freq=1.0), product of:
             0.38503096 = queryWeight, product of:
               3.0974483 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.016456172 = queryNorm
             0.82619166 = fieldWeight in 8407, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.109375 = fieldNorm(doc=8407)
       0.2 = coord(5/25)