Document (#18279)

Author

Narasimhamurthi, N.

Title

¬A primer on information theory

Source

Information studies. 2(1996) no.3, S.187-202

Year

1996

Abstract

Presents, at an elementary level, the central ideas of information theory in terms of naive probability theory. Information theory rests on the 2 pillars of quantifying uncertainty and coding and deals with how best to code information so that its uncertainty can be reduced most efficiently. Develops the quantification of uncertainty in 2 steps: first, the special case when all possible outcomes have the same probability; and second, the general case when all possibilities need not be equally probable. Examines 2 forms of coding: proactive and reactive. Coding is essentially an artificial classification or indexing of data and this aspect of information theory is of interest to anyone classifying, storing, and disseminating information

Theme

Information

Similar documents (content)

1. Klir, G.I.; Wierman, M.J.: Uncertainty-based information : Elements of generalized information theory (1998) 0.15

   0.14521377 = sum of:
     0.14521377 = product of:
       0.9075861 = sum of:
         0.21265441 = weight(abstract_txt:probability in 969) [ClassicSimilarity], result of:
           0.21265441 = score(doc=969,freq=1.0), product of:
             0.24710368 = queryWeight, product of:
               2.0735054 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.017309673 = queryNorm
             0.86058784 = fieldWeight in 969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.125 = fieldNorm(doc=969)
         0.02773931 = weight(abstract_txt:information in 969) [ClassicSimilarity], result of:
           0.02773931 = score(doc=969,freq=1.0), product of:
             0.09166435 = queryWeight, product of:
               2.187391 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.017309673 = queryNorm
             0.3026183 = fieldWeight in 969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.125 = fieldNorm(doc=969)
         0.32719553 = weight(abstract_txt:uncertainty in 969) [ClassicSimilarity], result of:
           0.32719553 = score(doc=969,freq=1.0), product of:
             0.37699154 = queryWeight, product of:
               3.136729 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017309673 = queryNorm
             0.8679121 = fieldWeight in 969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.125 = fieldNorm(doc=969)
         0.33999684 = weight(abstract_txt:theory in 969) [ClassicSimilarity], result of:
           0.33999684 = score(doc=969,freq=5.0), product of:
             0.26816547 = queryWeight, product of:
               3.4153638 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.017309673 = queryNorm
             1.2678621 = fieldWeight in 969, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.125 = fieldNorm(doc=969)
       0.16 = coord(4/25)
   

2. Leydesdorff, L.; Ivanova, I.A.: Mutual redundancies in interhuman communication systems : steps toward a calculus of processing meaning (2014) 0.12

   0.123110846 = sum of:
     0.123110846 = product of:
       0.51296186 = sum of:
         0.020352472 = weight(abstract_txt:when in 1211) [ClassicSimilarity], result of:
           0.020352472 = score(doc=1211,freq=1.0), product of:
             0.08971306 = queryWeight, product of:
               1.2493767 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.017309673 = queryNorm
             0.22686186 = fieldWeight in 1211, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1211)
         0.05486054 = weight(abstract_txt:case in 1211) [ClassicSimilarity], result of:
           0.05486054 = score(doc=1211,freq=3.0), product of:
             0.120478764 = queryWeight, product of:
               1.4478408 = boost
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.017309673 = queryNorm
             0.45535442 = fieldWeight in 1211, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1211)
         0.02972688 = weight(abstract_txt:information in 1211) [ClassicSimilarity], result of:
           0.02972688 = score(doc=1211,freq=6.0), product of:
             0.09166435 = queryWeight, product of:
               2.187391 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.017309673 = queryNorm
             0.32430142 = fieldWeight in 1211, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1211)
         0.13182914 = weight(abstract_txt:coding in 1211) [ClassicSimilarity], result of:
           0.13182914 = score(doc=1211,freq=1.0), product of:
             0.35684717 = queryWeight, product of:
               3.0517735 = boost
               6.7552447 = idf(docFreq=139, maxDocs=44218)
               0.017309673 = queryNorm
             0.36942744 = fieldWeight in 1211, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7552447 = idf(docFreq=139, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1211)
         0.14314803 = weight(abstract_txt:uncertainty in 1211) [ClassicSimilarity], result of:
           0.14314803 = score(doc=1211,freq=1.0), product of:
             0.37699154 = queryWeight, product of:
               3.136729 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017309673 = queryNorm
             0.37971154 = fieldWeight in 1211, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1211)
         0.13304481 = weight(abstract_txt:theory in 1211) [ClassicSimilarity], result of:
           0.13304481 = score(doc=1211,freq=4.0), product of:
             0.26816547 = queryWeight, product of:
               3.4153638 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.017309673 = queryNorm
             0.4961295 = fieldWeight in 1211, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1211)
       0.24 = coord(6/25)
   

3. Fry, J.: Scholarly research and information practices : a domain analytic approach (2006) 0.11

   0.10658395 = sum of:
     0.10658395 = product of:
       0.53291976 = sum of:
         0.047707748 = weight(abstract_txt:deals in 969) [ClassicSimilarity], result of:
           0.047707748 = score(doc=969,freq=1.0), product of:
             0.11494733 = queryWeight, product of:
               6.640641 = idf(docFreq=156, maxDocs=44218)
               0.017309673 = queryNorm
             0.41504008 = fieldWeight in 969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.640641 = idf(docFreq=156, maxDocs=44218)
               0.0625 = fieldNorm(doc=969)
         0.036198568 = weight(abstract_txt:case in 969) [ClassicSimilarity], result of:
           0.036198568 = score(doc=969,freq=1.0), product of:
             0.120478764 = queryWeight, product of:
               1.4478408 = boost
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.017309673 = queryNorm
             0.300456 = fieldWeight in 969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.0625 = fieldNorm(doc=969)
         0.03397358 = weight(abstract_txt:information in 969) [ClassicSimilarity], result of:
           0.03397358 = score(doc=969,freq=6.0), product of:
             0.09166435 = queryWeight, product of:
               2.187391 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.017309673 = queryNorm
             0.3706302 = fieldWeight in 969, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=969)
         0.28335965 = weight(abstract_txt:uncertainty in 969) [ClassicSimilarity], result of:
           0.28335965 = score(doc=969,freq=3.0), product of:
             0.37699154 = queryWeight, product of:
               3.136729 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017309673 = queryNorm
             0.75163394 = fieldWeight in 969, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0625 = fieldNorm(doc=969)
         0.1316802 = weight(abstract_txt:theory in 969) [ClassicSimilarity], result of:
           0.1316802 = score(doc=969,freq=3.0), product of:
             0.26816547 = queryWeight, product of:
               3.4153638 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.017309673 = queryNorm
             0.49104086 = fieldWeight in 969, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.0625 = fieldNorm(doc=969)
       0.2 = coord(5/25)
   

4. Brashers, D.E.; Hogan, T.P.: ¬The appraisal and management of uncertainty : implications for information-retrieval systems (2013) 0.10

   0.099953085 = sum of:
     0.099953085 = product of:
       0.6247068 = sum of:
         0.05494339 = weight(abstract_txt:reduced in 2708) [ClassicSimilarity], result of:
           0.05494339 = score(doc=2708,freq=1.0), product of:
             0.12629415 = queryWeight, product of:
               1.0481952 = boost
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.017309673 = queryNorm
             0.43504304 = fieldWeight in 2708, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.0625 = fieldNorm(doc=2708)
         0.03101349 = weight(abstract_txt:information in 2708) [ClassicSimilarity], result of:
           0.03101349 = score(doc=2708,freq=5.0), product of:
             0.09166435 = queryWeight, product of:
               2.187391 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.017309673 = queryNorm
             0.33833754 = fieldWeight in 2708, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2708)
         0.46272433 = weight(abstract_txt:uncertainty in 2708) [ClassicSimilarity], result of:
           0.46272433 = score(doc=2708,freq=8.0), product of:
             0.37699154 = queryWeight, product of:
               3.136729 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017309673 = queryNorm
             1.227413 = fieldWeight in 2708, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0625 = fieldNorm(doc=2708)
         0.076025605 = weight(abstract_txt:theory in 2708) [ClassicSimilarity], result of:
           0.076025605 = score(doc=2708,freq=1.0), product of:
             0.26816547 = queryWeight, product of:
               3.4153638 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.017309673 = queryNorm
             0.28350258 = fieldWeight in 2708, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.0625 = fieldNorm(doc=2708)
       0.16 = coord(4/25)
   

5. Ingwersen, P.; Wormell, I.: Ranganathan in the perspective of advanced information retrieval (1992) 0.09

   0.09270131 = sum of:
     0.09270131 = product of:
       0.5793832 = sum of:
         0.072397135 = weight(abstract_txt:case in 7695) [ClassicSimilarity], result of:
           0.072397135 = score(doc=7695,freq=1.0), product of:
             0.120478764 = queryWeight, product of:
               1.4478408 = boost
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.017309673 = queryNorm
             0.600912 = fieldWeight in 7695, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.125 = fieldNorm(doc=7695)
         0.02773931 = weight(abstract_txt:information in 7695) [ClassicSimilarity], result of:
           0.02773931 = score(doc=7695,freq=1.0), product of:
             0.09166435 = queryWeight, product of:
               2.187391 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.017309673 = queryNorm
             0.3026183 = fieldWeight in 7695, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.125 = fieldNorm(doc=7695)
         0.32719553 = weight(abstract_txt:uncertainty in 7695) [ClassicSimilarity], result of:
           0.32719553 = score(doc=7695,freq=1.0), product of:
             0.37699154 = queryWeight, product of:
               3.136729 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.017309673 = queryNorm
             0.8679121 = fieldWeight in 7695, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.125 = fieldNorm(doc=7695)
         0.15205121 = weight(abstract_txt:theory in 7695) [ClassicSimilarity], result of:
           0.15205121 = score(doc=7695,freq=1.0), product of:
             0.26816547 = queryWeight, product of:
               3.4153638 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.017309673 = queryNorm
             0.56700516 = fieldWeight in 7695, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.125 = fieldNorm(doc=7695)
       0.16 = coord(4/25)