Document (#36246)

Author

Korthof, G.

Title

Information Content, Compressibility and Meaning : Published: 18 June 2000. Updated 31 May 2006. Postscript 20 Oct 2009.

Source

http://home.planet.nl/~gkorthof/kortho44a.htm

Year

2000

Abstract

In New Scientist issue 18 Sept 1999, "Life force" pp27-30 Paul Davies writes "an apparently random sequence such as 110101001010010111... cannot be condensed into a simple set of instructions, so it has a high information content." (p29). This notion of 'information content' leads to paradoxes. Consider random number generator software. Let it generate 100 and 1000 random numbers. According to the above definition the second sequence of numbers has an information content ten times higher than the first, because its description would be ten times longer. However they are both generated by the same simple set of instructions, so should have exactly the same 'information content'. There is the paradox. It seems clear that this measure of 'information content' misses the point. It measures compressibility of a sequence, not 'information content'. One needs meaning of a sequence to capture information content.

Theme

Information

Similar documents (content)

1. Simkin, M.V.; Roychowdhury, V.P.: ¬A mathematical theory of citing (2007) 0.08

   0.07745112 = sum of:
     0.07745112 = product of:
       0.4840695 = sum of:
         0.09006416 = weight(abstract_txt:scientist in 589) [ClassicSimilarity], result of:
           0.09006416 = score(doc=589,freq=2.0), product of:
             0.1348945 = queryWeight, product of:
               1.0651513 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.016765641 = queryNorm
             0.6676637 = fieldWeight in 589, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.0625 = fieldNorm(doc=589)
         0.14852037 = weight(abstract_txt:writes in 589) [ClassicSimilarity], result of:
           0.14852037 = score(doc=589,freq=2.0), product of:
             0.18828551 = queryWeight, product of:
               1.2584114 = boost
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.016765641 = queryNorm
             0.788804 = fieldWeight in 589, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.0625 = fieldNorm(doc=589)
         0.031497028 = weight(abstract_txt:same in 589) [ClassicSimilarity], result of:
           0.031497028 = score(doc=589,freq=1.0), product of:
             0.10629005 = queryWeight, product of:
               1.3371358 = boost
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.016765641 = queryNorm
             0.2963309 = fieldWeight in 589, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.0625 = fieldNorm(doc=589)
         0.21398795 = weight(abstract_txt:random in 589) [ClassicSimilarity], result of:
           0.21398795 = score(doc=589,freq=3.0), product of:
             0.3026187 = queryWeight, product of:
               2.7632663 = boost
               6.532101 = idf(docFreq=174, maxDocs=44218)
               0.016765641 = queryNorm
             0.70712066 = fieldWeight in 589, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.532101 = idf(docFreq=174, maxDocs=44218)
               0.0625 = fieldNorm(doc=589)
       0.16 = coord(4/25)
   

2. Bremer, M.; Cohnitz, D.: Information and information flow : an introduction (2004) 0.08

   0.07671608 = sum of:
     0.07671608 = product of:
       0.4794755 = sum of:
         0.07751636 = weight(abstract_txt:meaning in 5217) [ClassicSimilarity], result of:
           0.07751636 = score(doc=5217,freq=1.0), product of:
             0.14785896 = queryWeight, product of:
               1.5770775 = boost
               5.592094 = idf(docFreq=447, maxDocs=44218)
               0.016765641 = queryNorm
             0.5242588 = fieldWeight in 5217, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.592094 = idf(docFreq=447, maxDocs=44218)
               0.09375 = fieldNorm(doc=5217)
         0.08715175 = weight(abstract_txt:information in 5217) [ClassicSimilarity], result of:
           0.08715175 = score(doc=5217,freq=12.0), product of:
             0.11084831 = queryWeight, product of:
               2.7310128 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.016765641 = queryNorm
             0.7862254 = fieldWeight in 5217, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=5217)
         0.185319 = weight(abstract_txt:random in 5217) [ClassicSimilarity], result of:
           0.185319 = score(doc=5217,freq=1.0), product of:
             0.3026187 = queryWeight, product of:
               2.7632663 = boost
               6.532101 = idf(docFreq=174, maxDocs=44218)
               0.016765641 = queryNorm
             0.6123845 = fieldWeight in 5217, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.532101 = idf(docFreq=174, maxDocs=44218)
               0.09375 = fieldNorm(doc=5217)
         0.1294884 = weight(abstract_txt:content in 5217) [ClassicSimilarity], result of:
           0.1294884 = score(doc=5217,freq=1.0), product of:
             0.33044 = queryWeight, product of:
               4.7152586 = boost
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.016765641 = queryNorm
             0.39186656 = fieldWeight in 5217, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.09375 = fieldNorm(doc=5217)
       0.16 = coord(4/25)
   

3. Tsai, R.T.-H.; Chiu, B.; Wu, C.-E.: Visual webpage block importance prediction using conditional random fields (2011) 0.07

   0.067713335 = sum of:
     0.067713335 = product of:
       0.5642778 = sum of:
         0.06548699 = weight(abstract_txt:times in 4924) [ClassicSimilarity], result of:
           0.06548699 = score(doc=4924,freq=1.0), product of:
             0.17314751 = queryWeight, product of:
               1.706622 = boost
               6.0514402 = idf(docFreq=282, maxDocs=44218)
               0.016765641 = queryNorm
             0.37821501 = fieldWeight in 4924, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0514402 = idf(docFreq=282, maxDocs=44218)
               0.0625 = fieldNorm(doc=4924)
         0.123546004 = weight(abstract_txt:random in 4924) [ClassicSimilarity], result of:
           0.123546004 = score(doc=4924,freq=1.0), product of:
             0.3026187 = queryWeight, product of:
               2.7632663 = boost
               6.532101 = idf(docFreq=174, maxDocs=44218)
               0.016765641 = queryNorm
             0.40825632 = fieldWeight in 4924, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.532101 = idf(docFreq=174, maxDocs=44218)
               0.0625 = fieldNorm(doc=4924)
         0.37524483 = weight(abstract_txt:sequence in 4924) [ClassicSimilarity], result of:
           0.37524483 = score(doc=4924,freq=4.0), product of:
             0.44006082 = queryWeight, product of:
               3.8476944 = boost
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.016765641 = queryNorm
             0.85271126 = fieldWeight in 4924, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.0625 = fieldNorm(doc=4924)
       0.12 = coord(3/25)
   

4. Sherman, C.; Price, G.: ¬The invisible Web : uncovering sources search engines can't see (2004) 0.07

   0.06718294 = sum of:
     0.06718294 = product of:
       0.4198934 = sum of:
         0.08011316 = weight(abstract_txt:exactly in 20) [ClassicSimilarity], result of:
           0.08011316 = score(doc=20,freq=1.0), product of:
             0.13546658 = queryWeight, product of:
               1.0674076 = boost
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.016765641 = queryNorm
             0.5913869 = fieldWeight in 20, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.078125 = fieldNorm(doc=20)
         0.10300079 = weight(abstract_txt:paradox in 20) [ClassicSimilarity], result of:
           0.10300079 = score(doc=20,freq=1.0), product of:
             0.16017322 = queryWeight, product of:
               1.1606711 = boost
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.016765641 = queryNorm
             0.6430587 = fieldWeight in 20, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.078125 = fieldNorm(doc=20)
         0.020965453 = weight(abstract_txt:information in 20) [ClassicSimilarity], result of:
           0.020965453 = score(doc=20,freq=1.0), product of:
             0.11084831 = queryWeight, product of:
               2.7310128 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.016765641 = queryNorm
             0.18913643 = fieldWeight in 20, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=20)
         0.21581401 = weight(abstract_txt:content in 20) [ClassicSimilarity], result of:
           0.21581401 = score(doc=20,freq=4.0), product of:
             0.33044 = queryWeight, product of:
               4.7152586 = boost
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.016765641 = queryNorm
             0.653111 = fieldWeight in 20, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.078125 = fieldNorm(doc=20)
       0.16 = coord(4/25)
   

5. Heastrom, M.: Descriptive practices for electronic records : deciding what is essential and imaging what is possible (1993) 0.06

   0.061366033 = sum of:
     0.061366033 = product of:
       0.3835377 = sum of:
         0.15137438 = weight(abstract_txt:sept in 8332) [ClassicSimilarity], result of:
           0.15137438 = score(doc=8332,freq=1.0), product of:
             0.18334834 = queryWeight, product of:
               1.241803 = boost
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.016765641 = queryNorm
             0.8256109 = fieldWeight in 8332, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.09375 = fieldNorm(doc=8332)
         0.07751636 = weight(abstract_txt:meaning in 8332) [ClassicSimilarity], result of:
           0.07751636 = score(doc=8332,freq=1.0), product of:
             0.14785896 = queryWeight, product of:
               1.5770775 = boost
               5.592094 = idf(docFreq=447, maxDocs=44218)
               0.016765641 = queryNorm
             0.5242588 = fieldWeight in 8332, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.592094 = idf(docFreq=447, maxDocs=44218)
               0.09375 = fieldNorm(doc=8332)
         0.025158545 = weight(abstract_txt:information in 8332) [ClassicSimilarity], result of:
           0.025158545 = score(doc=8332,freq=1.0), product of:
             0.11084831 = queryWeight, product of:
               2.7310128 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.016765641 = queryNorm
             0.22696373 = fieldWeight in 8332, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=8332)
         0.1294884 = weight(abstract_txt:content in 8332) [ClassicSimilarity], result of:
           0.1294884 = score(doc=8332,freq=1.0), product of:
             0.33044 = queryWeight, product of:
               4.7152586 = boost
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.016765641 = queryNorm
             0.39186656 = fieldWeight in 8332, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.17991 = idf(docFreq=1838, maxDocs=44218)
               0.09375 = fieldNorm(doc=8332)
       0.16 = coord(4/25)