Document (#39212)

Author

Bawden, D.
Robinson, L.

Title

¬"A few exciting words" : information and entropy revisited

Source

Journal of the Association for Information Science and Technology. 66(2015) no.10, S.1965-1987

Year

2015

Series

Advances in information science

Abstract

A review is presented of the relation between information and entropy, focusing on two main issues: the similarity of the formal definitions of physical entropy, according to statistical mechanics, and of information, according to information theory; and the possible subjectivity of entropy considered as missing information. The paper updates the 1983 analysis of Shaw and Davis. The difference in the interpretations of information given respectively by Shannon and by Wiener, significant for the information sciences, receives particular consideration. Analysis of a range of material, from literary theory to thermodynamics, is used to draw out the issues. Emphasis is placed on recourse to the original sources, and on direct quotation, to attempt to overcome some of the misunderstandings and oversimplifications that have occurred with these topics. Although it is strongly related to entropy, information is neither identical with it, nor its opposite. Information is related to order and pattern, but also to disorder and randomness. The relations between information and the "interesting complexity," which embodies both patterns and randomness, are worthy of attention.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23459/abstract.

Theme

Information

Similar documents (author)

1. Robinson, L.; Bawden, D.: Internet subject gateways (1999) 5.44

   5.4360685 = sum of:
     5.4360685 = sum of:
       2.4799726 = weight(author_txt:robinson in 1899) [ClassicSimilarity], result of:
         2.4799726 = score(doc=1899,freq=1.0), product of:
           0.6646243 = queryWeight, product of:
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.089058526 = queryNorm
           3.7313905 = fieldWeight in 1899, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.5 = fieldNorm(doc=1899)
       2.956096 = weight(author_txt:bawden in 1899) [ClassicSimilarity], result of:
         2.956096 = score(doc=1899,freq=1.0), product of:
           0.7471778 = queryWeight, product of:
             1.0602881 = boost
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.089058526 = queryNorm
           3.956349 = fieldWeight in 1899, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.5 = fieldNorm(doc=1899)
   

2. Robinson, L.; Bawden, D.: Distance learning and LIS professional development (2002) 5.44

   5.4360685 = sum of:
     5.4360685 = sum of:
       2.4799726 = weight(author_txt:robinson in 691) [ClassicSimilarity], result of:
         2.4799726 = score(doc=691,freq=1.0), product of:
           0.6646243 = queryWeight, product of:
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.089058526 = queryNorm
           3.7313905 = fieldWeight in 691, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.5 = fieldNorm(doc=691)
       2.956096 = weight(author_txt:bawden in 691) [ClassicSimilarity], result of:
         2.956096 = score(doc=691,freq=1.0), product of:
           0.7471778 = queryWeight, product of:
             1.0602881 = boost
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.089058526 = queryNorm
           3.956349 = fieldWeight in 691, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.5 = fieldNorm(doc=691)
   

3. Robinson, L.; Bawden, D.: Libraries and open society : Popper, Soros and digital information (2001) 5.44

   5.4360685 = sum of:
     5.4360685 = sum of:
       2.4799726 = weight(author_txt:robinson in 702) [ClassicSimilarity], result of:
         2.4799726 = score(doc=702,freq=1.0), product of:
           0.6646243 = queryWeight, product of:
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.089058526 = queryNorm
           3.7313905 = fieldWeight in 702, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.5 = fieldNorm(doc=702)
       2.956096 = weight(author_txt:bawden in 702) [ClassicSimilarity], result of:
         2.956096 = score(doc=702,freq=1.0), product of:
           0.7471778 = queryWeight, product of:
             1.0602881 = boost
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.089058526 = queryNorm
           3.956349 = fieldWeight in 702, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.5 = fieldNorm(doc=702)
   

4. Bawden, D.; Robinson, L.: ¬An introduction to information science (2012) 5.44

   5.4360685 = sum of:
     5.4360685 = sum of:
       2.4799726 = weight(author_txt:robinson in 4966) [ClassicSimilarity], result of:
         2.4799726 = score(doc=4966,freq=1.0), product of:
           0.6646243 = queryWeight, product of:
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.089058526 = queryNorm
           3.7313905 = fieldWeight in 4966, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.5 = fieldNorm(doc=4966)
       2.956096 = weight(author_txt:bawden in 4966) [ClassicSimilarity], result of:
         2.956096 = score(doc=4966,freq=1.0), product of:
           0.7471778 = queryWeight, product of:
             1.0602881 = boost
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.089058526 = queryNorm
           3.956349 = fieldWeight in 4966, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.5 = fieldNorm(doc=4966)
   

5. Bawden, D.; Robinson, L.: No such thing as society? : On the individuality of information behavior (2013) 5.44

   5.4360685 = sum of:
     5.4360685 = sum of:
       2.4799726 = weight(author_txt:robinson in 1139) [ClassicSimilarity], result of:
         2.4799726 = score(doc=1139,freq=1.0), product of:
           0.6646243 = queryWeight, product of:
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.089058526 = queryNorm
           3.7313905 = fieldWeight in 1139, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.462781 = idf(docFreq=68, maxDocs=44218)
             0.5 = fieldNorm(doc=1139)
       2.956096 = weight(author_txt:bawden in 1139) [ClassicSimilarity], result of:
         2.956096 = score(doc=1139,freq=1.0), product of:
           0.7471778 = queryWeight, product of:
             1.0602881 = boost
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.089058526 = queryNorm
           3.956349 = fieldWeight in 1139, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.912698 = idf(docFreq=43, maxDocs=44218)
             0.5 = fieldNorm(doc=1139)
   

Similar documents (content)

1. Cole, C.: Shannon revisited : information in terms of uncertainty (1993) 0.20

   0.20405404 = sum of:
     0.20405404 = product of:
       1.0202702 = sum of:
         0.33223107 = weight(title_txt:revisited in 4069) [ClassicSimilarity], result of:
           0.33223107 = score(doc=4069,freq=1.0), product of:
             0.11728602 = queryWeight, product of:
               1.0061966 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.015431234 = queryNorm
             2.832657 = fieldWeight in 4069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.375 = fieldNorm(doc=4069)
         0.10510956 = weight(abstract_txt:shannon in 4069) [ClassicSimilarity], result of:
           0.10510956 = score(doc=4069,freq=1.0), product of:
             0.1372211 = queryWeight, product of:
               1.088354 = boost
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.015431234 = queryNorm
             0.76598686 = fieldWeight in 4069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.09375 = fieldNorm(doc=4069)
         0.035971045 = weight(abstract_txt:theory in 4069) [ClassicSimilarity], result of:
           0.035971045 = score(doc=4069,freq=1.0), product of:
             0.084587224 = queryWeight, product of:
               1.2084457 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.015431234 = queryNorm
             0.42525387 = fieldWeight in 4069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.09375 = fieldNorm(doc=4069)
         0.061141 = weight(abstract_txt:information in 4069) [ClassicSimilarity], result of:
           0.061141 = score(doc=4069,freq=5.0), product of:
             0.12047338 = queryWeight, product of:
               3.2248185 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015431234 = queryNorm
             0.5075063 = fieldWeight in 4069, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=4069)
         0.48581755 = weight(abstract_txt:entropy in 4069) [ClassicSimilarity], result of:
           0.48581755 = score(doc=4069,freq=1.0), product of:
             0.6510758 = queryWeight, product of:
               5.301033 = boost
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.015431234 = queryNorm
             0.74617666 = fieldWeight in 4069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.09375 = fieldNorm(doc=4069)
       0.2 = coord(5/25)
   

2. Kearns, J.; O'Connor, B.: Dancing with entropy : form attributes, children, and representation (2004) 0.11

   0.10549658 = sum of:
     0.10549658 = product of:
       0.8791382 = sum of:
         0.02997587 = weight(abstract_txt:theory in 4437) [ClassicSimilarity], result of:
           0.02997587 = score(doc=4437,freq=1.0), product of:
             0.084587224 = queryWeight, product of:
               1.2084457 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.015431234 = queryNorm
             0.35437822 = fieldWeight in 4437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.078125 = fieldNorm(doc=4437)
         0.039466348 = weight(abstract_txt:information in 4437) [ClassicSimilarity], result of:
           0.039466348 = score(doc=4437,freq=3.0), product of:
             0.12047338 = queryWeight, product of:
               3.2248185 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015431234 = queryNorm
             0.32759392 = fieldWeight in 4437, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=4437)
         0.80969596 = weight(abstract_txt:entropy in 4437) [ClassicSimilarity], result of:
           0.80969596 = score(doc=4437,freq=4.0), product of:
             0.6510758 = queryWeight, product of:
               5.301033 = boost
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.015431234 = queryNorm
             1.2436278 = fieldWeight in 4437, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.078125 = fieldNorm(doc=4437)
       0.12 = coord(3/25)
   

3. Gil, B.; Marijuan, P.C.: ¬La informacion, abstraccion o realidad? (1996) 0.10

   0.10285994 = sum of:
     0.10285994 = product of:
       0.8571662 = sum of:
         0.08759129 = weight(abstract_txt:shannon in 280) [ClassicSimilarity], result of:
           0.08759129 = score(doc=280,freq=1.0), product of:
             0.1372211 = queryWeight, product of:
               1.088354 = boost
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.015431234 = queryNorm
             0.63832235 = fieldWeight in 280, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.078125 = fieldNorm(doc=280)
         0.06835772 = weight(abstract_txt:information in 280) [ClassicSimilarity], result of:
           0.06835772 = score(doc=280,freq=9.0), product of:
             0.12047338 = queryWeight, product of:
               3.2248185 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015431234 = queryNorm
             0.56740934 = fieldWeight in 280, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=280)
         0.7012172 = weight(abstract_txt:entropy in 280) [ClassicSimilarity], result of:
           0.7012172 = score(doc=280,freq=3.0), product of:
             0.6510758 = queryWeight, product of:
               5.301033 = boost
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.015431234 = queryNorm
             1.0770131 = fieldWeight in 280, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.078125 = fieldNorm(doc=280)
       0.12 = coord(3/25)
   

4. Son, J.; Lee, J.; Larsen, I.; Nissenbaum, K.R.; Woo, J.: Understanding the uncertainty of disaster tweets and its effect on retweeting : the perspectives of uncertainty reduction theory and information entropy (2020) 0.09

   0.09467465 = sum of:
     0.09467465 = product of:
       0.7889554 = sum of:
         0.023980696 = weight(abstract_txt:theory in 5962) [ClassicSimilarity], result of:
           0.023980696 = score(doc=5962,freq=1.0), product of:
             0.084587224 = queryWeight, product of:
               1.2084457 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.015431234 = queryNorm
             0.28350258 = fieldWeight in 5962, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.0625 = fieldNorm(doc=5962)
         0.040760666 = weight(abstract_txt:information in 5962) [ClassicSimilarity], result of:
           0.040760666 = score(doc=5962,freq=5.0), product of:
             0.12047338 = queryWeight, product of:
               3.2248185 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015431234 = queryNorm
             0.33833754 = fieldWeight in 5962, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=5962)
         0.724214 = weight(abstract_txt:entropy in 5962) [ClassicSimilarity], result of:
           0.724214 = score(doc=5962,freq=5.0), product of:
             0.6510758 = queryWeight, product of:
               5.301033 = boost
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.015431234 = queryNorm
             1.1123345 = fieldWeight in 5962, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.0625 = fieldNorm(doc=5962)
       0.12 = coord(3/25)
   

5. Liu, Z.: Dissipative structure theory, synergetics, and their implications for the management of information systems (1996) 0.07

   0.0744557 = sum of:
     0.0744557 = product of:
       0.6204642 = sum of:
         0.062303677 = weight(abstract_txt:theory in 4222) [ClassicSimilarity], result of:
           0.062303677 = score(doc=4222,freq=3.0), product of:
             0.084587224 = queryWeight, product of:
               1.2084457 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.015431234 = queryNorm
             0.7365613 = fieldWeight in 4222, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
         0.07234301 = weight(abstract_txt:information in 4222) [ClassicSimilarity], result of:
           0.07234301 = score(doc=4222,freq=7.0), product of:
             0.12047338 = queryWeight, product of:
               3.2248185 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.015431234 = queryNorm
             0.60048956 = fieldWeight in 4222, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
         0.48581755 = weight(abstract_txt:entropy in 4222) [ClassicSimilarity], result of:
           0.48581755 = score(doc=4222,freq=1.0), product of:
             0.6510758 = queryWeight, product of:
               5.301033 = boost
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.015431234 = queryNorm
             0.74617666 = fieldWeight in 4222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.09375 = fieldNorm(doc=4222)
       0.12 = coord(3/25)