Free Republic
Browse · Search
News/Activism
Topics · Post Article

To: LiteKeeper
It is shown that the well-known theory of information given by Shannon is an important contribution, but can only describe the lowest (statistical) level of information, while ignoring the most crucial aspects of its higher level definition.

Yes, this is the primary theoretical difference between Kolmogorov and Shannon. Shannon only deals with "zero-order" information, whereas Kolmogorov information deals with "n-order" information.

Using a fixed fifth-order structure for his theory is only slightly less wrong than using a fixed zero-order structure (i.e. Shannon). From what you are saying, he is trying to reinvent Kolmogorov, badly. It is puzzling that someone who nominally knows so much about information theory is apparently unaware of Kolmogorov's redefinition of the field, since it is really the essence of the matter.

162 posted on 07/26/2003 10:06:20 AM PDT by tortoise (All these moments lost in time, like tears in the rain.)
[ Post Reply | Private Reply | To 159 | View Replies ]


To: tortoise
It is puzzling that someone who nominally knows so much about information theory is apparently unaware of Kolmogorov's redefinition of the field, since it is really the essence of the matter.

What is even more puzzling is how it is that someone who nominally knows so much about information theory manages to have NO papers published in the relevant technical journals to that field, but instead publishes a book on the topic.

Or perhaps I should say it is temporarily puzzling, that is until one becomes aware that technical journal articles must undergo a nominally rigorous peer-review process before the are accepted for publication, while book manuscripts do not.

163 posted on 07/26/2003 12:00:11 PM PDT by longshadow
[ Post Reply | Private Reply | To 162 | View Replies ]

Free Republic
Browse · Search
News/Activism
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson