Free Republic
Browse · Search
Religion
Topics · Post Article

To: Doctor Stochastic
Did you mean this citation?

Random-text models have been proposed as an explanation for the power law relationship between word frequency and rank, the so-called Zipf's law. They are generally regarded as null hypotheses rather than models in the strict sense. In this context, recent theories of language emergence and evolution assume this law as a priori information with no need of explanation. Here, random texts and real texts are compared through (a) the so-called lexical spectrum and (b) the distribution of words having the same length. It is shown that real texts fill the lexical spectrum much more efficiently and regardless of the word length, suggesting that the meaningfulness of Zipf's law is high. ZIPF'S LAW AND RANDOM TEXTS

1,472 posted on 06/20/2002 1:24:15 PM PDT by AndrewC
[ Post Reply | Private Reply | To 1469 | View Replies ]


To: AndrewC
That's one. The Santa Fé Institute also has some papers, one of which shows that Zipf's law can be derived from randomly generated text (some letters and some blanks). I would argue that Zipf's law has little empirical content.
1,478 posted on 06/20/2002 1:51:27 PM PDT by Doctor Stochastic
[ Post Reply | Private Reply | To 1472 | View Replies ]

Free Republic
Browse · Search
Religion
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson