http://guardians.net/egypt/gp1.htm
The Great Pyramid was opened during the Late Kingdom (or perhaps a little before, during the Persian occupation), and like other tombs and such in Egypt, was quite the tourist attraction. Sometime during the century or so preceding the Islamic conquest of Egypt, the local authority (I believe it was the Byzantine Empire) closed the thing back up. During the few centuries it was open, someone managed to cut four characters in an alphabetic script, they can be seen over the entrance, and are in a so-far-unknown language.
As you noted, the muzzie bozos couldn’t find the original entrance that had not been any great challenge to the earlier authorities.