Milleniums just sounds uneducated. I prefer to stick with the Latin plurals for Latin words.
More like "public school" but I guess that is pretty much the same thing.