That's a very telling question: the key words there are "to school". Schools are not the same thing as society at large. They are populated by children who do not have the same rights as adults in society. Do I think kids should be allowed to wear swastikas in school? No. Do I think adults should be allowed to wear swastikas on the street? Yes, I do (the sons of bitches).
Do you think that every citizen, in ordinary society, should be treated by the State as it treats children in a classroom?