Let me clarify. It did happen occasionally that Levites would marry outside of the tribe. But those who did so were then ineligible for temple service. Consider this:
If a priest's daughter is married to an outsider she shall not eat of the offering of the holy things. (Leviticus 22:12)
So the possibility of such marriages is considered. They are not prohibited. But the daughter cannot then eat of the offerings.
I've already asked Quester this question and I'll ask you as well. Does "outsider" mean outside the tribe of Levi or outside the tribes of Israel?