Could it be possible that Mayberry wasn't integrated? This was the late '50s and '60s. I bet the thought didn't even occur to them.
Good points....perhaps I am being too “reverse PC” about this.