Good point. You're right. I have friends that live in upstate, small town NY ( I lived there myself for a while) and there are lots of little fifedoms and tax districts, etc.
No inch of ground is unincorporated. Comes from NY having been an English colony.
Ideally, we'd have no more than four levels of government: Federal, State, County, and if needed, Town or City. It's ridiculous to have a village contained within a town, for instance.