I think in the old days, before there was "naturalization" all the people were citizens, except for the slaves and indians which if present in the district were presumed NOT to participate in the body politic.
I don't know the history of naturalization rules, like when they were established. I expect it was a crazy quilt dependent on the state, the time and the ethnicity.
The slaves and Savages did count for some of the population state by state, even though suffrage was not yet extended to those groups.
Wrong.
This was never the case!