Well, of course. Why do you think that matters?? The fact remains that there is a ubiquitous history in the US of "non-voting" classes of citizens, all perfectly Constitutional.
The interference of the Federal government in making a determination as to who can or cannot vote is of VERY recent vintage, and AFAIK, only applies to those states impacted by the "Voting Rights Act" (i.e. the segregated "Old South"). The rest of the states STILL determine who can or cannot vote in all elections (including for federal offices) held within their jurisdiction.