Voter registration is entirely a function of the state department of the state in which you register. There are federal qualifications for which you state may deny you the right to vote: federal felony conviction, refusal to register for Selective Service, etc. But most states do not allow purging rolls of voters who've voted in recent elections who are otherwise qualified.
But think about the practical side of this if you would.
First, it's not clear that the biggest demographic that would fail to meet minimum requirements of the Census would be conservatives, libertarians, or any of the other groups one might classify as "good guys."
Second, the Census data will not be compiled in time to disrupt registrations that must be done to qualify for November.
;-/