The 14th amendment clearly implies that the states have the right to deny the right to vote on the basis of conviction for a crime. (It was originally put in there to allow disfranchisement of former Confederates.)
Not that Congress pays any attention to what the Constitution says...