When the founders' constituted the country it was not the business of the Federal Government who could vote.
Sure - so the states did it.