Good question. Free speech, for example, allows Nazis to march in Skokie. I think Nazis are assholes, but I believe that the same freedom to call them obnoxious, stupid decerebrates who are obvious refutations of the law of natural selection (the stupid do not die out quick) is the same freedom which gives them the right to demonstrate it to us all.
As for voting, I am not in favor of universal suffrage. There is nothing inherently constitutional about that. I think voting should be restricted to property owners, as per: many of our original laws. That said, it ain't gonna happen, and I think all eligible voters under our current laws should be allowed to vote.
Your history is off center. In many instances after the founding of our nation, women were allowed to vote.
The idea that only property holders should be allowed the vote is non-sense. Citizenship and resident requirements should be the only requirement for voting in the United States but the idea that a person who rents or leases or even lives in a homeless shelter shouldn’t be able to vote runs counter to the American spirit.