That's a very interesting point. This was apparently never much of an issue back in the days before the U.S. had a massive standing military instead of relying primarily on state militias for its armed forces.
This was precisely Benjamin Franklin’s argument against a property qualification.
Franklin: I am afraid that by depositing the Right of Suffrage in the freeholders exclusively we shall injure the lower Class of freemen. This Class possess hardy Virtues and great Integrity. The revolutionary war is a glorious Testimony in favor of Plebeian Virtue-our military and naval men are sensible of this Truth. I myself know that our Seamen who were Prisoners in England refused all the allurements that were made use of, to draw them from their allegiance to their Country-threatened with ignominious Halters, they still refused. This was not the case with the English Seamen, who, on being made Prisoners entered into the American Service and pointed out where other Prisoners could be made-and this arose from a plain cause. The Americans were all free and equal to any of their fellow citizens-the English Seamen were not so. In antient Times every free man was an Elector, but afterwards England made a Law which required that every Elector should be a freeholder. This Law related to the County Elections-the Consequence was that the Residue of the Inhabitants felt themselves disgraced, and in the next Parliament a law was made, authorizing the Justice of the Peace to fix the Price of Labour and to compel Persons who were not freeholders to labour for those who were, at a stated rate, or to be put in Prison as idle vagabonds. From this Period the common People of England lost a great Portion of attachment to their Country