All the previous presidents were born before April 30, 1789, the date of General Washingtons inauguration as the first President of the United States. They were therefore born before there was a United States, although they were born in America. There was a United States before the adoption of the Constitution.
From the Articles of Confederation:
Preamble To all to whom these Presents shall come, we the undersigned Delegates of the States affixed to our Names send greeting.
Articles of Confederation and perpetual Union between the States of New Hampshire, Massachusetts bay, Rhode Island and Providence Plantations, Connecticut, New York, New Jersey, Pennsylvania, Delaware, Maryland, Virginia, North Carolina, South Carolina and Georgia.
Article I. The Stile of this Confederacy shall be "The United States of America."
It was one country, albeit with a not very practicable form of government.