No. Quote Madison and "all the others" saying that the situation with Rhode Island was an anomaly which would be straightened out.
I allude in a particular manner to those two States that have not thought fit to throw themselves into the bosom of the Confederacy. It is a desirable thing, on our part as well as theirs, that a re-union should take place as soon as possible. I have no doubt, if we proceed to take those steps which would be prudent and requisite at this juncture, that in a short time we should see that disposition prevailing in those States which have not come in, that we have seen prevailing in those States which have embraced the constitution.
It is clear: Rhode Island was not in the union. Nobody claimed otherwise and, in fact, people were calling for an embargo. Your metaphysical union, detectable only by it's normative aura, did not exist, nor predate the constitution.
One can claim a belief in a "right" of secession only be completely ignoring the Federalist while placing all faith in an interpretation of the 10th amendment which is completely at odds with the views of Hamilton, Washington, Madison, Marshall and all other significant interpreters of the Constitution.
The only significant interpreters of the constitution were those that ratified it. They had this to say:
WE the Delegates of the people of Virginia, duly elected in pursuance of a recommendation from the General Assembly, and now met in Convention, having fully and freely investigated and discussed the proceedings of the Federal Convention, and being prepared as well as the most mature deliberation hath enabled us, to decide thereon, DO in the name and in behalf of the people of Virginia, declare and make known that the powers granted under the Constitution, being derived from the people of the United States may be resumed by them whensoever the same shall be perverted to their injury or oppression, and that every power not granted thereby remains with them and at their will: that therefore no right of any denomination, can be cancelled, abridged, restrained or modified, by the Congress, by the Senate or House of Representatives acting in any capacity, by the President or any department or officer of the United States, except in those instances in which power is given by the Constitution for those purposes: and that among other essential rights, the liberty of conscience and of the press cannot be cancelled, abridged, restrained or modified by any authority of the United States.With these impressions, with a solemn appeal to the searcher of hearts for the purity of our intentions, and under the conviction, that, whatsoever imperfections may exist in the Constitution, ought rather to be examined in the mode prescribed therein, than to bring the Union into danger by a delay, with a hope of obtaining amendments previous to the ratification:
We the said Delegates, in the name and in behalf of the people of Virginia, do by these presents assent to, and ratify the Constitution recommended on the seventeenth day of September, one thousand seven hundred and eighty seven, by the Foederal Convention for the Government of the United States; hereby announcing to all those whom it may concern, that the said Constitution is binding upon the said People, according to an authentic copy hereto annexed, in the words following: