I agree.
One of the things I wonder about, however, is the validity of the argument that states had the right to become part of our republic, and had the right to leave when it no longer suited them, the nullification theory.
I thought Andrew Jackson had the better of this argument when in 1832 he told South Carolina that even if they did secede, he'd conquer them again in the name of the United States. In other words, Jackson's argument wasn't about rights, it was about force, in the era of manifest destiny.
That will be debated forever, of course. Interesting, though, that the Confederacy (if I recall correctly) did not permit secession of any of its member states. Not that the issue ever arose in its short life.