You are correct.
The south never had the legal right to secede in the first place but Texas v. White (1869) confirmed that succession was illegal.
Both New York and Virginia explicitly retained the right to secede from the USA through specific language in their conditional ratification of the Constitution.
Thank you Patrick Henry.