No man, no association of men, no state or set of states has a right to withdraw itself from this Union, of its own accord. The same power which knit us together, can only unknit. The same formality, which forged the links of the Union, is necessary to dissolve it. The majority of States which form the Union must consent to the withdrawal of any one branch of it. Until that consent has been obtained, any attempt to dissolve the Union, or obstruct the efficacy of its constitutional laws, is Treason--Treason to all intents and purposes.
Any other doctrine, such as that which has been lately held forth by the Federal Republican that any one State may withdraw itself from the Union, is abominable heresy which strips its author of every possible pretension to the name or character of Federalist.
We call, therefore, upon the government of the Union to exert its energies, when the season shall demand it and seize the first traitor who shall spring out of the hotbed of the convention of Harford. This illustrious Union, which has been cemented by the blood of our forefathers, the pride of America and the wonder of the world must not be tamely sacrificed to the heated brains or the aspiring hearts of a few malcontents. The Union must be saved, when any one shall dare to assail it.
Countrymen of the East! We call upon you to keep a vigilant eye upon those wretched men who would plunge us into civil war and irretrievable disgrace. Whatever be the temporary calamities which may assail us, let us swear, upon the altar of our country, to SAVE THE UNION." -- Richmond Enquirer, November 1814.
It is also highly relevant that the Hartford Convention got together and talked about seceding. They made no attempt to actually do so.