My Confederate ancestors would agree with you.
It is also relevant that in the 1850s the later secessionists demanded significant expansion of federal power in order to protect slavery against opposition by northern states based on their States' Rights.