Madison believed that unanimous consent would be required for even one state to secede because that act of secession would dissolve the Union and abrogate the contract.
Under Madison's guidelines, all the states would have to approve the withdrawal of Texas, and then the states could, if they wished, reinstate the Union without Texas.
I know that Madison said that a proper secession required the consent of the other states but I'm not aware where he said it required unanimous consent.