You join an exclusive country club with the consent of the existing members. Do you need their permission to quit? Of course not.
It would depend on what the agreement said. Regardless, try and leave while owing money and with all the club property you can get your hands on and see how they react.