There was, indeed, such a party, only it was called the Constitutional Union Party.
Like I said, it was just a presidential ticket. There were never any Constitutional Union office-holders. They were all just Democrats.