There are worse things than having a Democrat in the White House - like watching the Republican Party morph into a lame version of the Democratic Party!
Punishing Republicrats in `04 makes sense if they get the message that they have stabbed their core constituency - "non-rich" whites - in the back, and they won't win another election until they apologize.
Guess what, they'll figure out a way to win without you. And if your guys happen to win the primary, they'll just stay home - after all, you didn't stick up for them, why should they stick up for you?
Welcome to political REALITY. It ain't pretty sometimes.