We tried to do that and we lost. Remember?
The Republican Party (Bush, Santorum, etc.) supported Specter. They actively campaigned for the man.
No, a small group of underfunded conservatives tried, and narrowly lost. In retrospect, I wonder whether those who supported Specter wish they'd voted for principle instead?