The fringers won't vote for a mainstream candidate by default anyway.
There's no way he'll get any crossover votes, as someone like McCain would. There's also a good chance some conservatives would sit out the election.