From the data I've seen nonvoters don't break down much differently from voters, except that they're less committed to politics in general.
For every person who didn't vote because Romney wasn't conservative enough, there must have been many more for whom that wouldn't have made a difference.
It was the "Reagan Democrats" that stayed home.
Why would they vote for a counterfeit democrat?