You get to take accountability if Obama gets re-elected and succeeds. Whether you like it or not.
The country is moving to the left no matter who is elected.
What matters is what happens in 2016. If someone like Scott Walker is elected in 2106 with a conservative majority in Congress, then a Romney loss will have been a beautiful thing.
That is only hope the country will move to the right in the next five years.