Is he the only good conservative in the whole state? If not there is no reason why a another good conservative couldn't replace him. His opponents are just going to use his broken promise against him.
The problem is that Johnson has been tested by fire and found to be good. So many Republicans run, claiming to be conservative, then pull a Paul Ryan.