As far as I know the only difference between a conservative and a libertarian, or a liberal and a libertarian, is which portion of their agenda you are looking at.
Libertarians are conservative on economic issues, and liberal on social/cultural, immigration, and national defense.
If Libertarians move right on abortion and such, then they start losing the need to use their language of separation from conservatives, and they approach being conservative.
I'm not sure that's compatible for leading a peaceful life in any human community.