Conservatism is limited government, there is no need to bring in the fantasy libertarians, for one thing the most impossible thing for them to have under their social liberalism goals (and successes) is limited small government.
Social liberalism is obviously very, very easy to accomplish as we can see, and the more of it we get and the less socially conservative America becomes, then the more it results in massive and all controlling government.
Libertarianism is smaller government than conservatism, so it has a place.
As I said, most self-proclaimed libertarians are not libertarians. They want to do what they want, but they want socialism to save them when it goes wrong. It’s an impossible philosophy to maintain, because you are trying to hold opposite style philosophies in your mind simultaneously.
A true libertarian is left to his own devices to live the live he wants and be responsible for himself.
The Founding Fathers were to the right of conservatives, because they wanted a person to be the most basic form of government and they wrote the Constitution that way.
The libertarians couldn't stomach a "dictatorship of the non-entrepreneurial" and so they are left with a vision of an anarcho-capitalist or minarchist dreamland that most humans couldn't survive and wouldn't choose even if they could.
There are various kinds of libertarians, and the more reasonable ones, though we disagree with them on some things, could be within the Big Tent. Other than the Mises Caucus, the LP is far away from that.