BINGO!
I never could quite put my finger on exactly what it was about libertarians that make them seem to be conservative and liberal at the same time. But you nailed it. The don't like government primarily because the "liberties" they are most concerned with, are often vices rather than virtues.
This is of course just a generalization, but defining Libertarians as, "Conservative on economic issues and Liberal on social issues" comes pretty close to the mark for the vast majority of them that I've known.
The one thing I'd like to know about Libertarianism is this --- Are there pro-abortion and anti-abortion wings? And if so, which is larger? Reason I ask is that the few Libertarians I've heard discussing this issue are pro-abortion and they frame it as an issue of "Liberty and Freedom for the Woman!" - completely discounting the possibility that a 9-month-old, about-to-be-born baby could ever have any rights too, or even any traces of humanity.
If it turns out that there is a large contingent of pro-life libertarians out there, it would certainly increase my opinion of them considerably.