Many (not all) of the Libertarians I've met in my life were either full-on Socialists or Libertines (anything goes with no consequences), not Libertarians. I've met relatively few true Libertarians.
You are exactly correct. I used to debate on a local forum a so called libertarian. He always became angry when I called him a libertine. These folks are easy to spot, they want the government to control so much and provide so many services, such as national health care. A true libertarian would favor legalizing drugs but would oppose the government giving out free health care.