It would be more correct to say you lean libertarian or some other wording.
People who are actual libertarians maintain that human bings own themselves. They are not owned by the state or others. They assert their rights. That includes the right to do things that may be harmful to themselves.
Good point. I lean towards libertarian. However, I think any time you get the state involved at any level in people's personal lives you are asking for trouble. Prohibition did not work and it does not take much stretch of my imagination to take the same stand on drugs.