I agree, but we also can't declare a free-for-all on crack, meth, heroin, etc. while we still have piles of laws forcing taxpayers to foot the bill for all the users' "treatment" and "disability" and "homelessness", etc.
That is not a problem associated with liberty. That is a problem associated with socialism.