There may have been plenty of weirdos, but the normal people correctly perceived them as weirdos and kept them out of public view.
As a kid in the 50s, I rarely heard about drugs in upstate NY and when I did, it was always about some shadowy, mysterious, surreal characters in far-away New York City.
Not only was deviancy dumbed down as stated by one the last sane democrats (Patrick Daniel Moynihan). We made it acceptable in our mad drive toward absolute egalitarianism.