Synesthesia is related to LSD use I think, but you may have hit it on the head.
I think the earliest reports of synesthesia - muddy as they may be - greatly predated LSD use:
https://en.wikipedia.org/wiki/Synesthesia