Like you do care? Your concern for the sick and dying is roughly equal to that of what you accuse others of. It's just strategic talking point to you. You want to keep pot and other abstractly chosen substances under the control of the government or as you might say "society".
Without bringing sick and dying people into it, and ignoring medical pot initiatives, this is a simple constitutional freedom issue.
Sure. I don't believe in recommending a carcinogen-loaded, bacteria-laden drug to a cancer patient. Or a drug shown to compromise the immune system to a patient with AIDS. Or a drug shown to reduce blood supply to the optic nerve to a glaucoma patient. Or a drug with objectionable side effects to a MS patient.
Or a drug that no major medical organization supports.