Abortion is done to somebody else's body: the unborn baby's. Pot use is done only to one's own body.
What if the user is pregnant?