The Constitution limits government, not citizens.
Look at the 9th and 10th Amendments. They tell you that there are plenty of unnumerated rights that are not listed in the Constitution and they are no less important than the enumerated, listed rights.
As originally written, it is pretty clear the Constitution would not have allowed federal criminalization of drug use, although it would allow prohibition of interstate traffic in them.
However, states would be perfectly free under the Constitution to impose whatever drug laws they chose, including the death penalty for marijuana possession.