It's not the proper role of SCOTUS to decide if something that is not interstate and not commerce is absurd. This was a state matter that SCOTUS warped Wickard and the Necessary and Proper clause to justify federal jurisidiction over every activity in the land.
The federal government regulates medication.
This was a case of medication.
If the states wanted to legalize it as a NONmedication then your argument would stand.