Wickard vs. Filburn pretty much takes care of that.
You really need to look at US v Lopez. It came later and was intended to limit federal over reach via interstate commerce.