That's the standard accusation for anyone who questions whether that's supposed to be the federal government's job. What do you think?
Eh, I would not mind getting the feds out of such things. But how do you defend against interstate/international racketeers and smuggling/contraband then?
Most federal laws came to be during prohibition, the mafia wars, and drug wars for the particular purpose of unified law against interstate/international racketeers...
States do not have any authority outside their own respective boundaries, and cannot make treaties with foreign governments.