Yes. If recreational drones were made illegal, it would be easy to break the law.
It seems to me that recreational drone users love their hobby, and the rest of us find it annoying or worse. We don't like the noise, and we don't like having our privacy invaded with flying cameras.
Also, we vastly outnumber the drone users.
So, I suspect that a political movement to ban recreational drone use might succeed right now. It would certainly succeed after the first use -- anywhere in the world -- of hundreds of drones programmed to kill humans.
And leave government use of hundreds of drones programmed to kill undefended humans unchallengeable by said humans?
That has been going on for years, and the number of people killed is in the thousands, not counting the people who were the actual targets. The non-combatant people on the receiving end of our drone strikes would like them to be illegal, but that hasn't happened.