When I get caught for speeding, I get punished for it.
No you don't...you get fined, and you get to go on driving unless of course, you get caught too many times, at which time you (temporarily) lose your license.
So then, is that what you would have us do with illegal aliens?
Fine them for entering the nation illegally, but allow them to remain here after that?