Ideally, sure. But there was a reason that this law, and labor law, and OSHA and the like came about. They may not all be optimal solutions, but I wouldn't want to live in a country where they didn't exist at all.
The only problem is that each of these laws has robbed someone of their individual freedom. Dealing with abusive employers may be difficult, but when people refuse to work for them they change.