They shouldn’t be allowed in at all. If someone comes to work they come alone. And then go home.
Personally I would be much more concerned about the F1 student visas. The numbers of people coming in by abusing that program absolutely dwarfs H1 and H4.