I agree, and add the obvious: libertarians advocate ending all government welfare programs, medical care, and schooling.
Enact these parts of the libertarian program first, and the attraction for the wrong kind of immigrant declines.
All libertarian talk of "open borders" is predicated on these reforms having been made. No libertarian advocates open borders with our existing set of social programs.