Nobody was complaining much about mass immigration in 1972 because it hadn't really started, and nobody was really calling for more immigration (after the 1965 law was passed), because they figured the levels of immigration we'd had earlier were a thing of the past that wouldn't return.
Free trade, though, has always been a libertarian mantra.