Actually, I've always thought the biggest impediment to a border fence would be the endless enviro lawsuits filed against building it. You figure there has to be some kind of endangered critter along most of the route.
Seems to me like there was a recent court ruling over San Diego county fence, I think, that said that border security trumped enviro concerns.