The usurper has no right to even hold the office. No one stopped him twice, why would anyone stop him now?
The only way I see it backfiring is if border state governors deploy the National Guard and take their own steps to deport the invaders. Obama, Holder, and the media will howl - but that is the only way.