If you remember 2004, people were furious about illegals but the two candidates effectively embargoed the issue by refusing to discuss or debate it. Kerry never attacked Bush for his stand on illegals, and Bush returned the favor. Call it Skull & Bones Courtesy.
I remember people on FR were furious, but FR does not reflect the populace at large.
There were no polls indicating that illegal immigration was a major issue in 2004.