That I could buy *if* they were confined to the farm. But they were seen by just about everyone on the planet. We never "see" the invasion directly, but it does take place "off camera" i.e. during the news programs seen on the TV.
You see the whole "invasion" only through the eyes of Mel Gibson's character. There's no objective proof that any of the movie's plot action occurs anywhere but within his own mind.