Despite the folklore surrounding alleged aliens' ability to exert neurological control over people with their eyes, a hypothetical case could be made that enough pissed off humans swarming in numbers with guns could overwhelm an alien colony and shoot their skinny little asses even with their superior tech.
The Battle of Isandlwana is a case in point.
What are they afraid of?