I think you are right about your latter assessment but concerning your former: considering how far advanced aliens could be - it would be hard to tell if we were ever visited by them in much the same way ants can not tell when we are “visiting” them & even when we might outright step on them. Could we even detect whether an alien is in our midst.
I find it fun to think about such things.