This galaxy is at least 13 billion years in age. That’s long enough for colonizing the galaxy thousands of times over, starting from the level of technology we have now.
If “they” aren’t already here, “they” aren’t anywhere.
Yup, that’s a good expression of Fermi’s Paradox.