You and I are the same in that regard. It’s almost like I have an inner compass in my head.
I’m not always sure whether I’m going North or South, especially at night; but I never forget a landmark and always have a ‘sense’ of where I should head.
You and I are probably like the migrating birds, which scientists think have some kind of magnetic guide in their heads :-)