Well, I think they built it towards the mountains to simply be closer to the quarries. Why move the stone long distance when you can just build the pyramid close to where the stone is?
Makes sense.