The only reason some desire a different location for the Temple is a Christian religious one.
Since attempting to rebuild the Temple is fraught with so many difficulties that it would take years and war(s) to resolve, those who wish to hasten it would like it to be in an easier location so rebuilding could start quickly. They need the talisman for the Rapture, and they want to be alive to see it.