I guess I consider "my side" to posess the moral high ground in this matter because the muslims fought wars of aggression to get the lands they now posess, whereas the Christians tended to yield territory. The Alhambra is located in territory that was historically Christian, and was won back by them. It's not the same as if we invaded Saudi Arabia and occupied Mecca.
The Muslims conquered the Sassanids, who conquered the Parthians, and the Byzantines, who descended from the Romans, and who conquered the Seleucids, the Attalids, the Antigonids and the Ptolemids, who were in turn descended from Alexander the Great, who conquered the Achaemenids, who conquered the Medes, etc.
Nobody has the moral ground, because every piece of land was conquered from somebody else if you look back far enough.