The “invited guests” are not coming to pray.
They’re coming to consecrate. Or whatever you call it when a physical building is turned into a mosque.
Once they use a house of worship for prayers - no matter which religion claims it - that house of worship can now be claimed under Islamic law as a muslim mosque.