I remember they took communion at some Episcopal church. Around here, you have to be baptized for that.
No priest is likely to ask them to prove they have been baptized.