There is, of course, no need whatsoever to go to a church building to receive communion. My own parish, when it was first established, had Mass in a community building in our development. The Pope frequently has Mass in large stadiums or out of doors, and this is frequently done in the Church. Holy communion is often received outside of Mass, in Hospitals and nursing homes, and even at the believer's homes, in certain cases, usually of illness.
You’re missing my point — presumably willfully, since it was pretty clear. The point is, no human being or human institution has to sanction my symbolic “ingestion” of Christ.