It's the place (the visible church) wherever people gather together in his name, be it a building, a house, a basement, a cave or a field.
In either case, it's to be set apart from the world, just as we (the invisible church) are called to be set apart from the world.
And while the temple itself has been rent, it doesn't negate the holiness of the gathering. See Paul's letters to Timothy on the importance of church structure and order. See Paul's rebuke to the Corinthian church for their very un-holy gatherings.
Now, are you still suggesting that the church isn't to be set apart from the world?
The Church is, by definition, set apart.
Show me the scripture that says that "the Church" is "a place".