I have attended wonderful services in a brush arbor. If people go to church for the building, then they have the wrong attitude. Jesus did not do that.
I have attended MANY Masses at scout camps...outside...whatever weather...and they were as meaningful as Mass in any Cathedral. However, when Catholicism was beginning in the first century...holding Mass outside probably became a little stressful so they decided to build a church building...probably just a modest house. They then thought...we are honoring the creator of the universe so lets try to build an edifice that is a little more appropriate, so they built a nice church building....and it progressed from there. Nothing wrong with that, just man's attempt to offer to God to build as beautiful a building as possible to honor Him...