I don't dispute that the scripture you are using is not to compel them to come and taste of the Lord in order that they might prayefully become a member of the House of God. But I don't see where that means that we must bring them to the assemble rather. I think it can very easily be argued that the House of God is the family of God, is salvation, is the spiritual house rather than the physical synagogue/church building/worship service. Or it could be both, but I think you would have a hard time finding commentaries that it just refers to the building, etc. Do you have other passages that support your statement then?
You don't accept the inerrancy of that one?