I was following until: “his family built a structure in their back hard.” This was not a smart thing to do. Sounds like they built a what a reasonable person would call a “church” in a residential neighborhood.
So you’re saying if someone builds a barn and decides to hold weekly get-togethers for friends in that structure instead of letting people trample all over his main home, he should be jailed for code violations.
It is a catch 22. They were told they could not have 20 people in their living room. What else but move to a back yard structure. I agree a lot of nuances here but sounds like some of these zoning/construction. building codes are just an excuse to stop freedom of association.