Membership and attendance are two different things.
That is true, but you usually dont hang around a place you dont want to be a member of. And most people do not go to a different church every weekend for variety.
Further going at Christmas and Easter you shouldnt ever be counted as a member or your attendance really being considered as representative of anything.